Slashdot Mirror


Yahoo! Develops Anti-Spam Architecture

prostoalex writes "Yahoo!, the owner of one of the largest e-mail systems in the world, is said to be developing a cryptographic product that will be offered freely to mail servers. 'Domain Keys,' according to the Reuters article, would require the message sender to authenticate in order for message to come across a trusted e-mail network. The idea has been around for ages, however, it required someone from the big league like Yahoo! to step in." While Yahoo! isn't the first name that comes to mind when I think of trusted email, it's still a step in the right direction.

25 of 283 comments (clear)

  1. Oh yeah it seems like a good idea right now.... by i_want_you_to_throw_ · · Score: 3, Interesting

    But ultimately one has to worry about the lock that Yahoo! might have on servers once they get it installed all over the place.

    Could you imagine this becoming really popular and then Yahoo! getting bought by someone like oh say Microsoft? (or any other big commercial interest)

  2. Temporary by dolo666 · · Score: 3, Interesting

    But how am I going to get my special penis enlargement information now? And what about that family matter I am resolving with Mr. Mobotu?

    In all seriousness, I think this is a good idea. But, sadly, it's going to be cracked. Domain keys can be forged, and that will be the first thing that these spam servers will be focussing on right now. They'll set up a Yahoo acct and monitor traffic to see what the domain keys look like. They will then duplicate the acks and be back in business. It's only a matter of time.

    This is a good step, no doubt. It is just that we should be looking at ways of putting spammers out of business, too. Hit their wallets, not their tech. Tech can always be worked around, especially by dubious people.

    Instead of domain keys, I had a different idea that might work a lot better.

    What if nobody sent email over the Internet?

    Today we have the ability to use web forms to pass messages back and forth to other users on the same service. With that option, the server admin would be able to flag spammers and ban them. If you wanted to message another user of another server, you could type in their location as USERNAME@DOMAIN, and that would queue to be sent in batch to the other server after authentication.

    No outside contact. No spam. One message per customer. If you send more than a certain number of messages in a day, they are held as possible spam.

    Privacy goes out the window, but hey... it's not like there is any privacy in non-encrypted email anyway.

  3. So now... by Snaller · · Score: 3, Funny

    ...you'll only be spammed by Yahoo??

    --
    If Google really cared they would fix Android Chrome to reflow text, instead of discriminating
    1. Re:So now... by gbjbaanb · · Score: 4, Insightful

      yes, but now you'll know for sure that the email came from Yahoo - and not some forged return-to that dumps on some ordinary Joe's server.

      step, by step, the spam problem can be solved. That doesn't mean that you should not take the first step simply because it doesn't provide a total cure.

  4. Re:OS? by swb · · Score: 3, Informative

    $ telnet mx1.mail.yahoo.com 25
    Trying 64.157.4.78...
    Connected to mx1.mail.yahoo.com.
    Escape character is '^]'.
    220 YSmtp mta108.mail.sc5.yahoo.com ESMTP service ready


    It looks like they run YSmtp, just like everyone else I know. In all seriousness, I'd imagine there isn't much of Yahoo's infrastructure that isn't highly optimized for Yahoo's own use. I think that Yahoo did a lot with FreeBSD at one time, but I'd presume whatever they have isn't just an out of the box app.

  5. Open standards? by satyap · · Score: 4, Insightful

    As long as it's an open standard that eventually becomes RFC3821, I'll be okay with it. But if it's one of those proprietary "pay us to participate" schemes, they can go jump. Oh, and there should be no scope for someone to say "pay us or we won't accept email from you.

  6. Not necessarily by meldroc · · Score: 4, Interesting
    If they use decent encryption, cracking this scheme will be nearly impossible. If they use a digital signature algorithm such as DSA or MD5, or public key algorithms such as RSA, the computational power required to crack these keys will be far beyond the means of the richest spammers.

    Personally, I'd like to see two things.

    1. The software Yahoo! is developing should be open-source, so nobody can monopolize it. At the very minimum, the protocols involved should be well documented so open-sourcers can make their own implementations if they have to.

    2. Give this software a few months to propogate to a good chunk of the ISPs out there. Then, Yahoo! should announce that they will NOT accept any email that is not signed with this software. I'll guarantee that everyone will be using this new protocol in a matter of weeks, since no ISP wants customers screaming because they can't get mail through to Yahoo! accounts.

    --

    Meldroc, Waster of Electrons
  7. Must be missing something by Space+cowboy · · Score: 5, Insightful
    The text of the article has to be wrong - they say the private key is delivered as a message header! Hmm, not very private...

    I'm assuming that what is sent out is an encypted token for which the public key can be used to decrpyt, so:

    • Alice wants to send an email to Bob.
    • Alice encrypts the MD5 checksum of the mail body content (or some other representative text, probably longer than 32 bytes!) using her private key, and embeds the resulting encoded string into a mail header
    • Bob receives the mail, and looks up Alice's public key to decrypt the token
    • Bob compares the decrypted token with the same representative text to see if they match.
    • Match => Read. No match => Put into 'Junk' folder


    So, the token to be encoded will change from mail to mail, thus making replay techniques pretty much impossible, I think. At least, that's the way I'd do it, and I'm pretty sure I've seen it presented before as well...

    On the other hand, I ain't a security expert, so there's probably a gaping hole in the above :-)

    Simon

    --
    Physicists get Hadrons!
  8. Re:Oh yeah it seems like a good idea right now.... by swb · · Score: 4, Insightful

    It can be open sourced, but that doesn't mean anything about preventing lock-in.

    Presumably a 'domain key' is some cryptographic element that authenticates that your domain is who it claims to be. To me this sounds an awful lot like SSL where a third party issues the keys, or acts as a clearinghouse for self-issued keys.

    Either way, Yahoo could be the man in the middle acting as either issuer or clearinghouse. Think of it this way, OpenSSL is open sourced, but that doesn't keep the SSL issuers from having a lock on that market.

  9. You just can't win with the /. crowd by Anonymous Coward · · Score: 5, Funny

    If someone announced a cure for all cancers, this crowd would immediately dismiss it because it could possible be bought by Microsoft. You pimply-faced pessimists remind my of Eor from Winnie the Pooh.

    1. Re:You just can't win with the /. crowd by jpetts · · Score: 4, Funny

      You pimply-faced pessimists remind my of Eor from Winnie the Pooh.

      No, Xor is the operation most often used in cryptographic functions...

      --
      Call me old fashioned, but I like a dump to be as memorable as it is devastating - Bender
  10. Broken already? by CaptainSuperBoy · · Score: 4, Interesting
  11. So what about a teergrube? by rah1420 · · Score: 3, Interesting

    The first time that I heard about a teergrube to use as a way to block -- or at least make it damned difficult for -- spammers I was intrigued at its simplicity. And tho' I find references to it all over the 'net, I don't think that it has been mainstreamed yet, and frankly I don't know why. Have spammers developed a counter to a teergrube? Or do mail admins simply not know enough about them?

    --
    Mit der Dummheit kämpfen Götter selbst vergebens.
  12. One solution by FonkiE · · Score: 4, Insightful

    when you think about it, BUT this should come from IETF or some other body not from a company. A few important points:

    1) Who will issue the keys?

    2) Is anonymous mail possible if the receiver allows it?

    Furthermore spamming is a social problem emerging from our commercial world and technical solutions can never be 100%. What if:

    a) I send spam from a "secure" domain?

    b) forge certificates?

    c) the certificates are too expensive? (like SSL, I think it should be included with a domain)

    I like the "Bayes" spam filters best. You get 99.5% spam protection and keep anonymous mail.

    We all see the need for authenticated senders (biz communication, etc.), but we should be careful ...

    1. Re:One solution by the+uNF+cola · · Score: 3, Insightful
      ... this should come from IETF or some other body not from a company.


      We should expect something like this to come from the IETF, but big corps do good things all the time. What makes you uncomfortable about it? The privacy issue? If it's on the net and you want privacy, encrypt the content. But if you want to hit my network w/ SMTP, much less an ICMP package, I want to at least know who you are.

      Are you worrying who will govern the entire thing? Who do you trust? Some .org run by someone? Some corp? The gov't? All-in-all, you have to trust SOMEONE.
      --

      --
      "I'm not bright. Big words confuse me. But Wanda loves me and that should be enough for you." - Cosmo

  13. Re:Trusted email? by hey · · Score: 4, Insightful

    I use Yahoo mail and its very good.

    They have a pretty good spam catching service.
    It puts suspected spam in a "Bulk" folder. You can
    review this folder or just like it get purged after 30 days. Nice. You can also click on the "its not spam" / "this is spam" buttons to help them tune.

    They offer a SSL login and it was discuessed recently on Slashdot that they use the Javascriptcrypto library to calculate MD5's on the client side and send the digiest for seduvcity (maybe when you are not logging in with SSL).

    You can check your POP3/IMAP mailboxes. The resources come back color-coded.

    Good uptime. Always available.

    It's free. You can enought resources for reseaonable use. But you can buy more if you want.

    All this sounds exactly like a crypto-nerd and slashdotter would design a mail service. And this new thing is going to be opensourced!

  14. User account verification by pe1chl · · Score: 4, Insightful

    First let them implement some user account verification, so that a RCPT TO: results in a 550 reply when that user does not exist.
    This enables SMTP callbacks to stop spam being spoofed "from yahoo", just like everyone else does.

  15. So where's the info? by TrebleJunkie · · Score: 3, Interesting

    Okay, so they're developing a system that they'll release to open-source developers.... why not DEVELOP it in the open in the first place?

    --

    Ed R.Zahurak

    You know, oblivion keeps looking better every day.

  16. Re:Why? by santiag0 · · Score: 3, Informative
    I've used yahoo e-mail for 4 years now. I have 2 accounts, a "main" one I forward all my other e-mail accounts to, and a "throw-away" account I use for posting on yahoo finance message boards, and also for instances where an e-mail address is required but don't want extra spam (ex. online shopping).
    My experience over-all has been excellent, with on minor exception:
    Yahoo! sneaks in yet more spam
    YAHOO! GRANTED ITSELF PERMISSION to spam by creating a new "marketing preferences" page that lets users pick "yes or no" to specific categories of marketing pitches. The problem is, Yahoo! set every users' option to "yes" -- even if long ago, they indicated they never wanted any Yahoo! spam.
    Yahoo! started e-mailing the privacy policy change to users Thursday. In the notice, the company suggested the marketing policy changes were made for users so they could more easily control the amount of e-mail offers they receive.
    "It is designed to make it easier for you to manage the marketing communications you receive from Yahoo! and ensure you get the latest relevant information to meet your needs," the notice says. It also says that marketing preferences have been "reset," and unless users actively follow a sequence of steps to change these preferences "you may begin receiving marketing messages from Yahoo! about ways to enhance your Yahoo! experience, including special offers and new features."
    But some Yahoo! users don't see the change as an enhancement, but rather a tactic to trick users into accepting more spam -- and a betrayal of their initial registration agreements.
    "I checked and they had changed all my settings!" writes one irate poster to an Internet mailing group devoted to privacy. "This means that you may well be inundated with even more junk mail than you are already receiving. In order to change your settings back to whatever you had them at before, you will need to log in to your account and physically change them," the poster adds.
    A Yahoo! spokesperson said no company officials were available to comment on the change, but offered an e-mail statement explaining the company's position.
    "We have created a new marketing preferences page which allows users to choose how Yahoo! communicates with them about Yahoo! products and services. Yahoo!'s products and services have changed and grown over the years and many were not available when users registered in the past," the e-mail says. "We are notifying users proactively via e-mail of this change, after which they have 60 days after the date of the mailing to edit those marketing preferences, giving users plenty of time to decide how they want Yahoo! to communicate with them."
    This was from a google search on "yahoo marketing preferences", and pretty well sums up what happened. They basically reset user marketing preferences, twice in about 4 years if I remember correctly.
    It was a bad decision IMHO, but easy enough to reset your preferences, here is yahoo's page on privacy, with links to reset your marketing preferences:
    http://privacy.yahoo.com/
    Other than this one issue, I've been very happy with Yahoo. Being able to check all my e-mail on one Web site for free is great. Never have lost any e-mails, no problems at all.
  17. Are cycles that cheap? by Frisky070802 · · Score: 3, Interesting
    As I understand it, the proposal requires public-key encryption for every email sent, done by the sender at the time of sending. (If the "private key" -- something encrypted with the private key -- could be computed once and reused in every message, it could be copied and replayed by a forger.) This can dramatically raise the overhead associated with sending mail. Perhaps that overhead is reasonable, perhaps not.

    Bala Krishnamurthy at AT&T Labs has given a number of talks recently, including to the IETF, on a spam disincentive program he calls SHRED. My understanding is that it uses offline cryptographic computation to amortize this overhead and distribute it to parties willing and able to devote the computational resources.

    In any case, the tag line for this article had it right, standardizing this will be hard and heavy-hitters like Yahoo will need to take the lead. But a key problem is getting the new system to interoperate with the old.

    --
    Mencken had it right. So glad that's old news.
  18. Lock-in isn't necessarily an issue by RevMike · · Score: 3, Insightful

    It can be open sourced, but that doesn't mean anything about preventing lock-in.

    Presumably a 'domain key' is some cryptographic element that authenticates that your domain is who it claims to be. To me this sounds an awful lot like SSL where a third party issues the keys, or acts as a clearinghouse for self-issued keys.

    Either way, Yahoo could be the man in the middle acting as either issuer or clearinghouse. Think of it this way, OpenSSL is open sourced, but that doesn't keep the SSL issuers from having a lock on that market.

    I don't see how lock in will be an issue. Imagine the following scenario:

    1. Originating mail software sends a message, including some token in the header that is encrypted using the sending mail server's private key.
    2. Zero or more intermediate mail server pass along the message.
    3. The destination mail server receives the message.
    4. The destination mail server looks up the domain of the message originator and requests that domain's public key.
    5. The destination mail server attempts to decrypt the token.
    6. If the token is successfully decrypted, the mail is delivered. The receiver knows the identify of the sending system with certainty. Email domains can't be spoofed.
    7. Otherwise the message is dropped.

    I can't see how this would neccesitate a clearinghouse.

  19. identity based antispam is censorship tool by esj+at+harvee · · Score: 4, Interesting

    a thing to remember is that if someone can prevent a spammer from communicating based on identity (or lack thereof), you can be silenced as well.

    This is why I have put my efforts into sender-pay systems and specifically the camram project. We invite you to please come and join us in the effort to build a decentralized, user-friendly, freedom-of-speech supporting antispam system and hit spammers in the pocketbook.

    camram antique documentation (too busy writing code to write new documentation)

  20. Re:Not sure if I understand it right by RevMike · · Score: 4, Interesting

    How do they propose to keep the encrypted private key secure? I did RTFA but couldn't find any explanation of how the encrypted version of the private key could not be spoofed since it is part of the message header.

    If the spammer...or anyone for that matter is spoofing a header anyway, it shouldn't be difficult to find out the encrypted private key, since it is sent out with every message originating from the domain.

    I could, presumably send an email from my secure email address to a non-existent email address of the domain whose encrypted private key I wish to find out: eg bounce@email.com. The bounced message should have it in the header.

    The authentication token would likely be some sort of hash of the message contents. In that way, a token is only valid for that particular message. The sender would generate a checksum of the message, encrypt it with a private key, then transmit the encrypted checksum as the token. The receiver would generate the same hash of the message contents, and decrypt the token with the public key. If the decrypted checksum equals the generated checksum, then one can be confident that the message came from the server it said it came from.

  21. Yahoo beats eariler proposals? I hope not. by kerubi · · Score: 4, Interesting

    Would you rather choose a Yahoo product over an open standard that is under development? I'm speaking of AMTP, of course. (See AMTP author's site).

    Yahoo's size doesn't give that much weight to their proposal. Yahoo's email is not used in business to business communication (do not count hot dog stands as businesses), so businesses can just aswell block everything that originates from *@yahoo.com if it is not directed to their consumer service department.

    Also, reverse mx records provide much of the same benefits with minimal alterations needed to current email infrastructure. One DNS record added and small change in MTA software.

    If Yahoo would really like to do a service to the internet community, they should rather consider looking AMTP and reverse mx records.

    --
    I joined two users too late.
  22. Leading to a standard by Offwhite98 · · Score: 3, Insightful

    The way the IETF and other standards bodies have worked is that some organization wouldtry out a new concept for a technology and once they feel the concept is working, they will create a Request For Comments (RFC) which allows others to implement and offer feedback. Over time the RFC gains support and ultimately becomes a recommendation.

    This process was used to create the internet today, including all of the network protocols and services that run on top of it. Even SMTP was an RFC first.

    --
    Brennan Stehling - http://brennan.offwhite.net/blog/