Slashdot Mirror


Microsoft and Yahoo! Fight Spam - Sort Of

kyndig writes "In a Forbes article, Microsoft claims that 90% of email on the internet is spam. To fight this, Yahoo! has teamed with Cisco in developing DKIM, a signature based email authentication. Not to be outdone, Microsoft is proposing SenderID, which examines an email to see if it is coming from an authorized server. Earthlink's chief technology officer, Tripp Cox, goes on to examine the pro's and con's of each specification and provides practical application results." From the article: "Critics have accused Microsoft forcing SenderID on the industry without addressing questions about perceived shortcomings. The company drew fresh criticism recently when reports claimed that its Hotmail service would delete all messages without a valid SenderID record beginning in November. While AOL uses SPF, many e-mail systems do not. If Microsoft went through with this, for example, a significant portion of valid e-mails would never reach intended Hotmail recipients."

30 of 344 comments (clear)

  1. Re:Let MS do it... by natedubbya · · Score: 2, Insightful

    Right, somehow I doubt microsoft would start deleting e-mails. That's just silly. The instant someone finds out a real e-mail was deleted is the instant they switch e-mail providers.

  2. Bad news by mfloy · · Score: 4, Insightful

    This has bad news written all over it. These companies are going to try and use their size to push their technologies on everyone else. This will result in systems that are beneficial for Yahoo and Microsoft, but that don't adress the needs of everyone else. If something like this is done, it should be done internationally by a group of companies and individuals from a variety of backgrounds.

    1. Re:Bad news by kryptx · · Score: 2, Insightful

      Of course, but something like this "should" have been done ten years ago. Spam is nothing new.

      I, for one, am glad that somebody seems to be trying to do something about spam other than blacklisting, whitelisting (a la TDMA), or bayesian filtering. I couldn't care less if it's Microsoft, as long as 1) everyone can use it, and 2) it works.

      --
      Mods: Do you disagree with me? Go ahead and mod me down. Meta-mods will sort it out. Good luck!
  3. what should be done by hsmith · · Score: 3, Insightful

    is all the major companies sit down and design a new email system. the current email system is like a sinking boat they are trying to patch and prevent it from reaching the bottom. now, everyone is going their own seperate way (MS, Yahoo), where there will be no standard. the whole system needs to be scraped and rebuilt from the ground up taking into consideration spam, which was never present when the system was designed.

  4. Multiple e-mail accounts and masking by Zweideutig · · Score: 2, Insightful

    With several gmail accounts, I never have trouble managing spam. I don't reply to suspicious e-mails, and if I do, I am sure not to use the return e-mail address of my primary account. I keep an account for things like ebay, rentacoder, guru.com, etc., and a seperate account for personal e-mail. I have been doing this for over a year and I have only received six spam messages, and those were in the secondary account. I don't see why AOL couldn't encourage their users to do this. Isn't this why we have multiple e-mail accounts available from ISPs?

    --
    Powered by caffeine and sugar; BSD
  5. The problem... Meetings by Alex+P+Keaton+in+da · · Score: 4, Insightful

    One of the main problems with this, in my OPINION, is that corporations can't keep up with individuals. It is sort of like how Geurrilas, from the time of the US colonies to Vietnam, have been able to put a hurting on huge armies.
    Corporations aren't as light on their feet as spammers and internet miscreants (for the most part- I know I am speaking in generalities).
    It takes many meetings over years it seems (Meetings- None of us is as dumb as all of us...) to come up with a new policy or system regarding spam etc.- commitees are formed, proposals made etc. Then, someone (or group) without meetings, without authorizations, comes up with a way around the new system.
    As has been said a zillion times before on here, by people more intelligent than I- the only way to stop Spam is to make it not pay, by having no one respond to it. It is like Drugs or Prostitution- if there were no client base, there would be no sellers....

    --
    And All I Ask is a Tall Ship And a Star to Steer Her By
    1. Re:The problem... Meetings by Otter · · Score: 2, Insightful
      I think you have the right analogy and the wrong conclusion. What it is -- it's easier to be destructive and nihilistic than to be careful and responsible. Spammers aren't smarter than the guys who developed mail protocols, they simply don't have to care about negative consequences of their actions.

      Incidentally -- Sky Dayton's CTO is named Tripp Cox? WTF? I grew up in Connecticut and went to Yale and I've never actually met people with names like that.

    2. Re:The problem... Meetings by isotpist · · Score: 2, Insightful

      Except that drug dealers and prostitutes actually supply something:-)
      I really don't understand how anyone buys anything from spammers. How many people have the unique lack of critical thinking skills and lack of erections to support all these spammers?

  6. Re:At least it works by _LORAX_ · · Score: 2, Insightful

    Not really. Once people start seeing that every mail from everyone they know excpet those on hotmail get a warning it will cease to be effective.

    False positives are WORSE than false nevatives.

  7. Re:All things considered, not a good thing by Phrack · · Score: 3, Insightful

    SpamAssassin reduces my spam by 98%. That's just one example of filters... the point being that the more filters deployed out there (at ISP's, companies, etc), the more spam gets auto-tossed into the bit-bucket, and the less economically viable it is. Simply starve the market, requiring no protocol changes.

    --
    Dump the IRS - http://www.fairtax.org
  8. What About by Noodlord · · Score: 3, Insightful

    PGP key's? I thought people knew about and used these. With a pgp key, it is signed with an encrypted hash, and you have the option of encrypting the message along side it. Once this is done, you know an email is coming from a valid user because it contains their key. These are already used in workplaces around the world. Why implement a new system when one already exists? Not only does one exist it is more or less and open standard. Yeesh! I wish people would actually stop rebuilding the wheel in the software industry.

  9. PRA DOES NOT WORK! by Anonymous Coward · · Score: 1, Insightful

    It's trivial to add arbitrary headers to SMTP data, worse the headers PRA uses don't have to be present at all.

    Microsoft need to stop checking PRA against our spf v1 records. Afterall, I don't check SenderID records against SMTP MFROM (ie: SPF), even if it would be a worthwhile counter to Microsoft's position.

    Then there's that unacceptable patent license and some rather disturbing support for Microsofts silly, broken system and abuse of existing SPF records within the IETF.

  10. Re:Let MS do it... by Iriel · · Score: 3, Insightful

    My biggest concern (and please don't bash me for this) is not about Hotmail users getting all their email flagged as spam. The problem I can see with this is if Microsoft strongarms other servers into using the SenderID. It's almost like the way that the majority of websites have CSS hacks and workarounds for a broken browser(IE) that still won't be fixed in the next version. If enough people are using the proprietary garbage, then people will others will be forced to support it.

    If they can muscle thier SenderID onto enough servers out there than less email becomes spam, then SenderID is free to be a gateway for other proprietary garbage that MS may decided to bundle with it. Microsoft has had its overwhelming failures at times, but it also has a record of 'forcing' their way onto enough of the market to make an impact for better or worse. That's just my take on it; it's not what it will do, but what it will allow to happen in the future (should it catch on)

    --
    Perfecting Discordia
    www.stevenvansickle.com
  11. Re:Heh by hal9000(jr) · · Score: 4, Insightful

    It's not just Microsoft's old tricks. Many 800 lb. gorillas (Cisco, IBM, Intel) have done the same with more or less success. Most of the time, wrangling is done in working groups where vendors start deploying products based on early standard drafts, which commits them to lock-in, which then motivates them to fight for thier methods regardless of technical requirements. Besides, market dominant driven standardization is not always a bad thing. The anti-spam market is so fragmented that having a Microsoft force a decision may actually move a resolution.

  12. Re:Sender Policy Framework by tb3 · · Score: 2, Insightful

    Except that the Forbes article says that "... a Sender Policy Framework (SPF) record, which is covered under Microsoft's SenderID framework. "

    Does this now mean that SenderID includes SPF? Or is Forbes confused?

    Anyway, it doesn't get around the fact that SPF generates false positives, according to the article.

    --

    www.lucernesys.comHorizon: Calendar-based personal finance

  13. Re:Two email systems by brainnolo · · Score: 2, Insightful

    Why would this stop spam? In my physical mailbox i get spam as well and don't tell me they don't pay the shipping fee or the guys that put those ads in your mailbox. So how would this be any different? They could afford to spam before the email, so they can also if emailing becomes a paid service.

  14. Re:At least it works by slavemowgli · · Score: 3, Insightful

    And? What would prevent a spammer or phisher from creating the necessary setup to pass verification? Things like SPF and Sender-ID are good for stopping (or at least warning about) mail that some spam clown sent with a forged From: address (which can be highly annoying if the forged address is in one of *your* domains), but it won't do a thing about, say, email that comes from, say, "support@paypa1.com" or so.

    Besides, if you want to warn users about phishing, you don't even need any of these tricks. GMail, for example, warns me with a big red banner when it thinks that an email may be a phishing attempt, and so far, it's always been right - no false positives, no false negatives, even without any technical trick that depend on the honesty of the sender (which both SPF and Sender-ID ultimately do, in that they allow malicious senders to set up systems so that tests are passed for spam and phishing mails and the like).

    I only wish their spam filter would be as effective... :)

    --
    quidquid latine dictum sit altum videtur.
  15. Industry announcements by merc · · Score: 2, Insightful

    Yahoo!: Announcing: Domain Keys!
    Microsoft: Announcing: SenderID!

    (some time later)

    Yahoo!: Presenting: Domain Keys Identified Mgmt!
    Cisco: Presenting: IIM!
    Microsoft: Um, hey lookie... SenderID!

    --
    It's true no man is an island, but if you take a bunch of dead guys and tie 'em together, they make a good raft.
  16. Re:Two email systems by hal9000(jr) · · Score: 2, Insightful

    Um, that won't stop spam, but it will increase the likelihood that you will get better quality spam. I have been tracking me snail mail for a few months. 70% of the mail I receive I would classify as spam. Credit card offers and advertising circulars from companies I have never done business with (MBNA, Providian to name two). Then there is the mail I receive from companies I do business with, but are trying to extend thier reach. All that mail costs money to print and mail. I don't know what the bulk rate is, but I bet it is larger than $.05 and the cost to the USPS to actually deliver it must be higher. HOwever, since they are going to spend the money sending out snail mail, they might as well go the incremental cost of making the mass mailing look good so that recipients will open it. I think the same principle will apply with per charge USPS email. No, the driver for the USPS to charge $.05 send an email is pure profit (and to regain control of it's monopoly) because the costs to process and deliver snail mail outpaces the revenue collected to send it.

  17. ... how will sender ID work... by Anonymous Coward · · Score: 1, Insightful

    yeah this will work.... as most spam I get comes from hotmail

  18. Re:All things considered, not a good thing by Anonymous Coward · · Score: 1, Insightful

    The objective of the new protocol is to cut back on unwanted bandwidth/cpu usage by receiving and filtering spam and to only allow mail from trusted sources.

    Filtering doesn't fix the problem. It just prolongs it. A new protocol would fix the problem for the most part, but there's also a price to pay. It has to be adopted by servers.

  19. legitmate - /dev/null + SPAM with SenderID by Anonymous Coward · · Score: 1, Insightful

    Um .. wait .. isn't there a BUG in SenderID?

    Domains below org and info can be registered in DNS within minutes today and are cheap. So it's easy to integrate SenderID into Spamtools by allocating a domain just-in-time, transfer the SPAM and then kill the domain again, all done with a single click of a button. Thanks to anonymous Domain registry services and zillions of Domains out there this will make it likewise difficult to track back the SPAMmer.

    However non-SPAMmers will have trouble supporting SenderID in their domains. I for my part often roam ISPs, so it's hard to track all those outgoing MTAs to add them to my SenderID entries of the domains I use to send eMails from.

    As a consequence this means, it's more easy to make SPAM conforming to SenderID than to do this in my highly mobile world. Thanks again, Microsoft, and poor users of Hotmail.

    SenderID shall be integrated in the ReverseDNS of the sending MTA and not in the Domain seen in From! It's relatively easy (thanks to djbdns-tools) to automatically add SenderID records to this reverse lookup of the Relay on the fly, such that all From-Adresses show up in the reverse as soon as the eMail is relayed. However this does not help, as open relays then automatically add SenderIDs as well.

    Checkmate. Either way, SenderID promotes SPAM.

  20. Re:Hashcash for mail would be better by Alioth · · Score: 4, Insightful

    The trouble is many spammers are now using networks (say, 50,000 or more) of pwned Windows zombies. They are doing it on a huge distributed network - they don't care if calculating a hash slows them down. If each zombie only sends 100 emails per day, that's 5 million spam emails sent. You'd have to have an insanely long calculation time to make a dent on a zombie network.

  21. Only as long as few use it by bluGill · · Score: 2, Insightful

    This works for now. However when everyone moves to it, it won't help at all. It is trivial for spammers to get around this - follow the standard. They don't bother now because most of their mail isn't being stopped by this trick. When it starts stopping a lot of email they will just implement that part of the standard and greylisting will become useless.

  22. Re:Hashcash for mail would be better by warkda+rrior · · Score: 2, Insightful
    many spammers are now using networks (say, 50,000 [my emphasis] or more) of pwned Windows zombies
    I would be very interested to hear the source of this number.
    --
    You need to install an RTFM interface.
  23. Re:All things considered, not a good thing by Uncle+Grimmy · · Score: 2, Insightful
    SpamAssassin is a great idea for relatively small amounts of email traffic, but utterly impractical for large ISPs that process terabytes of incoming email traffic daily. ISPs must also consider the adverse effects of false positives in their spam filters. (anyone else remember AOL's snafu when they blocked a series of emails from a county government in Florida? )

    The other problem, of course, is that spammers constantly use new tricks to avoid filters. "In a race between bullets and armor, bullets will always have an advantage" Purely defensive measures, such as filters and block lists will give the advantage to the spammer as they are more able to adapt quickly than large ISPs are.

    Litigation and Criminal prosecutions, combined with efffective and adaptive filtering measures are the best bet. Unfortunately, effective litigation and prosecution is made more difficult by a lack of effective authentication for email traffic. These are things that SenderID and SPF are designed to address. Prosecuting individuals who advertise through spam is another effective measure. (for example, maybe RICO would be useful in going after folks who hire spammers to do their advertising?) There are plenty of laws which address criminal conspiracy, and applying those to the anti-spam laws which have hit the books recently may take some of the economic incentive out of unsolicited email advertising.

    Just a thought...

    -Grim

  24. Re:ANSWER THE FUCKING QUESTION FUNNY MAN by friedmud · · Score: 2, Insightful

    Ok, I'll bite..

    "Why should a company not use it's marketshare to leverage it's products?"

    Your basic premise is fine... that in general companies should be able to use their marketshare as a selling point. The problem is that in Market economies Monopolies develop (either "naturally" because they are the best, or through illegal practices).

    In our economy once a company or product reaches the state of "Monopoly" there are certain rules that they must play by in order to allow natural market forces to continue (rules as in laws). One of those is that you can't use a Monopoly in one sector to force your way into another sector.

    Microsoft has violated this time and time again... and to the detriment of consumers and consumer choice. A few recent examples:

    1. Internet Explorer. Bundling IE with Windows was how MS pushed itself into the "internet sector" using their monopoly on operating systems.

    "But IE is free! How is this bad for the consumer?!". Because MS then put proprietary extensions into IE that only it's web-server and authoring tools (Frontpage and Visual Studio) are equiped to serve/create (ActiveX and extensions to Java). So if you want to talk to IE the best way to do it is with Windows Server after creating it in Visual Studio/Frontpage... and since they used their monopoly to deploy IE... 90% of people are using it.....

    2. Windows Media Player (Both the format and the player). This one is the next MS cash cow. They bundle WMP with Windows so everyone has it...

    "But WMP is free! And it works well! How is that bad for consumers?!"

    Becuase of what they are doing now. They are pushing WMP as the next format for EVERYTHING. Music, Movies, Streaming Media... Have you noticed that the new HD-DVD codec is WMP based? Do you think you'll be able to play those without a license from MS? All MS has to do is start making set top DVD players and they can force everyone else out of the market (by not licensing the codec to them).... wait they already are! (Think XBox 360).

    What about streaming wmp?? What kind of server do you need to do that? Oh.. right.. Windows Server.

    What about music? Oh you mean WMPs with DRM will only be playable in Windows? Hmmm.

    #

    For some reason people have a hard time understanding just how evil MS really is. And when I say "evil" I don't mean that trying to make money is evil. That's capitalism. What's evil is trying to make money at the detriment to consumer choice and product quality.

    This is really a problem because destructive Monopolies are bad for the entire economy. They stagnate innovation and produce "economic blackholes" where all the money from the economy pours... but nothing comes out (how many billions does Microsoft have just sitting around in liquid assets?)

    Ok. That should do, nobody read this far anyway.

    Friedmud

  25. Zombies will steal your sender ID by Animats · · Score: 3, Insightful
    Right now, most zombie machines send using some arbitrary identity. Most of them are just proxies or forwarders, not mail generators. The way the spam industry works is that you rent some zombies at SpecialHam, get a "bulletproof mail server" from Black Box Hosting in China, install Dark Mailer, and go. Dark Mailer runs on the "bulletproof mail server" and generates the messages, which are sent via your rented proxy farm.

    If sender ID goes in, the software that takes over a target machine will just have to use the normal sending identity for that machine, or, more simply, transmit it back to the bulk mailer so the mailer can construct the outgoing messages accordingly.

    MX Logic reports that, as of March, 9% of spam already has valid SPF markings, and 0.83% have valid Sender ID markings. So the technology to bypass SPF and Sender ID is already deployed.

  26. Re:At least it works by Elwood+P+Dowd · · Score: 2, Insightful
    Besides, if you want to warn users about phishing, you don't even need any of these tricks. GMail, for example, warns me with a big red banner when it thinks that an email may be a phishing attempt
    What makes you think Google isn't using SPF and Sender-ID for those banners? And dunno what you mean "no false negatives". I've seen quite a few fishing attempts on my gmail account that had no banner.

    All the SPF and Sender-ID critics continuously point out that SPF and Sender-ID only have the features they were originally designed to have. Ok. That's plenty. How can it not be a good thing to be able to show whether a given SMPT agent is authorized by the domain? Yes, obviously, we all know that spammers will then be able to set up their own domains and spam via those domains with SPF and Sender-ID. That's FINE. That was the entire goal of the technology. All of a sudden, plain old blacklists will work way way better. You won't get spam messages that appear to be from acquaintances. No one ever said that messages using SPF and Sender-ID should always pass through your spam filter.
    --

    There are no trails. There are no trees out here.
  27. I beg to differ... by doctorjay · · Score: 1, Insightful

    I have multiple hotmail accounts, and one of them is a generic name that could easily get slammed by dictionary spammers. The other is a not so generic name. I literally NEVER get spam on that account. So your claim that hotmail purposfully sells its lists or allows spam to go to ALL hotmail members is bogus. Stop signing up for pr0n stop giving merchants your email, and dont use email addys like puppy123@hotmail.com and I gurantee you wont have any spam from anywhere. Hotmail most definitly does NOT allow spam, nor do they sell their lists or anything like that. If you dont believe me make a new hotmail account, dont give the address to ANYONE... and see how much spam you get. You wont get any, guranteed. But of course you must make your email address something that a dictionary cant get etc..