Slashdot Mirror


Microsoft Researching Anti-Spam Technique

Tim C writes "Microsoft's Research group are working on a technique to combat spam. Dubbed the 'Penny Black project', it involves making email senders perform a computation taking around 10 seconds, which their recipients can then check for. This delay would limit bulk emailing speeds to around 8000 a day, meaning that to spam all of those 'fresh, guaranteed 25 million addresses' would take approximately 8.5 years." We've reported on this before.

97 of 660 comments (clear)

  1. Question... by Xpilot · · Score: 3, Insightful

    How do you "make" senders do anything?


    --
    "Backups are for wimps. Real men upload their data to an FTP site and have everyone else mirror it." -- Linus Torvalds
    1. Re:Question... by notque · · Score: 2, Funny

      How do you "make" senders do anything?

      With large pointy sticks....

      --
      http://use.perl.org
    2. Re:Question... by tomstdenis · · Score: 2, Interesting

      By rejecting their emails otherwise. D'uh.

      You really want to email me [or get priority over other emails] you will do as I say.

      Of course you can get to the point where it's too much hassle. I think MSFT is seeking to have this built into OE [e.g. integrated]

      Tom

      --
      Someday, I'll have a real sig.
    3. Re:Question... by asquared256 · · Score: 2, Informative

      by automatically rejecting any emails where the computation's results aren't present, like using cryptographic signatures?

    4. Re:Question... by Kierthos · · Score: 2, Insightful

      Oh, they could roll it out as part of a "required" patch that fixes other security holes, it could be part of the next version of Outlook, and as part of MSN... there are ways.

      What concerns me is how this would affect people who use Eudora, or yahoo-mail, or any of the host of other systems that don't require the Lords of Redmond holding their hands to send e-mail.

      It seems that it would be a stop-gap measure for anyone using MS products or services to spam, but unless it was adopted by every major (and many minor) e-mail services, it would have very little actual effect.

      Kierthos

      --
      Mr. Hu is not a ninja.
    5. Re:Question... by tomstdenis · · Score: 4, Informative

      The technique is on page 426 of Advances in Cryptology -- Crypto 2003 [LLNCS2729].

      Not exactly a monopoly here as anyone else can implement it.

      Tom

      --
      Someday, I'll have a real sig.
    6. Re:Question... by Geoffreyerffoeg · · Score: 2, Informative
      By refusing connections or refusing to send e-mail unless they do. Kind of like how SMTP servers "make" the senders do a HELO before sending the message. Like:
      220 mail.example.com SMTP server ready
      HELO client.example.com
      250-Hello client.example.com, calculate
      250 1+2+3+4
      ANSR 10
      250 Answer correct, continue
      MAIL FROM:<foo@example.com>
      ...
      or
      ...
      250 Hello spammer.example.com, calculate
      250 1+2+3+4
      MAIL FROM:<user@example.com>
      503 You didn't answer my question, go away
      although the computation would be a lot harder than just 1+2+3+4. Disclaimer: I have no idea how the system works in practice. This is just a possible way.
    7. Re:Question... by tomstdenis · · Score: 2, Informative

      Don't take my word for it...

      read the paper yourself!

      Tom

      --
      Someday, I'll have a real sig.
    8. Re:Question... by the_mad_poster · · Score: 4, Informative

      Calm down, killer. Microsoft's not THAT smart.

      It Is Not A Big Secret

      At worst, I suppose Microsoft could make it's own scheme and try to push other people out, but I doubt that there are enough Microsoft MTAs out there to make that sort of system survive. If they implemented it for Microsoft-only, they'd almost have to give the option to revert to a traditional white-list when the sender can't play Microsoft's Holy Encryption Puzzle. After all. If you send someone an e-mail and outlook Express won't give it to them, just tell them that - Outlook Express won't let you look at it. I sent it, sorry. The problem is clearly on your end, call support for help.

      Microsoft HATES support costs and one thing you don't do on Windows is screw with grandma's emails.

      --
      Alito: A vote for Alito is a punch in the eye to put that bitch back in her place!
    9. Re:Question... by Lord+Kano · · Score: 2, Interesting

      you don't understand, once the sender does this there will be some type of key. If the client doesn't see this key in the headers or wherever then it will be seen as spam by the reciving client.

      How do you know if the key is valid?

      Why can't a spammer just make up a false key? Does the client check it mathematically? How long does that take? Why not just delete the spam manually (like we all do now) if it's still going to take time to filter it out?

      LK

      --
      "Hi. This is my friend, Jack Shit, and you don't know him." - Lord Kano
    10. Re:Question... by MegaHamsterX · · Score: 4, Insightful

      With that question, I thought of another one....

      If this is so computationally expensive, what would happen to the mailserver if I sent...oh half a million emails with bad keys in them.

    11. Re:Question... by DShard · · Score: 2, Insightful

      If you look at the implementation, verification of the key is negligble. You don't need keys because it is not encryption, it is simply a hash function. It depends on the memory bus speeds to make it slow so it isn't even computationally heavy. It relies on memory latency so it really doesn't take up resources from your system. It appears the only disadvantage is distributed mailing and progress of technology.

    12. Re:Question... by JPriest · · Score: 2, Insightful

      The mail exchanger would already know the "key" becasuse it had to create the hash using something. It is possible to make this much more CPU intensive for the sending client than the mailstore but it is a valid point though. many ISP's have several million dollar mail platforms that function at 90% + utilization. Even adding one small step to the process could bring the platform to its knees.

      --
      Saying Java is nice because it works on all OS's is like saying that anal sex is nice because it works on all genders.
    13. Re:Question... by violet16 · · Score: 2, Informative

      But as the grandparent implies, the sender still isn't made to do anything. Rather, the client refuses to accept mail unless it complies with this protocol.

      Which begs the question: how is something like this ever going to reach critical mass? Because if you're an early adopter, you're bouncing back e-mails to servers that don't yet comply, so don't perform the validation, so you never get your e-mail. You bear a high cost for other people's non-adoption.

      This seems like something you want to adopt once everyone else has, but not before--which means it has a very low chance of getting widely adopted in the first place.

  2. Oh yeah they invented this... by tomstdenis · · Score: 5, Insightful

    Well actually yeah they did. At Crypto'03 a method for memory bound HC was presented.

    So while MSFT didn't invent the original HashCash concept MSFT did improve upon it. So before anyone gets the bright idea of flaming MSFT ignorantly.... know your facts!

    Tom

    --
    Someday, I'll have a real sig.
    1. Re:Oh yeah they invented this... by tomstdenis · · Score: 2, Insightful

      Um? The point, my small minded ignorant little friend is if it takes you 10 seconds to send an email it takes spammers 10 seconds to send an email.

      The real contribution MSFT made was their memory-bound HashCash which was designed to perform comparably on the latest machines [e.g. P4-3000] and the oldest machines [e.g. P2-233].

      And this is part about sales but the research is freely available off the web as well as part of the Crypto'03 proceedings.

      Tom

      --
      Someday, I'll have a real sig.
    2. Re:Oh yeah they invented this... by tomstdenis · · Score: 2, Interesting

      That's just it, reductions. HC is based on the difficulty of finding collisions in a hash. If you break HC you break the hash.

      This memory-bound one doesn't have such a nice reduction but it's conjectured to be similar.

      So you can't "fake the method". Sure they could put a fake header in there, e.g.

      X-MBHC: BLAH

      But the verifier could trivially see it was faked.

      Tom

      --
      Someday, I'll have a real sig.
    3. Re:Oh yeah they invented this... by BasilBrush · · Score: 2, Insightful
      Hmmm, If only we could think of a way of "faking" other methods. Maybe we could "fake" cracking an RSA key. Maybe SETI could "fake" analysing those radio signals. Maybe they could have "faked" decoding the human genome.

      There's are plenty of math problems where thinking up the question, and checking the answer take little resources, but calculating the answer takes lots of resources. You can't "fake" the calculation.

      Increasing the computing power you throw at the question clearly does mean you can send more eMails per hour. But at a cost. And giving a large increase in dollar cost for bulk emailers is exactly the point of this method.

    4. Re:Oh yeah they invented this... by mcpkaaos · · Score: 2, Funny

      So while MSFT didn't invent the original HashCash concept MSFT did improve upon it. So before anyone gets the bright idea of flaming MSFT ignorantly.... know your facts!

      That never stopped us before!

      --
      It goes from God, to Jerry, to me.
    5. Re:Oh yeah they invented this... by tomstdenis · · Score: 2, Interesting

      If you have zero-waitstate memory you could essentially own the system [well it's still a slowdown but you will win overall].

      However, 8MB of what essentially amounts to cache is expensive. This means now for a spammer to spam in volume they have to buy a $20,000 cpu.

      The trick though, is in the original HC to make spammers slow down you have to slow down the lower end users.

      MSFT research realized that if you make the memory bus the major limitation you can level most desktops. E.g. a P4-3000 is only 4 times faster than a P2-233 in terms of tag generation.

      Ram is relatively cheap [even in older desktops] so you can step this upto [say] 32MB buffers. They will only be required to send an email but will totally prevent "zero-wait state 32MB cells" since they would cost a shit load of money.

      Of course this makes the system useless for portables since they often have little memory to spare. At the conference the speakers suggested that the ISP would then generate tags [at a cost] for the users.

      Tom

      --
      Someday, I'll have a real sig.
    6. Re:Oh yeah they invented this... by swillden · · Score: 4, Interesting

      I believe you 100%, only Microsoft would come up with a solution that artificially induces inefficiency.

      I'm no fan of Microsoft, but this is silly. Lots of security tools "artificially induce" inefficiency. One relatively early example that comes to mind is Unix crypt, the function originally used to hash passwords. It runs a DES-like algorithm many times to produce its results, not because that improves the quality of the hashing, but because it takes longer, which makes brute force attacks harder. The Unix login program also deliberately introduces an artificial delay after every failed login attempt, and it's not to give you time to remember your password.

      There are many instances in which slowing down legitimate users a little is an effective mechanism for deterring abuse.

      That said, I still think this particular idea is stupid, since there are plenty of people who have a legitimate reason to send large volumes of e-mail, and this would cause them more pain than it would cause spammers.

      --
      Note to ACs: I usually delete AC replies without reading them. If you want to talk to me, log in.
    7. Re:Oh yeah they invented this... by Tony+Hoyle · · Score: 2, Insightful

      Actually it *is* the server if you happen to have a mailing list with 1000 users on it as I do.

      If something like this became popular I'd have to drop the mailing list as the hardware cost would be prohibitive (10 messages a day, 10,000 emails at 10 seconds an email doesn't scale when the machine is serving web pages too).

      The LKML people would be stuffed... they'd need to invest in one of those expensive zero wait-state memory modules just to stay online.

  3. not a solution by Quasar1999 · · Score: 2, Insightful

    This is not a solution... as *I* still have to check for something on my end, and then discard if that condition is not met... my bandwidth and time are still wasted.

    --

    ---
    Programming is like sex... Make one mistake and support it the rest of your life.
    1. Re:not a solution by notque · · Score: 4, Insightful

      This is not a solution... as *I* still have to check for something on my end, and then discard if that condition is not met... my bandwidth and time are still wasted.

      Whine!

      It may not be the end all be all solution, but obviously we haven't found that yet. This seems like a pretty good solution for the moment. There may be a better one that comes out, making this one null and void, but we are continuing to find ideas which are a little better than the last.

      How can that be a bad thing?

      --
      http://use.perl.org
    2. Re:not a solution by tomstdenis · · Score: 2, Interesting

      Your server can do the calculations for you. That's the point. You pay for email right? [if you don't run your own server]. Then why not expect your ISP to actually provide service.

      The idea though is that you can automate the process. E.g. unless the email has a tag on it that's valid you delete/filter the message.

      Tom

      --
      Someday, I'll have a real sig.
    3. Re:not a solution by dustman · · Score: 3, Insightful

      No, it *is* a solution...

      Some of your bandwidth and time is being wasted in the short term, because spam is still being circulated.

      But in the long term, spam ceases to be an effective business model.

    4. Re:not a solution by xigxag · · Score: 2, Insightful

      No, *you* don't have to check for anything. Your email client will check, and could easily be programmed to discard the email sight unseen if it doesn't contain the appropriate validation code.

      --
      There are two kinds of people: 1) those who start arrays with one and 1) those who start them with zero.
    5. Re:not a solution by walt-sjc · · Score: 4, Insightful

      Um, maybe you don't realize what spammers have been doing lately. They use huge networks of compromized machines to spam FOR them (thank you MS and your wonderful security model). There is plenty of horsepower out there to handle any kind of HC type system. The bottom line is that spammers ALREADY have the resources to make a HC system useless.

    6. Re:not a solution by tomstdenis · · Score: 2, Insightful

      I'd think the server would verify and the users would generate.

      Recall that verification is trivial while generation is what takes the time.

      Or the server could put the burden on the users.

      The idea is not to stop spam it's to make it easier to filter out. Spammers won't take a 10,000x fold penalty increase to spam with valid tags...

      Tom

      --
      Someday, I'll have a real sig.
    7. Re:not a solution by ReadParse · · Score: 2, Interesting

      I have two points. First, I think you're wrong about that. They speak in terms of the sender and the recipient taking actions, but I think they're referring to software on the sender and recipient computers taking these actions, and not humans. The only action that was clearly intended to be taken by a human was the part about agressively whitelisting good recipients, which is definitely something that I anticipate users will need to be willing to do.

      The second point that I have is that the whining is interesting, and this is a big part of the problem. We, the lazy users, will absolutely have to get used to taking some sort of action ourselves as part of whatever the SPAM solution turns out to be. Right now we like the very low barrier to entry into the e-mail community, but that is exactly what makes SPAM possible.

      I have taken a couple of very small steps in the direction of participation in the solution. I decided to start signing all of my e-mail with my PGP signature. It it ignored by many and it confuses many, and it probably makes some roll their eyes (it's quite a geek fashion statement). But it damn sure identifies the message as one that I wrote, and it (sort of, except without a CA) identifies me as a person and not a spammer. I feel that PGP signatures might very well be a part of the SPAM solution. Everybody could sign all of their e-mail, which is getting easier for non-geeks every day, and we could all start rejecting e-mail that is not signed. We could even all get real keys from real CAs and reject all mail from users that have not been independently verified. Send whatever you want in your e-mail, even Viagra ads, but make sure I can trace it back to YOU.

      The second step I have taken is to install and use SpamAssassin on my mail server. It's something that is making the situation more tolerable, although it's still costing me a little in terms of bandwidth of the messages I never see and don't want to see being sent to my server. It also minimizes the impact of SPAM on me, which could be a bad thing because my SPAM problem is actually bigger than I regularly realize. But my point is that it required some effort on my part. It wasn't enough for me to bitch about SPAM. I had to take an action.

      SPAM is more like terrorism (bear with me) than is initially obvious. Do you check under your car for a bomb before you get in? Neither do I. But I did when I lived in a place where car bombs against my demographic were a reality. I altered my behavior to counter the threat. I could have said, "I shouldn't have to check under my car," but instead I got down on the ground and took a look. I could also say, "Airport security is an inconvenience, " or "Do I look like a terrorist?" or "SPAM should just go away or be 'fixed' by the government or somebody like Microsoft, but not in a way that I have to participate." But the problem is here and it's staring us in the face. We must change our behavior in order to fix the problem. Once we're all on board with the fact that we are all a part of the solution, we can be free of it.

      This MS Research stuff is all very interesting, and all ideas are welcome at the table of solutions, but the neat thing is that the technology to remove SPAM from our lives already exists. But it's a little strange and uncomfortable. It would be great if we could all pull together on some sort of e-mail signing solution and work together to get the word out to the world that we can take our e-mail system back.

      First, though, we have to get over the fact that we MUST change our assumptions and we must raise the barrier to entry -- not much, but some.

      Finally, I'm sure I probably misunderstood the spirit of your reply. It got me started on a vent, and that's not a bad thing.

      RP

    8. Re:not a solution by swillden · · Score: 2, Informative

      What you're missing is the fact that the 50 e-mails you delete take *your* time, whereas the 50 you send burn only your computer's time. You click send and go on to something else while your computer chugs away in the background.

      I don't know about you, but my computer's time is worth next to nothing to me, whereas my time is rather important (to me).

      --
      Note to ACs: I usually delete AC replies without reading them. If you want to talk to me, log in.
    9. Re:not a solution by schon · · Score: 4, Insightful

      No, it *is* a solution...

      No, it isn't. Three years ago it might have been a solution, but right now, it's just a colossal waste of time.

      The problem with this is that it operates on the assumtion that spammers work within the same boundaries as everyone else. Anyone who has spent even a tiny fraction of their time fighting spam knows this is simply not true.

      The days of spammers sending spam from a single server are long gone - nowadays, they use thousands of trojaned machines to do their work. How many machines do spammers control? Enough to launch effective DDoS'es on some of the largest pipes out there.

      The effectiveness of this 'solution' would be marginal at best.

      Now compare the effect it would have on legitimate users - an individual sending mail wouldn't notice 10 seconds.. but email is not only used by individuals.

      Something to keep in mind when assessing any anti-spam 'solution' such as this is the following:

      From a receiver's standpoint, the only difference between a legitimate mailing list and a spammer is that the user asked to be part of a mailing list.

      Now think about how this would affect legitimate mailing lists: How many mail servers do most mailing lists have? One? Two? Six? Some large mailing lists might have a dozen.

      So how does this affect those mailing lists?

      It would shut them down, is how. They would cease to be useful, as it would take days for their mails to get through.

      So the 'obvious' solution to this problem would be to whitelist legitimate mailing lists, right? Wrong. That's not a solution either (and we'll ignore the point that any 'solution' that requires exceptions is probably not very well thought out.)

      I maintian a mail server for a few thousand people. I have no idea which mailing lists they would subscribe to. It would probably become a full-time job to keep such a whitelist up to date. (And most users wouldn't have any idea to notify me in the first place - so the end effect is that they would subscribe, and then bitch about how they're not getting the stuff they signed up for.)

      This 'solution' does not solve anything, and will create more and worse problems than it attempts to solve.

    10. Re:not a solution by Fjornir · · Score: 4, Insightful
      Sir,

      The idea is not to save you fifty-seconds of time by deleting your spam. That's a fringe benefit. The idea is to stop spam by making it harder and more expensive to do so. If we can up the price and difficulty to a certain point spam will no longer be a viable marketting technique.

      You're missing no voodoo magic whatsoever, I think you've simply failed to think this through in its entirety. You claim you're sending 50 emails a day. In all likelihood most of these emails are not first-contact emails which would require a crypto challenge, but are in fact addressed to an established-contact which doesn't challenge you.

      But for the sake of argument lets say all 50 of these emails are first contact. Dandy. Lets look at how this goes. You write the first letter, and proofread it, and click send. Your system does not immediately lock for ten seconds. Instead your message goes into your outgoing message queue. While you are writing and proofreading your next message the system is busily computing the hash for the previous message.

      Let's suppose even further that you type uncommonly fast, require not proofreading, and get all 50 of the messages into your outbox. You take a deep breath, run to the bathroom or for a refill on your coffee, or whatever -- guess whats happening while you're afk?

      --
      I want a new world. I think this one is broken.
    11. Re:not a solution by p7 · · Score: 4, Interesting

      You are missing the point. Nobody is saying that this is going to be required for all machines. Essentially it is an extra header attached to emails so email recipients can filter messages that don't have this tag. As I see it this is how it would work for most end users.

      First setup a whitelist, make this your first spam check. On the whitelist? Email goes through never checking for any other spam criteria. (Mailing list should be accepted here).\
      For mail that doesn't pass the white list check we can check for the header created by the MS program. We verify that the computationally intense header is correct and maybe we can let that through if we want, maybe I let emails with this tag pass through my spam checker with a higher spam score.
      If we decided to accept mails with the header, we now check the remaining email with a very thorough spam checker and use a very low score.

      No matter how many computers they have, it will lower the number of emails that are able to be sent, if people filter on this criteria.

    12. Re:not a solution by ArgumentBoy · · Score: 2, Informative

      Let me offer an analogy to antibiotics. If you only take part of the prescription, you kill, say, 99% of the bacteria, but that last 1% is superbacteria, often antibiotic resistant. That's what this technique will do to spammers. In the short run, some will get more sophisticated, and trick other people's computers into sending out the 25 million spams. Others may be run out of business. But in the long run, this will force smart spammers to cull their lists, in the same way that marketing has become more target-oriented and less broadband during our lifetimes. Spammers will need to collect detailed information on where we surf and how we spend our money, and may do this illegitimately, ala Gator, BonzaiBuddy, or KaZaa. They will reduce their lists to manageable levels, maybe half a million or so per product. But we will still get spam, and we will get it from superspammers - technology resistant ones. We need a more complete solution - the whole prescription, if you will. Half measures might be good PR, but they're just as dangerous as half a prescription.

    13. Re:not a solution by riffer · · Score: 2, Insightful
      Whine!
      What, are you a retard? You think it's whining when some total unknown entity costs your corporation $150,000 a year just for anti-spam software and hardware to run on it?
      It may not be the end all be all solution, but obviously we haven't found that yet. This seems like a pretty good solution for the moment.
      No. It sucks. And it's not a solution. A solution is something that completely solves an issue. This wouldn't solve the issue.

      Why not? Because the issue isn't "How do I filter spam?" THe issue is "How do I stop spam from being created in the first place?"

      There may be a better one that comes out, making this one null and void, but we are continuing to find ideas which are a little better than the last.
      This is actually one of the stupidest ideas I've heard in a while. Let's see...

      a) Doesn't stop spammers from sending e-mail in the first place
      b) Naive idea that "[...] a computational "price" of a 10-second levy would mean spammers would only be able to send about 8,000 messages a day, at most".[1]
      c) Ends up delaying delivery of legitimate e-mail!
      d) Useless unless supported by both e-mail clients and MTA's.
      e) Will add yet more complexity, cost, administration, explanation and general headaches to an e-mail system that used to be frelling useful.

      How can that be a bad thing?
      See above. Also, it wastes valuable time and resources to pursue the idea...

      Remember, Spam is a social problem. Spammers are, by nature, criminals. Not just because spamming is illegal in many states, not just because spammers will literally break-into computer systems just to launch campaigns, but also because frequently the content of the spam itself is illegal.
      Frankly, as with any crime, it's not likely it will ever go away. The best we can do is make it less profitable for the spammers. To accomplish that, we need to punish those who encourage spam, at the least socially.

      If you know someone who's ever responded to an obvious spam, rail them for it! Publically humiliate them and explain how incredibly stupid and thoughtless they are. Shun them. Mock them. And most importantly, educate them.

      [1] Does Mr. Wobbler really think a spammer is just one guy on one PC sending e-mail out all by his lonesome? What good does this sytem do when spammers launch massive parallel sessions, using not only multiple dedicated T-1 lines but literally hundreds upon hundreds of open relays and proxies? What the hell sort of name is "Mr. Wobbler"?!!!

      --
      In the darkness of future past, The magician longs to see. One chants between two worlds, "Fire, walk with me!"
  4. Comment removed by account_deleted · · Score: 2, Insightful

    Comment removed based on user account deletion

  5. I RTFA, but what exactly is it? by monadicIO · · Score: 4, Interesting

    Is it something that will require using Outlook on Windows to work? Alternatively, will I be force to use some MS software just to send mail to people who are using MS based web/mail/etc client/server programs?

    --

    The law of excluded middle : Either I'm foo or I'm foobar

  6. Involves calculating hashes by baseinfinity · · Score: 5, Interesting

    We studied this in a computer security course I took. This technique has been proposed to TCP establishment as well. It involves the server calculating a hash of a particular nonce (random value). The server then provides the hash and a certain number of bits of the nonce. It becomes the clients job to complete the nonce such that the value hashes out correctly. The server can vary the number of bits it provides to vary the difficulty of the puzzle...

    1. Re:Involves calculating hashes by baseinfinity · · Score: 2, Informative

      It's transparent to that. All this has to do with is if you want to use a service of a server (sending mail). This strategy doesn't have to be global, you could tack it onto any authentication protocol and it would only be the senders job to get the required software. However the reciever authenticates is the buisiness of the server they recieve from.

  7. Phew by Lord_Dweomer · · Score: 3, Funny
    From the article:
    "The payment is not made in the currency of money, but in the memory and the computer power required to work out cryptographic puzzles. "

    Phew!!! For a second there I thought I was going to have to do a math problem for each email I was going to send. I woulda been fucked!

    --
    Buy Steampunk Clothing Online!
  8. Spammers don't use their own computers by UnderAttack · · Score: 4, Insightful

    Even today, the most annoying spammers are not using their own computers, but insteady they are bouncing e-mail off virus infected and trojaned PCs.

    So 8,000 emails / day is fine, if you have a couple thousands relays to pick from.

    --
    ---- join dshield.org Distributed Intrusion Detec
    1. Re:Spammers don't use their own computers by Apreche · · Score: 2, Informative

      Damn straight. All the spam I get is from stupid people on campus who have insecure computers that spammers gain control over and send spam with.

      Let's say you leave your gun safe unlocked and someone comes in and takes your guns and kills somebody. You're going to get sued for big moneys. If you leave your computer "unlocked" and someone sends spam with it you should be held accountable in some way.

      Spam is an international problem and is very difficult to stop. But there are known spammers in the united states. Make a law that punishes them with federal prison time. Then enforce that law and lock them up. Spam wont go away, but it will definitely decrease. To solve spam on the international level we will need a new international organization that governs the net. They tried, but I think they'll get it on one of the next few go arounds.

      --
      The GeekNights podcast is going strong. Listen!
    2. Re:Spammers don't use their own computers by Kleedrac2 · · Score: 2, Interesting

      The only thing I could argue against that would be that if this did go through it would make the trojans and virii not only more noticable, but it would make infected machines almost impossible to work on, thusly resulting in more of them being fixed (cause you can't use a broken computer) and less relays! This does seem to be a fairly good solution. Though I do have to agree that if MS decides to create the method it better be an open standard that every one else can adopt or it'll go the way of BetaMax & OS/2.

      Kleedrac

      --
      Sure we wang, can.
  9. This not only isn't going to work, it's a disaster by FreeUser · · Score: 5, Insightful

    Count on Microsoft's "cure" to be worse than the disease itself. You would think for $40 billion they could buy just a little more intelligence than that.

    SMTP needs to be redesigned. Not by Microsoft, who will use any change in the protocol to tighten their monopoly grip, locking in their customers (and locking out the non-Microsoft world), but by the IETF.

    Spammers having to do a computation before delivering email isn't going to limit them to 8000 pieces of mail a day, it simply means they're going to cluster all of those Windoze boxes their custom worms have infected, and let those millions of PCs do the work for them in parallel. SPAM won't decrease one bit, but the load and toll it places on those who use the net will go up significantly.

    The solution isn't to increase the cost of email (computationally, bandwidth-wise, or financial), the solution is to repair the design flaws in SMTP (and, for that matter, USENET, something that remains the most useful medium on the 'net despite its widespread abuse) that make SPAM a viable methodology.

    --
    The Future of Human Evolution: Autonomy
  10. Re:10 seconds by tomstdenis · · Score: 4, Informative

    Mod parent down [-1,unsightful]

    The research this is based on [presented at crypto'03] is designed to level the difference between a P4-3000 and a P2-233. They use problems where cache hits will be lower [e.g. use a 8MB buffer or something] so you end up computing at the speed of your memory bus.

    If you had done some research before posting your crap you'd know this.

    Tom

    --
    Someday, I'll have a real sig.
  11. How about my old hardware? by bigberk · · Score: 3, Informative

    How is my older hardware (or even pretty recent hardware on a huge ISP, with lots of SMTP activity) supposed to be able to handle this? Bah. It seems to me that adding computational difficulty is not such a great way to combat spam. Do you have any idea how effective IP blocklists and statistical filters alone are? (Or, you could combine them as this project is doings).

  12. Okay.. by NegativeK · · Score: 5, Insightful

    If this works as stated, then I can see issues.. For instance, large mailing lists. Would they have to be white-listed? 3000 seconds of computation is a heavy tax on a community based program like the Linux Kernel Mailing List, which averages 300 messages to my inbox a day. Also, there's the issue of viral spammers.. Those that send out viruses to do the spamming for them. If you infect enough, 8000 mails per day per computer can still be quite a bit.

    Personally, my whole take on spam is that everything needs to be done on the user end. Laws have loopholes in every situation (foreign spammers being a large one,) server restrictions are either too restrictive on small servers, or can be defeated with distributed computing.. I say we stick with Bayesian filtering. It works _wonders_ for me, and I'd love to see more people use it.

    --
    This statement is false.
    1. Re:Okay.. by Sparr0 · · Score: 2, Informative

      You already opt-in to mailing lists by subscribing to them, which takes anywhere from 10 seconds to 5 minutes depending on the list. Would it be so hard to add them to a client-side white-list, perhaps an additional 10 to 30 seconds, in addition to subscribing?

    2. Re:Okay.. by Lord+Kholdan · · Score: 2, Informative

      If this works as stated, then I can see issues.. For instance, large mailing lists. Would they have to be white-listed? 3000 seconds of computation is a heavy tax on a community based program like the Linux Kernel Mailing List, which averages 300 messages to my inbox a day. Also, there's the issue of viral spammers.. Those that send out viruses to do the spamming for them. If you infect enough, 8000 mails per day per computer can still be quite a bit.

      Personally, my whole take on spam is that everything needs to be done on the user end. Laws have loopholes in every situation (foreign spammers being a large one,) server restrictions are either too restrictive on small servers, or can be defeated with distributed computing.. I say we stick with Bayesian filtering. It works _wonders_ for me, and I'd love to see more people use it.


      Whitelists my good friend, whitelists.

      Just make it so that some people dont have to calculate hashes for you and there you go.

  13. Comment removed by account_deleted · · Score: 5, Interesting

    Comment removed based on user account deletion

  14. what's your point? by penguin7of9 · · Score: 3, Insightful

    Microsoft Research is no different from other industrial research labs: IBM, Bell Labs, etc. They hire the same kinds of people and get the same kinds of inventions out of them. One can't expect any more or less from any big company with a lot of money to spend. However, so far, MSR has not had much positive impact when it comes to driving innovation into the marketplace.

    If Penny Black is all there is, it doesn't look like that's going to change. It will probably be decades before we know whether MSR will have had lasting impact. By that time, Microsoft will probably be a benign, lumbering giant, just like its monopolistic predecessors, AT&T and IBM.

    1. Re:what's your point? by Frisky070802 · · Score: 3, Interesting
      I fully agree that MSR hasn't had a huge impact thus far, but I don't think it's fair to equate AT&T and IBM's research arms in this fashion. AT&T's research has declined considerably in recent years as its (pseudo-)monopoly in long distance has dried up, and IMHO the company has done only a so-so job in translating research into practice, and in particular revenue for the company. Yet even then, no one can deny AT&T's impact with such things as the transistor, UNIX, C++, etc.

      On the other hand, IBM Research has done pretty well, though it too has gone through hard times. Its contributions to open-source are substantial, and at the same time, it's much more in touch with the demands of the company.

      Now, if someone had beaten me to it and moderated my parent as flamebait perhaps I'd have kept quiet....

      --
      Mencken had it right. So glad that's old news.
    2. Re:what's your point? by penguin7of9 · · Score: 4, Interesting

      The point is they did produce a result, it was published in a first tier crypto journal and the results are acknowledged as correct.

      And my point is that your comment is both insulting to MSR and misses the point.

      Your comment is insulting to MSR because anybody who knows anything about CS research knows that MSR has top people. They have produced hundreds of first tier journal publications over the years. This is just a minor publication among many good things MSR has done.

      It's meaningless because you are missing the main problem that all industrial research labs share: making the connection between research and products. MSR has been as unsuccessful at that as any other of the big industrial computer research labs before. Microsoft's problems is the quality and lack of innovation in their products, not their research labs.

      mod parent offtopic.

      I suppose when your points are weak, you have to fall back on calling on moderators. Why don't you engage your brain instead of falling back on such underhanded tactics?

    3. Re:what's your point? by penguin7of9 · · Score: 4, Insightful

      How is me pointing out that the article speaks of a published paper insult MSR?

      It's patronizing. MSR doesn't have just one journal publication to their credit, they have had a sustained output of quality publications over years. There shouldn't be any question in anybody's mind whether MSR is an innovative and high-quality research lab: it clearly is. They are among the top-rated research labs in computer science, both in general and in specific areas.

      I was hoping to FP to dispel the people who are naturally going to post out how MSFT is not innovative.

      What you are missing is that whether MSR publishes nice papers or not has nothing to do with whether Microsoft "is innovative", i.e., whether the company produces innovative products. MSR is innovative, but Microsoft products are not. That disconnect is common among large companies and their research labs.

      You seem to be agreeing with me while arguing against my post!!!

      You are engaging in the usual confusion between research labs and corporate products. The only thing I can't tell is whether it's out of ignorance or whether you are doing it deliberately (PR departments often like to use releases about interesting research results to cover up inadequacies in a company's product line).

  15. No research involved by psychoid · · Score: 2, Funny

    This is just a fancy way of saying "Microsoft is trying to figure out how to turn off Hotmail"

  16. GPU's? by Naksu · · Score: 2, Interesting

    The idea was originally formulated to use CPU memory cycles by team member Cynthia Dwork in 1992.
    But they soon realised it was better to use memory latency - the time it takes for the computer's processor to get information from its memory chip - than CPU power.


    Don't GPU's have a lot smaller memory latency?

    hmm, whats this?
    BrookGPU: General Purpose Programming on GPUs ;)

  17. Uhm by geeveees · · Score: 4, Insightful

    If it takes a long time to send out bulk email, what about all the mailinglists people subscribe to? How would lkml or sourceforge lists continue to operate?

    --
    I am a viral sig. Please help me spread.
  18. Why are people too lazy to read the article? by Koatdus · · Score: 2, Informative
    Do any of you actually read the articles before you open your mouths?

    The idea was originally formulated to use CPU memory cycles by team member Cynthia Dwork in 1992.

    But they soon realised it was better to use memory latency - the time it takes for the computer's processor to get information from its memory chip - than CPU power. That way, it does not matter how old or new a computer is because the system does not rely on processor chip speeds, which can improve at rapid rates. A cryptographic puzzle that is simple enough not to bog down the processor too much, but that requires information to be accessed from memory, levels the difference between older and newer computers.
    --
    Every wrong attempt discarded is a step forward - T. Edison
  19. Re:Proposed "Sender do Something" technique. by hashinclude · · Score: 3, Informative

    While this seems useful at first glance (at least open relays would stop working), how does your technique address these issues:

    1. Clueless admins (of windows or *nix servers) who refuse to use SA or similar? These are the same who leave the mail servers as open relays in the first place.

    2. People who use their own SMTP server

    Sure, go ahead and say that you can add reverse domain lookups. But registering a domain is quite cheap these days ($4.95 a year) and point the NS to your machine, set up MX records, and you're on your way.

    Your solution is useful, but not comprehnsive. I doubt there is a comprehensive solution short of making the spammers incapable of accessing the internet.

    --
    Clueless People? Everywhere I look, I see them. And some of them, they WORK here!

    --
    US is now divided as the "Red" and "blue" states. Red States = communist countries. Coincidence? I think not
  20. Limiting technology? by dybdahl · · Score: 4, Insightful

    This seems to be a "let's fix this by limiting what technology can do" case.

    Instead, they should focus on adding more functionality to the smtp protocol. For instance, they could add sender e-mail address verification. You can't check the actual e-mail address, but you can make a "dial-back" TCP connection to check, if the e-mail is known by the mail-server that belongs to the sender e-mail address.

    Combined with law enforcement, blacklists etc., this is extremely effective.

  21. Mailing list operators do use their own computers by swillden · · Score: 3, Insightful

    So this would have the effect of making legitimate high-volume, high-subscribership mailing lists expensive to operate (unless subscribers configured their MTAs to accept "unstamped" messages from the list, which is annoying and error-prone -- and has an obvious "workaround" for the spammers).

    <tinfoilhat mode="on">Ha! Now we see Microsoft's *real* goal... to slow Linux development by shutting down the kernel mailing list!</tinfoilhat>

    Seriously, though, any attempt to make e-mail expensive hampers those who have a legitimate need to send lots of e-mail.

    Plus, there are obvious workarounds that will be developed in short order. A hardware stamp-generator could probably cut the stamp generation time to practically nothing, particularly since their approach somehow depends on memory/CPU latencies rather than processing time. You might be able to make a much faster stamp generator by running it on your graphics card, and custom-built hardware could certainly do it.

    --
    Note to ACs: I usually delete AC replies without reading them. If you want to talk to me, log in.
  22. Re:Can Multiple Email Processes be Spawned ... by Have+Blue · · Score: 2, Insightful

    CPU time is also finite. If 1 process can send 8,000 emails at 100% CPU usage, then 10 processes will send 800 emails each and 8,000 emails in the same time. You're right that a machine with multiple CPUs could send more email, but a 4-CPU box could still send only 32,000 emails per day instead of millions, and a system with more than 4 CPUs (or buying a large number of computers) is extremely expensive.

  23. Scrap SMTP? by sethadam1 · · Score: 2, Insightful

    Before you chuck the entire protocol, do you have a solution for a better one?

    Until you know how you're going to repair the problem, let's not get too excited about scrapping a protocol that still has a lot of flexibility. I've learned a lot about SMTP in the last few months, if there was universal agreeement as to WHAT to do, we could probably accomplish it in place.

    What are the options? Whitelists, blacklists, red lists, gray lists, hash cash, filters, etc. No one can agree HOW to combat the problem. A new protocol would accomplish nothing without a planned solution that makes palpable the limitations of SMTP. Til then, let's not get hasty about blowing it off.

  24. Why not just.... by rongage · · Score: 4, Interesting

    Ok, I'll bite - why not just insert a "sleep (10);" line into the connection response of sendmail (or qmail, or whatever MTA you are using)? By making the sender wait 10 seconds before delivery can begin, you get the same effect as a tar-pit...

    --
    Ron Gage - Westland, MI
    1. Re:Why not just.... by stef0x77 · · Score: 2, Informative

      With no cost to the sending computer, it can spawn tens thousands of concurrent email sessions, which all wait a painless 10 seconds.

      Hashcash (although it has it's drawbacks) forces the sending machine to actually do something. That's the difference.

  25. Textbook case of over-engineering by Angst+Badger · · Score: 3, Insightful

    The programmer who works next to me used to be a construction worker. Every so often, I come up for an idea for some kind of home project, explain it to him, and he tells me a way to accomplish it that is much simpler and more reliable.

    This MS solution is almost a caricature of one of my own over-done home improvement ideas. Why bother with some elaborate cryptographic system to delay inbound emails? Why not just have the receiving SMTP process call sleep(10) at the beginning of the SMTP session? You get the same desired slowdown, and all you have to change is the SMTP server software. There's no need to modify MTAs, promulgate new standards, or fit yourself more tightly into the MS monopoly noose.

    --
    Proud member of the Weirdo-American community.
    1. Re:Textbook case of over-engineering by DunbarTheInept · · Score: 3, Informative

      It's about more than just sleeping a while. The problem with a "sleep" solution is that the sender can still queue up messages to send out elsewhere while waiting for the sleep confirmation messages to come back from the first messages sent, like so:

      Thread 1:
      for x goes from 1 to 100000, send message number X to a server somewhere.

      Thread 2:
      In a loop, respond to any 10 second sleep requests that came back from servers being talked to by thread 1.

      Thus, the overall additional cost to the spammer is NOT 10 seconds per message, but 10 seconds overall for the whole batch of messages. Not a big deal, really. (The server-side sleeping solution only works for the case where the spammer is talking to a small list of e-mail servers. So long as the spammer is sending 10,000 messages to 10,000 different SMTP servers, each one can sleep 10 seconds and it won't delay the spammer much overall, provided the spamming program is smart enough to start in on the next message before waiting for a reply from the first.)

      What microsoft's solution does is make the sender pay a resource cost that is more signifigant than just sleeping a few seconds (which costs almost nothing), so that a long delay is guaranteed. (It also makes it impossible to lie and fake out the message - because it has to be an answer to the math question asked by the recipient's server, and until you see that question, the sending program doesn't know what fake thing to put into the header.)

      The idea is sound, so long as the algorithm is well published (not used by MS as a monopoly-enhancer like they usually do), and it's not possible to devise a question which is deliberately problematic for the program to solve. (If there exists a special case of a question to ask the sender which isn't solvable in reasonable time, then a malicious site could set things up so that when you try to send mail to that site your own mail server gets stuck trying to solve an impossible math problem and can't continue.)

      --

      Don't label something "offtopic" unless you know the topic well enough to tell what's on topic.

  26. Re:Mailing list operators do use their own compute by the+eric+conspiracy · · Score: 2, Interesting

    So this would have the effect of making legitimate high-volume, high-subscribership mailing lists expensive to operate

    Well, maybe. There still could be a white list for cases like this.

    I think that high volume mailing lists should probably actually be newsgroups anyway. But what it does do is put a crimp in people who host a lot of low volume mailing lists.

  27. Stop the presses! by kitzilla · · Score: 2, Funny

    Stop the presses! Microsoft has found a way to slow down email! This is news? ;-)

    --
    This is my post. There are many others like it. If you don't like what you read here, go try one of the others.
  28. Why bother with the computation? by eaolson · · Score: 2, Interesting
    OK, I may be missing something here. The point of this method is to make the sending computer jump through some sort of computational hoop that takes about 10 seconds, so that it can't just send a huge amount of mail in a short time.

    So why bother with all the computation and hashing, and just refuse to accept connections from a given IP except every 10 seconds? So if an email was sent from AAA.BBB.CCC.DDD at 00:00.00, don't accept another from that IP until 00:00.10.

    This makes it happen entirely at the recipeient server side, so you're not breaking SMTP, and it's backwards compatible with everyone else.

    On the other hand, if it's 10/sec per email it doesn't sound like this would be feasable to implement:

    • Hotmail receives about 2,000,000,000 spams per day. Let's say the amount of legitimate email they handle is 10% of that.
    • legit emails: 200,000,000
    • emails/day at 10 s/email: 8640
    • necessary servers to handle this amount of email: 23,000
    OK, this is a bit of an oversimplification because it assumes that in that 10 s, no other server is trying to send mail to that machine, but it's a rough guess.
    1. Re:Why bother with the computation? by Skapare · · Score: 2, Interesting

      The idea is not to take longer sending one email. Spammers don't send spam one at a time and wait for the first one to be finished before sending the second one. The idea is to force the spammer to spend something, specifically in this case 10-20 seconds of CPU time, per message. If all you are doing is sleeping 10 seconds, the spammers can out multithread you and just wait, while making 10000 other SMTP connections in parallel doing the same thing. The rate of messages will ultimately be the same but it will just take 10 seconds longer for the rate to reach the peak. Imagine what work the spammer's spam engine is doing while 10000 victims are sleeping for 10 seconds ... nothing at all ... then as soon as those sleeps are done, the spam flows. The spammer just has to raise the number of concurrent connections that are done. RAM is cheap.

      Your proposal would affect how many spams you get from that one spammer, but not how much total the spammer can get through. If you get more than 8640 spams per day from the same one IP address, then your proposal will be effective. But many spammers have 1000 servers, and some have 1000000 or more cracked windows machines at their disposal. Even the crypto idea is weak against the latter situation.

      --
      now we need to go OSS in diesel cars
  29. What they fail to mention... by KC7GR · · Score: 4, Insightful

    Something that the Redmond Empire conveniently neglects to mention is that an awful lot of the spam is due to virus-compromised systems running -- you guessed it -- Microsoft Windows! I've lost count of the number of broadband IP ranges, notably from Shaw Cable and Comcast, that I've had to dump into our domain's local 'Reject' list thanks to their endless attempts to propagate Swen, SoBig, or whatever the latest spammer-zombie trojan is.

    Perhaps, if Steve 'Uncle Fester' Ballmer and his cronies had paid more attention to basic security to begin with, or had taken the trouble to actually try and educate their customers about the most basic computing security steps, there wouldn't be such a huge problem now.

    This 'Penny Black' nonsense looks like nothing more than a means for them to make money off a mess that they created in the first place.

    --

    Bruce Lane, KC7GR,

    Blue Feather Technologies

  30. Re:This not only isn't going to work, it's a disas by cavebear42 · · Score: 2, Interesting

    First, let us note that the S in SMTP stands for simple. What may look like a "flaw" today was indeed an attempt to make a standard that is usable with no regard for OS, system, bandwidth, transmission medium, or any of the other factors which complicate computers today now that everyone and their grandma has one.

    Micro$oft's proposal has several issues. First, the proposal itself:

    "If I don't know you, I have to prove to you that I have spent a little bit of time in resources to send you that e-mail."

    This changes the effort to convincing the system that I know you and we can bypass all of this. Microsoft's track record tells me that this will be accomplished quickly (likely before the software even reaches final release.)

    "...use memory latency ... that way, it does not matter how old or new a computer is because the system does not rely on processor chip speeds..."

    No, it relies on bus speeds and memory speeds, not to mention caching schemes. These change almost as rapidly as processor speeds these days.

    All of that is meaningless when you look at the greater problem:

    "For this scheme to work, it would want to be something all mail agents would want to do,"
    There are 2 ways to implement such a solution; on the server side and on the client. As for the server:
    Not just want to do but be able to do. Since SMTP severs began requiring authentication (several years ago), most spammers have turned to using old servers still alive on the net. These would not have new schemes implemented. Denying them to play if they don't update would kill several servers (including several universities).
    As for the client:
    Anyone who can say "HELO" can send a mail (see RFC 821, RFC 1123, RFC 2821). This means that any decent coder can write a mail SMTP client in about 30 minutes. We will never be able to assume all spammers are using any e-mail client.

    "It is certainly not going to stop all spam for good"
    And in the aftermath, we will all have slowed our systems with no effect on spam levels.

  31. duh? by agurkan · · Score: 2, Insightful

    This delay would limit bulk emailing speeds to around 8000 a day, meaning that to spam all of those 'fresh, guaranteed 25 million addresses' would take approximately 8.5 years.
    Yeah, because they did not hear of parallel processing yet ;-)

    --
    ato
  32. Combining this with Distributed Computing by SkunkAh · · Score: 2, Insightful

    I guess we could combine this with distributed computing so if you send out an e-mail you are helping solving one of the puzzles like for example RC5, OGR or ECC2. And make the world better.

    But I think microsoft is intending to create a complete new business model for e-mail providers (and ofcourse for microsoft's hotmail.com) by selling the computing power to companies who need it.

  33. What about legitimate bulk mailers? by clickster · · Score: 3, Insightful

    I actively subscribe to a lot of tech sites that have tens of thousands of subscribers. Slashdot is one of those sites. How many people have Slashdot e-mail their mail to them? How are legitimate bulk mailers (of their own content, not ads) supposed to send out newsletters, etc.)? If a retail outlet with a legitimate opt-in newsletter needs to send it to 50,000 or 100,000 people, what kind of hardware upgrades are they going to be looking at. I mean, I can add them to a trusted senders list on my side, but that doesn't tell them that they no longer have to run the computations. "If I don't know you, I have to prove to you that I have spent a little bit of time in resources to send you that e-mail. How do you know whether you "know" me or not? Does the user's mail client alert the sending server that it approves of mail from that SMTP server? Once senders have proved they have solved the required "puzzle", they can be added to a "safe list" of senders. Whose list? My personal list that is part of my mail client? My mail service's white list? Microsoft's special white list?

    --
    If you mod me down, I shall become less powerful than you could possibly imagine.
  34. This might be a non-issue for mailing lists. by hkmwbz · · Score: 2, Informative
    This doesn't have to be a big problem for mailing lists.

    You know how mailing lists require you to confirm your membership? Well, this confirmation mail would have you add the mailing list to your whitelist. As a result, future mailings on that list would be let through without having to do the computation.

    The mailing list could simply refuse to deliver mail if you ask it to do the computation, or it might give you a one time warning that you have to add it to the whitelist, or similar.

    But all it takes is to add the mailing list to your whitelist once, and it won't be a problem anymore.

    With that said, spammers could start pretending to be mail from various mailing lists. I am not sure how big a problem this would be, but it would definitely make an impact on spammers if they couldn't just spew out millions of e-mails to random people in a short period of time. They would have to either go through the computations, or figure out which mailing lists you are a member of and use it to spam you, and so on. But this sounds like it would take too much time anyway, so the spammer would hopefully just give up. And if they did start spoofing mailing lists, then I'm sure there would be ways to prevent that as well. Most mailing lists don't accept mail from people who aren't subscribed, right?

    The reason spam "works" is that you can just press a button and the rest happens automatically. If the spammer has to start doing manual labor, my guess is he'll be looking for something else to do. (Such as taking a swim off the deep end wearing concrete shoes, I hope...)

    --
    Clever signature text goes here.
  35. Email Fiefdoms by rakeswell · · Score: 2, Insightful

    Having read the article, I was impressed by how clever their proposed solution was, though since I don't have a CS background, I don't understand how a mathematical computation can be essentially bottlenecked by memory latency -- I'd love it if someone could give an explanation of how that works.I'm guessing that some cryptographic hash needs to be held in memory, such that the nature of the data structure and physical access to it proves a bottleneck. This is probably way off.

    But having read the /. comments, it becomes clearer to me that this solution, and many other proposed solutions face problems insofar as they "break" the assumed contract under which email has worked for so many years. To me, this seems to boil down to a challenge / response system (allbeit one that increases the overhead of the transaction signifigantly). The problem with these systems is that for a time, email will be broken for certain people, or broken when trying to communicate with certain people depending on whether or not one has migrated to the proposed system. I'd worry that this would have the effect of segmenting email users into little fiefdoms determined by which email system they are using.

    I don't think a migration can happen unless there is some "benevolent dictator" who can force everyone to migrate to such-and-such a new email model and system, and frankly, I wouldn't want that forced on us.

    It seems that the challenge to any such spam-reduction system is that migration must be immediate and non-backwards-compatible, and universal, otherwise for a time email users will be segmented into little fiefdoms based on whether they've migrated, and solution to which they've migrated.

    --
    All one has to do is hit the right keys at the right time and the instrument plays itself. - Johann Sebastian Bach
  36. old and embraced by Tom · · Score: 2, Informative

    The technology is fairly old, it's known as Hash Cash.

    It has known shortcomings, but it is one of the best solutions out there.

    Its main problem, however, was not yet known when it was invented: That spammers would control huge zombie networks, as they do today.
    With 100k zombies (which is not uncommon), the spammers can still send out 10k mails per second, or those 25 mio. spams the topic speaks about in under one hour.

    --
    Assorted stuff I do sometimes: Lemuria.org
  37. Re:Proposed "Sender do Something" technique. by John+Hasler · · Score: 5, Insightful

    > The email is sent and the server runs it through
    > the scoring process. If the message scores more
    > than 6/10 the server sends the sender an
    > authentication message, asking to validate the
    > email.

    So you are one of those resposible for bomabarding me with those damn things.

    > This would require spammers to manually
    > intervene and waste tons of their time. if they
    > forged the sender email...

    They always do. My domain is a favorite.

    > ...their email would go to someone else's
    > email...

    Yes. Mine.

    > ...and they would just trash it...

    Isn't that what the spammers say? "If you don't want it, just delete it. What's the big deal?"
    The big deal is that about a quarter of my email is bogus bounces and useless "confirmation" message from systems such as yours.

    _NEVER_ _REPLY_ _TO_ _SPAM_

    --
    Warning: this article may contain humor, sarcasm, parody, and perhaps even irony. Read at your own risk.
  38. Re:Yes, let's pace innovation by grandmas by the_mad_poster · · Score: 2, Insightful

    It's ironic that your complaint about worst-case users and grandmas is tied to mention of industry.

    Anything that produces an end product for a userbase must adapt to suit the needs of that userbase at the time that the product is being produced. If the end user is so egregiously stupid that they can't even handle e-mail without someone holding their hand, then rather than evolving toward the next great technological advance, usability must be made the next branch for improvement.

    Think about it in relation to industry once. If automakers had blazed trails toward the next great evolution in automobiles, we could have cars that run a 1/4 mile in 4 seconds at nearly 200mph. Oh wait! We do! They're called funny cars! And nobody except a particular niche knows how to use and maintain them, and they're exceptionally dangerous machines. They are not refined for the general public, they are not safe, and when something goes wrong, it's often disastrous. Neutered cars like Corvettes and, for a few adventurous souls, Vipers, are fed to the public as top-of-the-line even though they're not. They're safe, (relatively) easy to use, and, for the most part, attractive to the buying public because, even if they break down it's just an inconvenience, they don't generally erupt into a fireball the size of a small house.

    The computer industry will continue to evolve in much the same way. Crippled, blighted, and weak but generally consumer friendly software will drive the marketplace. In the meantime, hobbyists (Vipers and backyard mechanics) and hardcore computer geeks (funny cars and track techs) will continue to use the cutting edge workhorses that are far less refined, but far more advanced.

    --
    Alito: A vote for Alito is a punch in the eye to put that bitch back in her place!
  39. solution by shokk · · Score: 2, Insightful

    So the solution is for spammers to set up compute farms of cheap old hardware with an open soure version of the mailer. Since memory latency matters, and not processor speed, the solution is to have access to more than one computer. A farm of 10 machines then sends out 80,000 messages a day. A real super computer farm funded by a spammer alliance could get back to shipping millions of spam messages a day. What was the cheapest supercomputer cluster mentioned on Slashdot, something like $30,000? Is that really all that much money when you consider that a group of spammers could split that and amortize over many years? Remember, age of the hardware is not a consideration, just CPUs with access to memory segments. How about a very large system with hundreds of virtual 386 processes running 128k memory segments?

    I think in the long run only something more expensive will deter most spam, but will not succeed completely. Case in point is all the junk mail we still get in our real mailbox. Someone out there is paying for postage to send that crap, yet they still ship it to me so that I can place it in my trash can.

    --
    "Beware of he who would deny you access to information, for in his heart, he dreams himself your master."
  40. My simple solution by KalvinB · · Score: 2, Insightful

    Instead of hitting the delete button I started putting spam in a folder for later analysis. What I found is that spammers use affiliate programs. For example, I recently got a porn spam with an image from

    http://gallery7.withsex.com/

    All I do is block withsex.com with an expression filter and all spam that's afilitated with that site goes away. Spammers can't ofuscate an URL otherwise it won't work. The image linked from the same site is 28KB. If that spam was sent out to 25 million people and all of them looked at it once that cost the spammers 667GB of transfer. On a standard DSL line it would take about 6 months to transfer that. These companies need a dedicated host to allow them that kind of bandwidth. The company may have a number of domains for the site but spammers aren't going to be using random ones to advertise it like they use random from e-mail addresses. They also have to keep the domains functional or all that spam goes to waste.

    Not many hosts would allow that kind of bandwidth transfer without charging up the nose for it. Which limits the number of hosts that spammers will use for images. 2004Hosting.org/.net is a big one for the cable filter and "banned CD." 530000x.net is also affiliated with those spams.

    http ://www.silverstate.co.sy@click.com-click.com.ph/cl ick.php?id=sicosyl

    click-net and click-com are what spammers use to get paid. If you click on a spam link, most likely it goes through a common domain to log the referal to calculate how much the spammer gets paid. Block the referal site and all spam that uses that referer to get paid is gone.

    For example

    http://www.xswcde.biz/index.php?id=173&affid=561 &c ampid=
    342

    Is a big e-bay spammer site. I block xswcde.biz with an expression filter and all e-bay spam from that company goes away.

    It basically boils down to blocking the company and not the spammer. My spam count went from about a dozen a day to 1 or 2 and they also have obvious tells. If possible I also block the domain in the from address. Using a web-form cut down on spam quite a bit as well.

    Ben

  41. Re:10 seconds by Jeremy+Erwin · · Score: 3, Insightful

    You mean this paper? In that case, the Pentium IV 3066 (533 MHz DDR), was 2.66 times faster than the Pentium II 266 (PC66), and just as fast as a 1.2 Ghz Pentium III (PC133).

    I'd love to see the Itanium 2 results. The entire program could fit in cache... Yes, the array size could be increased in size, but that would futrher penalize users of PDAs, which already suffer quite a bit.

    The real question is whether this program is suffiently enough of a unique case that further advances in memory technology (short of the Itanium's rather expensive brute force solution) will not make this program obsolete.

  42. Re:Mailing list operators do use their own compute by M.+Silver · · Score: 2, Interesting

    Well, maybe. There still could be a white list for cases like this.

    I think that high volume mailing lists should probably actually be newsgroups anyway. But what it does do is put a crimp in people who host a lot of low volume mailing lists.


    As somebody who hosts low-volume mailing lists, I have to agree.

    Whitelists are nifty (we use them extensively), but what worries me on that score is that if they become frequent, I suspect we'll just see spammers hijacking address books along with machines, and forging "trusted" From lines.

    --

    Slashdot's token middle-aged housewife
  43. Motives by arth1 · · Score: 2, Insightful
    Um? The point, my small minded ignorant little friend is if it takes you 10 seconds to send an email it takes spammers 10 seconds to send an email.


    No, if it takes 10 seconds for a spammer with the latest dual Xeon CPU (or hacked into a superfast company computer), it will take several minutes for the average user, and hours for my mother on her old P200 (which is more than good enough for sending email), or days for myself on my 20MHz PDA.

    Of course, this will incite people to buy new PC's, which comes with a new operating system, made by guess who?

    Nah, I'm not cynical. It's probably worse.

    Regards,
    --
    *Art
    1. Re:Motives by Reziac · · Score: 3, Insightful

      My question is.. what happens with mailing lists that have subscribers in the middle 6 figures? I'm on a couple that have over 200,000 subs. Exactly how stale would they be by the time they all got sent, under any sort of delay-per-post tactic?

      --
      ~REZ~ #43301. Who'd fake being me anyway?
  44. Our heroes at Microsoft!! by DrDebug · · Score: 2, Funny

    If they can pull this off, maybe the world won't see them as the profit-mongering 800-pound gorilla monopoly corporation they are. They will be heroes to us working-class.

    Unless, of course, they make it proprietary and charge huge license fees.

    Oh, well. It was Christmas... we all can wish...

  45. Re:Yes, let's pace innovation by grandmas by DShard · · Score: 2, Insightful

    The only problem with your analogy is the fact that you don't have to drive a viper. This scheme would mean that you do.

  46. Why not... by The+Master+Control+P · · Score: 2, Informative

    Simply de-allocate the IP blocks of any ISP that continually harbors spammers, meaning it refuses to terminate them immediately? They can't spam if they can't connect to the internet!

    And to "strongly discourage" any ISP that would consider flaunting this rule, they get zero compensation for that netblock they paid for and are denied from buying any new netblock for a time (possibly a week).

    Because this would necissarly work on the level of ARIN and the root DNS servers, you can't avoid it, because those are known, reputable organizations who will have no choice to comply.

    Can anyone think of a way you *could* avoid this?

  47. E-mail list killer by Black+Art · · Score: 3, Insightful

    I don't think this is a good idea.

    First, it would kill legitimate mailing lists. Imagine what the perl5-porters list or the Linux kernel list or any of the other high traffic mailing lists would have to do to keep operational. Large mailing lists already have problems with lag. This would just add to that.

    Also, there does not seem to be anything that would stop them from doing these operations in background and just contact multiple sites while working on the problem. They would just multi-thread the mail spammer or just hijack more machines to use as their slaves.

    This technique requires replacing every mail program out there to support the protocol. Of course, they will just make it a condition to connect to exchange. Might be a way of getting people away from having to talk to compromised Windows mail servers.

    This is a bad solution for a big problem.

    "Something must be done! This is something, therefore we must do it!"

    --
    "Trademarks are the heraldry of the new feudalism."
  48. Re:Proposed "Sender do Something" technique. by robogun · · Score: 2, Interesting

    As a matter of policy, I do not respond to whitelisting requests because the sender of the whitelisting request has already accused, with zero basis in fact, of being a spammer...

    If you got a whitelisting request from him, it would have been because your message looks like spam. That is not a zero basis in fact from his perspective.

    In fact it would be because you did something in your email to total a high bayesian filtering score.

    As the sender *I* would not be insulted if that were to happen. In fact, it would be great to know that the mail I send is not being silently trashed. How unimportant is your message that the perceived insult is of greater importance?

    I always wonder these days whether a mail got through, when it is not answered. I find I end up on the phone more often than not, because mail is no longer a reliable method of communication due to spam.

    If you continue to get a lot of whitelist requests after such a system is implemented, it would behoove you to make your mail look less like spam. For instance, not using Base-64 encoding, or sending purely HTML mail, or including trademarked names of pharmaceuticals, or including random strings of characters, linking to spam domains, putting lookalike accented characters or too much punctuation in the subject line, or cc'ing or bcc'ing everyone in your mail.

  49. research? microsoft? by MoFoQ · · Score: 4, Interesting

    M$ should consider out-sourcing it since well....my hotmail account still gets spam even though I set it to exclusive (meaning only email from ppl in your address book will get through); spam with obvious fake addresses. And the spam that goes through this "exclusive filter" also seem to fly passed my custom filters that have the words that the spam has ("financial", "viagra", "herbal", etc.)

    Yahoo works better with regards to spam though I wish it would empty the bulk mail folder more often.

    And my pop3 acct has something called greylisting and that alone cuts 95% of spam. Plus black and white listing IPs and domains helps too (for instance, only allowing email from hotmail.com if it originates from one of hotmail's servers, etc.) and blocking known spam-haven Class C ranges (eg x.x.x.*).

  50. M$ is the major cause of spam! by webweave · · Score: 2, Insightful

    M$ should be spending the time and money preventing their mail servers from becoming compromised and finding ways for its desktops to not get so easily owned and that would prevent the majority of spam that comes to my systems.

    This "spam filter" stuff when performed by M$ is an insult when it does little to address the problem which it has a contributed to.

    ---
    Please stop discussing M$ fixes on /. Bill should pay for tech support if he wants to own the code.

  51. Re:This not only isn't going to work, it's a disas by fermion · · Score: 2, Interesting
    The issue is not limiting spam or fixing any protocols. What MS is creating is trusted spam. In exchange for the spammer solving your little puzzle, the receiver agrees not to filter the spam directly to the trash can. The protocol is no better than traditional filters, and would be very hard to make secure. It will most likely decrease the security of Windows users and increase the amount of ads they must look at.

    First, the protocol is overly complex. The receiver sets the puzzle. How does the receiver to this. But sending the puzzle before receiving the email? That is complex, perhaps involving connections that must remain open for tens of seconds, or lists that correlate puzzles to particular senders, and the sender must match the answer. How will the puzzle be generated. Will it be psuedorandom or pad. How will we gauge the strength of the puzzle. I do not see how this is superior to current filtering.

    Second, alternate filtering methods will still be needed. Whitelists will have to be kept so that friends, interoffice mail, and current customers will not be challenged. Email that does not meet the challenge will still have to be accepted and filtered. The only advantage is that certain email will be tagged as 'safe' because the sender solved your puzzle. This 'safe' email will still often have to filtered to meet the specific needs of the receiver. For instance, a 'safe' email may still contain graphic sexual content unsuitable for the office.

    Third, there may be no way to know whether the calculation was done. If the puzzle is pseudo-random, the sender may exploit some weakness. If the puzzle is off a standard one-time pad, and the number of puzzles are finite, or can be cataloged into a finite number of sets, the sender may have database that already contains complete or partial answers. So, even if the spammer is not using owned hardware, there is no way to know that each email is in fact generating any specific liability.

    Again, this is a ploy for MS to sell servers to advertisers. The number of machines, and related number of MS licenses, is going to be non-trivial. The client will be built into outlook and the marketing will convince consumers that anything marked safe is legitimate advertising and not spam. This does nothing to solve the spam problem.

    --
    "She's a scientist and a lesbian. She's not going to let it slide." Orphan Black
  52. Just hashcash - wasteful, impotent, and harmful. by argent · · Score: 2, Interesting

    This is just hashcash.

    Hashcash is wasteful... it just runs processes at full blast for tens of seconds to tens of minutes at a time, which is a small energy waste but overall a loss.

    Hashcash is impotent... any hashcash scheme cheap enough to let someone with an older computer send mail in less than minutes won't slow down a P4-3GHz at all.

    Hashcash is harmful, because it makes no distinction between solicited and unsolicited mail. How would you subscribe to Slashdot without whitelisting it?

    And once you're whitelisting senders, you might as well just whitelist everyone you get mail from, and now you only need to discourage unknown senders. And hashcash is still a silly solution there, how about real cash?

    Here's one way to do that. Whitelist not a sender, but a server. A server at a company that simply charges a few pennies to a few dollars to forward mail (you pick the level of unsolicited mail you want), or one that requires other hoops...

    Much simpler, doesn't require new proprietary Microsoft technology, and allows all kinds of alternatives...