Slashdot Mirror


University Capitulates, Switches Off Spam Filters

Heraklit writes "As reported on German news site Heise, the system administrators of the Technical University of Braunschweig have temporarily given up the fight against spam. Because of the legal obligation to deliver all mail and of the delay time exceeding critical 5 days(!), they decided to switch off all filter mechanisms. Before, the 20 servers dedicated to processing e-mail alone had been breaking down under a load of 100000 unprocessed mail messages, ca. 98% of which had been spam or viruses. ... A similar e-mail jam occurred recently at the IT central of the German Federal Government. Is this the beginning of the end of e-mail?" (The Fish may be useful.)

470 comments

  1. In post-communist Germany... by Phosphor3k · · Score: 1, Funny

    Shark jumps email!

    1. Re:In post-communist Germany... by Quo_R · · Score: 1

      You do realize that Heidelberg is located in a part of Germany which never was communist, right?

  2. Question? by untouchable · · Score: 5, Insightful

    Does anybody know the filtering methods they were using before they decided to toss everything to wind?

    --
    As Seen On TV's? Come back!!!
    1. Re:Question? by Nasarius · · Score: 3, Interesting

      Good question. I would think that 100,000 emails is really not a lot, even for 20 low-end PCs.

      --
      LOAD "SIG",8,1
    2. Re:Question? by Donny+Smith · · Score: 4, Insightful

      >Good question. I would think that 100,000 emails is really not a lot, even for 20 low-end PCs.

      I'm sure that's not the point - it's easy to deliver 100K mails, but the problem is that you've got to manually check for false positives and un-mark them as good email.

    3. Re:Question? by dont_think_twice · · Score: 5, Funny

      Does anybody know the filtering methods they were using before they decided to toss everything to wind?

      They had a team of 20 monkeys that would read the emails and determine if they were spam. Unfortunately, the monkeys are easily distracted, so anytime they got spam about banannas, they would lose focus. This lead to the backlog.

      What? you have never gotten bananna spam before?

    4. Re:Question? by Anonymous Coward · · Score: 4, Funny
      What? you have never gotten bananna spam before?

      Yes, but the emphasis wasn't so much the banana as it was where it was inserted.

    5. Re:Question? by dickiedoodles · · Score: 4, Funny

      What? you have never gotten bananna spam before?

      No but I often get asked if I'm satisfied with the size and/or performance of my ba|\|a|\|a

      --
      In Soviet Russia Slashdot cliches use you
    6. Re:Question? by slashdot_commentator · · Score: 4, Interesting


      No one (sane) *manually* checks for false positives, just the end user. You do need manual personnel to follow up on end user inquiries, but it should be moot. If you have the right spamblocking service/setup, you're not going to get false positives...

      --
      There is no America. There is no democracy. There is only IBM and AT&T and DuPont, Dow, General Electric, and Exxon
    7. Re:Question? by AndroidCat · · Score: 4, Funny

      Frequently for stuff that would keep bananas ripe for days without going mushy.

      --
      One line blog. I hear that they're called Twitters now.
    8. Re:Question? by Anonymous Coward · · Score: 1, Interesting

      This shouldn't be a problem for mildly capable admins. Our company uses Sun's Sun ONE Messaging Server (aka Java Enterprise Systems Messaging Server, formerly iPlanet Messaging Server, formerly Netscape Messaging Server, formerly Netscape Mail Server) and we process three million messages a day with an almost empty mail queue at all times. Even a normal home PC should be able to process hundreds of thousands of messages in a day without much strain.

      Their hardware is severely underpowered (thinking IO bottlekneck here) or their software is poorly tuned or they are using ancient hardware.

      How they think refusing to process spam is going to help I have no idea. That's only going to increase the load. A decent system could filter out much of the spam at the SMTP level without incurring the extra IO of writing to disk and processing the message all the way.

    9. Re:Question? by Seumas · · Score: 5, Informative

      Simple problems have simple solutions.

      You can increase the threshhold at which you declare spam to be spam. Allows for more misses, but reduces the false positives to, essentially, nothing.

      Or, you can just tag likely spam with ***SPAM*** in the subject and let the user deal with it.

      Or even better, you can direct likely spam into a specific IMAP folder on the server that the user's client can subscribe to and they can glance at their personal SPAM folder on the server whenever they want without having to download all the bodies.

      As someone who personally uses postfix+procmail+spamassassin+razor and recieves 4,000 emails per day, I am currently filtering out 98% of the spam on the server and have had ZERO false positives in two years and 2.9million messages.

      Statistically, you will eventually get some false positives - especially if you have a large userbase (as opposed to just one or two accounts). But if one out of every few million messages isn't acceptable, you can just use one of the previously suggested methods.

      The worst you can do is nothing at all.

    10. Re:Question? by cfuse · · Score: 1
      What? you have never gotten bananna spam before?

      No, but I got spam from a site advertising a sweepstake with a prize of 50 pounds of lobster. I laughed so hard that I decided to set a screen dump of the mail as my desktop.

    11. Re:Question? by spudgun · · Score: 1

      TAG with spam _AND_ remove web bugs !

      Otherwise your spam just gets worse , even if you have trained them NOT to unsub ......

      --
      Type unto others as you would have them type unto you.
    12. Re:Question? by Anonymous Coward · · Score: 0
      They had a team of 20 monkeys...Unfortunately, the monkeys are easily distracted

      They were spending too much time being touched.

      What would Dieter say? I grow weary of all the spam. All the offers. (Sigh) My monkey is quite big enough, but no one sends me email offering to touch him... Now is the time on Sprockets when we delete!

    13. Re:Question? by Anonymous Coward · · Score: 0

      As far as I know they received ~ 10000-20000 emails an hour, while the 30000 emails on Tuesday and ~100000 emails on the week-end is just the number of emails they were not able to handle and deliver, i.e. it is just backlog piling up.

    14. Re:Question? by Monkelectric · · Score: 2, Interesting

      Surely it is Bayesian classification which brings my Athlon 1700 to a screeching halt (spam assassin) (takes about 1 second to classify an e-mail). There are FPGA and DSP based Bayesian classification systems, they should really look into them.

      --

      Religion is a gateway psychosis. -- Dave Foley

    15. Re:Question? by rolocroz · · Score: 1

      Could I have a picture of that please?

      --

      I meta-mod all positive moderation Unfair, because it's abuse of the system.

    16. Re:Question? by Pieroxy · · Score: 3, Insightful

      It looks to me that they were not delivering spam mails. Otherwise their obligation to deliver everything would have been fulfilled.

      Hence, a difficulty for the end users to mark themselves the false positives....

    17. Re:Question? by techno-vampire · · Score: 3, Insightful

      Unless you don't care about false positives, you don't block spam at the server by sending it to /dev/nul. You put it in a special folder that the end user can check. That way, false positives can be received, and you can adjust your filters as needed. Presumably, their spam filters were getting so overloaded that they couldn't even do this much.

      --
      Good, inexpensive web hosting
    18. Re:Question? by Anonymous Coward · · Score: 2, Insightful

      I am currently filtering out 98% of the spam on the server and have had ZERO false positives in two years and 2.9million messages.

      The trouble with false positives is that you you don't know you have them. Unless you manually went through the 2.9 million messages categorized as spam and determined that they were, indeed, spam. In which case there's no point in having a mail filter system!

      Moderation: -1, Idiot

    19. Re:Question? by edunbar93 · · Score: 2, Insightful

      More than likely they were using spamassassin, but with all the external checks still turned on. They recommend for large sites to turn these off because checking SPEWS, ORDB and Spamcop takes a few vital seconds per message, and when you're delivering more than about 20K messages per day you start getting a backlog.

      I know that we used to do this and while it made spamassassin more effective, it's much faster to do it using a firewall or tcpserver rules. We have a single server delivering 50K+ messages per day and it's all we need. If the load were to double, we could still use the same machine.

      It's worth noting that making these changes with spamassassin and qmail is really easy and would only take about ten or fifteen minutes per server if you know how.

      --
      "No problem. I have the capacity to do infinite work so long as you don't mind that my quality approaches zero."-Dilbert
    20. Re:Question? by andy+landy · · Score: 3, Interesting

      I work at a UK university and we're introducing a new system to deal with spam. We've already got an in-house product, MailScanner which does the detection job pretty well, but our mail servers are quite loaded with junk.

      We're about to offer a "delete at gateway" option, so our users don't have to filter their email and lessen the load on the mail servers at the same time. This service is optional, so our users can choose whether they want it, but we'll be strongly encouraging them to use it.

      Additionally, they can set their spam threshold, so they can delete most spam, but review the borderline cases.

      --
      perl -e 'print "Just another Perl newbie\n";'
    21. Re:Question? by Anonymous Coward · · Score: 0

      Germans did loose in 1944 too!

    22. Re:Question? by slashdot_commentator · · Score: 1


      As I said, with the right spamblocking service & setup, you don't get false positives. There are spam blocking services, that catalog spam, and then prevent that spam block from reaching the customer. Unless you are waiting for email from a friend that wants to tell you where you can get Viagra cheap, and then sends that same message to 5000 other email accounts. (*DUH*)

      --
      There is no America. There is no democracy. There is only IBM and AT&T and DuPont, Dow, General Electric, and Exxon
    23. Re:Question? by Anonymous Coward · · Score: 0

      Funniest thing I've seen on here in a while. Thanks. :)

      --
      Moo

    24. Re:Question? by Spetiam · · Score: 1

      No one (sane) *manually* checks for false positives, just the end user.

      Like how Yahoo Mail has their system set up with a bulk mail folder. That system works wonderfully well so far as my experience with it has been.
    25. Re:Question? by markxz · · Score: 2, Insightful

      Will the "delete at gateway" be able to delete the high scoring spam, with the medium level spam (+ false positives) going to the user for filtering?

    26. Re:Question? by cfuse · · Score: 1
      Could I have a picture of that please?

      Sorry, it was a while ago. The website is just as funny.

      This is my current desktop image.

    27. Re:Question? by macemoneta · · Score: 2, Interesting

      My sister-in-law is now receiving over 2400 spam a day, and no longer even has the time to scan for false positives. For folks like her, email is definitely broken. She has no choice but to rely on spam filtering to make the right choice, even though a false positive could cost her small business a serious amount of revenue. Even the local processing on her PC to sort/filter the emails is keeping her machine busy.

      For many of us, the problem isn't that bad. But we need to recognize that many others are dealing with an onerous problem.

      --

      Can You Say Linux? I Knew That You Could.

    28. Re:Question? by Anonymous Coward · · Score: 0

      Unless you don't care about false positives, you don't block spam at the server by sending it to /dev/nul. You put it in a special folder that the end user can check.

      Perhaps their problem was with storing all those spam e-mails then?

    29. Re:Question? by Lars+T. · · Score: 1

      In their own statement (in German) about the problem, they say that their Spam- and Virus-checkers can go through up to 10,000 mails per hour. Those then are usualy delivered to the user (because according to German law they have to) but put into special "folders". But because they got a somewhat more than 10k mails per hour for some days, those 100k messages piled up, and they now let them through unchecked in the default inbox.

      --

      Lars T.

      To the guy who modded me down from perfect to terrible Karma - Apple haters still suck

    30. Re:Question? by Jibber · · Score: 3, Informative

      I don't know what kind of machine you are running but we have SA running on it's own machine, serving two mail servers. It handles over 300K messages a day with network tests enabled, and the standard scan time is sub 1 second.

      If you are going to be running SA with any kind of volume you need to keep in mind...

      1 - Run a local DNS caching server. dnscache works well, give it lot's of memory to play with

      2 - Rsync and run as many of the RBL's locally as you can.

      3 - Set the max number of children that SA is allowed to spawn, on our hardware that number is about 12.

      4 - Lot's of memory! Depending on the number of max children, you might want 1 gig or even 2 gigs of memory

      5 - Off load SA on to it's own dedicated machine, so if need be you can easily inject another server using hardware or dns round robin load sharing.

      I don't know what kind of volume the Uni was handling but with 20 machines I think I could easily handle upwards of 20 million deliveries per day.

    31. Re:Question? by TiggsPanther · · Score: 1
      More than likely they were using spamassassin, but with all the external checks still turned on. They recommend for large sites to turn these off because checking SPEWS, ORDB and Spamcop takes a few vital seconds per message, and when you're delivering more than about 20K messages per day you start getting a backlog.

      Hmmmmmm. That's a shame. Especially for large organisations, using a blacklist on the score-system seems like a good idea. Is there any way of somehow cacheing a local copy of a blacklist (updated daily) and then modifrying SA's rules to check locally?

      No, I don't run a mailserver. But if I did I'd want to run combinations of checks, not replying purely on one method.

      Tiggs
      --
      Tiggs
      "120 chars should be enough for everyone..."
    32. Re:Question? by krumms · · Score: 1

      performance of my ba|\|a|\|a

      Mine does sixty monkeys to the gallon

    33. Re:Question? by Anonymous Coward · · Score: 0

      I have this thing doing very well
      http://www.spambouncer.org

      It's just a bunch of procmail scripts, and it's the best filter I have tried, extremely fast and efficient! And it's also open and free.

      Our German collegues should try it before they give up completely.

    34. Re:Question? by Monkelectric · · Score: 1

      Wow, that's hard to even imagine. I recieve 300 - 500 a day and thats more then anyone I've ever met.

      --

      Religion is a gateway psychosis. -- Dave Foley

    35. Re:Question? by edunbar93 · · Score: 1

      What's a better idea is what I said, to use a firewall that refers to a RTBL. It's much faster, uses less CPU time and relieves a lot of load from the spamassassin box.

      --
      "No problem. I have the capacity to do infinite work so long as you don't mind that my quality approaches zero."-Dilbert
    36. Re:Question? by Seumas · · Score: 1

      Since you clearly don't have a clue:

      Of course you know you have them. You can rule out a significant portion of messages based on the type of file attachments they have. You can rule out another significant portion based on the sender addresses. Another huge chunk is ruled out because it's wanted mail from whitelisted senders.

      This reduces the amount of mail that you need to pay any attention to at all by a large portion. Additionally, the STATISTICS.TXT file with spamassassin shows tests against corpuses at set score levels and anything over something like 16 is likely to produce a false positives so infrequently that it doesn't even register (going by memory here). At any rate, you can confidently seperate out any messages with an extremely high spamassassin score. For my case, anything over 25 which is actually a large portion of my spam since I've written and customized plenty of spamassassin rule sets.

      Using procmail, you have potentially questionable positives seperated into a SPAM_LOW mbox. You can set the low spam bar conservatively high just to be safe. You've now reduced the quantity of email that needs manual verification by about 95%.

      The remaining spam that exists in the SPAM_LOW mbox is scripted out into a list of subject lines only which you can eyeball with much success.

      In addition, you run the same statistical rule analysis that the spambayes devs use against your manually verified corpus occasionally to see how successful it is working. This gives you solid evidence of the quality of your filtering.

      And, again, the fact that I am the only person who has an account on this server solidifies the effectiveness of all taken measures as what I want and do not want is not muddled with a global deployment shared with hundreds or thousands of other accounts who are training a server-wide bayes as well.

      The idea of having to sort through 2.9 million messages by hand just to prove that there are no false positives is idiotic. Do you really think any message containing an attachment called 'your_profile.scr.pif' is ever going to be non-spam? Clearly not.

      This isn't rocket science.

    37. Re:Question? by mph · · Score: 1
      My sister-in-law is now receiving over 2400 spam a day
      Do you have any idea how that happened?

      I have email addresses that are about 10 years old, and publicised to hell and back. I have a valid email address here on Slashdot, I post to Usenet with my real address, and Google has hundreds of hits for my addresses. I get about 260 spams/day on average, almost all of which SpamAssassin catches.

      I just can't figure out what someone would have to do to get ten times the amount of spam that I do. Any ideas?

    38. Re:Question? by macemoneta · · Score: 1
      She runs a corporate gifts business, and several hundred businesses and vendors have her email address. I suspect that one or more of them ended up getting compromised, and either her email account was harvested, or some of her vendor/client machines are actually generating spam via virus, trojan or web hijacking (or possibly even as a sideline business!).

      I suggested she contact her ISP to have them do a first-line spam filtering for the account, which will hopefully reduce the rate she sees to a manageable number. I'm also going to be looking through the headers on the spam, to see if the majority are originating from a single source.

      --

      Can You Say Linux? I Knew That You Could.

    39. Re:Question? by andy+landy · · Score: 1

      I think the plan is to delete high scoring mail at the gateway (Scores are user-definable, but default is 8). Any mail with socres between 6 and their chosen score will be tagged, but delivered.

      The user can set the delete-at-gateway as low as 5, so they can expect to never see a tag, but they do run the risk of losing false-positives.

      --
      perl -e 'print "Just another Perl newbie\n";'
    40. Re:Question? by brolin9 · · Score: 1

      Then your experience is 100% different from mine. I continually get *obvious* spam showing up in my inbox, while mail I've asked for, and that I've told Yahoo was NOT spam dozens of times, goes to the spam folder. My experience with Yahoo's system is that it seems extremely arbitrary and absolutely cannot be trusted without checking for yourself, unless you just don't mind losing the false positives that *will* go to the spam folder. And you still have to deal with the ones that end up in your inbox, anyway. Sometimes I wonder why I don't just turn it off and filter everything manually...it's barely better than that.

  3. White listing + Auth tokens by Anonymous Coward · · Score: 3, Interesting

    Just white list known good addresses. Hand out auth tokens (X-Not-Spam: md5 digest here) and white list those temporarily. And white list known good PGP keys.

    Byebye, spam.

    Byebye, email.

    1. Re:White listing + Auth tokens by arivanov · · Score: 1

      Continuing on this, what is SPAM for me is some other people's lifeline. The correct policy should be tag with an appropriate header, defang if dangerous and leave the user decide.

      --
      Baker's Law: Misery no longer loves company. Nowadays it insists on it
      http://www.sigsegv.cx/
  4. Don't forget the other problem... by chrispyman · · Score: 4, Interesting

    If you don't filter out any of the spam, then some mail server somewhere is gonna have to store all that junk mail. Even with a quota system I'd expect that there'd be a whole bunch of people just "giving up" on e-mail.

    1. Re:Don't forget the other problem... by dealsites · · Score: 3, Interesting

      Yeah, you'd think even if you you had sorry filters in place, some filetering would be better than none. Giving up is just the wrong thing to do. Many people have had good success with Spam Assassin, even if you have to fine-tune it by hand it should help with the obvious and common spam emails. Some of the spam will always get though, but it shouldn't be too had to catch the majority of spam.

      --
      New deal processing engine online: http://www.dealsites.net/livedeals.html

    2. Re:Don't forget the other problem... by hammock · · Score: 3, Interesting

      Strip all attachments.
      All of them. Don't process them, just ban them.
      If you want to send a file, use ftp or send a link to a read-only http or smb/nfs share.

      Using email server blacklists instead of filters on the spam will work a lot better too. Hopefully they aren't using a brain damaged email server like Exchange.

    3. Re:Don't forget the other problem... by Cruciform · · Score: 1

      Any idea how to have Mozilla kill all email with attachments?

      I was surprised to see that there doesn't seem to be an option to do so. Just filtering by keywords.

    4. Re:Don't forget the other problem... by Fweeky · · Score: 2, Interesting

      SpamAssassin's pretty heavyweight; a purer statistics based system like dspam is probably more suitable for large scale systems like this; you don't want a perl script chugging over every single email for seconds at a time. I wouldn't be suprised if they needed 20 mail servers if they were using SA...

    5. Re:Don't forget the other problem... by Anonymous Coward · · Score: 2, Informative

      Thats why you use the spamd for Spam Assassain.. significantly alieviates the problems associated with running a perl interpreter for each email being processed

    6. Re:Don't forget the other problem... by MntlChaos · · Score: 2, Informative

      Filter on custom header Content-Type. multipart/mixed implies a message with attachments

    7. Re:Don't forget the other problem... by Cruciform · · Score: 1

      Aha! I'd looked at headers but they'd been inconsistent depending on the source. Thanks!

    8. Re:Don't forget the other problem... by ifoxtrot · · Score: 1

      At a University?! The whole academic process would grid to a halt if they couldn't send each other emails containing papers/funding proposals.

    9. Re:Don't forget the other problem... by Anonymous Coward · · Score: 0

      If you were my system administrator, I would punch you in the face.

      Thank you for your time.

    10. Re:Don't forget the other problem... by Fweeky · · Score: 1

      It's still slow; again, if performance is a concern there are better solutions that will scale higher. Thankfully performance isn't much of a concern for me, so I stick with SA ;)

    11. Re:Don't forget the other problem... by WuphonsReach · · Score: 2, Informative

      Strip all attachments.
      All of them. Don't process them, just ban them.
      If you want to send a file, use ftp or send a link to a read-only http or smb/nfs share.


      Love to... but not gonna happen with our users.

      We settled on blocking all executable attachments (VBS, EXE, SCR, etc.).

      You know, the extensions that 99.999% of users have no business reason to be sending to each other, but which are used by the viruses/worms to spread. Blocking those put a good damper on the amount of virus/worm mails that were getting through and was cheap CPU-wise.

      --
      Wolde you bothe eate your cake, and have your cake?
    12. Re:Don't forget the other problem... by Anonymous Coward · · Score: 0

      Here at Intel where I work, the IT department recently decided to use SpamAssassin to filter all our incoming emails. It's worked pretty well as far as I can tell (I'm just a user), and an article was printed on the company website about it. Shortly thereafter, someone wrote a "letter to the editor" protesting our use of this product because of the "negative" name (assassin).

    13. Re:Don't forget the other problem... by Dekortage · · Score: 2, Insightful

      Strip all attachments?!? You're kidding, right? In a university or business setting, that is NOT a viable option for most people. They're still figuring out how to right-click under Windows and make things print correctly to the printer down the hall; forget teaching all of them how about FTP, SMB, NFS or some other file serving method.

      And you've got to be kidding about blacklists being better than filters... talk about false positives, sheesh! Maybe the best blacklists are better than the worst filters, but that doesn't say much. Simple control lists (black or white) are not a long-term viable solution; if they were, none of us would ever get spam, would we? You really need something that makes your email trustworthy, like Zoemail.

      --
      $nice = $webHosting + $domainNames + $sslCerts
  5. Finally by Anonymous Coward · · Score: 3, Funny

    "they decided to switch off all filter mechanisms"

    Finally, I can get my "male enhancement" emails again.

    1. Re:Finally by NanoGator · · Score: 1

      "Finally, I can get my "male enhancement" emails again."

      Crap! None of my hats fit anymore!!

      --
      "Derp de derp."
  6. I wonder... by BeneathTheVeil · · Score: 5, Funny

    what sort of awful sound the servers made as soon as the filters were turned off? ...I imagine it would be akin to someone who 'just' made it in a mad dash to the bathroom.

    1. Re:I wonder... by AndroidCat · · Score: 1

      I wonder what sort of awful sound was heard across the University as all the spams and viruses hit people's mailboxes and the various $YOU_GOT_MAIL sounds rang out, followed by cursing.

      --
      One line blog. I hear that they're called Twitters now.
    2. Re:I wonder... by Anonymous Coward · · Score: 0

      As if a million legitimate mail messages all cried out in terror, and then were suddenly silenced.

    3. Re:I wonder... by Drooling+Iguana · · Score: 5, Funny

      Have you seen Ghostbusters? Remember when the environmentalist guy shut down their containment unit?

      Same thing.

      --
      ... I'm addicted to placebos
    4. Re:I wonder... by Anonymous Coward · · Score: 0

      And all the spam started singing their victory tune.

    5. Re:I wonder... by Anonymous Coward · · Score: 0

      The guy who bore a strong resemblance to Real Genius' Dr. Hathaway?

  7. Spam And Viruses by FiberOpPraise · · Score: 5, Insightful

    Perhaps just disabling spam filters and leaving virus blocks in place would be a less drastic approach. Detecting spam is non-trivial, but detecting viruses is not. They are easily found and the email should be blocked. This is implemented by my ISP (Road Runner NYC). Emails containing viruses are replaced by a text message warning that a virus was sent to the email address.

    1. Re:Spam And Viruses by j-pimp · · Score: 1

      Emails containing viruses are replaced by a text message warning that a virus was sent to the email address. Yeah thats the vast majority of the contents my Road Runner inbox.

      --
      --- Justin Dearing http://www.justaprogrammer.net/ We're just programmers.
    2. Re:Spam And Viruses by slamb · · Score: 5, Interesting
      Emails containing viruses are replaced by a text message warning that a virus was sent to the email address.

      And that warning is so useful. Who do you send it to?

      • The recipients? They don't care.
      • The "senders"? They don't care. (The From: address is forged!)

      These messages are a waste of everyone's time. I get hundreds of worms daily...but I never see them, because they're easy to filter. What I do see are these damned "helpful" messages that "I" sent someone a virus. Those are much harder to filter.

      Much better way: reject viruses in the SMTP transaction. The SMTP client is then responsible for notifying the sender. If that client is a virus or worm, it will do nothing; no one is bothered. If it's a false positive, the sender will get the bounce. Reliable, unobstrusive.

      If you want to filter email politely, you must follow these rules. People who don't cause the rest of us constant headaches. The worst thing is that they don't even realize it.

    3. Re:Spam And Viruses by Mad+Marlin · · Score: 1

      These messages are a waste of everyone's time. I get hundreds of worms daily...but I never see them, because they're easy to filter. What I do see are these damned "helpful" messages that "I" sent someone a virus. Those are much harder to filter.

      I get those all the time too, and I know my machine (FreeBSD) isn't randomly spewing worms out at people. I just mark them as spam too, so I don't see them that much easier.

    4. Re:Spam And Viruses by tomstdenis · · Score: 5, Interesting

      Oh common, the 100s of daily "message has virus" emails I get are very useful. It makes me keep my Gentoo box win32 virus free!

      I once confronted a sysop about this and they told me "if we don't email them back people won't know the message was rejected". Apparently the idea of checking while reading the message never crossed his mind.

      As another poster suggested I just filter out all "warning" emails as junk which helps.

      Tom

      --
      Someday, I'll have a real sig.
    5. Re:Spam And Viruses by Anonymous Coward · · Score: 0

      On the contrary.

      It is easy (at least for me) to spot an email with a virus even if it is not removed by your antivirus software; it is the case as long as you are not using Outlook. With Pegasus, I was able to notice many emails with virus attachements which Norton failed to detect (until I switched to Nod32).

      It is much more time saving for me if the filters of spam are kept on and the viruses are set free! I know this is an extreem opinion, but the idea that spam is less annoying/disruptive than viruses is rediculous.

    6. Re:Spam And Viruses by Burning1 · · Score: 3, Informative

      Permanant Failure (5xx SMTP) codes are not safe either.

      There are many cases where email is relayed before being sent to a system that does virus scanning. (Consider what happens when you use sendmail aliases and virtual domain entries that contain somthing on the order of "user: user@someotherhost.com".)

      Your SMTP 5xx error will cause the relaying server to generate a bounce. The bounce will go to the person listed by the forged "To" headers, and will even include a copy of the Virus.

      The proper way to deal with email worms is to quietly delete them.

    7. Re:Spam And Viruses by slamb · · Score: 2, Insightful
      Permanant Failure (5xx SMTP) codes are not safe either. There are many cases where email is relayed before being sent to a system that does virus scanning. (Consider what happens when you use sendmail aliases and virtual domain entries that contain somthing on the order of "user: user@someotherhost.com".)

      They exist, but I do not agree that they are common. Not only do they have to have a rule like that, but they have to not be using virus scanning themselves.

      So, yes, people can get bounces from virus emails from this method. But it's much, much rarer than the other way. And with the randomization these viruses do, no one in particular is targeted.

      The proper way to deal with email worms is to quietly delete them.

      That's a horrible idea. You will have false positives, and those will be important messages. This is why people think email software isn't reliable. It is...but administrators like you configure it in an unreliable way.

    8. Re:Spam And Viruses by RovingSlug · · Score: 3, Insightful
      If you want to filter email politely, you must follow these rules.

      One small quibble about a final point in those rules:

      I reject almost any MIME attachment that could be Windows malware. Even .zip files now. I politely ask them to arrange with me another way to send it. (Sending binaries through email isn't such a good idea anyway; it's indirect, and base64 bloats files 50%.)

      It's indirect? What's a good way to transfer binary files that is both direct and secure? ... and archived with a personal note. One handy thing I do for large attachments is to upload them to a http server and send the link. But this is a pain in the ass for anything other than the biggest files. What are the good options otherwise?

    9. Re:Spam And Viruses by wibs · · Score: 1

      I'm a fan of servers flagging spam and delivering it with the flag in the subject, but I can't stand virus blocks.

      Even grandmothers have heard enough about viruses on the news lately to know that they shouldn't accept unknown attachments, and I honestly can't think of anyone I know within the past 3 years or so who has gotten a virus that way. These same people have gotten viruses through AIM, so these aren't even the technical elite - it's just that general precautions when it comes to email have made their way into the realm of common sense.

      Meanwhile, I get emails with valid attachments all the time, be it from beta testers or friends or whoever, that are in .sit and .zip format. Unfortunately, all I receive is a message that says "The file ____.zip was flagged as a virus and could not be delivered. No backup was saved."

      File compression and transfer are basic needs. Killing that is just a few steps short of unplugging your computer from the wall and heading back to the pre-internet days of use. Quite frankly, I'm sick of Solitaire.

      --
      If you get nervous, just remember that there are a few billion other people who don't really give a damn.
    10. Re:Spam And Viruses by thogard · · Score: 2, Interesting

      Most viruses have a text line that start out:
      TVqQAAMAAAAEAAA
      since they are mime encoded .exe. Simple solution is to hunt for that tag when the message comes in and kill any message that has it. Should you have a real person sending an exe attachment, they will get the bounce if you reject it while the SMTP connection is still active and there is no siletnly lost real mail. A patch for sendmail can cope with a few hundred thousand messages an hour on pc class servers so its no big deal but I've got a faster hack when it matters.

    11. Re:Spam And Viruses by slamb · · Score: 1
      It's indirect? What's a good way to transfer binary files that is both direct and secure? ... and archived with a personal note. One handy thing I do for large attachments is to upload them to a http server and send the link. But this is a pain in the ass for anything other than the biggest files. What are the good options

      First, the section you're referring to is not one of my hard rules. It's just an extra note about how I implement them. If you disagree, no big deal.

      It's indirect in the sense that mail tends to go from your client to a SMTP server on your end to one on their end to their computer (two extra machines)...in the simplest case. There might be at least another couple machines involved, especially if there are infranets there.

      I tend to do as you said (HTTP), but I have an easier time uploading. If you have WebDAV set up, you can just drag on Windows (Web Folders), OS X, and other systems. I also use SSH public keys, so uploading something from the commandline is as simple as typing an scp or rsync command.

      Another option is an instant messaging client. File transfers in AIM, IRC, etc. are direct connections between the two machines. Not perfect, though: both machines have to be online simultaneously, and firewalls are sometimes a problem.

    12. Re:Spam And Viruses by ezzzD55J · · Score: 2, Informative

      base64 bloats 1/3, not 1/2.. i agree it's not great though. (Makes me wonder why newsgroups are so popular for leet file sharing.)

    13. Re:Spam And Viruses by agentofchange · · Score: 1

      From the rules you referenced it says: I reject almost any MIME attachment that could be Windows malware. Even .zip files now. I politely ask them to arrange with me another way to send it. This just doesnt work for a lot of average joe users. Event if they are savvy enough to zip a file it is a big step to getting them to use ftp or some other method. -- Agent

    14. Re:Spam And Viruses by slamb · · Score: 1

      That's not one of the rules. The rules are the things in bold. The bulleted stuff below is just how I do things.

    15. Re:Spam And Viruses by stesch · · Score: 1
      This is implemented by my ISP (Road Runner NYC). Emails containing viruses are replaced by a text message warning that a virus was sent to the email address.

      Yes. And they send a warning to the faked address in the worm e-mail, too! :-(

      And I can't reach them to send them a link to Anti-Virus Companies: Tenacious Spammers ...

    16. Re:Spam And Viruses by Wastl · · Score: 5, Informative
      Much better way: reject viruses in the SMTP transaction. The SMTP client is then responsible for notifying the sender. If that client is a virus or worm, it will do nothing; no one is bothered. If it's a false positive, the sender will get the bounce. Reliable, unobstrusive.

      Two things:

      • in many countries (e.g. Germany) you are actually obliged to deliver a message, regardless of whether its a Virus or not, or at least send the recepient a message that he received an email and can fetch it by some means.
      • your proposal is short-sighted: most viruses are already relayed via several systems before they reach my mail server, so a bounce would be generated in any case; I suspect that this is true for most other systems as well.

      The approach that we take is the following: We mark virus messages with a special header and deliver them in a dedicated folder in the user's mailbox. Most users simply delete all messages in this folder, but then it is their choice, we abide to all laws and do not generate bounce messages.

      Sebastian

    17. Re:Spam And Viruses by RollingThunder · · Score: 1

      Then I would suggest using a file transfer protocol, not a bodged-on addition to Simple Mail Transfer Protocol.

      And while you may not know anyone stupid enough to both do it AND admit to it, it happens, constantly, all the bloody time. I work in a tier-2 support center for a major company, and it happens ALL THE TIME despite people knowing better.

    18. Re:Spam And Viruses by Burning1 · · Score: 2, Insightful

      Oh please, don't give me crap about my ability to do my job.

      You are horribly mistaken about how common both SMTP virus scanning is, and how often the situation I described occurs. Email is relayed for anyone who has a forwarding address, many people who have changed ISPs, lots of people using custom email hosting, and a sizable percentage of the people who own custom domains.

      Virus scanning is becoming common, but is not at all universal. Many email servers scan for viruses only during local delivery, and not when relaying.

      Additionally, some systems use a form of relaying to deliver all email. This is the case for AMaViS in Postfix and "Sendmail Relay" configurations. Someone spitting out 5xx error codes with such a setup will guarantee "MAIL DELIVERY FAILURE" for all. : )

      Old fashion viruses are becoming rare, and someone sending them is likely to find out one way or another. If what they sent is important, they will probably check to see if it arrived.

      The proper response of course, is for venders to start identifying viruses differently than worms. If that were the case, we could send those "You've got virus" emails only in situations where the "From" address is correct. Some vendors do this.

      With all that said, you sir, are hurting reliability of email. I delete several hundred mail delivery status notifications a day, because I no longer have the time or energy to see if they are genuine.

      The sad fact is, email stopped being reliable the moment people began accidentally deleting valid email with their spam. People expect a little unreliability, and can handle it.

    19. Re:Spam And Viruses by Anonymous Coward · · Score: 0

      "people think email software isn't reliable"

      Fact: SMTP is inherently unreliable. Read the RFC. Mail can be lost even when people don't accidentally delete it with the bottomless pit of spam. Therefore, don't send critical information via email and expect it to reach its destination 100% of the time, or even within a specified time.

    20. Re:Spam And Viruses by jeremyp · · Score: 1

      I've read the RFC. Tell me what features of it make it unreliable. If all e-mail servers were correctly implemented and correctly configured, the only way to lose mail would be a hardware failure.

      --
      All I want is a secure system where it's easy to do anything I want. Is that too much to ask ~~ Randall Munroe
    21. Re:Spam And Viruses by jeremyp · · Score: 2, Insightful

      Slightly pedantic: the bounce message will go to the address in the forged reply-to header, or from header, or envelope sender.

      I would question quietly deleting such mails. Most of the worm/virus ridden mails that I get come from people who have infected systems and where I am in their address book. They need to know they have an infected system.

      --
      All I want is a secure system where it's easy to do anything I want. Is that too much to ask ~~ Randall Munroe
    22. Re:Spam And Viruses by julesh · · Score: 1

      Much better way: reject viruses in the SMTP transaction. The SMTP client is then responsible for notifying the sender. If that client is a virus or worm, it will do nothing; no one is bothered. If it's a false positive, the sender will get the bounce. Reliable, unobstrusive.

      If you want to filter email politely, you must follow these rules. People who don't cause the rest of us constant headaches. The worst thing is that they don't even realize it.


      All very interesting. However the vast majority of people don't run an SMTP server, but filter their e-mail on delivery (e.g. after a POP3 download), so cannot follow this suggestion. Sorry.

    23. Re:Spam And Viruses by julesh · · Score: 1

      Just a couple of nitpicks:

      Your article says "base64 bloats files 50%".

      1. As somebody else has pointed out, the figure is actually 33%.
      2. Almost all low-bandwidth connections use some form of adaptive compression that's likely to reduce this overhead to 10% or less.

    24. Re:Spam And Viruses by FireFury03 · · Score: 1

      Happilly, after a bit of training my spamassassin filters most of the viruses and bounces from virus scanners.

    25. Re:Spam And Viruses by slamb · · Score: 1

      You're right; thanks for the correction.

    26. Re:Spam And Viruses by slamb · · Score: 1
      All very interesting. However the vast majority of people don't run an SMTP server, but filter their e-mail on delivery (e.g. after a POP3 download), so cannot follow this suggestion. Sorry.

      They're actually not breaking any of three rules, provided they:

      • don't delete something outright. Stuffing it into an infrequently-checked spam folder is okay.
      • don't send automated replies
    27. Re:Spam And Viruses by slamb · · Score: 1
      in many countries (e.g. Germany) you are actually obliged to deliver a message, regardless of whether its a Virus or not, or at least send the recepient a message that he received an email and can fetch it by some means.

      I feel sorry for you. How much disk space do you have devoted to viruses?

      your proposal is short-sighted: most viruses are already relayed via several systems before they reach my mail server, so a bounce would be generated in any case; I suspect that this is true for most other systems as well.

      Most? Really? How does this happen? From everything I've seen, the malware directly connects to the MX-specified server for the destination address. So I'd think the server in question should generally be under your control.

      At some point, though, there's only so much you can do. Those servers forwarding it really should be doing virus checking. (I just changed the wording of rule #3 to include this.) When people upstream are being stupid...it would be nice to handle that gracefully, but I think #1 is more important. There's no right answer here.

      The approach that we take is the following: We mark virus messages with a special header and deliver them in a dedicated folder in the user's mailbox. Most users simply delete all messages in this folder, but then it is their choice, we abide to all laws and do not generate bounce messages.

      You are meeting the rules I mentioned, then, provided you're not sending vacation messages and such in reply. But I don't envy you the wasted disk space.

    28. Re:Spam And Viruses by Anonymous Coward · · Score: 0

      Smart users of Newsgroups use Yenc for uploading which has only 2-3% overhead. For your next question, from my experience, those who do this use what are the equivalent of throwaway accounts with throwaway CCs. They get all wigged out about people who don't do it the right way and are willing to pay 10-20/month for their l33tn355 and don't get upset if their account gets cancelled for uploading warez or whatevah.

    29. Re:Spam And Viruses by Anonymous Coward · · Score: 0

      That's crap. The overhead is in the datastream which is already compressed. The problem with base64 is converting Octal streams into 7 bit text. That's the cause of the overhead.

    30. Re:Spam And Viruses by slamb · · Score: 1
      Virus scanning is becoming common, but is not at all universal. Many email servers scan for viruses only during local delivery, and not when relaying.

      ...and such systems are broken, not following my (now more explicit) rule #3. It would be really, really nice if there were a way to get your system to get them to do the Right Thing no matter how they're misconfigured, but there isn't. So when this happens, there's no right thing to do. But I say the more wrong thing would be to drop the email, since you can never be certain it's malware.

      Additionally, some systems use a form of relaying to deliver all email. This is the case for AMaViS in Postfix and "Sendmail Relay" configurations. Someone spitting out 5xx error codes with such a setup will guarantee "MAIL DELIVERY FAILURE" for all. : )

      Let me clarify: I mean sending a 5XX at the end of your sphere of influence. Thus, if you are sending a 5XX internally and bouncing from there, I still consider that broken.

      So if you do use such a setup and follow my three rules (you should!), you're stuck with actually delivering the messages. Maybe in a quarantine system, like one of the other posters mentioned.

      If what they sent is important, they will probably check to see if it arrived.

      Bah. I have people who I communicate with only through email. How am I supposed to check if something arrived?

    31. Re:Spam And Viruses by Anonymous Coward · · Score: 0

      Oh yes, automated replies to people who get their email rejected by my server is bad because... um... oh yeah, because you're pissy about getting Windows Virus bounce messages. Ahhh, I get it.

      People who don't have virus-infested systems, who is sending a message to someone, whose email gets canned without any kind of response, these people are going to look so kindly upon your benevolent deletion.

      Hey buddy. Next time a string of V.I.E.s to the C.E.O. gets dumped by your filter, expect to get called to the carpet. Explain your pissy attitude all you want, but if you want to keep your job you'll have to adjust your filters.

    32. Re:Spam And Viruses by Vellmont · · Score: 3, Interesting


      I would question quietly deleting such mails. Most of the worm/virus ridden mails that I get come from people who have infected systems and where I am in their address book. They need to know they have an infected system.


      I quarantine all the worms/viruses sent to my system. I look through the quarantine directory about once a week. On ONE occacion (out of a few hundred virus laden messages) I was able to determine who was sending the virus. The vast majority of the time the viruses don't leak any information about the system, and they come from dynamic IP addreses. Delivering the virus, or a "user X sent you a virus" message to the user is useless. I've never once had a false positive (and I believe the chance of false positives is about zero).

      Delivering the virus laden email is just stupid. The reasons deleting it, or quarantining it far outweigh the reasons for delivering it. I'm pretty good about being able to track where a virus came from and I was only able to track down one virus origin. End users are going to have zero ability, and zero interest in doing do. They'll actually send out false "you've got a virus" reports to their friends (who don't actually have a virus, the from address was just forged).

      --
      AccountKiller
    33. Re:Spam And Viruses by Haeleth · · Score: 1

      I have people who I communicate with only through email. How am I supposed to check if something arrived?

      Wasn't that question answered yesterday? ;)

    34. Re:Spam And Viruses by Anonymous Coward · · Score: 0

      What the hell are you talking about?

    35. Re:Spam And Viruses by JamieKitson · · Score: 0

      The original ip is useful so you can let the isp know. I rang ntl (most of my worms come from ntl ips) a while back to ask them if they actually read any of my complaints, I actually got straight through to a human who told me that it was important for people to complain because it was the only way that they could find out about the worms.

    36. Re:Spam And Viruses by magarity · · Score: 1

      in many countries (e.g. Germany) you are actually obliged to deliver a message, regardless of whether its a Virus

      I can't help but marvel at what legislative insanity dreamed this up. Viruses/worms are not "messages" purposefully sent to a recipient; they're just random spewings trying to infect as many computers as possible. I think of all the folks in Asia last year being told they can't wear those face masks because they are obligated to receive any SARs viruses someone might try to "deliver" to them.

    37. Re:Spam And Viruses by Anonymous Coward · · Score: 0

      Correct, but 7-bit text can be further compressed by modem compression. I'm not sure about the 10% figure as the parent poster said, but still...

    38. Re:Spam And Viruses by Frit+Mock · · Score: 1


      It is in everyones responsibility to have an uninfected system and not in your responsibility to notify the owner of infected systems.

    39. Re:Spam And Viruses by wibs · · Score: 1

      Then I would suggest using a file transfer protocol The people I'm talking about have gotten viruses through AIM. That's a whole new level of computing ineptitude, and there's no way they're going to grasp even logging into and using FTP. Email attachments have been around for a long time, they're accepted, they're standard... but if they can't be delivered then why have them at all?

      --
      If you get nervous, just remember that there are a few billion other people who don't really give a damn.
    40. Re:Spam And Viruses by Wastl · · Score: 1
      I feel sorry for you. How much disk space do you have devoted to viruses?

      The diskspace used is almost irrelevant compared to current disk capacities. Our mail server probably has 0.5 TB disk storage for 5000 students (I don't have the exact numbers, though). Users can delete messages or even have them discarded. The important point is that it has to be the user's choice, not the administrators. This might be different for corporate mail systems, but we are a university, which in Germany is a public entity, for which the laws are usually more stringent.

      Most? Really? How does this happen? From everything I've seen, the malware directly connects to the MX-specified server for the destination address. So I'd think the server in question should generally be under your control.

      You probably never worked in a large institution. The relay server very often is not under your control, nor is it possible to use the relay for time-consuming tasks like content filtering. At our institute, the MX host simply decides to which mail servers the mail is forwarded, and the server itself is not under our control. Port 25 connections from outside to other hosts are blocked by the routers. I know several other institutions (university as well as corporate) that have this kind of setup.

      Those servers forwarding it really should be doing virus checking.

      That's a requirement almost as illusionary as to require all Windows installations to be patched! :-)

      You are meeting the rules I mentioned, then, provided you're not sending vacation messages and such in reply.

      We don't, as emails get delivered, it would be unsensible to do so.

      Sebastian

    41. Re:Spam And Viruses by slamb · · Score: 1
      You probably never worked in a large institution. The relay server very often is not under your control, nor is it possible to use the relay for time-consuming tasks like content filtering. At our institute, the MX host simply decides to which mail servers the mail is forwarded, and the server itself is not under our control. Port 25 connections from outside to other hosts are blocked by the routers. I know several other institutions (university as well as corporate) that have this kind of setup.

      Bureaucracy, then. Always fun. I do work in a large institution (a University-run hospital), but I don't have anything to do with the email here, thank God. We just play with our departmental Oracle server.

      That's a requirement almost as illusionary as to require all Windows installations to be patched! :-)

      Hey, it can be done. That's one thing the support staff here does right - they can pump out updates to everyone automatically. For a while they weren't really taking advantage of it, but after some embarrassing incidents, they started pushing recent updates. Now every machine is up-to-date, and it seems like they'll keep it that way.

      Of course, where your organization's machines end, and the general Internet begins...that's another story. If they were patched, we wouldn't be getting these damned virus emails. Newer versions of Microsoft software will encourage users to patch more, but there's always someone who will turn it off, and it will be years before people upgrade anyway.

    42. Re:Spam And Viruses by Burning1 · · Score: 1

      "So when this happens, there's no right thing to do. But I say the more wrong thing would be to drop the email, since you can never be certain it's malware."

      The proper thing to do is to run a quarantine, however that's not an option in many situations.

      "Thus, if you are sending a 5XX internally and bouncing from there, I still consider that broken."

      I have no doubt that you would consider a situation that always generated bounces broken. I thought it was a situation worth pointing out, because it's not at all obvious to some administrators.

      "Bah. I have people who I communicate with only through email. How am I supposed to check if something arrived?"

      They can still send you an email that asks if their important document arrived. So long as that email doesn't contain the original virus payload, they will get through.

      My final word: people far more qualified than you or myself have argued about this subject. The man who developed MIME Defang (David F. Skoll) says drop. In my personal experience, it has been the best solution.

    43. Re:Spam And Viruses by slamb · · Score: 1
      I have no doubt that you would consider a situation that always generated bounces broken. I thought it was a situation worth pointing out, because it's not at all obvious to some administrators.

      Yeah, maybe I'll write up a more complete description of my rules sometimes that makes this more explicit.

      They can still send you an email that asks if their important document arrived. So long as that email doesn't contain the original virus payload, they will get through.

      And if the original mail didn't contain a virus payload either? I'm worried about false positives, not sending potentially-infected files. Here's a good example. Since you mentioned MIMEDefang, this came up on their mailing lists:

      Example: someone sends a business inquiry and attaches a vcard. With the default filter, if the vCard filename includes the email address and the domain is a .com - say "My Name (here at there.com).vcf" - it will trigger filter_bad_filename. Your server discards the message, but they never get a bounce notice, and of course they never hear back from you. If you're lucky, they'll try to reach you by phone. If you're not lucky, they'll figure "Well, these people have never responded to a single one of my emails, I guess I'll take my business elsewhere." If they get a bounce notice, at least they'll know you didn't get the message.
      That's from this message.
    44. Re:Spam And Viruses by Burning1 · · Score: 1

      Agreed, that's a dumb way of doing things. It's also a rather old example.

      Most current MIME Defang installs will simply strip the .vcf file from the email, and notify you (the recipient) that it was removed while delivering the rest of the email. Stripping files is used mostly as a safety measure to catch potential viruses that virus scanners did not (or could not) identify.

      As a side note, IMO some filenames (such as .pif and .scr) are worth silently dropping. I've never seen them used as a ligitimate attachment.

  8. Mirror by karmatic · · Score: 3, Informative

    Site's a little slow -
    Akamai Mirror.

  9. translation by Anonymous Coward · · Score: 2, Informative

    Spam wave?rrollt DOES Braunschweig

    The system administrators at the computing centre of the technical Universit?Braunschweig kapituliert on Friday of yesterday before the effects of an unknown Spam load and the Spam and virus filters DO deactivated. After "quite controversially gef?ten service discussion" the responsible persons decided that their setting obligation, all enamels within f? To deliver days to the Empf?er, priority before the Sch?ingsschutz genius?. For the description of the situation the Admins submitted the following numbers:

    "our server park of approx.. 20 systems alone for enamels is overloaded. A "basic load" of zun?st 30,000 rough enamels (Di) on approximately 100,000 enamels expanded (Fr). [... ] Per hour up to 10.000 enamels by the Spam and virus scanners are worked on and set. 98% of it are "unerw?chte" Mails (Spam, viruses) for which we nevertheless a legal setting obligation have."

    W?end Mails within the Braunschweiger of computer network to be still normally set, m?en themselves external Mail Empfanger with the advice to manage, them should e-Mail-Anh?e after M?ichkeit only after R?sprache with the sender?nen and otherwise a local virus scanner use and this at least once t?ich update.

    The University of Braunschweig is not threatened as only ones of the Spam oversupply: Already since past week the computing centre of the free Universit?Berlin blocks perforce all Mails with potenziell gef?lichen Attachments, and as reported the E-Mail supply of the Federal Government in the digital M sags?.

    It d?te indisputablely its that the Admins of the?rfluteten computing centres does not act differently k?en, but a deichbruch as in the Braunschweiger IT landscape tr? surely not to the Abschwellen of the Spam wave, rather to their further growth with (hps/c't)

    1. Re:translation by Anonymous Coward · · Score: 3, Informative

      MS Exchange servers. It's gotta be MS Exchange servers: no other SMTP server in the world could possibly require 20 servers to deal with only 100,000 emails an hour, even with only 1 GHz mail servers. Sendmail, Postfix, Qmail, all could handle 100,000 emails an hour on only 10 such machines, even running SpamAssassin and CRM114. Unless maybe they skimped on RAM and accepted vastly oversized mail messages, in which case they'd start swapping themselves to death at a lower than expected threshold.

      I hope they find the idiot who selected their servers and software combinations and send them straight back to Redmond, in a box, along with the snipped off tie of the Microsoft person who sold them the bill of goods.

    2. Re:translation by NonSequor · · Score: 1

      You should really substitute email for enamel there.

      --
      My only political goal is to see to it that no political party achieves its goals.
    3. Re:translation by theM_xl · · Score: 2, Funny

      That's a translation? Into what language? :)

    4. Re:translation by pseudochaotic · · Score: 2, Funny

      Why did you even bother posting that? It's almost incoherent.

      all enamels within f? To deliver days to the Empf?er, priority before the Sch?ingsschutz genius?

      I'll give you a dollar if you can tell me what that means.

      --
      And the l33t shall inherit the 34r7h.
    5. Re:translation by Anonymous Coward · · Score: 0

      Try translating from English to Russian and back:
      The Spirit is willing but the flesh is weak.
      You get:
      The vodka is great but the meat is rotten. :)

    6. Re:translation by Anonymous Coward · · Score: 0
    7. Re:translation by orin · · Score: 4, Informative

      To quote the post directly above you ...

      No, sendmail (Score:5, Informative)
      by marnanel (98063) on Monday May 24, @12:04PM (#9234290)
      (http://marnanel.org/)

      7: They're using MS Exchange SMTP servers, which bog down incredibly under load, especially if you run any separate service such as spam processing.
      Nah, it's sendmail:

      $ dig -t MX tu-bs.de
      [...]
      tu-bs.de. 172738 IN MX 10 rzcomm5.rz.tu-bs.de.

      $ telnet rzcomm5.rz.tu-bs.de smtp
      Trying 134.169.9.40...
      Connected to rzcomm5.rz.tu-bs.de.
      Escape character is '^]'.
      220 rzcomm5.rz.tu-bs.de ESMTP Sendmail 8.11.1/8.11.1; Mon, 24 May 2004 04:00:51 +0200 (METDST)

    8. Re:translation by Sweetshark · · Score: 1

      to deal with only 100,000 emails an hour
      The original (german) article states they had a queue of 30000 undelivered mails on Tuesday growing to 100000 undelivered mails on Friday - the amount of incoming spam is probably much bigger, so thier setup isnt that bad ...

  10. Probably a better alternative... by Milo+of+Kroton · · Score: 4, Insightful

    ...is to inform the students how to install their own software, like Spam Assassin. That would distribute the processing to the people who actually would use it.

    1. Re:Probably a better alternative... by n4KdR4zr · · Score: 2, Interesting

      What about some kind of seti@home like distributed filtering system on campus? There'd be privacy/security issues I guess, but with masking the recpients address, a whitelist system to bypass the filter, encryption, a well designed client,etc intercepting other people's mail might become hard enough to deter all but the most determined which would be fine by me if my inbox was clean -- let's face it email isn't really all that private to begin with.

      --
      "... drowning in information, ... starving for knowledge." --John Naisbitt
    2. Re:Probably a better alternative... by Anonymous Coward · · Score: 0

      Except that they then have to download the messages before they can filter the spam and viruses. What if they're connecting from off-campus over dialup?

    3. Re:Probably a better alternative... by nomadic · · Score: 1

      Oh come on, it's not really the University's job to teach something to its students, is it?!

    4. Re:Probably a better alternative... by jonbrewer · · Score: 1

      ...is to inform the students how to install their own software, like Spam Assassin. That would distribute the processing to the people who actually would use it.

      Not sure how this is a better option if the Uni's mail servers are going to fall over due to the load.

    5. Re:Probably a better alternative... by Oligonicella · · Score: 1

      Careful what you wish for. My ISP used Spam Assassin, and if they had voided all marked e-meils durint their test, Slashdot wouldn't have come thru.

    6. Re:Probably a better alternative... by ron_ivi · · Score: 1, Interesting
      Or to not give out their email addresses to spammers.

      They could easly educate their students to use a throwaway yahoomail or gmail or even better the awesome spam.la service when they sign up for pr0n services or NYTimes spam lists.

    7. Re:Probably a better alternative... by Milo+of+Kroton · · Score: 1

      Mailinator.com is also another site in the same vein, only you have to enter the email; all the emails aren't automatically displayed.

  11. It's done. by jrockway · · Score: 4, Interesting

    > Is this the end of email?

    Yes. When one university decides to stop filtering SPAM the entire world's infrastructure has effectively been shut down. Oh wait... no.

    My UIC account gets NO spam (because I don't give it to anyone :), so I think that responibility is the key to keeping email working. Adding some numbers (*sigh*) helps guard against random address guessing.

    Anyway I don't see anyone stopping you from using your own SPAM filter. Let's not blow this out of proportion, please.

    --
    My other car is first.
    1. Re:It's done. by Dizzle · · Score: 4, Funny

      Since you give it to no one, do you have an empty inbox all the time?

      --
      -Dizzle
      "I most likely AM so interested in myself."
    2. Re:It's done. by jrockway · · Score: 1

      It's available for finding in the directory. I don't give it to websites, etc., though.

      I forgot to read the article, though. Having read it I have only one comment... "Das est nicht gut." Then again neither is my German...

      --
      My other car is first.
    3. Re:It's done. by achurch · · Score: 1

      My UIC account gets NO spam (because I don't give it to anyone :), so I think that responibility is the key to keeping email working.

      Unfortunately, those of us who actually do something in the world don't have the option of keeping our addresses secret.

      FWIW, I use a custom filter on spam URLs and Windows executables that catches most of the garbage I receive.

    4. Re:It's done. by TEMM · · Score: 1

      My universities email addresses are random numbers and letters and i get more spam in that account than i do in one based on my nickname... The spammers use randomized emails to send out their payloads, so everyone gets it... Ive never used my uni email to sign up for anything either.

    5. Re:It's done. by Anonymous Coward · · Score: 0

      Well, aren't you lucky. Has not even a spammer asked your university for a list of student emails under the freedom of information act? spammers exploited that loophole at my institution.

    6. Re:It's done. by shadow_slicer · · Score: 5, Funny

      "Adding some numbers (*sigh*) helps guard against random address guessing."

      Exactly! That's why I require all my users to use multi-case letters, symbols and numbers as their email address. I also require them to change the address every couple of weeks to a value different than any previous value (in case some spammer has managed to brute force it, or the user has leaked it). This has practically eliminated spam and reduced the mail server's storage usage by 99.9% (though the mail server still has to work really hard sending all those 550's).

    7. Re:It's done. by Breakfast+Cereal · · Score: 1

      At LISA '98 a sysadmin at a university said that he agreed to comply with the request by sending the address list on greenbar hardcopy. Didn't hear back from the spammer.

    8. Re:It's done. by Q2Serpent · · Score: 1

      Yeah, I used to do this too. Get an email address, only use it for personal email. The problem now is that once one of the people who has your address places it in their Outlook address book, all the spyware, malware, adware, *ware on their machine has access to it. Even personal addresses get spam now, unless you only give your address to the few people you know who don't use outlook.

    9. Re:It's done. by taernim · · Score: 1

      Let's not blow this out of proportion, please.

      You must be new here.... ;)

      --
      "PC Load Letter? What the $@#% does that mean?!"
    10. Re:It's done. by some+guy+I+know · · Score: 1, Insightful
      multi-case letters
      Except that case in email addresses is ignored (or should be, if you follow the standards).
      So requiring multi-case is useless.
      I also require them to change the address every couple of weeks
      If you make your users change their email addresses every couple of weeks, then I wouldn't want to be one of your users.
      Imagine if everybody did this.
      The number of SPAM messages would quickly be swamped by the number of change-of-address messages.
      I'm certainly not going to take the time to update my address book every couple of weeks from someone who changes his/her email address that often.
      That means that your users are SOL if they want me to stay in touch with them.

      There is such a thing as going overboard.
      You are going overboard.
      --
      Those who sacrifice security to condemn liberty deserve to repeat history or something. - Benjamin Santayana
    11. Re:It's done. by Chop · · Score: 1

      You are new here aren't you?

      Chop

    12. Re:It's done. by simcop2387 · · Score: 1, Funny

      it wouldn't happen to be jrockway @imsa.edu would it?

    13. Re:It's done. by Anonymous Coward · · Score: 0
      I would expect that his UIC account would end in uic.edu.

      ...idiot.

    14. Re:It's done. by TheLink · · Score: 4, Funny

      WHOOSH...

      Have you had your coffee today?

      --
    15. Re:It's done. by shadow_slicer · · Score: 1

      It was hyperbole and extended metaphor.

      I don't really control a mail server. I was merely maintaining so for rhetorical purposes. I was just taking the parent poster's suggestion of obfuscating their email address to avoid spam (by adding numbers to it) to the logical extreme. I was also comparing this obfuscation to the obfuscation of passwords (both of which are ironically used to prevent unauthorized people from gaining access to otherwise accessible resources).

      I am aware that SMTP is supposed to ignore case (that factual error was missed during editting -- since origionally I claimed that they had to use their passwords for email addresses, but found that too absurd, and distracting from my point)

    16. Re:It's done. by Anonymous Coward · · Score: 0

      Newer than you, but not by much.
      Yeah, I missed the joke.
      It happens.

    17. Re:It's done. by Anonymous Coward · · Score: 0

      I don't drink coffee.
      So I missed the joke.
      It happens sometimes.

    18. Re:It's done. by missing_boy · · Score: 1
      [...] so I think that responibility is the key to keeping email working.

      No. "Responsibility" is not enough. I changed my university departmental account name in ~'98, and within 3 (!) days, I had SPAM trickling in, and I was *very* responsible with my new address. I'm guessing our server was compromised, or somebody got into our "departmental viewing only" section on our dept.'s webpage. I am still 100% "responsible" with my email address, and I now average 150 SPAMs a day (I keep track).

      Adding some numbers (*sigh*) helps guard against random address guessing.

      This might be a better solution, UNLESS, of course, your server or "internal" webpages are compromised (see above) and your address is released that way.
    19. Re:It's done. by Anonymous Coward · · Score: 0

      "Since you give it to no one, do you have an empty inbox all the time?"

      Well that saves me the trouble of having to check it. Hell its been so long *I* don't even know my email address anymore.

      This system has really cut down my workload too:
      Them: So we got the specs for the new project
      Me: Great! E-mail them to me.
      Them: What's your address?
      Me: I can't tell you that.
      Them: uh...
      *silence*

  12. Bummer by Anonymous Coward · · Score: 0

    The spammers have already won.

    But what about the email servers?

  13. blacklists by sumdumass · · Score: 3, Interesting

    Maybe they should just blacklist the most common spam and virus adresses by subnet then filter on a lower percentage. It would seem that if they got rid of china or some other area like what happend recently with spain, it would send a message to those networks to stop things and bear some of the weight.

    1. Re:blacklists by LordLucless · · Score: 2

      They can't do that. As the synopsis says, they are legally obliged to deliver all legitimate mail; if they just blacklist a whole subnet then they run the chance of blocking real mail. They just can't afford that.

      --
      Just because you're paranoid doesn't mean there isn't an invisible demon about to eat your face
    2. Re:blacklists by sumdumass · · Score: 1

      Then maybe a blacklist in conjunction with a white list from the people submiting or recieving who they are going to recieve mail from in that area.

      I'm sure if you ask the user to identify were legitamate email comes from, you can't be held acountable for those that didn't make it when the user never told you.

    3. Re:blacklists by AtomicBomb · · Score: 5, Insightful

      It is a common misunderstanding. While most web server these spams are pointing to may be located overseas, most of spams are originated from US. Mostly likely from hijacked fast cable/DSL connected home machines.

      You may think it is okay to block email from China or even the whole Asia because you don't know some Asians in person, but please check again where your RAM, mobo, anime etc come from... A lot of companies and university have collaborations overseas as well...

      We don't really have much options left... Basically, you will have to blacklist all the high boardband provider's IP range (rr, earthlink etc)... Sorry, geeks, your email server will no longer work... It is not really an ideal solution. The other idea is kind of similar to secured DNS, ie, mail server retrieves "good IPs" from a central server. Email originated elsewhere are assigned with very low priority or filtered out altogether.

      Everyone needs to be registered with their mail server with the governing body (similar to the domain name idea), say for $100 per IP. It is not that expensive if you really need that... But, prohibitive for spammer... Yes, it makes home run email server more expensive... But, you cannot get a domain name for free anyway. Why should we expect email server to be free? It may be the solution to get the economy of spamming right again.

    4. Re:blacklists by Anonymous Coward · · Score: 0
      please check again where your RAM, mobo, anime etc come from...

      Good point. I don't want them sending that tentacle monster after me. *shudder*

    5. Re:blacklists by Jaysyn · · Score: 1

      /toungeincheeek

      Can't we just shoot em instead? /toungeincheek

      Jaysyn

      --
      There is a war going on for your mind.
    6. Re:blacklists by AtomicBomb · · Score: 1

      It may work if the whitelist is well maintained. Also, we will have to think about how to avoid filtering off legitmate email from people you don't know before. They can be students intended to apply to the University. They can also be customer completing email registration after purchased your product...

      The proportion of SPAM originated from the SMTP server of ISP, universities and legitmate companies is pretty small. The proposed whitelist must be well maintained and include all.... Possibly in a way similar to domain name registration.

    7. Re:blacklists by 1u3hr · · Score: 4, Insightful
      It would seem that if they got rid of china

      As someone who lives in China I get more than a little tired of being filtered out because of the continent I live in. (Especially since the vast majority of spam I get is selling products from America, regardless of what server they're sending them through.) And in this particular case, being a university it's very likely that they have a sizeable number of students from China, and many staff with academic links.

    8. Re:blacklists by Anonymous Coward · · Score: 0

      Everyone needs to be registered with their mail server with the governing body (similar to the domain name idea), say for $100 per IP. It is not that expensive if you really need that... But, prohibitive for spammer... Yes, it makes home run email server more expensive... But, you cannot get a domain name for free anyway. Why should we expect email server to be free? It may be the solution to get the economy of spamming right again.

      There are so many reasons why this is a bad idea that typing them here just gives me a headache. Spam is the result of (1) poor server administration, (2) a mail transport protocol based on trust (which made sense at the time), (3) poor security all over the goddamn place, and (4) dumbasses who buy from spammers. Your proposal addresses none of these.

    9. Re:blacklists by 1010011010 · · Score: 4, Funny

      Call your elected representatives! Get them to outlaw spam!

      --
      Napster-to-go says "Fill and refill your compatible MP3 player", which is a lie. It's not MP3. It's WMA with DRM.
    10. Re:blacklists by merky1 · · Score: 1
      Sorry, geeks, your email server will no longer work...

      All ready happened. Most of the major providers started bouncing email coming from unregistered IPs or from known DSL / Cable Modem blocks. Took me a while to figure out why people weren't getting my emails...

      --
      --WooooHoooo--
    11. Re:blacklists by Dimensio · · Score: 2, Insightful

      As someone who lives in China I get more than a little tired of being filtered out because of the continent I live in.

      Then bitch at the Chinese ISPs who allowed the problem to exist in the first place.

    12. Re:blacklists by 1u3hr · · Score: 1
      Then bitch at the Chinese ISPs who allowed the problem to exist in the first place.

      MY ISP is in Hong Kong, and doesn't. The post I was replying to suggested banning ALL ISPs in China, no regard for their individual policies. And while you're throwing blame, it's your American spammers like Ralski who are reponsible. Why don't you bitch at your congressman to stop Americans from sending this crap all over the world.

    13. Re:blacklists by AndroidCat · · Score: 1
      Are they legally obliged to deliver all legitimate mail, or just not to drop it into /dev/null without any notification? (i.e. let the sender know that it didn't go through with an immediate 4xx or 5xx rejection?)

      There is no SMTP promise of perfect delivery and plenty of reasons that a legitimate mail could be rejected unrelated to spam or viruses. If no 5xx rejections are allowed for any reason, they're asking water to run uphill.

      --
      One line blog. I hear that they're called Twitters now.
    14. Re:blacklists by m2bord · · Score: 1

      well if notice something...the chinese gov't doesn't like outside sites and has banned them.

      the chinese gov't controls the isps.

      the isps host the spam and the emails (not always but bare with me).

      doesn't it make sense that this the chinese gov't way of getting the rest of the world to block connections from china?

      think about it...if we had a way of blocking all chinese telecoms/isps listed by email and also the ones host the spam-vertised sites, you would effectively be doing the job that the chinese gov't has been wanting...a total blockage of outside information.

      --
      Is it 5:30 yet?
    15. Re:blacklists by Openstandards.net · · Score: 1
      How do you know the spammers are in America?

      We did complain to congress, and they passed a lawy making it illegal. Our FBI has pursued several cases, but can't pursue cases outside the US. Thus, the spammers don't have a whole lot of incentive to operate in the US.

      The last I heard, 30% of spam was coming from China. I don't know where the other 70% is coming from. Given our CAN-SPAM act, any spam still coming from America is illegal. Being a federal crime (felony), it's not an insignificant one either.

      As for the products being American, you should try shopping here. Virtually everything in every store is from China. I am blown away when I see something common made in the USA. Thus, it's hard to believe that the products are all from America.

      The question I have is, how do you know the products are from America? How do you know the spammers are in the US?

    16. Re:blacklists by 1u3hr · · Score: 2, Insightful
      The question I have is, how do you know the products are from America? How do you know the spammers are in the US?

      When my spam mailbox is full of things offering me credit cards, mortgages and such that are only available or sellable in the US. Same for most of the viagra and diet pills, if I follow the links I usually end up at an American company. A small percentage aren't, of course, mainly Nigerian scams and some local stuff, but 95% is.

      This isn't just my opinion. See this in The Guardian: "There are really only 150 spammers doing 90% of all the spam we get in the US and Europe... at least 40 of them are in Boca Raton."

    17. Re:blacklists by sumdumass · · Score: 1

      I've been hearing alot of talk about domain registration being used to sort of authenticate an email adress. maybe somethign like a reverse lookup as well as the others. legitimat mail coming from a registered .com/whatever adress with the mail matching the dns record could bypass the other blacklist/whitelist and take some burden from it.

      As i am starting to see, the more one solution looks like it would work the more problems pop up. Even using multiple solutions seem to add more problems to the equasion.

    18. Re:blacklists by Openstandards.net · · Score: 1
      That article was written in February 2003. The CAN-SPAM act was signed into law in December 2003 and took effect on January 1, 2004.

      Due to this act, the percent that originates in the US is going to be very small this year and in the future. More importantly, because of the criminalization of SPAM in the US, the US is unlikely to be a contributor to the unprecedented growth in SPAM we're seeing this year.

      Because of the outrage of Americans over SPAM, you can bet that the few that continue to operate here will be caught.

    19. Re:blacklists by 1u3hr · · Score: 4, Insightful
      hat article was written in February 2003. The CAN-SPAM act was signed into law in December 2003 and took effect on January 1, 2004. Due to this act, the percent that originates in the US is going to be very small this year and in the future.

      Your faith is touching. Was it Nixon who started the first "war on drugs"? How's that going?

    20. Re:blacklists by Openstandards.net · · Score: 1
      You were the one that suggested we lobby our congress. If CAN-SPAM doesn't work, then it's unlikely that any government law will.

      Are there just 140 drug users in the world?

    21. Re:blacklists by Dimensio · · Score: 1

      How do you know the spammers are in America?

      Ralsky, #1 on the ROKSO, lives in Ohio. He's also known for using Chinese ISPs to host his sites for selling his illegal drugs.

      Ralsky deserves to be killed.

    22. Re:blacklists by Sipos · · Score: 1

      I may be being really stupid here but surely if spam is sent from a spoofed address then you can't tell where it is really from. If you could find the IP it originated from it would be much harder for people to send it and initivies like Domain keys etc would be pointless since if you could tell where it was from easily then there would be no reason to verify if the from address is real.

    23. Re:blacklists by Random832 · · Score: 1

      form SPAMSOL.TXT, abbreviated version - Emphasis means IMPORTANT

      This article advocates a

      (x) technical

      approach to fighting spam. Your idea will not work. Here is why it won't work.
      (One or more of the following may apply to your particular idea, and it may
      have other flaws which used to vary from state to state before a bad federal
      law was passed.)

      (x) It will stop spam for two weeks and then we'll be stuck with it
      (x) Requires immediate total cooperation from everybody at once

      Specifically, your plan fails to account for

      (x) Lack of centrally controlling authority for email
      (x) Unpopularity of weird new taxes
      (x) Huge existing software investment in SMTP
      (x) Susceptibility of protocols other than SMTP to attack
      (x) Extreme profitability of spam

      and the following philosophical objections may also apply:

      (x) Blacklists suck
      (x) Whitelists suck
      (x) Sending email should be free
      (x) Incompatiblity with open source or open source licenses

      Furthermore, this is what I think about you:

      (x) This is a stupid idea, and you're a stupid person for suggesting it.

      --
      We've secretly replaced Slashdot with new Folgers Crystals - let's see if it notices.
    24. Re:blacklists by jazir1979 · · Score: 1


      that is at once truly paranoic and utterly brilliant.

      --
      What's your GCNSEQNO?
    25. Re:blacklists by Tanami · · Score: 1

      That's just ridiculous.

      Why should email be any more expensive for me to use that what it actually costs (i.e. domain registration, connectivity/bandwidth, electricity)?

      To whom are you proposing that I should have to pay this artificial $100 charge? You? My government (I pay enough taxes thank you)? Your government (hah!)?

    26. Re:blacklists by Tin+Foil+Hat · · Score: 1

      Was it Nixon who started the first "war on drugs"? How's that going?

      It's going swimmingly. The government just can't keep up. Now, if we could get them to release our compatriots from their illegal slave farms....

      --
      No matter how many of my rights are taken away, somehow I still don't feel safe. -Frigid Monkey
    27. Re:blacklists by Antique+Geekmeister · · Score: 1

      China has actually been entire blocked before. Quite some years ago, when their primary uplink feed was a pair of ISDN lines to allow their censors to minitor all traffic, they lost their link from their upstream when over 50% of all traffic was spam. Their bandwidth has gotten larger since then. But really, a lot of the problem is the APNIC DNS authority, who allow fraudulent DNS sites and don't seem willing to implement an anti-spam providers. Couple that with with *no* broad standards for how to block relaying and forgery of email addresses, and you have a disaster. Folks, you need to hop over to http://spf.pobox.com and see what's going on in the new SMTP RFC's, designed to allow control over what mail is sent in your name. It's fascinating fair, and may help one hell of a lot against the viral traffic and the "forged from your domain to get past your whitelist" spam.

    28. Re:blacklists by sumdumass · · Score: 1

      Your not stupid if your smart enough to ask a question. the stupid people are the ones that don't even bother.

      Regular email servers (most anyways) have a setting for a reverse lookup. unless they are using a microsoft server wich i'm not sure if it is capable of, you can make sure the domain matches the ipadress/reply adress. I think this would solve the spoofed ip adress to a degree.

      I used to think of these settings as being real anal but latley i have seen a need for it. Also, if you look in the message source, you can see the originating ip adress even thought the mail header was spoofed. I havn't found a way to automate it, so as far as i know it is a long proccess. surley it isn't a cut and dry solution as i first thought it would be.

    29. Re:blacklists by Grishnakh · · Score: 1

      The $100 should be put into a trust fund which will be given as a reward to anyone who brings in the severed head of a spammer.

      I for one would like to see Alan Ralsky's head on a spike in a public place.

    30. Re:blacklists by Anonymous Coward · · Score: 0

      Lyndon Johnson started the 'War on Poverty' in the 1950's.

      [S]

    31. Re:blacklists by Anonymous Coward · · Score: 0
      Was it Nixon who started the first "war on drugs"?

      No, the first drug wars of the U.S. were when the U.S. and Britain sent gunboats into China to protect their importation of opium into China.

  14. Well... by Emperor+Tiberius · · Score: 1
    When you step back and look at the big picture, how many legitimate messages do you get a day, versus how many spam/viral messages you receive. Now think of the poor system administrators who receive daily calls whining about how legitimate mail was lost. To add insult to injury the EU is often also complaining about the deluge of spam.

    When you look at it, it just resembles a lose-lose situation more everyday.

    1. Re:Well... by cheekyboy · · Score: 1

      Just set the rules to NO images/media content in emails, not even those signatures with images.
      Any email with a img url in it, block it , put it in a hold folder, and send out an email to the sender telling them, try again with no images.

      This would kill 90% of the spam, the rest which is 100% text, well you can process text easier, and kill those with the 'click here to remove' urls.

      Another way to get rid of spam, is go after the companies that are in the spam, if XYZ is selling CRAP, then they should be responsible for it, or know at least WHO they used as a 3rd party to send it. Or get back at them, spam the hell out of the companies in the spam emails, generate 1000s of web pages with millions of combinations of usersnames @ company.com
      That way they will get a taste of their own medicine. If their own companies are removed from the list, then make up other bogus domain names with IPs pointing to their servers. If their own servers blow up coz they cannot handle 100000emails/hr. Then we'll be laughing because then they cant send back out or be in business.

      Better yet, lets make a DDOS email with 10000 img links to their servers in the email, and get that passed around using the spam services which would then in turn kill their own servers.

      We must figure out a way to kill the spammers using their own spam and techniques.

      Is there a website/list any where showing all companies which use spam services? Every little isp/edu and private company servers can then do a whole wide scale router firewall ban of those IPs/domains.

      Someone write a virus which will kill all the spam companies and their clients. PLEASE!!!!
      How hard can it be, just collect 100000 spam emails, analyze them, get the servers addresses, write the virus as a Paris doing it flashfile.exe. Then wait it do its work, if each virus does a few threads, and constantly does 20-30 http requests a min on their cgis or big http files, their server would croke or at least their log files would fill the HD and their ISP bill would be MASSIVE. And lots of people might not even bother to remove this virus too :)

      --
      Liberty freedom are no1, not dicks in suits.
    2. Re:Well... by VanillaCoke420 · · Score: 1

      Less than 1% is legitimate email, and that's after I have blocked hundreds of domains. Sad, really.

  15. end of email? by randomized · · Score: 4, Interesting

    Excuse me? One university gives up on spam filtering for questionable reasons and you declare death of email? Weird, I still do most of my communication via email. My servers all run spam marking services and my client filters out the junk as soon as it's retrieved.

    Of course more bandwidth is wasted on spam mails, but since I don't see much of it, it doesn't bother me so much.

    What do you propose to use instead of email? instant messaging? Talk about waste of time :)

    --
    -- shortcut - the longest distance between two points.
    1. Re:end of email? by LostCluster · · Score: 4, Insightful

      I don't think e-mail is dead, but e-mail as we know it, specificially the SMTP protocol, is long overdue for a retirement party.

      Afterall, the "from" field is a total free-response section in SMTP with no need to authenticate that you're really associated with the address you claim to be. That and other weaknesses are why spam is so hard to kill in the first place.

      We'd be in a much better place if our e-mail system at least had a trustworthy traceback facility so that we affirmatively know who sent the message by default.

    2. Re:End of Email? by tryptsoft · · Score: 1

      ...And right after I start learning to use close italics brackets. :Q

    3. Re:end of email? by log2.0 · · Score: 3, Insightful

      One problem is: who will make this specification? MS? They certainly want to.

      Once this new email2 protocol is invented, how long would it take to be implemented around the world by every admin?

      What happens when that protocol gets hacked (probably by the spammers)?

      I think its the right direction to make an email2 protocol but it wont be easy.

      --
      Can your karma go above being Excellent?
    4. Re:end of email? by bcrowell · · Score: 4, Insightful
      Of course more bandwidth is wasted on spam mails, but since I don't see much of it, it doesn't bother me so much.
      What's OK for you may not be OK for other people. Personally, I get about 200 spams a day, versus about 1-2 real e-mails. When the ratio of spam to good mail is 100:1, it gets hard to implement spam filtering that's accurate enough to do the job. And are you under the illusion that you aren't paying your ISP for the bandwidth they waste dealing with spam?

      There are some basic problems here:

      1. The e-mail protocols were never designed with the spam problem in mind.
      2. Any method for eliminating spam just encourages the spammers to look for countermeasures, viz. the current crop of spams with "pen1s" in them, or subject lines ending in "hekatomb spastic euphorbia malleus."
      3. There is no limit whatsoever to the number of spams that the spammers can generate. Any countermeasure that's based on the current protocols will break down once you hit it with a large enough volume of spam. Either it will be too slow, or it will produce too many errors.
    5. Re:end of email? by Compuser · · Score: 3, Funny

      What we really need is for our government to take
      the word(s) spamassasin literally...

    6. Re:end of email? by pommiekiwifruit · · Score: 1

      Like the Czech guy who went to the Nigerian embassey and started shooting random Nigerians cos he was sick of the spam?

    7. Re:end of email? by Sinus0idal · · Score: 1

      Oh... I thought they were already :-p

    8. Re:end of email? by duggy_92127 · · Score: 1

      Side note: when throwing up all the problems to a theory or course of action, which is a useful endeavor, it's also useful to give us your thoughts on possible solutions to those problems. Otherwise, you just come across as obstructionist and a pessimist, instead of a critical thinker.

      What do you think would be some good solutions or even brainstorms to attack these issues that you pose?

      Doug

    9. Re:end of email? by Tin+Foil+Hat · · Score: 1

      Very insightful, and of course, completely correct. However, I find my Mozilla Mail filters do a good enough job. Not perfect, no, but good enough. BTW, I also get something like 200 emails per day, and only one or two legitimate ones.

      It's not the ideal solution, but does provide a stop-gap for the present.

      --
      No matter how many of my rights are taken away, somehow I still don't feel safe. -Frigid Monkey
    10. Re:end of email? by bockman · · Score: 1
      Afterall, the "from" field is a total free-response section in SMTP with no need to authenticate that you're really associated with the address you claim to be.

      This could be addressed by a signature header in the e-mail. While it would not solve all spam problems, it could allow a certain identification of e-mail sources, and maybe lead to better filters.

      --
      Ciao

      ----

      FB

    11. Re:end of email? by log2.0 · · Score: 1

      Well, the way I see it, we need a protocol that has some kind of double verification that an email came from its real address. Then we need some kind of site where you can flag certain email addresses as spam-senders or even whole domains as "evil" :)

      These things are a little obvious but would require a lot of work. I think this or something along the lines needs to be done soon.
      We live in interesting times :)

      --
      Can your karma go above being Excellent?
    12. Re:end of email? by Compuser · · Score: 1

      It is unfortunate they slapped a "Funny" on me because
      I was not kidding.

  16. It'll never die. by DrEldarion · · Score: 3, Insightful

    Is this the beginning of the end of e-mail?

    I seriously doubt e-mail will ever die. It's FAR too convenient to just give up on. Even if it comes to the worst case scenario where you have to whitelist everyone who wants to send you e-mail, it'll never go away.

    1. Re:It'll never die. by sumdumass · · Score: 1

      I never check my email except for once or twice a week unless i'm expecting somethign. if someone has somethign to email me, there are either better off faxing it to me or calling ahead of time and tell me i have a message comming.

      i used to check my email constantly andhad certain important messages forwarded to my cell phone. it hasn't been all that hard to give it up. If it wasn't for some message boardfs i would just ignore it entirly

    2. Re:It'll never die. by Otter · · Score: 1
      Even if it comes to the worst case scenario where you have to whitelist everyone who wants to send you e-mail, it'll never go away.

      But that's the point -- there seems to be a legal issue here, not a technical one. (At least according to the linked article in German that no one would bother reading even if it were in English.)

      This could easily be the end of their email.

    3. Re:It'll never die. by Anonymous Coward · · Score: 0

      And you call yourself a geek? A pox on thee!

    4. Re:It'll never die. by Alan+Hicks · · Score: 4, Insightful
      I seriously doubt e-mail will ever die.

      I would agree, but only on a few stipulations. E-mail as we know it will almost certainly die sooner or later, to be replaced with something else that better fits our future needs. Like gopher and http, smtp, pop, and imap will all sooner or later be replaced by another set of protocols. Perhaps they will require something like SPF to reduce spoofed "From" headers. Perhaps they will support or even require encryption? Face it. Sooner or later, e-mail as we know it will die, but only when something else is able to take its place.

      --
      Slackware, what else when it must be secure, stable, and easy?
  17. 20 servers for only 100,000 messages? by whizkid042 · · Score: 5, Interesting

    Here at the university where I am a sysadmin, we get approx. 100K emails per day and we have no problem pushing them through spamassassin on a single server with dual 2.8 xeon processors. How in the world could this place possibly need 20 servers to process this much mail?!

    1. Re:20 servers for only 100,000 messages? by EvilGrin666 · · Score: 5, Funny

      I bet they run exchange.

    2. Re:20 servers for only 100,000 messages? by Anonymous Coward · · Score: 0

      And the answer is...

      Win-doze!

    3. Re:20 servers for only 100,000 messages? by chris_eineke · · Score: 4, Informative
      we get approx. 100K emails per day and we have no problem pushing them through spamassassin on a single server with dual 2.8 xeon processors.>
      RTFBT! (Babelfish Translation) They are processing 10,000 emails an hour and we don't know what kind of servers (old, old p2-233 boxen maybe?) they are using. Right now German univer-cities dn't have enough money to buy f'ing chairs and seats for their buildings.
      --
      "All you have to do is be fragile and grateful. So stay the underdog." Chuck Palahniuk, Choke
    4. Re:20 servers for only 100,000 messages? by dj245 · · Score: 5, Funny
      How in the world could this place possibly need 20 servers to process this much mail?!

      1 server processes spam, 1 processes viruses, 1 is a DNS server. The other 17 process data for the SETI@home German team.

      --
      Even those who arrange and design shrubberies are under considerable economic stress at this period in history.
    5. Re:20 servers for only 100,000 messages? by Anonymous Coward · · Score: 1, Insightful
      100K emails per day and we have no problem pushing them through spamassassin on a single server with dual 2.8 xeon processors. How in the world could this place possibly need 20 servers to process this much mail?!

      If they only processed 100,000 messages, they would have processed them long ago and thrown out the mailservers. They would no longer be necessary, given that they'd processed all the mail they're ever going to get.

      But they process 100,000 messages per hour. That's 24 times your 100,000 messages per day. Thus the need for over 20X the hardware you're using.

    6. Re:20 servers for only 100,000 messages? by kunudo · · Score: 3, Funny

      They probably run NT. :)

    7. Re:20 servers for only 100,000 messages? by Anonymous Coward · · Score: 3, Interesting

      Heck, at the ISP I run, we use eight old Netra t1's (single 440 MHz Ultrasparc) running qmail, and we run through over a million messages a day. They'd have to be running twenty 386 machines to have capacity issues with 10k/hour.

    8. Re:20 servers for only 100,000 messages? by Raven42rac · · Score: 1

      I hate to sound like a *nix fanboy, but they probably run Windows. I read a Linux magazine article about a uni in Montreal that had like 15 servers, even then that was for redundancy. Sounds like bad sysadmins than the death of e-mail. If I want a "____ is dying" headline, I will call Rob Enderle.

      --
      I hate sigs.
    9. Re:20 servers for only 100,000 messages? by some_schmuck · · Score: 4, Insightful

      er, let's see ... 10,000 messages per hour, across 20 boxes ... that's what, 500 messages per hour, per box? I'd think pretty much *any* computer worthy of the name could swing that.

    10. Re:20 servers for only 100,000 messages? by Anonymous Coward · · Score: 1, Funny

      Their software may be extremely slow, but it's the email equivalent of the Final Solution! Let's take a peak at the algorithm that is responible for slaying more than six million spam messages....

      1) Check the headers for a forged "from" address.
      2) Check the originating server against a blacklist of known spam servers.
      5) "Three, sir!"
      3) Check each word of the subject and message body against a list of keywords commonly used in spam.
      4) Check each word to make sure it's correctly spelled. This will keep them from fooling the previous filter with randomly misspelled words.
      5) Check the message for proper grammer, in case they tacked on a bunch of randomly selected word to beat the previous two filters.
      6) Take a five minute coffee break.
      7) Send an email to the message's sender asking them, under penalty of perjury, if they are a spammer.
      8) When (or if) they eventually reply, forward the original message to the proper account.

    11. Re:20 servers for only 100,000 messages? by Seumas · · Score: 5, Informative

      No, Sendmail:

      220 rzcomm5.rz.tu-bs.de ESMTP Sendmail 8.11.1/8.11.1; Mon, 24 May 2004 06:46:39 +0200 (METDST)

    12. Re:20 servers for only 100,000 messages? by Anonymous Coward · · Score: 0


      No, Sendmail:
      220 rzcomm5.rz.tu-bs.de ESMTP Sendmail 8.11.1/8.11.1; Mon, 24 May 2004 06:46:39 +0200 (METDST)



      Informative +1

    13. Re:20 servers for only 100,000 messages? by Anonymous Coward · · Score: 0

      that's still only 5,000 email an hour per machine. If the average email is 30k (!), then that's 42 only KILOBYTES a second the server must process.

    14. Re:20 servers for only 100,000 messages? by Tony-A · · Score: 1

      How in the world could this place possibly need 20 servers to process this much mail?!

      The "lower TCO" of Microsoft Windows?

    15. Re:20 servers for only 100,000 messages? by Anonymous Coward · · Score: 0

      They don't use exchange. They never would!

    16. Re:20 servers for only 100,000 messages? by @madeus · · Score: 1

      You hit it right on the nose. It seems they have incompetant system administrators or poor management who are not releasing the required funds (though given how little is required for such a system, even one offering full webmail and IMAP services, it seems the former in this case).

      Universities have a tendancy to hire cheaply, by using students or recent graduates with zero outside experiance, and so you get this kind of mismanagement of IT infrastructure. Added to this is that in Europe many are almost entirely government funded, and government IT infastructure is rarely managed well (with cronic underfunding & projects always going to the lowest bidder).

      You find brilliant academics in Universities, and Universities seem to think they can hire talented staff 'on the cheap' to run their internal systems, but the reality is the really capable students will either want to spend their time doing something more interesting, or go out and start making money - and in any case they will have little or no experience in managing infrastructure on an equivolent scale.

      IMO, where possible they should be hiring people from ISP & Telco backgrounds as the key staff responsible for infrastructure development, or at least bring them in to consult on the initial infrastucture or during revamps.

  18. Re:First Post by Anonymous Coward · · Score: 5, Informative

    Wait, don't tell me.

    1: They refused to use blacklists to cut the load.
    2: They refused to publish SPF records and use SPF to block all the email forged to look like it's from their domain, significantly cutting the spam load.
    3: They used one of those "commercial-grade" virus/spam mail scanners that's designed to use entirely Bayesian scanning without ever setting time-outs on the generated rules, and which was written for "completeness", not speed.
    4: They forgot to set up a honeypot machine to auto-block spam domains.
    6: They underbudgeted for the servers to actually do the mail handling, forgetting to set up up appropriate MX records with good fallover behavior, so when any of their served domain's MX record listed machine blinked that entire domain went offline.
    7: They're using MS Exchange SMTP servers, which bog down incredibly under load, especially if you run any separate service such as spam processing.

  19. Google translates by Anonymous Coward · · Score: 1, Informative
  20. Another riduculous law! by edoc · · Score: 3, Interesting

    "Because of the legal obligation to deliver all mail and of the delay time exceeding critical 5 days(!)"

    Is it just me or is this another ridiculous law? The University is providing free email services to those that are students at this establishment and they obviously need to filter out spam in order to be able to offer this service with there current hardware requirements. Spam is a legitimate problem and people that are offering free email services should be allowed to attempt to filter it as it can be extremely taxing on a busy mailserver. They can filter the spam without being intrusive or breaking privacy laws so I see no reason that it should be prevented by law.

    1. Re:Another riduculous law! by LordLucless · · Score: 2, Insightful

      Are they providing free internet access? Or are the students paying for it, directly or indirectly? Because if they're paying for it, and legitimate mail gets lost due to the Universitys system, that's probably a basis for somebody to sue them. Failure to provide a service that was paid for. The Uni probably can't take the risk of legal action.

      --
      Just because you're paranoid doesn't mean there isn't an invisible demon about to eat your face
    2. Re:Another riduculous law! by LostCluster · · Score: 1

      I'm not quite sure it's a legal obligation as much as one from the people who pay the bills. Afterall, what good to the University is an e-mail system that takes 5 days to process e-mail that's coming in from the outside?

      I'd take it that they'd start having problems with governement funding programs who'd no longer want to do business with them when they're that slow in responding.

    3. Re:Another riduculous law! by Fulcrum+of+Evil · · Score: 1

      Is it just me or is this another ridiculous law?

      No, the law is fine. The problem is that certain lawmakers (and probably lawyers, too) fail to realize that Email is not mail. It just sounds like mail - we have no reliability infrastructure beyond TCP and disk-backed storage, so there's no possible guarantee wrt email.

      --
      "We returned the General to El Salvador, or maybe Guatemala, it's difficult to tell from 10,000 feet"
    4. Re:Another riduculous law! by AndyChrist · · Score: 4, Informative

      Some university departments run on email. If you don't deliver reliably, you could create chaos in some classes.

    5. Re:Another riduculous law! by edoc · · Score: 1

      However, they obviously would not be filtering out communications from classes or student to student. The filters that they were using from the article seemed to be filtering only obvious SPAM (ie. porn etc.). The spam could also be considered to be a hinderance to delievering the email reliably. The filtering mechanisms that are available now are very effective and efficient.

    6. Re:Another riduculous law! by jak163 · · Score: 1

      Yeah free if you pay tuition.

    7. Re:Another riduculous law! by Anonymous Coward · · Score: 0

      It is not an essential service of a College or a University and in many places is being setup for free by the CS department.

    8. Re:Another riduculous law! by Tim+Browse · · Score: 1

      Heh. A government run dept. who won't deal with you because you're too slow when responding.

      That's a good one! :)

  21. Real Time Blackhole Lists by OldMiner · · Score: 5, Insightful

    Personally, if it were my universtiry, I would prefer they started to use a RTBL. The fact of the matter is, if the likely spam isn't sorted out first, I have to try to discern the stuff entirely by hand. And although I can easily pick out Viagra ads, I have relatives and the occasional acquaintence who send mail that looks awfully like spam. Didn't want to type a subject. Used "hello" as the subject. Didn't configure their mail client properly, so their "replyto" looks crazy. Without some initialy spam filtering, I would miss at least some of these -- in fact, I'd probably miss more mail with no filtering than with a judicious blackhole in front of me.

    Love or hate SPEWS and other kinder, gentler RTBLs, they're better than the present choice. It would certainly reduce the load of these email servers to where it could be more easily handled. And, if nothing else, they couldbe used to prioritize mail. Use Spam Assassin or something else to do some initial tag and filter so that mail coming from Asian IPs or originating from mail servers on cable/ADSL networks gets put into the "slow" processing queue while everything else gets sent down the faster pipe.

    </spouting with little to no knowledge>

    --
    You like splinters in your crotch? -Jon Caldara
    1. Re:Real Time Blackhole Lists by Anonymous Coward · · Score: 1, Insightful
      The point is, they can't use these blocklists. They're legally obligated to deliver anything that is addressed to one of their users. Dumb, but a valid concern for that kind of institution in Germany.

      I'm one of the guys who wears the mail admin hat an an Australian university (no, I won't say which one) and running "grep spamcop * | grep -c blocked" over today's mail logs (14.25 hours worth, and counting) gets me 1379, no 1384, no 1388 messages blocked so far today. 1398. 1400.

      1402. 1405. I'd love to be more aggressive in our rejections, but the UberAdmins here tell me they've tried and been hamstrung by the need for Universities in particular to be open to (1415) mail our students may need to send us from China, Brazil or (1420) hijacked DSL connections.

      But even Spamcop has its limits. One porn spammer towards the end of last year (before I decided to look for different windmills to tilt at) had a whole Class C he was spamming from, and switched originating IP addresses in an attempt to get past SpamCop. Worked reasonably well, too. Pity his lists were so bad - almost all of the addresses were invalid, so we bounced them, only to get the bounces rejected by their servers, so nearly 1000 pieces of re-bounced spam was ending up coming to Postmaster here per day from these low-lifes at their peak. 1430. We were blocking nearly 10,000 pieces of crap from those clowns per week for a couple of weeks. 1432. 1433.

      Maybe I should put a "XXXXXX spams blocked today" counter on my webpage... 1435... 1437... 1444... 1445...

    2. Re:Real Time Blackhole Lists by Anonymous Coward · · Score: 0

      Hmm - Karmatic here - just curious, why do you hate me so? I'd managed to avoid any freaks, but you have broken my streak.

    3. Re:Real Time Blackhole Lists by Anonymous Coward · · Score: 0

      > I have relatives and the occasional
      > acquaintence who send mail that looks
      > awfully like spam.

      You need new relatives.

  22. Not the end of email by Brad+Mace · · Score: 1
    Stories like this bring us closer to universal, homicidal rage against spammers. Blacklists don't look so fascist now, do they?
    How bad do you really need the spam countries on the internet?


    Spammer's disregard for the public good will force us to either put them all in guantanamo or move to email v2.0 . Either way, they'll be completely shut down.

    1. Re:Not the end of email by Tezkah · · Score: 2, Informative

      Yeah, who needs those stupid spam countries?


      You, for example, if you live in the US or Canada, or Europe... or.... you get the picture.


      Certainly, nobody likes the current situation, but suggesting that we send spammers (or people whos boxes have been hijacked by spammers) to prison camps without charge or bomb their countries (How'd you fix the economy? Bomb it?) is clearly stupid.

    2. Re:Not the end of email by Backov · · Score: 2, Funny

      No, really both those options sound good.

      --
      In the law there is no overlap between theft and copyright infringement whatsoever.
    3. Re:Not the end of email by dmaxwell · · Score: 1

      Stories like this bring us closer to universal, homicidal rage against spammers. Blacklists don't look so fascist now, do they?

      Preach on brother. Normally I'm against the death penalty. In the case of spammers, not only am I for the death penalty I'd replace the switch with a dial so it would last longer.

    4. Re:Not the end of email by dejamatt · · Score: 1
      Stories like this bring us closer to universal, homicidal rage against spammers.
      Can we add universal, homicidal rage against the idiots who are dumb enough to send money/reply to the spammers?

      Maybe I'm wrong, but it seems like if everyone were ignoring emails that had subjects like "northland elicit blest voltage calorimeter..." then spam would go away... since there would be no money in it. So, apparantly there are people in the world dumb enough to do business with companies that send emails like:

      I can recommend ano ther company that can provide you with 2.3 % fi xed ra.te for 20 ye ars. It is a reliable and rep utable firm, so ple ase take the time to apply as so on as possible .
  23. Client Side Filters by cbreaker · · Score: 2, Insightful

    The students and other users of their mail system will just have to use their own spam filters now.

    It's not the end of the world. There's a few good spam filters for outlook and outlook express, and some really awesome free ones for linux/unix.

    --
    - It's not the Macs I hate. It's Digg users. -
    1. Re:Client Side Filters by Too+Much+Noise · · Score: 1

      Give it enough traffic and you'll see the server dying sooner with individual filtering. Think of all those procmail+spamfilter processes that will be launched by every user for every email ...

      I wonder whether the junk folder approach would have been better (assuming there's such a law about having to deliver all the mail, better deliver the probable spam separately).

    2. Re:Client Side Filters by cbreaker · · Score: 1

      It's true to a degree; but the procmail stuff will only launch on the server if they have shell accounts and do their mail from the server itself.

      I'm guessing most students pop into their mail, download it, and the spam filter would take it from there.

      Before, their mail servers had to process all the spam themselves anyways, so at least that load is now gone..

      It's a silly descition if you ask me, but I'm sure they will be able to afford some new beefy linux boxes to handle it, being a university and all.

      --
      - It's not the Macs I hate. It's Digg users. -
  24. The begining of the end by secolactico · · Score: 1

    Is this the beginning of the end of e-mail?

    As we know it? I could only hope so. Nothing's gonna change, tho, until one of the many proposed methods of sender authetication is adopted as industry standard. But I'm not holding my breath.

    I get so much spam everyday in my work account, that I'm not even annoyed anylonger. I've come to accept it as a fact of life on the internet... ain't that sad? At least with such a large amount of sample e-mail, my Popfile hasn't had a false positive/false negative in months.

    --
    No sig
  25. Encouragement to spammer by fembots · · Score: 2, Interesting

    This kind of shutdown is only going to encourage spammers to send out even more junk mails.

    Now they know that most servers will eventually not able to cope up with the traffic, they might as well send out randomly-generated '@domain.com' spams until the admin gave in.

  26. Re:I wish . . . by Anonymous Coward · · Score: 0

    Makes you wonder doesn't it? Imagine how quickly it would get legistlated into oblivion if goverment IT departments around the world suddenly had no email filters. They'd probably call it terrorism...

    Hey Ralsky, how'd ya like to visit Guantanamo?

  27. Is this the beginning of the end of e-mail? by Anonymous Coward · · Score: 0, Troll

    Like all questions posed in Slashdot's blurbs, the answer is NO! This is one university we are talking about. Count them: one. Hope that answers your question. Bye now.

  28. Self-Destructing E-Mail helps by MikTheUser · · Score: 5, Informative

    www.spamgourmet.com has always worked well for me. Give your adress to whom you want, receive just as much mail from them as you want.

    1. Re:Self-Destructing E-Mail helps by blaberski · · Score: 1

      Exactly

      While its not the perfect solution, it does work. Plus you can see exactly who the spam is coming from.

      So if all of a sudden you get a bunch of spam on a spacific address, you just kill the address.

      It does have problems though, you really can't use it for a conact on a website since you would probably go over the limit rather quickly.

      But hey, it a little something to fight against the most commom way you get on spammers list.

    2. Re:Self-Destructing E-Mail helps by Anonymous Coward · · Score: 0

      It isn't hard for spammers to circumvent spamgourmet addresses. The big problem is that a throw-away address is created the first time an email is sent to that address; the email is then forwarded to you. A spammer can then just create throw-away adresses for you whenever he wants and send you as much spam as he likes.

    3. Re:Self-Destructing E-Mail helps by KD5UZZ · · Score: 2, Informative

      Have you actually used the service? You can specify how many messages you recieve from EACH address you give out. You can reset the counters anytime you want. You can also DISABLE the counter at any time. Its a great service!

      --
      -Daniel
      KD5UZZ
      www.w5yj.org
  29. Beginning of the end? by nurb432 · · Score: 5, Insightful

    No, but its one more nail in the coffin..

    Something has to be done soon or email just wont be practical to have. Between Spam and viruii its overloading a lot of comanines network feed and servers..

    And don't forget the cost of having to maintain antispam and antiviral solutions..

    I know personally where I'm at, we are hitting over 2/3 of all email is spam/virus. ( i hear we drop 10k a day from the black hole list alone )

    At home its 98%...

    --
    ---- Booth was a patriot ----
    1. Re:Beginning of the end? by G.+W.+Bush+Junior · · Score: 1

      viruii? :)
      Is this some kind of attempt to compromise between the correct form "viruses" and the wrong "virii"?

      --
      "I don't know that Atheists should be considered as citizens, nor should they be considered patriots." -George H.W. Bush
    2. Re:Beginning of the end? by Anonymous Coward · · Score: 0

      At my school, the spam ratio is 99.8% ... Gah, I don't even open my box anymore.

    3. Re:Beginning of the end? by Raven42rac · · Score: 1

      I feel your pain. Our 500 employees drop ~2,000 spam s a day into a public folder we use for blocking. That is on top of the thousands a day we already block, and the hundreds we tag as possibly being spam. I checked one guy's account with him, and he had over 5,000 spams. He had not checked the account in about six months. I think spam blocking and virus scanning will slowly just become a fact of life. I made an online spam counter for my home PC, since January 12 it is up to ~8,000. I check it from work every once in a while. The only way to combat spam would be to make it cost the sender money. How that would get done without inconveniencing many more people, I do not know, but I think that the vast majority of us would rather pay a nominal fee than put up with the rising costs of fighting spam.

      --
      I hate sigs.
  30. Parasites by Merlisk · · Score: 3, Interesting

    One would think that even spammers would realize that if things go too far, businesses might not carry emails at all anymore.

    I mean, even parasites usually try to not kill the host.

    *sigh*

    --
    Failure is not an option. It comes bundled with your Microsoft product. -- Ferenc Mantfeld
    1. Re:Parasites by dougmc · · Score: 3, Insightful
      One would think that even spammers would realize that if things go too far, businesses might not carry emails at all anymore.
      Yes, but suppose you're a spammer. A big-time spammer, but still just a single person. You're worried about killing the goose that lays the golden egg, so you cut the spam that you emit by 90%. Your income drops by 90%, but the total spam sent world wide drops by, oh, 0.5%?

      Even if the spammers band together and make a big organziation to self organize and police, spammers by almost by definition dishonest (no honor among theives!), and as soon as one realizes that he can make more money by ignoring the organzation (i.e. almost immediately), he will.

    2. Re:Parasites by conan776 · · Score: 1

      >I mean, even parasites usually try

      >to not kill the host.

      Yeah, well it's the same old

      Tragedy of the Commons

      --
      "Reality is that which, when you stop believing in it, doesn't go away." -- Philip K. Dick
    3. Re:Parasites by Dimensio · · Score: 1

      I mean, even parasites usually try to not kill the host.

      Spammers are dumber than your average parasite. A lot dumber.

    4. Re:Parasites by DraKKon · · Score: 1

      Did you know that over 70% of statistics are made up on the spot?

      --
      "It's not like your minds are as open as the source you love..." - Me to the majority of Slashdot.
    5. Re:Parasites by cpghost · · Score: 1

      The ROKSO list says otherwise. Stop 10 top spammers, and the spam will likely decrease by over 90%. It's not the small spammers who are flooding the net, it's a bunch of a few criminal individuals. Of course, you'll have to keep up the fight, since other sociopaths will gladly take the place of those top-10 spammers...

      Unfortunately, most of ROKSO are living in the Land of the Free, where they are unlikely to be prosecuted effectively [CAN-SPAM] :-(

      --
      cpghost at Cordula's Web.
    6. Re:Parasites by dougmc · · Score: 1
      The ROKSO list says otherwise. Stop 10 top spammers, and the spam will likely decrease by over 90%.
      Ok, fine. Suppose you're the #1 spammer in the world (responsible for 20% of the world-wide spam sent), and you suddenly grow a conscience, and decide to reduce your spam volume by 80%. Big whoop -- instead of getting 1500 spams/day, I now get 1260 spams/day. And as you mentioned, the other spammers will soon pick up the slack.

      Spammers are indeed ruining email -- I know lots of people who no longer check their email at all -- but they're not going to stop until they're forced to.

    7. Re:Parasites by fingerfucker · · Score: 1

      Mod parent up. This is hilarious!!!!

  31. Reject at SMTP time solved the problem.. by E-Prime · · Score: 4, Interesting

    I run Exim with an ACL extension called Exiscan, which runs SpamAssassin and virus checker during the SMTP dialogue.

    Rejected mails thus don't generate any undeliverable bounce messages to fill up the local mail queue, and the sender gets an immediate response.

    1. Re:Reject at SMTP time solved the problem.. by autosepha · · Score: 1

      I'am not an expert, but it think that the SMTP specs say that the decision whether an incoming email will be accepted or not has to be taken on the basis of the MAIL FROM and RCPT TO fields.

      How can you guarantee with such non-standard behavior that the other MTA does not mistake this for a transmission error and retries the delivery several times? I couldn't find an error code to signal "never come back with this message".

  32. Offtopic.......but by Anonymous Coward · · Score: 2, Informative

    Having gone through German, I find that WorldLingo.com returns a much more accurate translation than Altavista.

  33. So? by Anonymous Coward · · Score: 2, Insightful

    We shut off our email filters too. No need for them now that we go through Postini (http://www.postini.com). They filter the spam before it hits your server, then give each user power to customize their filters and view caught messages.

  34. In tomorrows news by wheels4u · · Score: 3, Funny

    University capitulates. /. visitors break down apache server. Oh .. i mean IIS server.

    --
    11 1101 1011111 0100 000 110 1011111 0101 10 01 1011111 101 1 011 1011111 0 1111 11 111 1011111 101
  35. You're right about your German by Anonymous Coward · · Score: 0

    Aber es ist nicht gut... ;)

  36. End of Email? by tryptsoft · · Score: 0, Flamebait
    Is this the beginning of the end of e-mail?

    Yeah, just after Microsoft goes bankrupt and we all stop jacking off to pr0n.

  37. I get no spam by kunudo · · Score: 1

    thanks to spamgourmet.

  38. No filter day by reynaert · · Score: 2, Interesting

    Maybe there should be an n-monthly day on which spam-filters are disabled. That way the public may realize the extent of the spam problem. Can you expect that they know it when they only get a few spams because all the rest is blocked at the server?

  39. I attempted a translation of the article in German by Milo+of+Kroton · · Score: 1
    About halfway through the second paragraph, I gave up. But I can understand it better than I can translate it into sane readable English.

    I took four years of German in high school, and what do I have to show for it?

    The Central Mail Server has been clogged up by an overload of Spam/Virii and has been interfereing with governmental affairs. The rest is people talking about non-delivery reports. If you really care, find a German speaking geek in your life, or struggle with the Babel Fish.

  40. It's the good old by Anonymous Coward · · Score: 0

    "My 100'000 e-mails a day isn't toppling the system... it's the 10 other millions, and I don't send nearly that much"

    The problem is never with you, remember?

  41. Reverse DNS to MX record checking.... by kraemer · · Score: 4, Informative

    Why dont these people start using reverse DNS to MX record verification? It checks to make sure the machine sending you email has a real reverse DNS that matches their MX record. If not, it disconnects. Combine that with the real time black hole list and you'll never see spam again! This mail package does it: Icewarp

    1. Re:Reverse DNS to MX record checking.... by Anonymous Coward · · Score: 2, Informative

      Why dont these people start using reverse DNS to MX record verification? It checks to make sure the machine sending you email has a real reverse DNS that matches their MX record. If not, it disconnects.

      That really isn't a good idea - you will reject a lot of legit mail as well. There are lots of cases where that isn't true. If SPF becomes common, then you can implement that, but the legit receiving mail server is very often not the legit sending mail server for a domain.

    2. Re:Reverse DNS to MX record checking.... by kraemer · · Score: 1

      Not neccesarilty. It only checks against the IP of the machine making the connection. So you could have like a hundred domains on one IP address as long as that IP address has a real reverse DNS and an MX record for that DNS entry. What this does is completely kill "slave" spam machines that have been taken over by worms....

    3. Re:Reverse DNS to MX record checking.... by slashdot_commentator · · Score: 1


      Legit email will be lost, because they originate from crappy email services.

      Also, you're forgetting there still is a CPU/network cost in running the reverse DNS/MX check. It may not be feasible, given their resources.

      --
      There is no America. There is no democracy. There is only IBM and AT&T and DuPont, Dow, General Electric, and Exxon
    4. Re:Reverse DNS to MX record checking.... by user32.ExitWindowsEx · · Score: 1

      It also kills people trying to send e-mail from places they don't have control over the reverse dns of. I have a domain that I send mail from, but since I'm operating at the good graces of my college admins, I consider myself lucky to be running the box...and am not even going to ask for reverse DNS.

      --
      "Evil will always triumph because good is dumb." -- Dark Helmet
    5. Re:Reverse DNS to MX record checking.... by yem · · Score: 1

      Anyone on a dynamic IP is basically screwed, right?

      --
      No, I did not read the f***ing article!
    6. Re:Reverse DNS to MX record checking.... by beakburke · · Score: 3, Insightful

      No, you should be using a MAIL SERVER that has an A record anyways. It's not that you can't send mail, you just can't run the SMTP server on a machine that you can't do a reverse-lookup on.

      --
      ----- Question authority, but not ours. Hate the man, but we're not him.
    7. Re:Reverse DNS to MX record checking.... by Zoop · · Score: 1, Informative

      True, but you're going to get a lot of false positives.

      Consider that they host with one company and have a dynamic app that sends confirmation or other e-mails (through a confirmed opt-in system, of course). That system has the FROM: set to some address of the organization, not the Web host, so they can get replies. The Web host only hosts their Web site, but the MX is pointing to another system entirely that handles their internal mail. The two won't match, and you'll throw the message away. Very annoying when you wanted to get the link to download that document on the impact of AIDS on the economy of Liberia--or your pr0n.

    8. Re:Reverse DNS to MX record checking.... by dcam · · Score: 1

      Here's why. I own a domain name that I bought so that I could have an email address that is independant of any ISP. There are other advantages, but that is the main one. For a modest amount I have it hosted somewhere, and the people who host it also host the POP box.

      However my ISP is different from the people hosting my site, so my emails are routed through my ISPs mail servers. Hence your suggestion would have problems for people like me.

      I know sooner or later I'll have to set up a mail server and web server and buy a business DSL account (or use dynamic DNS) but right now this is a very convenient (and cheap) solution for me.

      All that said, Reverse DNS checking only partically solves the problem of spam, namely it helps with the problem of correctly identifying where spam comes from. This isn't much help when we live in a world where there are whole networks of trojanned zombies and ISPs willing to swap spammers IP addresses througout their range.

      --
      meh
    9. Re:Reverse DNS to MX record checking.... by Burning1 · · Score: 1

      Lots of people use different servers for incoming and outgoing email. The outgoing servers won't have a MX record.

    10. Re:Reverse DNS to MX record checking.... by Random832 · · Score: 1

      suppose the reverse dns for the server that's trying to talk to you is outgoing-smtp.foo.com; the MX record for foo.com is incoming-smtp.foo.com. (and "outgoing-smtp.foo.com" lacks an MX record - no-one sends to somebody@outgoing-smtp.foo.com, so all are happy with this situation) the solution proposed in grandparent rejects this mail.

      --
      We've secretly replaced Slashdot with new Folgers Crystals - let's see if it notices.
    11. Re:Reverse DNS to MX record checking.... by Andrew+Cady · · Score: 1

      Sure you can. If you are checking reverse resolution how do you run two domains on a single IP? No, what you do is check the -domain- the sender claims to have and its MX record. Update the MX record dynamically to run an SMTP server on a dynamic IP. (It's not totally safe but it'll work well enough for the types who would do it).

    12. Re:Reverse DNS to MX record checking.... by Anonymous Coward · · Score: 0

      Nope, dont forget that a SMTP server doesnt require a MX record as per the RFC.

      The RFC *does* state that a mail server MUST have a rDNS entry though. Far too many stupid admins dont have email servers with rDNS and Ive had to dump that as a filtering rule

    13. Re:Reverse DNS to MX record checking.... by beakburke · · Score: 1

      They aren't saying that you have to have an MX record, just a valid reverse address, as opposed to DYN-diailup108.aol.com.

      --
      ----- Question authority, but not ours. Hate the man, but we're not him.
    14. Re:Reverse DNS to MX record checking.... by Random832 · · Score: 1

      the original proposal says your reverse address's MX record has to match your IP. (and, in the system you propose, how do you tell a machine how to qualify DYN-dialup108.aol.com as "invalid"? sure to you and me it's just dialup)

      --
      We've secretly replaced Slashdot with new Folgers Crystals - let's see if it notices.
  42. FUD ALERT, FUD ALERT by DeadPrez · · Score: 2, Funny

    The university probably doesn't pay much but there are many unemployed American citizens such as me who would welcome the opportunity to visit Germany and solve your spam problems. All the facts of this article suggest the problem is in implementation, not in technical feasiblity.

    1. Re:FUD ALERT, FUD ALERT by JohnsonWax · · Score: 1

      Hmm, they should outsource the problem to a country with cheaper/more available technically skilled labor.

      That's a great idea! We should try that in the US!

  43. Solution for US residents by Anonymous Coward · · Score: 1, Insightful


    set up a SPAM filter; send all filtered SPAM to Senators/Representatives who voted *for* the CANSPAM bill.

    Inform them that they can stop receiving your forwarded SPAM when they enact legislation which puts an effective stop to it.

    1. Re:Solution for US residents by benna · · Score: 1

      That's the best ideas i've ever heard!

      --
      "It is not how things are in the world that is mystical, but that it exists." -Ludwig Wittgenstein
  44. Mod up, the world needs to know... by kunudo · · Score: 1

    I'll second that. Spamgourmet is nice, I get no spam... :)

  45. Specs of the servers? by PurifyYourMind · · Score: 2, Interesting

    Anyone know the specifications of the 20 servers they were using? 100,000 messages isn't that much. Five day delays? Did I read that right?

    1. Re:Specs of the servers? by soccerisgod · · Score: 1

      Knowing them (I can see the building the servers are in from my window right now) I suspect some mustered-out Sun workstations.

      I must say I was pretty surprised by this. They have an active LUG and all and I really thought they could handle something like this. Seems I was wrong. Or perhaps they didn't give it enough attention and now need time to fix it - eg block most asian IPs, install a lower cpu usage spam filter etc.

      --
      If a train station is a place where a train stops, what's a workstation?
    2. Re:Specs of the servers? by oojah · · Score: 1

      When I was at TU-BS for a year about three years ago they had HP machines everywhere.

      That doesn't mean their servers are HP as well, but it could be a fair indication.

      This was three years ago mind.

      Cheers,

      Roger

      --
      Do you have any better hostages?
  46. Whore! by Anonymous Coward · · Score: 0
    Most slashdotters don't know, but heise.de is a very strong backbone in Germany. Slashdot couldn't take it down.

    On a side note, slashdotters now have an excuse for not reading TFA: "I don't speak German!"

  47. Wish my university would get rid of filters by foidulus · · Score: 5, Interesting

    I go to Penn State, but since the university feels it has to protect dumb windows users from themselves, I cannot even send or recieve email with the subject, "Hi such-and-such"(Try explaining to a friend overseas who has almost never in her life touched a computer, in her language, why she can't send you mail with that subject) because it might contain the bagle virus. This is the same university that put in a firewall because supposedly too many people on campus had a butt-load of viruses and spyware.
    Yet this same university loves to publish my email address on the web; ensuring I get tons of spam(some even in Chinese!)
    I hate when the community at large has to pay for the transgressions of a few slimeballs and the idiocy of some(not even most) gullible windows users.

    1. Re:Wish my university would get rid of filters by System.out.println() · · Score: 1

      (not even most)

      You sure about that?

      Most likely you only talk to other geeks, but keep in mind that the majority of the people who use the internet are NOT smart about viruses and spam.

    2. Re:Wish my university would get rid of filters by TykeClone · · Score: 1

      That's a Big 10 school for you!

      --
      A fine is a tax you pay for doing wrong and a tax is a fine you pay for doing all right.
    3. Re:Wish my university would get rid of filters by sailor420 · · Score: 1

      Thats a shame. Here at UNC, we have a pretty good email/virus policy. All emails are scanned for spam (and pretty damn well, too--I have gotten a grand total of 6 spam emails in the year I have been there). Instead of locking down the network (ie the firewall you were talking about), they let you police yourself--but if they detect any virus traffic coming from your machine, the network immediately knocks you off, and the user must come to tech support to let them clean the machine and authorize it to be put back on the network.

      Fortunately, we have an IT department that takes a fairly hands-off, police yourself approach. They let you use the network for whatever you want, but as soon as it starts to cause any sort of problem, you know about it (usually by being bumped off). I really think this is a better solution than schools with draconian rules about usage--such as limiting badwidth to 1GB a day, putting up huge firewalls, etc.

    4. Re:Wish my university would get rid of filters by foidulus · · Score: 1

      The bandwidth in the dorm is limited to 1.5 GB/wk and they have somehow found people who download music and taken them into disciplinary meetings, it's pretty hardcore.

  48. Don't be so naive by Shamashmuddamiq · · Score: 2, Interesting
    I have several accounts that I have given to nobody -- not friends, relatives, or even my wife -- for the purposes of testing whether or not they would get spam. Several of them are receiving spam. Even my root account is getting spam (though that's not so hard to guess). I'm not sure how the spammers' guessing algorithms work, but they do a pretty good job.

    In addition, I have two accounts that I use regularly -- one that I give to everyone (web registration forms, etc) where I don't care about spam, and another one that is personal and I only give to close friends. Guess which one gets more spam? That's right. My personal account gets about 150 per day. My "don't care" account gets like 6 per day. They have both been active for many years.

    --
    ...just my 2 gil.
    1. Re:Don't be so naive by Anonymous Coward · · Score: 0

      Family members have an annoying habit of "referring" me to spammers.

  49. HAHAHAHAHAHAHAno. by Anonymous Coward · · Score: 1, Funny

    shut up, karma whore. no double +5 funny for you!

  50. Spammers may adapt by Anonymous Coward · · Score: 0
    Here is a noble idea - the spammers may finally wake up and send you no more than 1 advertisement a day. After all, 1 message, 50 messages for penis enlargment. They all get the same result - delete. Some guys may need it but not me. Besides changing what you have could cause problems. Do you really want to invite problems down there?

    Side from that, we could bring back burning at the stake and other tortures for spammers. Here is a fitting idea - for those who are male and send out penis enlargement ad's, make them have sexual reassignment surgery and give 'em big boobs! They should have to check in yearly to make sure they are still female and with big boobs.

  51. Block Direct Access, use upstream MX record by just+someone · · Score: 2, Insightful

    98% spam and virus's? Damn. Think that the mail is coming from campus.

    Outside world:
    Block direct contact to the mail servers, use an upstream MX record.

    Inside world:
    authenticated SMTP.

  52. No, sendmail by marnanel · · Score: 5, Informative

    7: They're using MS Exchange SMTP servers, which bog down incredibly under load, especially if you run any separate service such as spam processing.

    Nah, it's sendmail:

    $ dig -t MX tu-bs.de
    [...]
    tu-bs.de. 172738 IN MX 10 rzcomm5.rz.tu-bs.de.

    $ telnet rzcomm5.rz.tu-bs.de smtp
    Trying 134.169.9.40...
    Connected to rzcomm5.rz.tu-bs.de.
    Escape character is '^]'.
    220 rzcomm5.rz.tu-bs.de ESMTP Sendmail 8.11.1/8.11.1; Mon, 24 May 2004 04:00:51 +0200 (METDST)
    --
    GROGGS: alive and well and living in
    1. Re:No, sendmail by Cheile · · Score: 5, Insightful

      That may not actually be the server handling the mail though. It's rather common to have a sendmail/postfix mail forwarder on the outside that forwards all mail to/from the Exchange server on the inside.

    2. Re:No, sendmail by orin · · Score: 1

      This may be the case. It may not be.

      It is a much longer bow to draw to assume a more complex mail topology (Sendmail as an SMTP relay to an internal Exchange infrastructure) than it is to assume a native Sendmail infrastructure or a native Exchange infrastructure.

    3. Re:No, sendmail by mcsmurf · · Score: 1

      I think they don't think they use the MS Exchange Server, because this site doesn't mention Windows is used as a operation system.

  53. they won't switch away from email by millahtime · · Score: 1

    They won't switch away from email all together. They will get a free yahoo or hotmail address. I mean, it would be less spam.

  54. Ideas for a new email protocol... by rice_burners_suck · · Score: 4, Insightful
    Is this the beginning of the end of e-mail?

    I would say this is probably not the end of email, nor is it the end of the Internet as a whole. However, it is probably the end of the protocols currently used to send and receive email.

    I believe that spam is ultimately a security issue, because it slows down systems and creates problems for users and system administrators. Sometimes, security problems are caused by buffer overruns and other programming errors. However, in this case, I think the entire protocol is faulty. It may have worked wonderfully before spammers, but it's time to introduce something new that will make it extremely difficult to send spam.

    I don't know exactly how the new protocol needs to look. But I have some ideas. Paying for "postage" is not one of them, as I think it is a very bad idea. Unless some payment system could be set up whereby the recipient of the mail receives the payment, not some 3rd party, like Microsoft, which would profit incredibly from garbage spam mails going all over the place. In fact, if that were the setup, then each recipient could state a price per email and/or per kilobyte of the mail message for receiving an email from a source, which the source would pay to the recipient as postage. A whitelist could be set up to allow certain senders, like one's friends, family, coworkers, etc., to send emails without paying the recipient. A blacklist could be set up to disallow all emails from specific senders and/or domains, as we have today, and if you read further in this post, you'll see my ideas for making sure that addresses are not spoofed. But I digress...

    Perhaps first of all, the mail headers need to include digital signatures based on the source and destination domain names, email addresses, and other identifying information that is unique to each email sent. To avoid address spoofing, for example, people sending junk with a 'yahoo' or 'hotmail' address, when in fact it originates elsewhere, each such domain would have a private key, which upon sending, would be used in the computation. A valid signature could not be computed when the address is spoofed, and so all spammers would need to use their own valid domain name. Further, the need to make computations would make it more costly for spammers to send mail in high volumes. The algorithm should be designed so that recipients of email will have a much lower cost to verify the key. Further, the signature system could, should, and would be used to verify that each bit of the contents of the email, including all attachments, arrived correctly and without being tampered with or corrupted in transit.

    1. Re:Ideas for a new email protocol... by idesofmarch · · Score: 1
      It is great that you are thinking of ideas, but you really should read the ton of material that has already been published on this, and you will see the pros and cons of what you are talking about.

      Your first proposal is way too complex. If we are going to overhaul something, it should not require any additional tweaking, such as using whitelists. Your second proposal places a great deal of power and trust (and additional revenue) in the hands of the Certificate Authorities. People like running their own mail servers without having to pay for certificates, which can run $100 per year or more.

    2. Re:Ideas for a new email protocol... by davburns · · Score: 1
      If spam is a computer security problem, then it is the Security Policy for email (not protocols or anything else) that is at fault.

      The Security Policy for email was once "Anyone on the internet may append to my mailbox." This worked reasonably well when the Internet was hard to get onto and misbehaving on the network could get you or your site kicked off. Now that services like finger and publicly availible directories are becoming rare -- people are turning this into "Anyone who knows my email address may append to my mailbox." This essentially makes email addresses a plaintext password that one gives out to all of one's friends, and hopes they won't leak it to a spammer. (This actually works for some people. Others get deluged in spam because their friends pass on forwards or infect themselves with viruses.)

      What people really want is closer to "People who aren't jerks may append to my mailbox, as long as the content of what they wish to append is not spam." -- But this requires that a list of "jerks" be kept, and senders authenticated to make sure that they're not on the list of jerks. (Note that one cannot authenticate an anonymous sender, so that part is really impossible. Even if the sender can authenticate the message to their domain, well, domains are cheap; spammers will just use a different one for each run of spam.) This also requires a content check to see if a message is "spam." I haven't proven it, but I belive this is equivelent to a turing test. At the very least, a spammer can still send a million messages to an address, and a filter that catches only 5 nines' spam will deliver ten bad messages. (Fortuneatly, spammers aren't smart/desperate enough for this -- yet.)

      So, if spam is a computer security problem, then email as we know it is doomed. On the other hand, if spam is a social problem, a criminal problem, or something else, then maybe we have a chance.

      I think that spam is a combination of several problems, and we can reduce it to "acceptable" levels with a combination of measures. Filters and blacklists help. Throwing the worst of the spammers in jail would help. Cleaning up zombie networks helps a lot. Filtering port 25 out from groups of machines likely to be compromised helps (but at some cost).

    3. Re:Ideas for a new email protocol... by Anonymous Coward · · Score: 2, Funny
      Your post advocates a

      (*) technical ( ) legislative ( ) market-based ( ) vigilante

      approach to fighting spam. Your idea will not work. Here is why it won't work.
      (One or more of the following may apply to your particular idea, and it may
      have other flaws which used to vary from state to state before a bad federal
      law was passed.)

      ( ) Spammers can easily use it to harvest email addresses
      (*) Mailing lists and other legitimate email uses would be affected
      ( ) No one will be able to find the guy or collect the money
      (*) It is defenseless against brute force attacks
      (*) It will stop spam for two weeks and then we'll be stuck with it
      (*) Users of email will not put up with it
      ( ) Microsoft will not put up with it
      ( ) The police will not put up with it
      (*) Requires too much cooperation from spammers
      (*) Requires immediate total cooperation from everybody at once
      ( ) Many email users cannot afford to lose business or alienate potential
      employers
      ( ) Spammers don't care about invalid addresses in their lists
      ( ) Anyone could anonymously destroy anyone else's career or business

      Specifically, your plan fails to account for

      ( ) Laws expressly prohibiting it
      (*) Lack of centrally controlling authority for email
      ( ) Open relays in foreign countries
      ( ) Ease of searching tiny alphanumeric address space of all email addresses
      (*) Asshats
      ( ) Jurisdictional problems
      (*) Unpopularity of weird new taxes
      ( ) Public reluctance to accept weird new forms of money
      ( ) Huge existing software investment in SMTP
      ( ) Susceptibility of protocols other than SMTP to attack
      ( ) Willingness of users to install OS patches received by email
      ( ) Armies of worm riddled broadband-connected Windows boxes
      ( ) Eternal arms race involved in all filtering approaches
      ( ) Extreme profitability of spam
      ( ) Joe jobs and/or identity theft
      (*) Technically illiterate politicians
      (*) Extreme stupidity on the part of people who do business with spammers
      ( ) Dishonesty on the part of spammers themselves
      ( ) Bandwidth costs that are unaffected by client filtering
      (*) Outlook

      and the following philosophical objections may also apply:

      (*) Ideas similar to yours are easy to come up with, yet none
      have ever been shown practical
      ( ) Any scheme based on opt-out is unacceptable
      ( ) SMTP headers should not be the subject of legislation
      ( ) Blacklists suck
      ( ) Whitelists suck
      ( ) We should be able to talk about Viagra without being censored
      ( ) Countermeasures should not involve wire fraud or credit card fraud
      ( ) Countermeasures should not involve sabotage of public networks
      (*) Countermeasures must work if phased in gradually
      (*) Sending email should be free
      ( ) Why should we have to trust you and your servers?
      ( ) Incompatiblity with open source or open source licenses
      (*) Feel-good measures do nothing to solve the problem
      ( ) Temporary/one-time email addresses are cumbersome
      ( ) I don't want the government reading my email
      ( ) Killing them that way is not slow and painful enough

      Furthermore, this is what I think about you:

      (*) Sorry dude, but I don't think it would work.
      ( ) This is a stupid idea, and you're a stupid person for suggesting it.
      ( ) Nice try, assh0le! I'm going to find out where you live and burn
      your house down!
    4. Re:Ideas for a new email protocol... by arantius · · Score: 1

      (*) Mailing lists and other legitimate email uses would be affected

      I'm tired of seeing this reason. Mailing lists are horrible. I've never "subscribed" to any community type discussion outlet in the form of a mailing list that was a pleasant experience. It's always a ton of messages I never want constantly streaming in, or a massive digest to sift through.
      I much much prefer the web-based forum for community interaction. It /correctly/ groups threads into posts, and makes it easy to skim threads and read just what I need to know. It also, and this is big, is not based on email.
      Sure, it's harder to read offline. I think a vast minority of users actually read their mailing lists offline though, and it would be trivial to throw all posts into a daily digest. Which could be delivered by email and read offline.

      I subscribe to the sender-cost-via-computation camp. Any true monetary cost is impossible. EMail is worldwide spreading all currencies and countries. Any payment small enough to justify paying for an email will be far too small to process without losing more than the payment itself.
      Yes yes, it means you can't have mailing lists. Boo hoo. There are viable bridges. For example, One could have a sender-computation-verified inbox which is used for all general email, and a second box that is not verified, and rejects all but whitelisted (mailing list) messages. This is of course a temporary solution. All migrations need workarounds for the short term.

      --
      Health is simply dying at the slowest rate possible.
  55. The Delivery Obligation Is Their Problem by numbsafari · · Score: 3, Insightful

    The whole thing about them being legally obligated to deliver mail is the silliest thing I've ever heard. Leave it to the Germans to enact such a law.

    Better to just not deliver ANY mail than to deal with that requirement.

    1. Re:The Delivery Obligation Is Their Problem by Wastl · · Score: 2, Interesting
      The whole thing about them being legally obligated to deliver mail is the silliest thing I've ever heard. Leave it to the Germans to enact such a law.

      Maybe you are living in a country where privacy laws are no longer enacted, but I prefer to have rather strict privacy laws over having someone spy on me.

      There are simple solutions that allow to abide to the law while still providing Spam filtering. We add appropriate headers to Spam and Virus Mails and deliver them to certain subfolders of a users mailbox. He/She can then decide to delete the mails. Users who would click on attachments are also not capable of using IMAP instead of POP and thus won't get access to the messages.

      Sebastian

    2. Re:The Delivery Obligation Is Their Problem by julesh · · Score: 1

      Maybe you are living in a country where privacy laws are no longer enacted, but I prefer to have rather strict privacy laws over having someone spy on me.

      WTF does this have to do with privacy?

    3. Re:The Delivery Obligation Is Their Problem by rainer_d · · Score: 1
      There are simple solutions that allow to abide to the law while still providing Spam filtering. We add appropriate headers to Spam and Virus Mails and deliver them to certain subfolders of a users mailbox.

      That's OK, but the user still has to work through hundrets of messages per month (or even thousands - I block 600 viruses alone for me and more than 6000 RBL-blocks).
      Best is to RBL dynamic IPs, open relays etc. pp.
      If you allow to receive spam, the spammers will just send more to your addresses. The result is, that you need more resources to process these messages and your users need more time to process the spam and drill down to the single ham that get's caught in the spam-folder for every 100 or 1000 messages.
      It's a race you're definitely going to lose.

      I don't believe that RBLing even violates the law in Germany. On the same basis, firewalls could be ruled illegal, because they can block mail-connections (if you firewall some script-kiddie).

      Rainer

      --
      Windows 2000 - from the guys who brought us edlin
    4. Re:The Delivery Obligation Is Their Problem by Wastl · · Score: 1
      WTF does this have to do with privacy?

      Blocking someone else's messages is breaking privacy. It is even questionable to do automatic classification of Spam messages. You could use the same techniques for classifying political opponents, after all, and block those messages that are not "politically correct" (I sometimes get the impression that this is what they are doing with your president). The minimum solution that is acceptable is to add a header and let the user decide what to do with it. Not that I am against filtering, I use it myself extensively. But it has to be fully user configurable and users have to be fully aware of it and capable of turning it off.

      Sebastian

    5. Re:The Delivery Obligation Is Their Problem by Wastl · · Score: 1
      That's OK, but the user still has to work through hundrets of messages per month

      Well, the user can configure to automatically discard all messages above a certain level. The important thing is that the user must have full control over this, otherwise you are breaking privacy and mail laws (which were originally developed for snail mail, of course), at least in Europe.

      I don't believe that RBLing even violates the law in Germany. On the same basis, firewalls could be ruled illegal, because they can block mail-connections (if you firewall some script-kiddie).

      IANAL, but arbitrary connections are probably not covered by mail privacy.

      Sebastian

    6. Re:The Delivery Obligation Is Their Problem by rainer_d · · Score: 1
      IANAL, but arbitrary connections are probably not covered by mail privacy.

      Yeah, but what else is a connection from a dynamic IP-address with no MX-record and no reverse-DNS entry?
      I guess that pretty much fits the "arbitrary" description, don't you think ?

      Rainer

      --
      Windows 2000 - from the guys who brought us edlin
  56. Something is not right by kbsingh · · Score: 4, Insightful

    the numbers dont add up, Loads of people have already raised the issue about the fact that 20 servers ( even decently mid spec single CPU machines ) will handle 100k emails an hour ( about 80 emails per min per machine is very achieveable ... ).

    But there are some other issues you need to look at, with these emails not being scanned - do you know how much of storage you need to have online to have a mailstore this size and developing by the hour at 100k msgs ? not everyonce will use pop3 to get their emails, and not all the users will check email every day. Were talking about a very very large and very well setup Mail Store for this kind of volume. What about network bandwidth ?

    A few basic things can reduce the work of those servers : Duplicacy level across these emails is going to be very high - all 100k emails per hour cannot be unique, there are going to be loads and loads of dupes, that dont even need to be scanned.

    Creating a small database in-house with bad MailSender's list ( kind of like an in house RBL ), and flushing that list on an 6 hour interval will slow the inflow as well to quite an extent - in some tests done, i have seen it go down by almost 15 - 18% when there is a heavy load. Since most 'real' mailservers tend to retry, even if a genuine mailserver is blacklisted for 6 hours - it wont make much of a difference, however most 'hijacked PC's sending spam' dont have any retry or resending mechanism - and will just not be able to send into your server.

    Another issue that helps stem the tide of bad email is to check for Virus infections before checking for spam. A lot of cases the tides of mail coming in can be virus infections ( which are easier and faster to check against - compared to rules + logic based spam checkers ).

    However, all this is said and done without knowing of what system and what kind of a setup they use, there is no way anyone can really know what happened and why.

    In the end, classic case for Linux and Unix based technologies to come into the frame I think.

    1. Re:Something is not right by lessthanjakejohn · · Score: 1

      One way I have heard is using CPU time as the penalty. Say it would take a few seconds of your CPU to send an email. You have to solve a math problem or something.

      That way spammers who rely on sending millions of emails can not compete because it would be too costly.

    2. Re:Something is not right by dcam · · Score: 1

      There is another issue. As I understand it mail is only considered to be delivered if it has left the sending server. When using something like an RBL, the connection is refused, hence the mail does not leave the server.

      INANAL, but it appears to me that they should switch off *some* of their spam handling tools. Even if this cuts 25% of spam, this solves some of the problem.

      --
      meh
  57. "Legal Obligations?" by KC7GR · · Score: 1

    The ONLY conditions I can see where there might be "legal obligations" to deliver all E-mail traffic is where the servers, and other university resources, are taxpayer (read: publically) funded.

    Is that what's going on here? If not, it seems to me it would be a clear case of "their servers, their bandwidth, their rules," and that they could run things any way they bloody well pleased.

    That's certainly the way it is with privately-owned systems.

    --

    Bruce Lane, KC7GR,

    Blue Feather Technologies

    1. Re:"Legal Obligations?" by Anonymous Coward · · Score: 0

      Ah, you obviously do not live in germany.
      Universitys ARE government funded here at least to some extend. The bigger part of the funds comes from the government anyway and we do not have those incredible fees other countrys have, at least not yet...
      Also there could be some obscure law steming from snailmail delivery that says you have to deliver a message no matter what, in germany EVERYTHING is regulated. Most say overregulated.
      Some rules are good, some are bad and some are just plain stupid, but rules can not simply be ignored.

    2. Re:"Legal Obligations?" by BeeRockxs · · Score: 1

      Here in germany, just about every university is publically funded.

  58. Obligatory by Anonymous Coward · · Score: 2, Funny

    Your post advocates a

    ( ) technical ( ) legislative ( ) market-based ( ) vigilante (*) lack of an

    approach to fighting spam. Your idea will not work. Here is why it won't work. (One or more of the following may apply to your particular idea, and it may have other flaws which used to vary from state to state before a bad federal law was passed.)

    ( ) Spammers can easily use it to harvest email addresses
    ( ) Mailing lists and other legitimate email uses would be affected
    ( ) No one will be able to find the guy or collect the money
    ( ) It is defenseless against brute force attacks
    ( ) It will stop spam for two weeks and then we'll be stuck with it
    (*) Users of email will not put up with it
    ( ) Microsoft will not put up with it
    ( ) The police will not put up with it
    ( ) Requires too much cooperation from spammers
    ( ) Requires immediate total cooperation from everybody at once
    ( ) Many email users cannot afford to lose business or alienate potential employers
    ( ) Spammers don't care about invalid addresses in their lists
    ( ) Anyone could anonymously destroy anyone else's career or business

    Specifically, your plan fails to account for

    ( ) Laws expressly prohibiting it
    ( ) Lack of centrally controlling authority for email
    ( ) Open relays in foreign countries
    ( ) Ease of searching tiny alphanumeric address space of all email addresses
    (*) Asshats
    ( ) Jurisdictional problems
    ( ) Unpopularity of weird new taxes
    ( ) Public reluctance to accept weird new forms of money
    ( ) Huge existing software investment in SMTP
    ( ) Susceptibility of protocols other than SMTP to attack
    (*) Willingness of users to install OS patches received by email
    ( ) Armies of worm riddled broadband-connected Windows boxes
    ( ) Eternal arms race involved in all filtering approaches
    ( ) Extreme profitability of spam
    ( ) Joe jobs and/or identity theft
    (*) Technically illiterate politicians
    (*) Extreme stupidity on the part of people who do business with spammers
    ( ) Dishonesty on the part of spammers themselves
    ( ) Bandwidth costs that are unaffected by client filtering
    (*) Outlook

    and the following philosophical objections may also apply:

    (*) Ideas similar to yours are easy to come up with, yet none have ever
    been shown practical
    ( ) Any scheme based on opt-out is unacceptable
    ( ) SMTP headers should not be the subject of legislation
    ( ) Blacklists suck
    ( ) Whitelists suck
    (*) No-lists suck
    ( ) We should be able to talk about Viagra without being censored
    ( ) Countermeasures should not involve wire fraud or credit card fraud
    (*) Countermeasures should not involve sabotage of public networks
    ( ) Countermeasures must work if phased in gradually
    ( ) Sending email should be free
    (*) Why should we have to trust you and your servers?
    ( ) Incompatiblity with open source or open source licenses
    (*) Feel-good measures do nothing to solve the problem
    ( ) Temporary/one-time email addresses are cumbersome
    ( ) I don't want the government reading my email
    ( ) Killing them that way is not slow and painful enough

    Furthermore, this is what I think about you:

    ( ) Sorry dude, but I don't think it would work.
    (*) This is a stupid idea, and you're a stupid person for suggesting it.
    ( ) Nice try, assh0le! I'm going to find out where you live and burn your
    house down!

  59. Solution: by The+Master+Control+P · · Score: 4, Interesting
    Spam people with ads for viagra. If someone is stupid enough to buy, send them a cyanide capsule :)

    Joking aside, it boils down to economics. Spam is profitable. If something is profitable, people will do it. Selling drugs is profitable, and the war on some drugs hasn't changed that. The answer to spam (and drugs) is not to try and stop them, but to make doing them unprofitable.

    What makes spam profitable is the presence of people on the internet who are SO incredibly stupid that they fall for it. (See Junkie loves his spam) Remove them, and you shoot spam through it's purtid heart. I can think of several methods of doing do:
    • If you respond to spam, you've probably got shitloads of viruses on your computer. Beyond any shadow of a doubt some of them are spamming people. If you ISP detects lots of mystery traffic from you on known virus ports, you're given one warning. Then you get kicked off without ceremony and not allowed to reconnect until you can prove to them that all computers using your connection are malware-free. No more malware, no more spam zombies.
    • (You, the ISP) Send test-spams. Specify in the header that it is NOT a real spam so you don't get blacklisted. Anyone who responds to them loses all services except port 80 until you prove to a professional who visits your house that you know enough not to buy from spam. Do it again and you will never be allowed to use your ISP's mail servers again.
    Neither of these can possibly be routed around or hacked by spammers, because they are not involved in any part of the process. If you are not in the habit of perpetuating malware with your computer, you needn't worry of getting caught up in it all. Neither of these requires a major invasion of your privacy
    1. Re:Solution: by JebuZ · · Score: 1

      Where exactly does one get cyanide, let alone in an easy to digest capsule form? No really. I'd like to know.

    2. Re:Solution: by Anonymous Coward · · Score: 0

      I sometimes respond to spam. With a temporary address of course. Then I can determine the business location of the spammer and start a campaign of harassment (calling their 1-800 number and start bitching, subscribing them with magazine subscriptions, sending their contact info to other spammers, etc).

      Isn't that right, you skincure/skinkure bastards at
      PO Box 667
      Elmira, NY 14902
      US
      (800) 546-3962

      fuckers, hope you like that chicks with dicks magazine!

    3. Re:Solution: by 40000 · · Score: 1

      ISPs could block port 25 by default unless you can prove you are an organisation which needs to run a mail server. Most people could manage to send by web mail, especially when they have high speed connections.

  60. Securing the entry point by 87C751 · · Score: 2, Insightful
    We'd be in a much better place if our e-mail system at least had a trustworthy traceback facility so that we affirmatively know who sent the message by default.
    No doubt, but that's a classic Hard Problem. How do you authenticate the entry point without a central credential clearing house? And who runs that clearing house? VeriSign? (hint: that would be a bad choice)

    I agree that SMTP needs a makeover, but what to replace it with is still very much an open question.

    --
    Mail? Put "slashdot" in the subject to pass the spam filters.
    1. Re:Securing the entry point by Andrew+Cady · · Score: 1

      It's not hard. If you get mail from x@y.com then you contact y.com to verify it's real; indeed, you will need only make sure the connection is made from y.com in some cases (or all cases if so-designed). There is overhead there, but spam is more overhead. Do it this way and you can build up a domain blacklist for spammers.

      But using the domain name system for addresses is pretty lame, considering it tends to make them unreliable (existentially).

  61. phoenix e-mail by chaos421 · · Score: 1

    this is in no way the end of e-mail... more like the first sign of a pending evolution. we're so tied to e-mail and instant communication, that the world requires e-mail, and i'm sure a much more secure e-mail protocol will be coming out in the near future. as soon as sendmail/postfix adopt such an advancement, spammers around the world will be looking for another line of work.

    i know i wouldn't mind paying my registrar a bit more each year to register my domain as a legitimate mail service...

    1. Re:phoenix e-mail by TiggsPanther · · Score: 1

      I think SMTP in it's current form is on it's last legs. I've seen it said in /. comments before, and kind of laughed it off - but I'm thinking these days that they have a point.

      E-Mail isn't going away. Simple. It's being used mroe and mroe often. Back in the day, a Simple Mail Transfer Protocol was sufficient. Nothing too complex was required, as there was less rubbish and also people would (sensibly) use otehr protocols for sending larger files.

      These days, however, there is Spam, viruses, and people who (rightly or wrongly) insist on sending out large files via e-mail. If anything what's needed now is a Secure Mail Transfer Protocol. So that only legitimate mail-servers can send messages out, and that these require at least some semblance of authentication from the client. Plus some way of identifying the source-machine's authenticity would be nice.

      Now on the technical side of things I admit I haven't got the slightest clue how to go about it. And I've no idea whether a from-scratch-replacement protocol would be any better than extensions to the existing SMTP-spec.
      But I do think that more-secure and less-simple is the way to go.

      Tiggs
      --
      Tiggs
      "120 chars should be enough for everyone..."
  62. Disc space vs. CPU by darnok · · Score: 2, Informative

    It seems that they've decided to provision potentially 50x their existing disc space for email (as 98% of the email is currently spam, which is presumably filtered out at the moment), instead of deploying additional resources for filtering before it gets to the users.

    Good luck with that approach! If their primary constraint is budgetary, as it would seem, it would make more sense to invest *more* in filtering so that the crap didn't get to users' mailboxes where it will doubtless stay indefinitely in some cases.

    Note: I'm assuming that, because they have some apparent requirement that all mail gets delivered, that they cannot effectively enforce email quotas that would result in non-delivery of email.

    1. Re:Disc space vs. CPU by julesh · · Score: 1

      50x their existing disc space for email
      [...]
      I'm assuming that, because they have some apparent requirement that all mail gets delivered, that they cannot effectively enforce email quotas that would result in non-delivery of email.


      You haven't really thought it through, have you? They're required to deliver all mail, yes? That includes the junk. The best they could do previously was deliver the junk elsewhere. So, they're not going to need any additional disk space.

  63. You fool! by mnemonic_ · · Score: 0, Offtopic

    Don't you see? We stand to lose everything!

  64. Easy Solution... by bruthasj · · Score: 3, Funny

    > /dev/null.

    Report that all emails are stored in an infinitismally small location that only future, advanced technologies will be able to restore email upon request. Requests will be queued until the technology has been developed.

  65. OpenBSD has a Good Solution: spamd by trippinonbsd · · Score: 4, Interesting

    spamd is a new approach to blocking spam. Its called greylisting. It rejects all email with a temporary failure notice in the hopes that the large volume spam senders don't have the resources to wait 30mins and send the same email again. Apperently this method works quite well and uses little resources.

    1. Re:OpenBSD has a Good Solution: spamd by benna · · Score: 4, Informative

      I seem to recall the whitepaper about this method being posted on slashdot a while back. My free email provider (softhome.net) implements this and it works ok but it still lets quite a bit through. It seemed like a great idea in theory though.

      --
      "It is not how things are in the world that is mystical, but that it exists." -Ludwig Wittgenstein
    2. Re:OpenBSD has a Good Solution: spamd by Tyrell+Hawthorne · · Score: 1

      spamd is a new approach to blocking spam. Its called greylisting. It rejects all email with a temporary failure notice in the hopes that the large volume spam senders don't have the resources to wait 30mins and send the same email again

      While it's an interesting idea, it wouldn't work. At least not in a university environment (I work at one) and probably not in most other places either. One of the benefits of email is that it is delivered very quickly. If an email takes 60 seconds to come through, that's slow. People want to be able to talk on the phone, say "I'm sending you that document" and get confirmation that it arrived while they're waiting.

      Adding a 30 minute time penalty on email would mean taking a big step backwards.

  66. clustering? by Anonymous Coward · · Score: 1, Insightful

    not to exploit the 'imagine a beowulf...' cliche.. but how would clustering email servers help this? has it already been tried?

  67. We handle 20x that amount with less than 10 server by Anonymous Coward · · Score: 0

    Where I work, we handle a couple million emails a day pretty decently with about 6 email servers. We definitely feel the "crunch" during spam blasts, but we can usually handle it. 20 servers unable to handle 100,000 emails is pretty lame. Seriously, upgrade those Windows 3.1 MTAs!

  68. Must be using SpamAssassin by ChrisWong · · Score: 4, Interesting

    The MTA's work is relatively light compared to what anti-spam software must do. This is especially true of SpamAssassin. While it does have some advantages over its competition, SpamAssassin is extremely resource intensive. Firstly, SpamAssassin is not written in fast C/C++ but Perl. Every email is sent through zillions of Perl regex rules. Then there is the Perl implementation of the Bayesian test, which really bogs down when an email auto-learned. Then there are the various (optional) network lookup tests: several RBLs, Pyzor/Razor/DCC ... each email can eat up a lot of resources even if you bypass the startup overhead by running spamd.

    I have also seen situations where SpamAssassin was not correctly respecting the maximum child spawn limit. Since spamd is a fairly heavyweight process, the server started swapping and throughput plunged.

    Such heavy overhead is not a essential part of anti-spam software. Something NOT written in Perl nor any "interpreted" language, something with a smaller footprint, will be much, much faster. I wonder how many people have switched to dspam for this reason?

    1. Re:Must be using SpamAssassin by Anonymous Coward · · Score: 1
      Every email is sent through zillions of Perl regex rules.

      You're right, and that's ridiculously inefficient.

      Every regexp gets compiled to a DFA (deterministic finite automata). Essentially a directed graph of states; each new byte in the data makes it follow an edge. If it gets to a certain vertex, it matches and takes an action.

      What they could do is combine all the DFAs into one. Several nodes then would trigger actions, some ending the processing, some making it continue. Dramatically more efficient.

      It's really inefficient to run the same input through more than one DFA, when you could combine the DFAs beforehand.

      I'm not aware of any project to actually do this for regexs, though. (In Perl, or otherwise.)

    2. Re:Must be using SpamAssassin by rossz · · Score: 0, Redundant

      I'm well aware of the load requirements of an MTA and of SpamAssassin and I stand by my original statement.

      --
      -- Will program for bandwidth
  69. Money by schouwl · · Score: 1

    How about buying a bigger server? But I guess that this not German mentality since everything has to be cheap. Lars

  70. Who are the crackheads that modded this shit up? by L.+J.+Beauregard · · Score: 1

    Attention, moderators: A robotranslation is not +3, Informative. It's -1, Karma Whore. We can use Babblefish for ourselves, thank you very much.

    Now a real translation by a human being into real English, that deserves a few mod points.

    --
    Ooh, moderator points! Five more idjits go to Minus One Hell!
    Delendae sunt RIAA, MPAA et Windoze
  71. What about network load? by xixax · · Score: 2, Interesting

    OK, you could tell the end users to find their own tools and just cope.

    However, I work in a large organisation, and with a 98% spam ratio, the mail infrastructre would need to be much larger (and more expensive!) than it actually neeeds to be. Let alone the (*&&^$@# junk traffic and bounces caused by auto-responses to forged addresses. Plus we have a significant number of staff who are clueless who would be excluded from communicating effectively because they do not have the time or skills to learn how to train a spam filter. in such a situation, no-one could no-longer *rely* on email to contact/inform our staff, reducing its value as a tool.

    Our email infrastructure already groans under the load each time another Outlook virus arrives.

    The hay-stack of spam is probably just as disruptive as false scanner positives.

    Xix.

    --
    "Everything is adjustable, provided you have the right tools"
    1. Re:What about network load? by AftanGustur · · Score: 3, Interesting


      Plus we have a significant number of staff who are clueless who would be excluded from communicating effectively because they do not have the time or skills to learn how to train a spam filter. in such a situation, no-one could no-longer *rely* on email to contact/inform our staff, reducing its value as a tool.

      True, I also work in a large international organisation, but our Spam/Ham ratio in "only" about 40%..

      I am handling the Spam problem and we have been running SpamAssassin, as a pilot project, for the last year.

      The SpamAssassin project almost got replaced by a commercial solution when people started asking themselves, "what good is it if we still deliver, the Spam to the users inboxes ?". Our users may be experts in other fields, but for many, computers are not their thing.

      Some commercial solutions have "Quarantine" system where you can send a report once a day to the recipients, with a list of all spam they received the day before, with a link for each email the user can click if he wants it delivered to his inbox.

      It took me 4 days, but I wrote my own Quarantine system that does exactly that, and got permission to release it under the GPL..

      That way the Spam doesn't constantly flow in the user's inboxes and takes up the users time. (And, 'no' manually creating a filter rule for thousands of users is not an option)

      --
      echo '[q]sa[ln0=aln80~Psnlbx]16isb572CCB9AE9DB03273snlbxq' |dc
    2. Re:What about network load? by paskie · · Score: 1

      Well, SpamAssassin just failed on me two weeks ago - suddenly its effectivity dropped from a fair 95%-98% to less than 50% and spam started pouring into my mailbox. It already happenned once but upgrading to a new version with newer rulesets helped, but this time there was nothing to upgrade to. I suppose some new kinds of spam started hitting me, but there were no obvious rules for me to catch these. So I tried dspam, trained it for three days and it quickly raised to about these 98% and is still improving fast. It is also much faster and provides a rather nice quarantinebox CGI interface in the box. The only problem I still have with it is how hungry is it about the disk space. After 14 days of usage (5000 innocent mails, 2000 spams) my personal dspam dictionary + sig database raised over 135M, if it will raise this fast how big will it be in two months? I yet need to solve that but I'm sure there will be a way out - I plan to try other storage methods or getting that segfaulting database purge tool to work. ;-)

      --
      It's not the fall that kills you. It's the sudden stop at the end. -Douglas Adams
    3. Re:What about network load? by Anonymous Coward · · Score: 0

      You should train spamassassin on your various folders. Ie, you can have one spam-folder where you automatically put spam.

      Then you can setup a cron-job to automatically train sa-learn on your various folders. Even your Trash-folder can be trained as ham if you are careful with what you put there. When you move mails between folders, the bayesian filter will be updated at next cron-run.

      It's working very good for me. I think I'm pretty close to 98-99%, but training the bayesian is crucial for success.

    4. Re:What about network load? by AftanGustur · · Score: 1


      Well, SpamAssassin just failed on me two weeks ago - suddenly its effectivity dropped from a fair 95%-98% to less than 50% and spam started pouring into my mailbox.

      Two things that I have done that keep SA hitting hard on the Spam problem, is to install the additional rules_du_jour and my_rules_du_jour
      and secondly the SURBL real-time system.. And SpamAssassin works like a charm again ..

      --
      echo '[q]sa[ln0=aln80~Psnlbx]16isb572CCB9AE9DB03273snlbxq' |dc
  72. I wonder by BCW2 · · Score: 4, Insightful

    Does Germany have a law that I'm not familiar with? Email is free not a paid service, why is there some obligation to deliver? Snail mail is normally Govt. run and delivery is what you pay for with a stamp.

    No one has to or could guarantee anything for email. With the amount flowing because of SPAM the dropped packets must be astronomical.

    --
    Professional Politicians are not the solution, they ARE the problem.
    1. Re:I wonder by Anonymous Coward · · Score: 1, Informative

      They're probably thinking of StGB 303a, Datenveränderung, which prohibits unlawful deletion, suppression, disabling and alteration of data. Mail can always be lost, but spam and worm filtering is a deliberate act, so this law probably applies.

      All it takes to avoid this is to have every user sign an agreement that the admins are allowed to apply automatic filtering which deletes mail without notice and, despite diligent configuration, can result in false positives.

    2. Re:I wonder by Advocadus+Diaboli · · Score: 1
      Does Germany have a law that I'm not familiar with?

      Could be. :-)

      Email is free not a paid service, why is there some obligation to deliver?

      Well, even if its for free it has to fulfill some requirements. For example also the air to breathe is for free and the government sets laws to prohibit the pollution of that "free good". One other reason could be that Email is becoming a way to have "legally relevant correspondence". In that context it is not a good idea to drop a mail. And AFAIK a big part of the problem are "undelivable message reports" that from one point of view really need to be delivered, because you never know if the reason is a fake address or just a typo in the address.

      Snail mail is normally Govt. run and delivery is what you pay for with a stamp.

      Here in Germany there are the first private firms that have a license to deliver mail. And they are competing with the now "private" post service.

      No one has to or could guarantee anything for email.

      But if you want to use email for real legally relevant communication then you need some guarantees.

  73. That's evil. by r00t · · Score: 1
    The blacklists, besides slowing down your email delivery, have too many false positives. Better idea:

    Simply discard any email that is of the "obviously bad" sort that grandma could never write. Purify the rest. So...

    Bad headers? bitbucket
    Bad MIME structure? bitbucket
    Windows executable? bitbucket
    Java, VBscript, or JavaScript? bitbucket
    External image? bitbucket
    Stange objects like flash? bitbucket

    Add the originating IP
    Add the envelope address
    Strip unknown HTML tags
    Re-compress GIF and PNG images
    Convert BMP to PNG

    Done! You have an email safe for Outlook Express, you didn't burden the server very much, and you took a huge bite out of the spam.

    1. Re:That's evil. by geminidomino · · Score: 1

      Strip Unknown HTML tags
      Re-compress GIF and PNG images
      Convert BMP to PNG


      Yeah, spam wasn't doing enough to bring mailservers to their knees, especially with no blocklisting. Let's throw pointless graphic conversions at the CPU while we're at it.

      Better idea. Strip ALL HTML tags. It doesn't belong in email.

  74. Authorization Based eMail systems the way to go. by phyrebyrd · · Score: 3, Informative

    I use Cashette for my email server. It's free, allows POP access, gives you the ability to activate its systems on other email accounts, and it works by using an authorization system. Basically, if someone isn't on your "authorized" list, then their mail gets put into a special folder. You can either review what's in that folder, or just forget about it. Here's the nifty part... If a spammer REALLY wants to get their message to you, they can pay you for delivery. You set the price, up to $300 for them to get their message to you.

    You can get your own account at http://www.cashette.com/

    Have fun!

    -Phyre

    --
    "When the people fear their government, there is tyranny; when the government fears the people, there is liberty." -Thom
  75. Beginning of the end of email by AtariDatacenter · · Score: 1

    Is this the beginning of the end of e-mail?

    A year ago, I would have laughed this notion off as absurd, but I'm starting to give it more credit. I'm easily dumping 75-100 messages out of my junk folder each day (after a very quick review of the header information). That is so where I can receive maybe 1-5 legitimate emails a day.

    I suppose I'll just have to wait for the problem to get worse for everyone else before the world wakes up and realizes the current system is just plain broke.

  76. Won't Last by fdiskne1 · · Score: 4, Interesting

    Being the person that blocks spam is a lose/lose situation. They don't understand how bad the problem is when you do your job right. They complain when spam gets through and complain when legit email gets blocked, but don't want you wasting all your time on it.

    I predict that this school will be forced back into filtering spam by their students (customers).

    [rant]See, 3 years ago, as spam was beginning to get bad, I began filtering spam on the email system I manage. Over 2.5 years, I developed a rather intensive filter, but since I knew I was not perfect, I had to scan blocked email for false positives. It got to the point I was spending 25% of my time scanning for false positives and the boss didn't like that. He also didn't want me to spend time trying to figure out how to set up Spam Assassin. (I'm not a Linux guru. Sorry!) The board didn't want to spend the money on a purchased system and didn't want me wasting my time with spam. They didn't think it was a problem so they told me to just stop blocking spam. My boss told them that spam was a BIG problem, but they never saw it so they didn't believe him. I asked my boss 10X "Are you sure you want me to stop blocking spam? They won't like the results." He confirmed. I stopped blocking spam and about 50,000 additional spams per week came flooding into the system. The 50,000 were what was being blocked previously. I was flooded with phone calls until everyone realized what was happening. Then, just 2 weeks ago, I was instructed by the board to go back to my filtering, but only spend 30 minutes a day on it. RIIIIGGGHHHHHTTTTT! Ever try scanning for legit email among the trash, adjusting filters to make it better and taking calls and emails from people that want you to be sure an email is blocked and only spend 30 minutes a day on it? I managed to put together a Spam Assassin box and it blocks 10,000 per week, but there's a lot that doesn't get blocked. I don't know enough about it to make it better.[/rant]

    --
    But why is the rum gone?
    1. Re:Won't Last by julesh · · Score: 2, Insightful

      OK, some stats:

      My company receives about 3,000 e-mails per week, of which 2,600 or so are junk.

      I recently installed a simple bayesian junk filter + whitelist on this, and it is catching about 2,500 of those 2,600 junk messages. Last week there were two false positives; the week before there were none. 99% of the false positives have come through mailing lists that add loads of shite to the bottom about how to unsubscribe. In the 2 months we've been using this filter, we have not had a single business-critical message filtered.

      Previously we used a spam-assasin style points system, which I would spend about an hour a week fine tuning. We were letting through about twice as much junk, filtering about 5 times as many legitimate messages.

      The message - try a bayesian filter (yes I know s.a. has a bayesian filter built in now, but IMO the other stuff it does just confuses the issue). Set up an IMAP folder for everyone to dump the junk that they receive into, one to put their false positives into, and one for their filtered messages to be delivered to. Instruct them clearly about what to do with them. Re-train every other week. You'll get much better results than you're getting now, by the sounds of it.

    2. Re:Won't Last by pclminion · · Score: 1
      Set up an IMAP folder for everyone to dump the junk that they receive into, one to put their false positives into, and one for their filtered messages to be delivered to.

      Just don't use a single Junk-box for company-wide purposes. The array of gack that people receive is just too variegated and inconsistent to make a good training set. Ideally, each person should have their own filter with their own weights. People have differing ideas of what a "spam" is.

      For example, my buddy at work does purchasing for IT, so he's always receiving invoices, receipts, and order confirmations. He needs to receive these things. I never receive such things at work. My filter would block them -- they look too "spammy." His does not.

      One man's spam is another man's job.

    3. Re:Won't Last by Anonymous Coward · · Score: 0

      If he wants to buy something off the shelf, tell him to get Brightmail. Along with other things like having real people actually look around the clock at mail hitting some obscene number of spamtraps they have, they use spamassassin or something like it. You can plug your own DNSBL's into it too. Not as cheap as a DIY job with SA unless they're hiring someone full-time (or even an intern part-time) to deal with spam. It starts looking pretty cost-effective at that point.

  77. Sayings that apply by grasshoppa · · Score: 0, Troll

    Throwing out the baby with the bathwater.
    Fucking retarded
    Cut off your nose to spite your face ( which always seemed somehow wrong to me... )
    Fucking retarded.

    Now, I'm not an admin on their campus ( which is a damn shame for them ), but talk about being just this side of the shortbus. ( Note that I read the bable, but ended up even more confused that simply trying my hand at it without it ). My pathetic little email server ( pII233, 128megs of ram, qmail with qmailscanner, clamscan and spamassassin ), is able to process your standard piece of spam in about 1 second. Approx. Now, I don't know what software they were using, but I'd be willing to hazard it was exchange.

    All this just goes to show one thing: GERMANS LOVE DAVID HASSLEHOFF.

    --
    Mod me down with all of your hatred and your journey towards the dark side will be complete!
  78. Why not tell the spam filter that non[A-Z] = spam? by mbourgon · · Score: 2, Interesting

    Dumb question, but someone mentioned the odd spellings these days... ba|\|a|\|a = banana. How many people spell that way? Why not tell the spam filter that more than one word using ^[A-Z] (for English language) has an increased likelihood of being spam?

    --
    "Sometimes a woman is a kind of religion, she can save your soul & set you free from all your sins" - Bad Examples
  79. Third Party Filtering seems the ticket by Punchinello · · Score: 1

    A great solution for my clients to reduce server load has been to outsource spam filtering to a third party (we recommend Frontbridge). They have an amazing filtering system that has to this date never had a false positive. Once the service is up you don't even have to think about spam anymore except the occasional one that gets through.

    --

    Remember... ZG9uJ3QgZm9yZ2V0IHRvIGRyaW5rIHlvdXIgb3ZhbHRpbmU=

  80. Yes, I believe it by argoff · · Score: 1

    You know, one day at work (in a data center of a global fortune 500 company in the bay area) someone just showed up one day with a delivery of a half million dollar IBM mainframe. It was our new email server. Too bad they didn't ask me, because I would have told them that all their email could be handled by a few PC's with ease, but they didn't. The decision was made by top level managment and I (and 90% of the IT department) was totally in the dark until it just showed up at the door! (How much you want to bet somebody was getting kickbacks or eyeing a cozy job at IBM)

    Anyhow, after that I would believe anything. How much you want to bet all 20 of those email servers are high end sun sparc stations?

    1. Re:Yes, I believe it by Anonymous Coward · · Score: 0

      You what they say about people being fired and IBM... sigh

  81. Port 80? by EventHorizon · · Score: 1

    Leave port 80 open and the malware will just start to use that. Spam is a biological phenomenon, and most any action designed to kill it will merely apply a selection force to the ecosystem, stepping the arms race up another notch. Frankly, spammers aren't going away until we get some kind of cryptographically secure digital trust system that can raise the cost of sending spam, and designing such a system is a Hard Problem (which might make an interesting slashdot thread).

    1. Re:Port 80? by The+Master+Control+P · · Score: 1

      You're right. I was thinking about a connection that goes to one and only one page that it about removing malware from your system.

      However, I do not agree that a signed trust system would stop spam. As long as there are idiots on the 'net who will fall for it, spammers WILL find a way to spam. The problem with the secure trust system, from my view, is the apparent requirement of a central database to track who is and is not trustworthy. Such a database would be too big a target for Big Brother not to muscle in on. And if nothing else, we've seen how well databases that try to track so much data do in terms of data integrity and accuracy.

      If we can get the real idiots (people who respond to spam) off the net, it won't be possible to find them via spamming. In short, take all the hosts for the parasite and quarantine them. Without anyone to parasitize, spamming would go away.

  82. Re:Who are the crackheads that modded this shit up by Anonymous Coward · · Score: 0

    This deserves a -1, Asshat...

  83. Re:Self-Destructing E-Mail helps - spamhole.com by Anonymous Coward · · Score: 0

    Spamhole.com does the same thing as well, but with fewer hoops to jump through.

  84. Spam & ISPs by Anonymous Coward · · Score: 2, Interesting

    If I understand this spam problem correctly, why do they (ISPs) filter incoming mail when logically they should be filtering outgoing mail? The way I see it is spammers hit unsuspecting network vendors (Chinese, Brazilian, Korean etc.) who are all to glad to have netted a hefty account until a week or two later they find themselves blacklisted all over the world. The damage is done and the spammer has already moved on to another ISP.

    If email were channelled, filtered, throttled and who knows what else on its way out instead of in, spammers would be discouraged or at least slowed down to a snail's pace. A trustworthy registry of ISPs using this technique could be created and providers could choose to receive mail from this list only. Spam has become a world wide plague and requires a global effort. Does this make any sense, anyone?

    1. Re:Spam & ISPs by Cinquero · · Score: 1

      The answer is simple: because they neither want nor have to do so.

  85. Paul Graham says: do the opposite by jsburke · · Score: 2, Interesting

    If you really want to make spam unprofitable, don't prevent people from clicking on the links. Instead, make everyone do it.

  86. I'm baffled at what is slowing their servers down. by Anonymous Coward · · Score: 1, Interesting

    Perhaps they're running Exchange or something over there. I would think that 100,000 emails, distributed to 20 different machines, would amount to 5,000 emails apiece. How could this possibly be a substantial increase in load over a period of _five days_ for just about anything?

    Going a bit further, it would mean these machines were blowing at least 17 real seconds processing each email, if each machine were performing only one scan at a time. Whose filter takes 17 seconds to process and scan one mail? I know that DNS lookups can take time, but doing regexps on text documents certainly doesn't take much by comparison.

    Now, it's possible that they only have three or four of these 20 machines acting as the front line MX servers for the system, with most of the others just storing subsets of the mail, and running POP/IMAP to deliver to users. It would mean five times the load would be on these machines, but geez... 5 x piddly is still near piddly.

    I've worked for a company dealt with way, way more than 10,000 mails per hour (a tenth of what the uni is taking more than five days to handle) and delivery time for that network was under 30 seconds--with only four servers acting for both incoming and outgoing mail.

    It sounds like they simply must have done something critically wrong somewhere in their network design that's acting as a severe bottleneck, or they are using REALLY old/slow machines to toss mail. ... but Germany is a pretty modern place, and my desktop machine (an AMD 1800+ system, which cost about $600 total in parts when I first built it) could handle the kind of load their servers should be seeing. They should be able to get access to enough power to deal with the mail load they're getting, or they're running on ten year old machines and are refusing to spend a cent on upgrading.

    I can only come to the conclusion that they're just flat out refusing to spend money to upgrade the equipment because the thing that's overloading what they have is spam. The only way that will ever work for them is if spam mysteriously disappears entirely from their network--which isn't bloody likely to happen in the real world anytime soon.

  87. Re:Who are the crackheads that modded this shit up by Anonymous Coward · · Score: 0
    Since when can ACs be karma whores, Tweedle Dum?
    ACs don't get karma.

  88. On a similar note... by moriya · · Score: 1

    This can be unrelated but it raises a concern of mine... the prospects of email in the long run or future.

    For years email has served us. It has delivered time after time and is a global-wide method of communication. Yet... despite of the wonders of email alone, we are seeing an ever-increasing amount of spam floating around... a bunch of which that creeps in when your filter has been well-trained.

    What I'd like to know is... can we reinvent the wheel? Is it possible to reinvent email with the purpose of ending all spam as we know it? Time and time again have I looked through random spam and found that they were delivered even tho it wasn't addressed directly to my email address. And sometimes, I see 'From' fields with my email address on it.

    I feel disappointed at how email has turned out given all the methods and tools out there to combat spam... It makes me wonder if we should abandon email altogether and go with something akin to instant messaging.

    1. Re:On a similar note... by yeremein · · Score: 1

      I've often thought about the same thing. SMTP lets you forge headers with impunity; it should be possible to at least verify that the sender exists.

      On top of that, I had another half-baked idea. Maintain a whitelist of acceptable senders, and bounce all received mail from anyone not in the list unless they can answer a question that would be hard for a spammer to automate, such as "type the letters you see in this funny looking graphic", or "which of these items doesn't belong" with thumbnail photos of a duck, a goose, and a pig, where the sender has to type "pig", or something like that.

      Then the recipient can decide whether to whitelist the sender, or the mail client could have an option to do so automatically when the message is replied to, etc.

      ---
      Does the "S" in "SMTP" stand for "spam"?

  89. Not correct... by Kjella · · Score: 1

    Everyone needs to be registered with their mail server with the governing body (similar to the domain name idea), say for $100 per IP. It is not that expensive if you really need that... But, prohibitive for spammer... Yes, it makes home run email server more expensive... But, you cannot get a domain name for free anyway. Why should we expect email server to be free? It may be the solution to get the economy of spamming right again.

    See, I got a perfectly free *.mine.nu DNS name. Dynamic DNS, baby. Also, it's *not* prohibitive to a spammer. They run a business, and by the time it gets whacked as a bad server, they've already made the appropriate SPAM runs and gotten away with the money anyway.

    Kjella

    --
    Live today, because you never know what tomorrow brings
  90. There's a point. by r00t · · Score: 2, Interesting

    There are graphics format exploits, including a
    recent one for Internet Explorer using BMP files.
    Lossless graphics re-compression is dirt cheap
    compared to SpamAssasin, Bayesian filters, and
    Apple's word vector thing.

    Rule: Do the cheap and obvious filtering, plus
    the filtering needed to protect Microsoft junk.

    I get legit email with HTML tags and even images.
    Often this lets me know the sender has no taste,
    but sometimes it is justified. You used an italic
    font to quote me; that doesn't work in plain text.
    Bold, underlining, and fixed-width characters can
    all be justified. The sort of formatting you'd see
    in a man page is perfectly legit.

    1. Re:There's a point. by geminidomino · · Score: 1

      There are graphics format exploits, including a recent one for Internet Explorer using BMP files.

      A moot point if you don't allow images at all.

      Lossless graphics re-compression is dirt cheap compared to SpamAssasin, Bayesian filters, and Apple's word vector thing.

      Agreed. sed 's/<.*?>//g' is even cheaper.

      Rule: Do the cheap and obvious filtering, plus the filtering needed to protect Microsoft junk.


      Rule: Do almost-free HTML stripping, all other points become moot.

      I get legit email with HTML tags and even images. Often this lets me know the sender has no taste, but sometimes it is justified. You used an italic font to quote me; that doesn't work in plain text.


      >> My text
      > Your Text
      My text

      has always worked just fine

      Bold, underlining, and fixed-width characters can all be justified. The sort of formatting you'd see in a man page is perfectly legit.


      That's your opinion. My rules say that if it isn't plain text, it's an attachment.

  91. I doubt it... by Kjella · · Score: 1

    ...e-mail has what nothing else has - everyone you know will have an email address. They might not have program foo or support protocol bar, but they will have e-mail. Even assuming you could create a better system, there'd have to be e-mail to Supermail(TM) and back gateways for many years to come.

    Kjella

    --
    Live today, because you never know what tomorrow brings
  92. less centralized servers by KalvinB · · Score: 3, Informative

    This isn't even the beginning of the end of email. It's simply becomming less and less workable to run a single mail server system with a large amount of users. Small time mail servers aren't targeted by spammers. Universities are heavily targeted because there are lots of users all going to a common domain.

    It's the same reason users of major ISPs are more likely to be probed for vulerabilities.

    I've found the method of filtering based on the "Click-Me" domains to be the most effective with virtually no false positives (zero is a realistic number).

    I've found that setting up a secure public mail system is cake. Mercury Mail is free and handles well. A single check box set by default is all it takes to keep it from being an open relay. Students of the university could probably do rather well offering their own e-mail services to students. Mercury Mail's filtering system is quite robust.

    MM supports IMAP/POP3/SMTP and alternate ports as well as SSL on all them. Adding a web-based front end also isn't that difficult if you know what you're doing. There's actually one built in and a more robust version coming.

    I already have a few hundred users on Indie-Mail and the amount of bandwidth used per day is pretty negligable.

    Ben

  93. dsbl.org by DreamerFi · · Score: 3, Informative

    Make your boss happy, and block on these three DNS based lists: dsbl.org, spamhaus.org, dnsbl.org. Everything coming from IP addresses in these range is basically garantueed not to contain false positives. It'll clear your inbox quite effectively. (I'm one of the volunteers helping out dsbl.org, so feel free to mail me with questions)

    -John

  94. Assist, not preempt, the user. by quinkin · · Score: 3, Interesting
    My approach has been to use spamd (avoid thread creation overheads) and run a base spam assessment on all mail. The assesment is stored in the header of the mail and the users can then filter/sort accordingly. Any "evil" attachments are automatically toasted, although the heuristic is very lax due to a high number of techie users.

    If required they can also set a spam level on the mail server in a MySQL user/account database to automatically delete mail over the specified threshold (for accounts receiving oodles of obvious spam).

    It has a nice balance between performance, security, and leaving most of the control in the hands of the users. We haven't faced extreme loads but it hasn't even raised an eyebrow over the load so far. Most importantly, no unhappy usres complaining of missing emails...

    Q.

    --
    Insert Signature Here
    1. Re:Assist, not preempt, the user. by Anonymous Coward · · Score: 0

      I don't think you understand the scale of a large university's e-mail system. Your suggestion is great if you only get a couple of thousand e-mails a day....

      But, the mail system at my university process something more like a million e-mails a day (although that should be dropping significantly since most of the students just went home for the summer).

  95. Perhaps they need some Canadian help... by MagicFab · · Score: 4, Informative
    Linux Journal recently featured an article on How HEC Montréal's new mail installation handled the spam and virus explosion of early 2004.

    The measured UBEs over a 3 moth period were 172,887 - only for their top-25 most spammed employees!

    --
    Notepad specialist & FAT administrator, group training available
  96. No false positives? by grahamsz · · Score: 5, Insightful

    How can you know you've had no false positives.

    Have you personally reviewed the 2.9M messages which were filtered out... if you have then i'd question the value of your filtering.

    I know i've occasionally had false positives and i get nowhere near your message volume. My personal favorite is the UK paypal-esque service NoChex which sends emails with the subject line "YOU'VE GOT CASH!!"...

    1. Re:No false positives? by Reziac · · Score: 3, Interesting

      The sysop of a local BBS grew his own spam filter, based on all sorts of header criteria, as observed in actual spam. It fails very rarely, maybe once or twice a year (either a false positive or a spam let through) and yes, he DOES hand-vet the results (did so every day for months, until he was absolutely sure it could be trusted, and still checks it on a regular basis).

      Anyway, if an amateur could do that well, I'm sure close enough to 100% accuracy *can* be achieved by a professional solution. In fact, it's made me wonder why some solutions don't perform better than they do.

      --
      ~REZ~ #43301. Who'd fake being me anyway?
    2. Re:No false positives? by mce · · Score: 1
      How can you know you've had no false positives.

      Have you personally reviewed the 2.9M messages which were filtered out... if you have then i'd question the value of your filtering.

      The key is when you deal with the spam. I use a custom filter as well. While it does not achieve 90% filtering for the real spam, it so far caused just 3 false positives over an 8 months timeframe (I get about 60 mails per day at work and about 120 at home (mainly because my home address is on LKML and the fetchmail-fiends list)).

      I know these statistics because I quickly scan the spam once per day at a moment when I have 2 minutes of spare time in between meetings or some such. Whereas manually evaluating and deleting each spam separately as it comes takes a lot of time, processing them in bundles of several tens that are very likely to be nothing but spam can be done rather quickly.

    3. Re:No false positives? by Anonymous Coward · · Score: 0

      * Strong rules list.
      * Good bayesian training.
      * Manual auditing (easily done based on subject only and occasionaly a few lines of body)
      * Maintained whitelists.
      * Custom tuned spamassassin rules.
      * Retention of all mail on server for awhile just in case.

      In addition, the spamassassin devs run statistical analysis of their rules based on a large corpus. With a score of 12 or higher, there is a possibility of 1 in 10,000 messages being marked falsely positive. A score of something like 15 is incalculable.

      Manual auditing (run a script to gather subject titles of messages without obviously unwanted atachments and scan over them - easy to pick out wanted and unwanted messages this way).

      After awhile, it becomes clear that there is no need to continue monitoring so closely based on proven reliability. And just in case anyone ever complains that they sent you a mail you never got, you retain the mail for a couple months.

      Simple enough.

    4. Re:No false positives? by Anonymous Coward · · Score: 0

      I don't believe this. Your saying someone reviews a few thousand spams a day for non-spam.

      What is the prupose of the spam filter then?

      Ruben

    5. Re:No false positives? by conJunk · · Score: 1

      based on all sorts of header criteria, as observed in actual spam

      right... this is about sampling

      just because one user can custom-tailor a system based on the kinds of mail he receives, doesn't mean that these specific header criteria are appropriate for all end users

      for example, i live in japan, and regularly recieve email from all over the US, all over japan, france, and kazakstan (with occaisional messages from the UK and spain)... so, im dubious that the "specific header criteria" that worked for your sysop would be 100% reliable for me, or for any wide and varied user base

    6. Re:No false positives? by Reziac · · Score: 1

      Actually, this spam sampling is not just for his own spam, but for all that received by all the BBS's users past and present, so it's quite a broad spectrum, and was archived over a space of a couple years while the filter was being developed. (We had some past users who spread their email addresses far and wide -- signing up on porn lists and the like -- to the point of being fullscale spam magnets. And different users got different types of spam.) It does NOT filter by subject line content, but it does filter on bogus subject lines, like those that start with 200 spaces (never seen outside of spam).

      Certain points were frequently the same regardless of the spam's origin, most notably mismatch of IP address and/or hostname between particular lines in the header, and also some bogus MIME types in the non-virus attachments that commonly accompany spam.

      Spam getting through to any account here became such a rarity as to be a WTF-moment. False positives are limited to a very few senders (including one small ISP that has known internal issues with their mail setup) that for some reason put bogus header info on outgoing mail, and those few were easy to whitelist.

      Conversely whatever lame-assed *commercial* filter Earthlink is now using is only about 80% effective (and dropping), and a little experimentation showed that it is filtering only on subject lines -- it will also filter out a legitimate forward of a spam with a classic subject like "enlarge your penis" even if it CAME from my own account! so I'm sure its false positive rate is equally bad.

      Anyway, I know spam type varies by your location, who your ISP is, etc. (frex, my Hotmail and ELN accounts have almost NO overlap in the types and origins of spam each gets). But our sysop found that some criteria are universal enough to choke out a broad spectrum of spam of any origin.

      --
      ~REZ~ #43301. Who'd fake being me anyway?
    7. Re:No false positives? by conJunk · · Score: 1

      shit :)

      what a good way to do it! look at DNS/hostname matching for a start... what a good indicator...

      why don't the big commercial filters do it this way?

    8. Re:No false positives? by Reziac · · Score: 1

      I've wondered that myself -- LIS, if an amateur who doesn't know shit about the protocol but could see that "this here part is clearly fake because it doesn't match that there part, which ALWAYS matches in non-spam email, therefore it is spam" -- then why the hell can't commercial spamfilters do as well, especially considering that a mail server IS in a position to do a realtime confirmation?

      There was one small local ISP here in L.A. that did confirm whether the sending host was live before it would put an email in the user's inbox. I'm not sure how it worked beyond that, but the result was that it killed most incoming spam.

      --
      ~REZ~ #43301. Who'd fake being me anyway?
  97. Re:Why not tell the spam filter that non[A-Z] = sp by cpghost · · Score: 1

    How would you send program[-fragments] and other non-[A-Z] mails? Tagging [^A-Z] as likely spam could wreck havoc in many mail settings.

    --
    cpghost at Cordula's Web.
  98. Greylisting is like a puzzle piece... by Burning1 · · Score: 1

    ...It's not that great alone.

    Greylisting forces a delay between when a spam is originally sent, and when it's finally accepted. Using existing systems such as Razor, DCC, you can use that small window of time to block a lot of crap.

    The best spam defense is in layers. SpamAssassin and Mimedefang can bring a huge number of simple spam and virus filtering techniques together in a way that is very, very hard to defeat.

  99. Centralism has its costs by urdak · · Score: 4, Insightful

    I've seen this happen in my local University too.

    Take a university that has thousands of people actively using email, and thousands of computers, probably a hundred of which function as mail server. Now, decide that "we need a central mail server to filter viruses and spam". Take a few useless machines lying in the computer center, and make them the mail server that's supposed to replace the hundred you had previously. Then slow down the new mail server by applying every concievable virus and spam filtering.

    What do you get? Incredibly slow service (sometimes mails get stuck for hours or more in the queue), single point of failure, and officially-mandated false positives (noone in the university can avoid them). AND, you still get a lot of spam.

    Computer centers must know that if they want to centralize a service that was previously decentralized (different departments and individual running their own mail servers and filters), they must be prepared. Prepared to handle the load (Google had to buy 100,000 machines to handle their load!), prepared to handle the humans who use their service, and prepared to handle exceptions (a person or department that doesn't want the centralized filtering). Often, these computer centers don't think of these issues in advance, causing things like described in this article.

  100. Re:Who are the crackheads that modded this shit up by mp3phish · · Score: 1

    "We can use Babblefish for ourselves, thank you very much."

    We can also subscribe to cable and get CNN and MSNBC and FOXNEWS ourselves, but most people don't and that is why major news needs to be posted to the local networks....

    It is about informing the masses buddy, not karma whoring. You'd be surprised the number of people who didn't read something because it wasn't translated. Most people don't sit on their computers all hours of the day and night reading slashdot and other various important websites. Most people just don't have time for it.

    If posting this translation rewards some sort of bonus, thats even better. Just more incentive for people to post information for the public to easilly read.

    --
    Your ignorance is infinitely greater than you realize.
  101. End of email? by Frodo420024 · · Score: 1
    Uh - I'm afraid it's a yes :(( Email isn't dead, it just smells that way :(

    Since one of the large virus outbreaks last falls, I've been at 300+ emails a day, mostly virus, spam second. It just doesn't fade away. Bogofilter does a good job, and it's doable to weed out most of the useful stuff from the junk, but it's still much more timeconsuming than it used to be.

    My solution is to take important projects away from email to alternative forums like Wiki's, SourceForge and the like.

    --
    I'm in a Unix state of mind.
  102. SMTP Tarpits are another powerful tool by Phatmanotoo · · Score: 4, Insightful

    Spamd and other means for "tarpitting" the calling SMTP are another great tool to be used in combination with RBLs and bayesian filters.

    It's a strategy in layers:

    • Apply tarpit to the most nasty IPs (maybe keep your own blacklist, since this could consume resources on your firewall)
    • Use RBL's as the second barrier; this is what will save most resources on your smtpd sever.
    • Use spam and virus filtering as the third barrier.
  103. MailScanner by Anonymous Coward · · Score: 1, Informative

    A very useful and free mail email scanning tool that is fast & GPL. (Please visit the sourceforge link if at all possible).

    Mailscaner at Sourceforge

    Mailscanner website

  104. You don't know how exactly they did filtering by RedLaggedTeut · · Score: 1

    Suppose they had some scheme to detect spam which involved taking the equivalent of a vector product with known "spam" emails (and doubling the score if "Nigerian" was in it), then it might take quite some time to filter all of it. And they might be sharing some files over network to slow it down. And they might use triple filters/servers for filtering spam, their homebrewn filter, and viruses.

    --
    I'm still trying to figure out what people mean by 'social skills' here.
  105. German Law [Was: I wonder] by krischik · · Score: 1

    The law in Germany is clear: If you take on a Message for someone else you must deliver. Payment is not required.

    One alternative is not to take the message in the first place. That is you have to filter right inside the smtp Server and reject the message with an error code.

    Other alternative is to use IMAP and filter the mail into different folder.

    An other alternaive is an opt-in service.

    The last option is very successful in Germany.

    With Regards

    Martin

  106. I think the article may be misimplying the load . by millisa · · Score: 2, Interesting

    It doesn't say breaking down after 100k emails a day. Everyone here knows most mail servers can do that on junk hardware in a day(yes, Even exchange can do it).

    It sounds more like they are having problems when they start reaching 100k messages in the queue. Anyone who's dealt with tracking a large number of small files across a file system knows that there can be slow downs (not that there aren't solutions to those, but they may not have been able to spend the time to address the problem since they've been 'fighting fires'). When my incoming postfix/amavis/spamassassin systems get 100k or so mails in their queues on ext3 file systems, they start behaving badly too. We addressed the 'fire' problem by throwing more front end servers at it while we take time to rethink our file systems where the queues reside. We'll get the the luxury of a few weeks to address it with other hardware before we start getting unacceptable delivery delays again (for us, thats
    Universities don't always have the money to throw hardware at a problem like this or are willing to give their often student supported IT administration the benefit of the doubt that 'we need $20k (euros, lira, beads, whatever) to buy some hardware to roll a better solution'.

    Yes, I'd be surprised too if they mean '100k emails a day and we bog down' . . . I just seriously doubt that is what they mean. Maybe they are stopping their spam/virus processing just to clear their backlog. Maybe its not that they aren't receiving it & spam processing it fast enough; maybe its their backend server that is taking it all in just can't keep up. I mean, if they've got 20 spam/virus receivers that are getting the job done and trying to hand off to one fat exchange box that isn't keeping up then their queues are going to grow on those front ends and eventually kill them which makes it look like their spam/virus scanners are causing the delays.

    Then again, they could be a bunch of retards and everyone is right that they don't know how to run even a low volume mail server . . . but somehow I doubt it . . .

  107. Beginning of the end by Andy+Smith · · Score: 1
    Is this the beginning of the end of e-mail?
    No, the beginning of the end of e-mail was when someone thought of sending unsolicited adverts by snail mail, someone else agreed with them, and our governments did effectively nothing to stop them. Decades later it was a natural progression to start sending those adverts by e-mail, and again, not a whole lot has been done to prevent it.
  108. It's a moving target by Cesare+Ferrari · · Score: 5, Insightful

    Because once a solution becomes commercial, the spammers get hold of it and work out how to modify their spam so that it gets through.

    1. Re:It's a moving target by David+Horn · · Score: 2, Interesting

      I don't suffer from spam as much as I do from emails bouncing back to my inbox from the sender saying "YOU'VE GOT A VIRUS!!!!!"

      After checking headers, none of these have come from my server but they have my name and email address as the sender. It pisses me off no end when I get near enough a thousand of these a day when none of them are from me.

      That's the reason so much useless traffic is on the net - bounced email reports pinging backwards and forwards and backwards and forwards and, well, you get the idea.

      Would it really kill this software to check to make sure that the sender's domain and reported email address match?

      --
      PocketGamer.org - For the gamer on the go!
    2. Re:It's a moving target by Cesare+Ferrari · · Score: 1

      Yeah, the virus scanner people generate a fair bit of traffic themselves. It does go to show though that there is a fine line between providing a useful service to the less well informed, and spam.

      Putting it another way, i'd prefer if the average joe who doesn't know much about this stuff at least was informed that their machine was infected with a mail sending virus. If only a few of them acted on it...

    3. Re:It's a moving target by Reziac · · Score: 1

      True, but in developing the BBS's spam filter, the main criterion was whether all the header's parts match and that none are obviously bogus. Anything that failed those tests got put in the spam bin for later examination and adding to the filter's string match. It does absolutely no filtering on subject or content.

      http://eqcitybbs.tripod.com/files.htm#Download

      --
      ~REZ~ #43301. Who'd fake being me anyway?
  109. I've got a better idea by Greyfox · · Score: 1

    Just turn the mail servers off completely. Once you hit the 98% crap level, the service is completely useless anyway.

    --

    I'm trying to teach myself to set people on fire with my mind... Is it hot in here?

    1. Re:I've got a better idea by Cinquero · · Score: 1

      Nope. I filter messages based on the condition that the sender exists in my address books...

    2. Re:I've got a better idea by Greyfox · · Score: 1

      Fair enough. Do you do that at the MTA level or the MUA level? Seems like it'd still waste a lot of bandwith and storage space if your mail server accepted the entire E-mail prior to you filtering it.

      --

      I'm trying to teach myself to set people on fire with my mind... Is it hot in here?

  110. Problem: by edunbar93 · · Score: 1

    1) ISPs are fighting for market share. They need that 20% of the population that is retarded enough to buy from spammers.
    2) If you kick people off for buying from spammers, they will go to some other ISP who will welcome them with open arms.
    3) Even without e-mail these idiots will find a way to buy from spammers.
    4) As much as we would like an entrance exam for using the internet, it will never happen. It's also an extraordinarily arrogant thing to even consider, you insensitive clod.

    --
    "No problem. I have the capacity to do infinite work so long as you don't mind that my quality approaches zero."-Dilbert
  111. I'm a JoeJobber by ZeekWatson · · Score: 1

    Your idea should be marked at -1 stupid.

    Rejecting spams potentially creates a bounce message which is just joe-jobbing some innocent 3rd party.

    If you don't know what joejobbing is, it is when someone gets 100,000 bounces from a spam run because people thought it was l33t to rejects spams.

    NewsFlash! Rejecting spams is a dumb idea.

  112. That would reject all mailing list traffic by ZeekWatson · · Score: 1

    Your idea has a fatal flaw. Almost all mailing list traffic would be rejected under your scheme (ie LKML, p5p, Parrot, etc)

  113. Um... by FrostedWheat · · Score: 1

    Maybe because they are German?

  114. Why not sign email... by oliverthered · · Score: 2, Insightful

    Why not sign email, at the mail routers and gateways.

    Email from large organizations could then be given priority (you'd know who it was by the signiture).

    If an organizations starts spamming remove there signiture from the trust list.

    --
    thank God the internet isn't a human right.
    1. Re:Why not sign email... by Cinquero · · Score: 1

      Don't think that would work.

    2. Re:Why not sign email... by oliverthered · · Score: 2, Interesting

      Why not, do tell.

      Lets say that there are a few thousand trusted parties,(shouldn't be too hard to set up).

      They are the top email servers (apart from spammers).

      Any mail from the servers gets priority delivery. (you know that it's really is from the servers because they've signed the message).

      Everything else (sorry all you who run sendmail/postfix at home), gets slow tracked, along with the spam.

      If a trusted sender is found to be sending span there trust certificate is removed and they get slow tracked.

      Known spammers could be put in the even slower mail delivery pool.

      --
      thank God the internet isn't a human right.
    3. Re:Why not sign email... by Cinquero · · Score: 1

      What do You mean by low-priority? Do You artificially slow down the servers so that, eg. the lower (what ever that means) 20% don't ever get through? If not, keep in mind that, usually, all mail is being delivered at once. Therefore such a priority has no meaning in general...

      I even think that it cannot be done _politically_. Too many just don't like such behaviour. I am, for example, one of them. The internet is free. And it should remain free. For me, that has a higher priority than any spam protection.

      And, of course, there are better methods. For example: http://www.livejournal.com/users/cinquero/11478.ht ml

    4. Re:Why not sign email... by oliverthered · · Score: 1

      At the moment the servers are artificially slow:
      A lot of the email is junk (spam).
      and all the emails need to be filtered.

      A potential solution could be to assign levels of trust to servers by allowing the servers to sign messages sent from them.

      If you don't have any trust then your treated as a potential spammer, so your emails are delayed by all the spam.

      If you do have trust then you skip the spam filters, or are only party to low level spam filters. so your emails are sent at near optimal speed(optimal speed being: no filtering in place).

      You could set up different trust levels, most companies will never send spam, unless they are hacked, so they can be highly trusted.

      If a spammer hacks a site then they should be dealt with.

      More open companies like hotmail(who have some potential for spam),if they can mange to keep there spam levels down, get a high trust level, otherwise they get a medium, low or nill trust level.

      Joe blogs could apply for a low level of trust and be dealt with if they spam.

      Everyone else gets treated as potential spam,it's still open, we just don't trust you because you could be a spammer(which is exactly what happenes at the moment).

      Because the filtering is based on a simple trust algorithm the overall overhead of scanning mail for spam goes down, speeding even the spammers up.

      Breach of trust would be more legally binding than the current spam climate, so spammers wouldn't have a leg to stand on if they breached or forged trust.

      --
      thank God the internet isn't a human right.
    5. Re:Why not sign email... by oliverthered · · Score: 1

      I'm proposing , more-or-less the same solution as your
      better method
      except filtering should be applied at the first possible opertunity based upon how much you trust the certificates of the senders.

      In your 'better solution' what's to stop spammers changing keys all the time unless you have to pay someone for the key who then assigns you a level of trust.

      --
      thank God the internet isn't a human right.
  115. Premier jumk protection method of (my) choice by Cinquero · · Score: 1
  116. Probably just a gateway machine by Moderation+abuser · · Score: 1

    We have 2 Solaris/Sendmail boxes as our mail gateway and about a thousand Exchange boxes(and admins to support them) on the internal network.

    In this case, they also have 2 gateway machines:

    rzcomm5.rz.tu-bs.de and rzcomm15.rz.tu-bs.de

    Having said that, the spam processing itself can be slow, especially if the machines have to query external hosts or processes asking if a mail looks like spam.

    --
    Government of the people, by corporate executives, for corporate profits.
  117. Stone, meet glass house by Kjella · · Score: 1

    "Your idea should be marked at -1 stupid.

    Rejecting spams potentially creates a bounce message which is just joe-jobbing some innocent 3rd party."

    That's exactly what he would avoid. The SPAM is rejected at delivery, hence there's no need for a bounce message.

    No real-time filter:
    Spam server -> Real server
    ->SENDING EMAIL
    <-MESSAGE ACCEPTED
    Real server -> JoeJobbed server
    ->SENDING BOUNCE
    <-BOUNCE ACCEPTED

    With real-time filter:
    Spam server -> Real server
    ->SENDING EMAIL
    <-MESSAGE REJECTED

    And had it been non-spam:
    Legitimate server -> Real server
    ->SENDING EMAIL
    <-MESSAGE REJECTED (mis-id as spam)

    And the legitimate server would send a "delivery failure: rejected as spam" to the user.

    Kjella

    --
    Live today, because you never know what tomorrow brings
    1. Re:Stone, meet glass house by Anonymous Coward · · Score: 0

      Sure. And what if the mail was relayed ?

      Spam server -> Relay Server
      -> Jay a mail - Accept

      Relay server -> Your Server
      -> Jay a mail - Reject

      Relay server -> JoeJob Victim Server
      -> Argl a bounce - Accept

      Please don't do it.

    2. Re:Stone, meet glass house by metamatic · · Score: 1

      What's the alternative?

      I don't have time to read the e-mail filtered by my spam filters, so you'd rather false positives just vanished into a black hole and the sender never found out?

      --
      GCHQ Quantum Insert installed. If only our tongues were made of glass, how much more careful we would be when we speak
  118. I've got one too... by nagora · · Score: 1
    You could also try my greylister: Coherent Mail Gateway at Freshmeat. It works pretty well as long as it runs on all your mail servers (otherwise the spammer will just send to the lower priority servers instead).

    There'll be an update this summer but the current version can run Clamav and check Spamhaus for blacklisting.

    All written in Perl so it should run fairly easily on everything.

    TWW

    --
    "Encyclopedia" is to "Wikipedia" what "Library" is to "Some people at a bus stop"
  119. Book 'em by daminotaur · · Score: 1

    When the Communications Decency Act was being argued in the Supreme Court, opponents of the act contended that a "technologic fix" was sufficient, i.e., filters. This was disingenuous, but served the argument to overturn the law. Immediately afterwards, the same lawyers set to work suing libraries and universities who had the temerity to install filters. What is needed is a rejection of this idea that the internet be a wild west of no laws, with the burden of protection on the individual. The telephone spam problem was solved with a LAW (shudder), not some kludgy filter, vigilante blacklist, "Bayesian analysis" or other wankoid spy-vs-spy nonsense.

  120. Dumb filters from dumb admins. by Anonymous Coward · · Score: 0
    sed 's/<.*?>//g' is even cheaper.

    And will also strip out things other than HTML tags. Maybe nobody ever sends emails with code in through your server...
    #include <stdio.h>
    int main(void) {
    printf ("whoops, let's hope the recipient knows enough C to be able "
    "to restore the header name you just stripped out...\n");
    return 0;
    }
  121. Its hard work, but you can get close... by smoker2 · · Score: 2, Informative

    I run my own webservers, with mail service etc.
    1 good thing was to make sure every user has a defined email address, or alias to their username. That means I can send a good 85% of mail straight to /dev/null as most spam is sent to madeupname@domain.com

    The rest of the spam is due to people leaving their addresses in plain site (on web pages etc) and not having virus free computers.

    I also run MailScanner to remove viruses, before the user can get to them, but I don't use spam assassin, because thats not my problem. The users are, to a large extent, to blame for the amount of spam going through the server, (see above) and I don't see why I should deprive them of their ill-gotten gains !
    My spam count in my inbox is virtually zero, the few I do get are forwarded from other servers, but are trivial to delete.
    If only people would use personal certificates to identify themselves, then spam filtering would be so much easier.

  122. No, spamd is a tarpit. by fuzzyping1 · · Score: 1

    Actually, spamd is known as a "tarpitting" approach. It uses a PF table of CIDR blocks based on the RBL's to cause the relay servers' mail spools to back up indefinitely.

    Greylisting is a newer feature to spamd, providing the ability to whitelist once the sender retransmits after a temporary failure. This feature was added to spamd by Bob Beck on 2/26/04.

  123. Errr... by RAMMS+EIN · · Score: 1

    ``Specify in the header that it is NOT a real spam so you don't get blacklisted.''

    Yeah, right. And spammers can't use the same mechanism to avoid getting blacklisted?

    --
    Please correct me if I got my facts wrong.
  124. viruii? by N3wsByt3 · · Score: 1

    It's virii, you unsensitive clod!

    It says so in my 1337 dictionnary!

    --
    --- "To pee or not to pee, that is the question." ---
  125. no unhappy usres complaining of missing emails... by Anonymous Coward · · Score: 0

    Most importantly, no unhappy usres complaining of missing emails...

    hahaa... funny!
    of course they don't complain about missing email, they never got any, so they don't know what to complain about.

    although, sometimes some mail service providers warn their users about possible loss in services or something like that, and i have seen it happen. just recently one local free email provider had warning on their page that it could take up to 5 days to delover some emails, and it actually never delivered emails that i sent to someone who used (back then) their service.

    and further more, about a year ago, i got two e-mails that were never deliverd... i only know about those emails because i have set up my account to send a copy of my emails to my cell phone as SMS. (or whatever of it fits in 160 symbols)

  126. No .. by fearlessfreddy · · Score: 0, Flamebait
    Is this the beginning of the end of e-mail?

    No, this is the beginning of the end of journalism.

  127. 20 servers? by night_flyer · · Score: 1

    maybe they need to upgrade or something, where I work we have 2 (two) servers that delete/quaranteen approx 100,000 messages a day, this is not including regular mail...

    both are running exchange

    --


    Thanks to file sharing, I purchase more CDs
    Thanks to the RIAA, I buy them used...
  128. destroy your own email by r00t · · Score: 1

    For your own personal email, go ahead and do that.

    The article was about a university server. You'll
    piss off every tenured professer, paying student,
    and administrator if you completely wipe out the
    cutesy stuff people like to send each other.

    There's a limited amount of mangling that must be
    done to protect the less-clueful users on campus
    and reduce storage requirements for spam.
    Beyond that, it's up to the user.

    1. Re:destroy your own email by geminidomino · · Score: 1

      "It's up to the user" only works if there's any incentive for the user to not let his/her system become a spam-spewing zombie/virus factory/etc... If the primary fear is pissing people off, then you can bet they won't do anything about those either, which makes the whole thing kind of a moot point, until the uni's network ends up in blocklists (a la comcast and roadrunner)

  129. legalities of delivering virii and spam by smartfart · · Score: 1
    Ok, so what about the virii? Is anyone legally liable for not delivering malware? I would think that the law and common sense shelter the admin choosing to filter virus-laden email.

    What about spam? It may not be destructive, but in USA I can think of several laws that spam violates (wire fraud, CAN-SPAM Act, what else?) --- are we legally required to deliver spam to users?

  130. Doom! by mwood · · Score: 1

    Oh, it's *always* the beginning of the end for email. COBOL is dying and Apple is about to tank, I hear.

  131. perhaps take a page from another institution by ChoyLeeFut · · Score: 1
    As written up recently in Linux Journal:

    Quote:

    HEC Montréal is Canada's first management school, founded in 1907. More than 11,000 students and 220 professors use HEC's e-mail system every year. Unfortunately, the proprietary e-mail system did not evolve and as the load started to increase, the infrastructure could no longer keep up with requirements.

    [snip]

    HEC Montréal is a tough e-mail problem: 35,000 users and more than 600,000 spam messages a week.

    Read on for the details.

    --

    The postman hits! The postman hits! You have mail.

  132. Re:Why not tell the spam filter that non[A-Z] = sp by pknoll · · Score: 1
    Sample tech-related email:

    I was comparing 802.11b and 802.11g the other day, and wondered why 11Mb fell back to ~2Mb even three feet from my MX4550 base station ...

    That's one reason why a straight ^[A-Z] wouldn't work. That would have to be one smart little regexp.

  133. I missed the joke. by some+guy+I+know · · Score: 1

    Whoops, sorry; I missed the joke.
    It happens sometimes.
    (Some of my joke posts are marked troll or off-topic, so it happens to me, too.)

    --
    Those who sacrifice security to condemn liberty deserve to repeat history or something. - Benjamin Santayana
  134. Re:I'm baffled at what is slowing their servers do by pclminion · · Score: 1
    Whose filter takes 17 seconds to process and scan one mail? I know that DNS lookups can take time, but doing regexps on text documents certainly doesn't take much by comparison.

    SpamAssassin is horrifically slow. Assuming they are using SA, and maybe a few other filters on top of it, and assuming the machine it's running on isn't the best in the world (say a 10 year old SPARC), I can easily imagine it taking 17 seconds per mail.

    SA works pretty well, but JEEZ, is it fucking slow.

  135. Spam can't be all that bad... by Anonymous Coward · · Score: 0

    I'm still mystified that espionage and anti-terrorism measures, or, from the private sector, vigilantism and lynching hasn't been invoked against spammers. I keep hearing how 90% of all spam is initiated by mere hundreds or thousands of people. Based on the economic costs alone, apparently folks think spammer's lives are worth hundreds of millions of dollars since everyone's willing to do nothing to stop the problem at its source. Not even the US government believes average citizens are worth that much (the average value of a human life for environment cost purposes is ~$6.8M). At what point to would spammers simply become "expendable" given the cost they inflict?

  136. ObGhostbusters by soulsteal · · Score: 1

    Dr. Raymond Stantz: Everything was fine with our system until the power grid was shut off by dickless here.
    Walter Peck: They caused an explosion!
    Mayor: Is this true?
    Dr. Peter Venkman: Yes it's true.
    [pause]
    Dr. Peter Venkman: This man has no dick.

  137. real easy fix by ShinGouki · · Score: 1

    1) rm -rf sendmail
    2) install qmail
    3) ????
    4) profit!

    --
    -dk
    Dream with the feathers of angels stuffed beneath your head.
  138. Re:Why not tell the spam filter that non[A-Z] = sp by mbourgon · · Score: 1

    Okay, A-Z, 0-9, and a period. Then one word of yours wouldn't work, and I'm sure you could set some sort of threshold... x words out of n in a row. But this is all picking nits.

    --
    "Sometimes a woman is a kind of religion, she can save your soul & set you free from all your sins" - Bad Examples
  139. IMAP mail and allowance lists by phorm · · Score: 1

    Before I started running mainly my own mailserver, I used to keep an account at gmx.net. At the end of a certain period, they would summary email me stating which messages were marked as SPAM and were to be summarily trashed. If I checked my mail on time, I could catch emails which were not spam and move then to the "inbox" through a webmail interface.

    I've considered a similar system (but not had time to configure it yet) where a user could basically flag emails in a file similar to a .fetchmailrc: mail the user a summary of marked "spam" messages, with links to mark email such as:

    -This is spam
    -Subscribed (bulkmail that is wanted from a particular domain)
    -Known contact (mail wanted from a particular person)
    -Keyword/wanted (link to a form in which you could specify an identifier in the mail, such as LUG mails that are all have a prefixed subject).

    Legitimate emails could all be tagged with a footer that says:

    -Block sender
    -Block sending domain
    -Block by keyword