Slashdot Mirror


DSPAM v3.0 RC1 Spam Filter Released

Nuclear Elephant writes "DSPAM v3.0 RC1 is now available for download, with a stable release scheduled for June 13. DSPAM has appeared on Slashdot and in Wired News in the past for its high levels of accurate spam filtering. v3.0 is the product of three solid months of work. Some of the highlights include a very sleek redesigned interface, PostgreSQL support, many mathematical enhancements, and support for many of Gary Robinson's algorithms (such as Chi-Square, Geometric Mean Test, and Robinson's technique for combining P-Values)."

182 comments

  1. How is this a YRO? by magefile · · Score: 3, Insightful

    I don't get it.

    1. Re:How is this a YRO? by Hannes+Eriksson · · Score: 1
      I don't get it.

      It is our god-given right to block any messages that are sent to us while we are online?
      Uhm.
      I say! It's my right online!
      --
      Geek rants since like... 2000 or something.
    2. Re:How is this a YRO? by Trashman · · Score: 2, Insightful

      maybe because It's your right (in the US at least) to not get spam? look at the recent legislation that's been passed.

      --
      Do not read this .sig
    3. Re:How is this a YRO? by Anonymous Coward · · Score: 0

      Actually it isn't. The submitter was wrong and simoniker didn't give attention.

    4. Re:How is this a YRO? by Anonymous Coward · · Score: 0

      Actually it isn't. The submitter was wrong and simoniker didn't give attention.

      Unlikely. The previous article on Slashdot was also YRO.

    5. Re:How is this a YRO? by Anonymous Coward · · Score: 0

      well no slashdot editor is giving attention.

  2. Good filter by vegetasaiyajin · · Score: 5, Informative

    I am using this filter and after some training it is very effective. Especially useful is the inoculation feature, which you can use to register a spam only address to spam sending sites so that it trains faster.

    --

    My heart is pure, but make no mistake, it's pure evil
    1. Re:Good filter by Three+Headed+Man · · Score: 2, Informative

      You could also try using Mailinator.com to use as a throwaway, although that's not really the intent you had, was it?

      --
      I'm probably at the karma cap. Mod up a funny troll instead, it lightens the mood :)
    2. Re:Good filter by nesthigh · · Score: 1

      SpamGourmet.com is cool as well..

    3. Re:Good filter by Seumas · · Score: 1

      I'm more than happy just using Spamassassin+Procmail. I might try DSPAM out, but not until it's available as a Debian package.

      I can't imagine it would be more accurate than Spamassassin, but when there's a .deb, I'll gladly test that out and see for myself.

    4. Re:Good filter by Ed+Avis · · Score: 1

      I wouldn't need to register a particular spam-only address; I get huge amounts of spam to made-up usernames at my domain. I used to get mail sent to any local-part @membled.com, but that became unmanageable about a year ago.

      --
      -- Ed Avis ed@membled.com
  3. Another one for the arms race... by Anonymous Coward · · Score: 5, Interesting
    How much more complex will spam filters have to get to gobble up all the CPU on the mailserver or mail client machine?

    I'm all for throwing technology at the problem, but I hope people still realise that having a complex (and effective) spam filter does not take away the millions of megabits of traffic wasted on UCE when it's in transit.

    1. Re:Another one for the arms race... by AntiOrganic · · Score: 4, Insightful
      I'm all for throwing technology at the problem, but I hope people still realise that having a complex (and effective) spam filter does not take away the millions of megabits of traffic wasted on UCE when it's in transit.
      If people stop receiving spam, and therefore the morons among us stop giving money to spammers by buying their crap, and thus remove all semblances of profits obtained through spamming, there won't really be much incentive to spam anymore, will there?
    2. Re:Another one for the arms race... by Hannes+Eriksson · · Score: 2, Insightful
      How much more complex will spam filters have to get to gobble up all the CPU on the mailserver or mail client machine?

      It already is. At 500+ users and 200 pieces of junk mail a day, that is already more mail than there are seconds in the same period. Would you think the new spam filters use less than 1 cpu second per mail? I hope you have a bad-ass mainframe for your companys spam filtering...
      --
      Geek rants since like... 2000 or something.
    3. Re:Another one for the arms race... by WormholeFiend · · Score: 4, Funny

      what I really like about this arms race is that news stories about "how bad spam is" are becoming a regular feature in numerous media outlets...

      what that means is that the opinion of the silent majority is being moved toward "angry mob" status, which, I believe will lead to the downfall of the Spam Kings.

      so if anyone is interested, I'm planning on opening an online store specializing in torches and pitchforks...

    4. Re:Another one for the arms race... by Senior+Frac · · Score: 3, Insightful

      If people stop receiving spam, and therefore the morons among us stop giving money to spammers by buying their crap, and thus remove all semblances of profits obtained through spamming, there won't really be much incentive to spam anymore, will there?

      Boy, that's a losing battle you propose. The spammer only needs one sucker out of 10 million to stay in business (since he steals his advertising costs). Yet, the defending network must educate all 10 million not to buy from spammers, an impossible task.

    5. Re:Another one for the arms race... by Karamchand · · Score: 2, Insightful

      Problem is many organisations aren't allowed not to deliver email which is probably spam. So they have to deliver it, probably only tagged (with an extra X-Header or some phrase added to the subject). I.e. people still receive spam they just have the possibility to trash it easier - which stupid people, i.e. people buying things advertised in spam emails, won't do anyway.
      Sucks, eh? :-/

    6. Re:Another one for the arms race... by Doctor7 · · Score: 1
      If people stop receiving spam, and therefore the morons among us stop giving money to spammers by buying their crap, and thus remove all semblances of profits obtained through spamming, there won't really be much incentive to spam anymore, will there?

      Right, because we all know that people with a no-longer-relevant business model are quite happy to give it up and move on to something else.

    7. Re:Another one for the arms race... by Kwil · · Score: 5, Funny

      Hey, you should send out some email about this service, I bet people would love the chance to buy in.

      Why, I think I know a place where you can send email to up to 2 million addresses for only...

      --

      That Jesus Christ guy is getting some terrible lag... it took him 3 days to respawn! -NJ CoolBreeze

    8. Re:Another one for the arms race... by Anonymous Coward · · Score: 0



      so if anyone is interested, I'm planning on opening an online store specializing in torches and pitchforks...


      Just find the contact info of all those people who are involved in the anti-spam effort. They're all sure to be interested in your products, and wouldn't mind an email about them :)

    9. Re:Another one for the arms race... by azatht · · Score: 0

      But if the "user" don't even reeceve the spam (i.e. the spam is stopped before it gets to the user), then he/she is unable to respond to it, and there will be no one from the network buying from spam.

      --
      ------- In the end there are no begining
    10. Re:Another one for the arms race... by afidel · · Score: 1

      Not even close to a cpu second per message. Barracude appliances can do up to ten million messages per day filtering both spam and virus's. Their accuracy is pretty damn good too.

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
    11. Re:Another one for the arms race... by Anonymous Coward · · Score: 0

      It looks like some developers at Barracuda are on the DSPAM mailing list and submitting patches and such, wouldn't surprise me if they were using DSPAM in their product (or planning to).

    12. Re:Another one for the arms race... by Anonymous Coward · · Score: 0

      Yeah, it worked so well at stopping the telemarketers.

    13. Re:Another one for the arms race... by bigberk · · Score: 2, Interesting
      but I hope people still realise that having a complex (and effective) spam filter does not take away the millions of megabits of traffic
      Hence WPBL, which uses sightings by statistical filters (like DSPAM) from multiple sites to build a real-time blocklist based on consensus sightings. Once the IP is on the blocklist, you don't waste bandwidth accepting mail from them.
    14. Re:Another one for the arms race... by the+grace+of+R'hllor · · Score: 1

      You miss the point. They need one in ten million of those who receive spam *now*. If a majority of servers block spam, 'ten million' people won't get reached, and the odds of getting through to the 'one' they need drop into insignificance.

      Thus they'd need to upgrade the amount they send, which at some point becomes unfeasible because all the damned mailservers are running so slowly.

    15. Re:Another one for the arms race... by Anonymous Coward · · Score: 0

      So send 100,000 extra spams per minute out - unless you're changing the content every single time, they will all suffer the same demise - being dropped, tagged, or quarantined. Combine a tool such as DSPAM with a tool such as TarProxy (or ipchains) and its source address reporting function can be used to block network addresses.

    16. Re:Another one for the arms race... by heybo · · Score: 1

      You know you have hit the nail on the head. This probelm will not be solved my fitlers. The traffic MUST stop. We still PAY for the bandwidth for bounced or blackholed mail. Maybe a cyber war against the assholes (yourbigvote.com) We as geeks could put a stop to all this if we tried.

    17. Re:Another one for the arms race... by heybo · · Score: 1

      We would also like to sponser tar and feathers on your online store. We also offer a service od skinning spammers alive with a dull knife. Our service is very afforable since we get some much pleasure from our work.

    18. Re:Another one for the arms race... by volkris · · Score: 1

      A spammer steals nothing.

      His entire advertising cost is paid for by people willing to pay it, that is, people willing to accept messages from completely unknow strangers.

      When you hand something over it's not theft, even when it's not in your interest to hand it over.

    19. Re:Another one for the arms race... by Master+of+Transhuman · · Score: 1

      "There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now."

      Change that to: Use in order of effectiveness - which means reverse order.

      --
      Richard Steven Hack - This sig is TOO GODDAMN SHORT TO DO ANYTHING USEFUL WITH! MORONS!
    20. Re:Another one for the arms race... by e_AltF4 · · Score: 1

      > A spammer steals nothing.

      You have NO idea.

      a spammer steals my bandwidth, disk space and CPU

      my mail server policy clearly forbids spam

    21. Re:Another one for the arms race... by That's+Unpossible! · · Score: 1

      He didn't say we educate 10 million not to buy from spam, he said we prevent those 10 million from getting the spam and having a chance to buy.

      --
      Ironically, the word ironically is often used incorrectly.
    22. Re:Another one for the arms race... by BlackHawk-666 · · Score: 1

      So wrong, the big spammers use zombie PC's to do the spam sending. Not only are they illegally accessing other peoples PCs, they are stealing the drive space and network bandwidth...and that's not counting the poor bastards who receive this rubbish.

      --
      All those moments will be lost in time, like tears in rain.
    23. Re:Another one for the arms race... by feargal · · Score: 2, Funny

      I always wondered why angry mobs wait until nighttime. If they just rampaged during the day, they wouldn't need the torches, and could carry machetes instead.

      --
      "A goldfish was his muse, eternally amused"
    24. Re:Another one for the arms race... by Ed+Avis · · Score: 1
      my mail server policy clearly forbids spam
      For computer programs, 'policy' is meaningless unless it is reflected in the behaviour of the program. If your mail server is happily accepting and delivering spam messages then clearly the policy you have configured is to allow spam.

      Otherwise, I could put up some obscure document on my website saying that downloading images is forbidden and then claim that anyone visiting the site is stealing bandwidth. This is nonsense of course - if I had a policy that images were not to be downloaded then I would configure the httpd not to serve them.

      Essentially, just be careful about using the word 'stealing'. It's a strong word and you can't use it to label any behaviour you don't like. I do not particularly wish to see advertising; this does not mean that advertisers are stealing my time and attention. Anonymous cowards are not stealing CPU resources from Slashdot by posting lame comments. And so on.
      --
      -- Ed Avis ed@membled.com
    25. Re:Another one for the arms race... by metamatic · · Score: 1

      what that means is that the opinion of the silent majority is being moved toward "angry mob" status, which, I believe will lead to the downfall of the Spam Kings.

      Yeah, those lousy spam kings, filling my inbox with their... ooh! a cheap way to make my penis larger! Where's my credit card?

      --
      GCHQ Quantum Insert installed. If only our tongues were made of glass, how much more careful we would be when we speak
    26. Re:Another one for the arms race... by swb · · Score: 1

      what that means is that the opinion of the silent majority is being moved toward "angry mob" status, which, I believe will lead to the downfall of the Spam Kings.

      Spam is too deeply involved with big business, either as direct suppliers (premium cost network connectivity, credit card services), or tangental involvement (list selling). Besides, the "silent majority" hated telemarking for *how long* before we got the fairly limp no-call list?

      If the government actually had an interest in stopping spamming, they would have done a RICO investigation of some of the more fraudulent spammed products and put everyone remotely connected up on several dozen federal racketeering, conspiracy, fraud and other charges that would have sent them all away to Club Fed for a decade, as well as encouraging many smaller spam entrepeneurs to go back to hawking Herbalife in RV parks.

      But we've seen little if any spam-related prosecution, only civil suit efforts by major ISPs. I'm pretty convinced that the Feds have been told it's a non-priority, partly due to Asscroft's terrorism paranoia, and partly because big business wants to keep spam as an option.

    27. Re:Another one for the arms race... by mi · · Score: 1
      I'm pretty convinced that the Feds have been told it's a non-priority, partly due to Ashcroft's terrorism paranoia, and partly because big business wants to keep spam as an option.

      Or, may be, it is just because spammers never hired hitmen to kill anyone? That they are not believed to have ever tried to bribe a judge, or kidnap a prosecutor's child?

      Using RICO laws against them may be just as inappropriate as some of the publicized (mis)applications of the PATRIOT act...

      --
      In Soviet Washington the swamp drains you.
    28. Re:Another one for the arms race... by volkris · · Score: 1

      Using "zombie PC's" is not necessary for spamming. If using a zombie PC is wrong, then prosecute that. Declare that it's wrong. But it's an entirely different matter than actual spamming.

      Declaring spamming to be wrong because of the use of zombie PCs is like declaring the playing of football to be wrong because some players choose to use illegal performance enhancers.

    29. Re:Another one for the arms race... by BlackHawk-666 · · Score: 1

      Since we have laws against hacking, and zombie PC's have been hacked, then yes, that is wrong in and of itself. But there are also laws against unsolicited email, which spammers are sending out, so that is also wrong. Let's not forget wire fraud laws in the US, since these spams are forging their from addresses and contain fraudulent statements they can be proscecuted for that too. Spamming is just plain wrong, and anyone who says otherwise is likely to actually be either a spammer, or a direct marketer, or someone who uses their services. I don't know of one person who has ever said to me they actually like this intrusive form of advertising.

      --
      All those moments will be lost in time, like tears in rain.
    30. Re:Another one for the arms race... by Kwil · · Score: 1

      Yeah, but some of us have to work during the day. Why do you think I'm here?

      --

      That Jesus Christ guy is getting some terrible lag... it took him 3 days to respawn! -NJ CoolBreeze

  4. Mozilla/Firebird work well for me ... by shm · · Score: 1

    Why would I need this?

    1. Re:Mozilla/Firebird work well for me ... by doormat · · Score: 1, Informative

      My copy of t-bird (0.6) its spam filter seems to suck more and more lately (perhaps its just the spammers are getting better at bypassing the filters). I just switched to server side spam filtering (just adding a tag to the subject), and then I key off that in t-bird.

      --
      The Doormat

      If you're not outraged, then you're not paying attention.
    2. Re:Mozilla/Firebird work well for me ... by Trashman · · Score: 1

      Simple, if what you have works for you then you probably don't need this.

      --
      Do not read this .sig
    3. Re:Mozilla/Firebird work well for me ... by Senior+Frac · · Score: 2, Insightful

      Wonderful, if you just want to stop seeing the spam. I, however, would enjoy not having to pay for it's delivery. This is the ostrich method of spam fighting.

    4. Re:Mozilla/Firebird work well for me ... by iconian · · Score: 3, Interesting

      I find that the spam letters that do get through T-Bird's junk mail filter are the ones padded with random strings of letters. My guess is that T-Bird is able to identify the spam words (eg: debt consolidation, enlargement) but the mispelled words (eg: peni5) are unknown to T-bird. So T-Bird makes the conservative decision not to mark the e-mail as spam. I figure a simple filter criteria that requires the correct spellings for at least half the words in the body (for unknown senders) should get rid of this problem. Anyone care to enlighten me if such a rule is in T-bird or is in the works? At the very least, this will have the side effect of encouraging people to at least spellcheck their e-mails before sending. :)

    5. Re:Mozilla/Firebird work well for me ... by WuphonsReach · · Score: 2, Interesting

      So T-Bird makes the conservative decision not to mark the e-mail as spam.

      T-Bird makes the mistake of making spam/ham a binary decision. I really wish it would work more like SpamBayes which has a trinary system (spam / unsure / ham). That works well because the stuff it tags as spam is almost always spam, and the false positives usually end up in the unsure pile. The "unsure" pile is also usually 1/10th the size of the "spam" pile, so it takes a lot less time to verify before tagging all of the "unsure" as spam.

      T-Bird has a ways to go before their system is as easy to use as SpamBayes for MSOutlook is. (e.g. moving messages back to the original folder if they were mis-tagged and then un-flagged by the user)

      --
      Wolde you bothe eate your cake, and have your cake?
  5. Great! by i+love+pineapples · · Score: 1

    Looks really promising, and I'll probably install it on my own e-mail server to give it a try. Now, how do we convince our ISPs to do the same?

    1. Re:Great! by GigsVT · · Score: 2, Insightful

      Be careful what you wish for.

      My mail hosting used to out and out block spam, and their filter wasn't very well maintained so it blocked lots of legitimate mailing list mail (like Securityfocus and NANOG).

      They've went to tagging mail now instead of dropping it, which is a lot better.

      ISP/mail server based blocking isn't really a good idea, even with ultra-conservative blocking, you'll still block legitimate emails.

      --
      I've had enough abrasive sigs. Kittens are cute and fuzzy.
    2. Re:Great! by i+love+pineapples · · Score: 1

      Excellent point. I really like the way my current provider is handling spam-- putting all the messages it thinks is spam in an IMAP folder, and then letting me file false positives and false negatives in special folders to help train the filters. However, the filtering model they're using now is really shabby, and doesn't even catch half of the spam I get. I'd love to see them keep the filing system and just replace whatever algorithm they're using to flag the spam.

  6. But will it? by ajiva · · Score: 4, Funny

    But will it find out who sent the SPAM and hurl them into the Sun? Until I get this feature, I don't think it'll be perfect :)

    1. Re:But will it? by dheltzel · · Score: 3, Funny

      I want a button on my mail client called "Retaliate", that will hunt down the sender, use various cracking techniques to take over their system, send back a copy of all their personal data, and subtly corrupt any email addresses it finds in any files or databases on the system. Optionally, it would locate some illegal content off the internet and copy it all over the filesystem, then send the IP address and other identifying info to the appropriate government agency.

      That would make it fun to get Spam!

    2. Re:But will it? by vinlud · · Score: 1

      Until you click on the button and realise directly that it was not the spam email which was selected but the invitation of your boss to discuss your promotion...!

      --
      Repeat after me: We are all individuals
    3. Re:But will it? by meringuoid · · Score: 1
      Retaliation against spammers, the eternal dilemma, the rights and wrongs of sinking to their level, fighting abuse with abuse, all that... But what it boils down to is a simple choice:

      Trident or Polaris?

      --
      Real Daleks don't climb stairs - they level the building.
    4. Re:But will it? by trezor · · Score: 1

      Wouldn't that be a rather mild reaction?

      No casteration by soldering-iron to ensure severe pain and cronic lack of reproductive skills?

      *shocked at the current /.-modesty*

      --
      Not Buzzword 2.0 compliant. Please speak english.
    5. Re:But will it? by dheltzel · · Score: 1

      Yeah, I forgot about that

      Still, it'd be a nice option. Might even teach some folks to be careful what they click (or what they wish for).

    6. Re:But will it? by dheltzel · · Score: 1

      True, and like nukes, it might have some deterrent value as well. I wonder if they might respect a black list a little more if they thought retaliation was a viable option for the recipient.

  7. Innovation - Statistical Hybrid Filter by ospirata · · Score: 4, Insightful

    DSPAM has a strong focus on providing better data to already existing algorithms (Bayesian, Chi-Square, etcetera) Combination algorithms work inherently well, but depend on the quality of data. Some of the approaches deployed in DSPAM towards this goal include Chained Tokens, Inoculation Groups, Classification Groups, advanced de-obfuscation techniques, and a new noise reduction algorithm called Bayesian Noise Reduction. The goal is to incorporate processing algorithms that can withstand the long haul of ever increasing message complexity. So far we're doing a great job.

    The idea of combining more than one anti-spam heuristic is not new. But one thing that cant be denied is that all methods are just complementar to Bayesian analysis, that can reach up to 95% precision by itself. Chi-Square, itself, can reach up to 85% precision

    1. Re:Innovation - Statistical Hybrid Filter by Antique+Geekmeister · · Score: 2, Interesting

      Friend, you need to take a look at the specs on CRM114 at crm114.sourceforge.net. While the interface and initial setup are fairly painful for people who don't build their own email setups, various folks are publishing that they get over 99.9% correct detection of both spam and non-spam. That's far better than any other single filter out there.

  8. Yay, we fixed spam! by Anonymous Coward · · Score: 5, Insightful

    Look! We came out with this great filter so nobody else gets spam! This solves the problem of spam once and for all! Even though spam is still clogging our networks and wasting bandwidth, this filter will solve all of our problems.

    With all the time spent on making spam filters, why don't we spend that time working out a new protocol for email transfers, one that would not be able to spoofed, or spend that time installing server side programs that put a small time delay between messages as well as bandwidth restrictions for all outgoing mail?

    1. Re:Yay, we fixed spam! by lawngnome · · Score: 2, Funny

      While I agree that this is not a cure all for spam, the bottom line is that it will make a difference. Spam only happens because people buy the crap they're offering. Stop the cash and spam will stop as a result, or evolve into huge robots that come to your house and steal gas from your car... gas stealing bastards, wilson I know you were behind this !!! Was this post informative, funny, offtopic or all three? I leave that up to you to ponder... :)

    2. Re:Yay, we fixed spam! by Senior+Frac · · Score: 4, Interesting

      With all the time spent on making spam filters, why don't we spend that time working out a new protocol for email transfers, one that would not be able to spoofed,

      Because there's nothing wrong with SMTP. SMTP already has extensions to allow authentication but it still requires a central authority to say "He is Senior Frac, we verify it." No one will trust such an authority even if it was scalable enough. If you think spam is caused by a lack of authentication, you're sadly misinformed. The cause is a lack of responsibility by the sending networks to enforce proper behavior of their users.

      or spend that time installing server side programs that put a small time delay between messages as well as bandwidth restrictions for all outgoing mail?

      These technologies exist. Unfortunately, most that install them stop monitoring them. Such work is considered a resource hog which the ISP would much rather spend on signing up new customers. Bandwidth restrictions on a customer who is running their own MTA makes things much more complex and much less scalable.

    3. Re:Yay, we fixed spam! by mabu · · Score: 1

      I appreciate what you're saying but the problem isn't with technology. It's with politics. Most spammers are breaking numerous laws, not the least of which are felony computer tampering laws when they use ghost proxies, and the larger problem is that the authorities don't seem that interested in going after them.

      Content-based filtering is a waste of time. The only exception to that would be to write a spam filter that sends a message to your local Attorney General trying to educate him on the illegal activities of spammers each time you receive a spam.

    4. Re:Yay, we fixed spam! by AbbyNormal · · Score: 2, Insightful

      Exactly! This is merely more duct tape to solve a leaking pipe problem. Look what happened with telemarketers! It became an epidemic, people got ticked off, and the FCC created the "Do not call list". Sure a few evil bastards found ways around it, but nevertheless, the amount of calls went down drastically. The same principles that kept telemarketers in business are the same that keep SPAM in business. There are a few morons that actually buy stuff from spam. I believe legislation is actually needed. Before everyone jumps out of their seat with statements like: "governments don't have the time/energy to go after every spammer", I say you are right.

      But what about the technically minded crowd? If a solution was delivered that could help speed up the nailing (or shutting down of zombie machines), and it was as simple as a "Spamcop" post, why wouldn't it work? Trace it back to the companies who peddle their wares in the SPAM messages and hammer them out.

      Technical solutions will never stamp out SPAM. Its similiar to the plight that the RIAA is facing. Come up with a "Secure" method of safeguarding media, and a few hours later it is broken. The arugments differ in that most people just want to listen to their own media and are not out to make a buck.

      --
      Sig it.
    5. Re:Yay, we fixed spam! by Thing+1 · · Score: 1
      Look what happened with telemarketers! It became an epidemic, people got ticked off, and the FCC created the "Do not call list".

      I still get calls coming through every once in a while. Others like to waste the telemarketers' time, chatting them up then saying "hang on a minute, let me get my credit card" and then just putting the phone down and going off and doing something else, checking back in a half hour to see if they've hung up yet.

      Seinfeld's response was great as well: "Okay, give me your home number and I'll call you back later so we can discuss this." (pause) "Well now you know how I feel!" (click)

      Me, I just say, "No, I'm not interested. Please take me off your calling list." Then I hang up. I don't need to get upset; they follow a script, and so do I. With SPAM it's not that easy because responding gives them the information that the email address is valid, and then it gets plastered all over the lists.

      Whitelists seem to work quite well; the biggest issue is getting a new friend onto the whitelist so that they can send you email. Having it bug you for each new sender's email address won't work since spammers are always inventing new "from" addresses. For my use, I'm using SpamBayes with Outlook (soon I'll be Windows-free, soon) and it seems to catch upwards of 90% of the spam I'm getting.

      They're getting sneakier, though; lots of spam now has misspelled words, and even some of it starts with what appears to be a story or a news article, totally unrelated, and then goes into the sales pitch. So I've been having to train more lately (the last couple weeks). Perhaps a whitelist where everything not on the whitelist goes into the "Junk Suspects" box, combined with a Bayesian filter? I don't have the answer, but there's gotta be one.

      --
      I feel fantastic, and I'm still alive.
    6. Re:Yay, we fixed spam! by dmaxwell · · Score: 1

      Perhaps a whitelist where everything not on the whitelist goes into the "Junk Suspects" box, combined with a Bayesian filter? I don't have the answer, but there's gotta be one.

      That is essentially what I do. I have instructed Spamassassin to whitelist friends, family, work, and some mailing lists. This has the additional effect of those mails being autotrained as ham. I also have a training folder that is like your Suspects box. Anything with a positive score winds up there. Every once in a great while, something valid is there but it's usually "innovative" spam that I use to train SA's Bayes filter.

      It has interesting behaivor. I'll go a week or two with nothing in the training folder. Crap will show up in it for a few days which then tapers off as I train the filter with them.

      I'm interested in DSPAM for a mailserver I maintain but it seems to me that I need quite a bit of user cooperation in the beginning for it to be effective. I only have a few users that are that motivated. I understand the maintainer's arguments about heuristic filters but heuristics do have the virtue of functioning from the beginning. What I would like to see is a Spamassassin with more statistical tests in addition to the Bayes test. Once enough mail is collected to blood the filters, the heuristics can be disabled bit by bit and the statistics tests have their scores raised. That process could even be automated.

    7. Re:Yay, we fixed spam! by Anonymous Coward · · Score: 0
      These technologies exist. Unfortunately, most that install them stop monitoring them. Such work is considered a resource hog which the ISP would much rather spend on signing up new customers.
      My users get 200 outbound messages in a 24-hour sliding window. If they go over, their account gets locked. (Software does this. I don't need to touch it.) I know it may sound like a lot, but how effective a spammer can you possibly be if you're so limited?

      On top of that, the outbound filter adds some stuff so I can instantly tell if the spam you've just forwarded to postmaster actually came from us. (This hasn't happened in a long time.) Sometimes I like to just leave the spammer's account active and make it seem like all their mail is going through -- when it's actually going straight to /dev/null.
  9. Spam is in our culture to stay by Jotaigna · · Score: 4, Insightful

    unless mail sending protocol is redesigned(for example,in a way you have to have your fingerprints recognized when you type it) we will have to face the fact SPAM will be in our daily news. Soon slashdot will put an article where the best 3 spam filters are compared, like a normal review.

    --
    "The quality of life is inversely proportional to the number of keys on your keyring."
    1. Re:Spam is in our culture to stay by linuxbaby · · Score: 4, Informative

      Spam filters compared, here. This article was linked from Slashdot a few months ago. Good info, too.

  10. hmmm by FS1 · · Score: 2, Informative

    Been looking for a new spam filter, hope this one does the trick. I tend to have alot of false positives with most spam filters i have tried. I would rather have a few spam slip through rather than having to weed through all my spam just because it may have blocked a real email.

    --
    A Fatal OE Exception has occurred, Sig will now reboot.
  11. Thunderbird, I meant Thunderbird! by Anonymous Coward · · Score: 0

    ... works for me ...

  12. Compared to other OSS projects by OnceWas · · Score: 1, Interesting

    How does DSPAM compare to other OSS projects like Spamassassin?

    --
    Laugh while you can, monkey-boy.
    1. Re:Compared to other OSS projects by Random+Web+Developer · · Score: 1

      Not true, I was wondering the same thing.

      If this guy wouldn't ve posted it i would, now people start replying.

      I am also using spamassassin and am quite happy with it. Is there any reason to switch and if so what?

      --
      Artists against online scams http://www.aa419.org/
    2. Re:Compared to other OSS projects by Anonymous Coward · · Score: 5, Informative

      As far as I know, the main difference is DSPAM does not use weighted filter rules at all like SpamAssassin's hybrid approach does - DSPAM is designed to purely rely on analysis of spam's properties (Bayesian, etc).

      The other cool thing about DPAM is that it is designed to let users add/modify their own spam database - every email DPAM processes is tagged with an identifier, and is logged in a server-side database. If a delivered email is in fact spam but wasn't tagged as such, the user can then forward the email to the designated spam-sorting address, and DSPAM will automatically update that user's spam corpus (eg, because it's tagged with an identifier, you don't have to worry about the user forwarding the full headers, as the server already has that info on file).

      AFAIK you can't do that with SpamAssassin.

    3. Re:Compared to other OSS projects by Anonymous Coward · · Score: 0

      er, DSPAM, not DPAM :)

    4. Re:Compared to other OSS projects by bourne · · Score: 2, Informative

      How does DSPAM compare to other OSS projects like Spamassassin?

      In short:

      • Less false negatives
      • Slightly more false positives
      • Slightly less plug-and-play
      • But overall, worth it.

      I am currently running an older version of DSPAM, which I switched to after the last time it hit /. I had been using SpamAssassin for years, and lately my SA false negatives had been creeping up, to the point where I could expect to see 3-10 spam a day in my inbox.

      With DSPAM, my false negatives have dropped to a trickle - somethine like 5 messages in the last month. My false positives are a bit higher; it tends to trigger more easily on various kinds of mass email - Daily Shark, alumni association events, Amazon.com email, DOD briefing transcripts. At the moment, that's less of a burden than the high false negatives were with SA.

      I had more trouble wedging DSPAM into my configuration, but that's because I didn't want to do it DSPAM's way (e.g., signatures in message body, forward email to an address when it is a false result, web interface for management). I basically want it to update the message headers, then let procmail/maildrop filter accordingly, and if it's a false pos/neg I want to just drop it into an IMAP folder which is emptied via the "learn from this mistake" program on a regular basis. YMMV but I think fitting into the mail pipeline is something DSPAM could do better.

      I trained off my existing corpus - e.g., let my SA-generated spam folder build up a bit, removed any false positives, removed SA markups, and ran that into DSPAM as spam corpus; did the same with all the normal mail that came in over a week or so, THEN switched. I've also set my wife up without as much training, and it took DSPAM longer to learn what was spam for her and what wasn't. So I think training it up beforehand with a corpus is a good idea.

      Overall, it was worth it to switch, and if I was good about upgrading to the newest I'd hopefully see my false positive rate drop.

      Just my .02.

    5. Re:Compared to other OSS projects by Anonymous Coward · · Score: 0

      erm, yes you can.

      $ cat .qmail-user-isspam
      | sa-learn --spam

  13. Is it easy to setup? by Trashman · · Score: 4, Insightful

    I tried to setup spamassasin a couple of months back and I found it to be too much of a hassle to setup. Could someone who used both spamassasin and dspam comment on easy or difficult it is to setup dspam?

    --
    Do not read this .sig
    1. Re:Is it easy to setup? by tricops · · Score: 2, Informative

      Well, using Gentoo Linux and evolution you don't really need to do too much in the way of configuring... I just emerged the package and added a piped filter rule to evolution. Unfortunately, it didn't seem very usable to me... no easy way to train it from within evolution, and it was taking like one to three seconds per message to process, which is kind of frustrating when your account tends to receive 80+ spams a day. (I know, that's still fairly minor, but that gives me like a 100:1 spam to real mail ratio.)

      --
      (\(\
      (^v^)
      (")")
      This is the cute vorpal bunny virus, copy to your sig or runaway, runaway in fear!
    2. Re:Is it easy to setup? by Brando_Calrisean · · Score: 2, Informative

      While I agree with you that it does lack integration with Evolution (I have a similar setup to yours), regarding the time it takes to process each message - you can add '-local' to your SA commandline and it will speed things up considerably. As far as training it, I set up a cron job to have it read and learn from my Spam and Inbox nightly. Not the most elegant solution, but it works okay.

      --
      Don't call me a cowboy, and don't tell me to slow down!
    3. Re:Is it easy to setup? by petabyte · · Score: 3, Insightful

      Are you piping it to spamassassin or spamc? If you have that much email it might make sense to run the spamd server (which is basically just spamassassin running all the time so you don't have to wait for it to start) and pipe the message to spamc to do its magic (the filter works the same). My advice is if you are really getting that much email, use spamd.

      Also it is posible to train spamassassin in evolution fairly easily. All you have to do are change two of the labels in evolution to "Ham" and "Spam". Then write 2 filter rules, 1 that says if its labeled "Ham" pipe it to sa-learn --ham; and another for "Spam" that does sa-learn --spam. Then you just change the label on the email you want to be spam, and apply filters to the message. There's a site on the web that has screenshots to go along with this but I can't find it at the moment.

    4. Re:Is it easy to setup? by humungusfungus · · Score: 3, Informative

      Easy is a relative term, but I think it's safe to say that you found spamassasin a hassle, you will not have an easy time with DSPAM.

      Like most good server-side software, it requires a moderately good understanding of it's general operation and at least a passing familiarity with its command line arguments and such. Having a handle on how to make your MTA do whatever you want, and the willingness to do some reading of faqs, mailing lists etc doesn't hurt either.

      In short, it's does take some mucking around to tweak it all out properly. Also of note, if you intend to use the cgi pictured in the screenshots, you should know something about setting up a webserver with proper exec priviledges for cgi.

      If you're thinking about using it only for yourself, I would recommend a cleint side solution like Mozzila Thunderbird or Eudora (win32 only) instead. They both have bayesian spam filtering built in and they're *really* easy to set up.

      --
      No sig.
    5. Re:Is it easy to setup? by tricops · · Score: 1

      Hmm, I was piping it to spamassassin but I'll have to give spamd/spamc a try. I just didn't see any note of that when I was looking around and found some pages on integrating it with evolution. Thanks for the info... and actually, as a side note... I was looking into the labelling thing, I can't remember how to label email offhand so I had a glance at the evolution site. I notice they have some evolution 2.0 pictures up. It appears that they're going to finally have something built in to deal with spam, since it there are "Junk"/"Not junk" buttons. That's more what I was thinking of/wishing for.

      --
      (\(\
      (^v^)
      (")")
      This is the cute vorpal bunny virus, copy to your sig or runaway, runaway in fear!
    6. Re:Is it easy to setup? by Fryboy · · Score: 1

      Evolution 1.5 (from breakmygentoo) has "Junk" and "Not Junk" buttons, and hooks into spamd, so you don't have to muck about with sa-learn ever again.

  14. It takes a lot to train by smartin · · Score: 4, Informative

    Warning, it seems to be designed more for high volume use than individual sites. I've fed dspam almost 3000 spams and it is still only catching 80%, does seem to be getting better though.

    --
    The difference between Canada and the USA is that in Canada healthcare is a right and gun ownership is a privilege.
    1. Re:It takes a lot to train by Anonymous Coward · · Score: 0

      You must be doing something wrong then. I get about 10-20 emails a day (the rest is spam). Blew away everything and started from scratch a couple months ago for fun, and i'm getting 99.95% accuracy.

    2. Re:It takes a lot to train by geirt · · Score: 2, Funny

      You must be doing something wrong then. I get about 10-20 emails a day (the rest is spam). Blew away everything and started from scratch a couple months ago for fun, and i'm getting 99.95% accuracy.

      So, you get 0.05% spam. Two months with 20 mails a day = 1200 mails. 0.05% of 1200 is 0.6. So, did you get a spam mail in the last two months, or not?

      --

      RFC1925
    3. Re:It takes a lot to train by Anonymous Coward · · Score: 1, Informative

      I got approximately 8000 spams in the past two months; the first month I considered "training", and started with the default training set on their website. The second month I got around 4000 spams and 2 made it through. 99.95% = 1/2000.

    4. Re:It takes a lot to train by Anonymous Coward · · Score: 0
      Correction.

      It _used_ to take a lot to train.

      Since the early v3.0 alpha's, I haven't bothered doing anything but on-the-job training. No corpus feed or anything. Here are my current results:
      DSPAM has caught 7432 spams

      ...learned 58 spams

      ...scanned 5692 innocent emails

      ...with 39 false positives

      Your SPAM Ratio is 56.65%

      Your SPAM Filtering Accuracy is 99.860% since last reset

      Your FP Rate is 0.638% since last reset

      Your overall accuracy is 99.641% since last reset
      It's due for a update, that's with 3.0 Alpha3. The important thing is, it started giving really good results after I had sent it about 20 spams as they arrive in the inbox.

      So my personal reccomendation is to forget corpus, it isn't worth the candle.

      ygnome
  15. Re:client-side versus server-side anti-spam by ubiquitin · · Score: 5, Interesting

    When you run your own mail server, or administrate a mail server for a large number of people, server-side anti-spam filters and countermeasures start making a lot more sense. Do the math on a company with 100 employees (at $25/hr) who check mail twice a day and spend 5 minutes each time hassling with anti-spam measures in client-side mail apps. In this scenario, a seamless anti-spam solution is worth conservatively $400 per day, or $100k/year not counting bandwidth savings. There are definitely cases when client-side filtering makes sense, but if you can handle it at the server, email-based business methods scale better.

    --
    http://tinyurl.com/4ny52
  16. Content based filters and spam by Senior+Frac · · Score: 3, Interesting

    I have not actually used DSPAM, but have just read the specs.

    Yawn. Yet another, albeit well designed, content-based filter. While content-based filters are a valuable tool, let's not forget that the spam problem is one of anti-social behavior and consent and has nothing to do with content. Using content as a factor in deciding what is spam or not spam will always be flawed. Even if you tweak your favorite filter from 99% to 99.9%, the spammers can just up the ante by sending more. Scaling up costs them little on an individual basis. It saddens me to see really brilliant people put great amounts of work into a project whose underlying premise is flawed.

    1. Re:Content based filters and spam by Matt2k · · Score: 3, Insightful

      Just because it is not perfect does not mean it is flawed or undeserving of effort. 99.9% accurate is 99.9% better than 0%

  17. a True AntiSpam measure by CodeTRap · · Score: 4, Insightful

    would be to publicly humiliate/boycott the companies that use the spammers services. Like drug dealers, as long as there is a market, the spammers will be around. Remove the demand, and the suppliers will eventually move onto selling something else.

    If you can't kill the leeches because the water is too murky, then boil off the pond!

    --
    CodeTrap (www.codetrap.net)
    1. Re:a True AntiSpam measure by Anonymous Coward · · Score: 0

      Exactly my idea. You might even take it a step further and twist it into showing the companies are using illegal services.

    2. Re:a True AntiSpam measure by chabotc · · Score: 1

      Oh great, and we all know how well the war-on-drugs is going..

      Oh ps, incase you haven't noticed those companies who push their products thru spam-vertising , arnt really well thought off, or well known to begin with (I for one never recognised any brand names for the verbal viagra or penis enlargers they sell, i'd hope the same goes for everyone!)

    3. Re:a True AntiSpam measure by jmv · · Score: 1

      Damn, I've been boycott Nigerian scammers for years and I still get those in my inbox. :( Obviously not the best solution, is it? (it's not like well-established businesses are spamming anyway).

    4. Re:a True AntiSpam measure by keraneuology · · Score: 2, Insightful
      Nothing will eliminate all spam. Period.

      That said, there are certain courses of action that would be quite effective against certain types of spam. For example, consider the dozen or so mortgage applications that arrive each day with specific promises along the lines of "$200,000 mortgage for $350 regardless of credit". If I were to reply some loan officer somewhere would presumably call me back. If said officer were required by law to give me $200,000 at $350/month you can believe that word would quickly get around that this particular lead source was no good and that particular individual would be forced to change tactics.

      To step up the pressure a bit, a law that revoked the license of any lender who purchased leads from any company that did not include a specific phrase - "this is an unsolicited attempt to procure a loan application" for example - would mean that lenders either use bulk emailers who provide a clear and consistent way to identify (and /dev/nul) to generate leads or lose their entire income. Ditto goes for insurance underwriters.

      For all spams that are not outright frauds there is a stationary target ultimately providing the goods/services. They are not hard to identify, nor is it difficult to regulate them at the federal level (Article I, Section 8). For most insurance and lending organizations they are already subject to a myriad of of regulations. It won't matter that the spam is sent from zombie blind dates in China who have pockets full of herbs to give you many big large p.e.n....is pr0n, the underwriters who use companies that engage in fraudulent advertisements are easy to find, and have nice, deep pockets to pay all kinds of fines.

      --
      If the g'vt kept the data on you that google does you'd better believe you'd be calling it "doing evil"
  18. So how does this help me reduce the ... by Skapare · · Score: 3, Insightful

    So how does this help me reduce the amount of bandwidth and server resources used by spammers who continue to try sending spam to me and my users?

    --
    now we need to go OSS in diesel cars
    1. Re:So how does this help me reduce the ... by Anonymous Coward · · Score: 1, Insightful

      Use DSPAM's source address reporting tool to blackhole spammer IPs.

    2. Re:So how does this help me reduce the ... by Antique+Geekmeister · · Score: 1

      For cutting the bandwidth usage, you really need to implement 2 features on a site-wide basis. 1: Blacklists. *Harsh* blacklists, that bounce email from sites that not merely send spam but that allow spam or refuse to fix open relays. 2: SPF, at spf.pobox.com, which is designed to allow a "sender policy framework" of publishing via DNS who is allowed to send email pretending to be from a domain. Simply publishing such records for your own domain and activating an SPF filter put that large chunk of email forged to look like it is from your domain. It really does help!

    3. Re:So how does this help me reduce the ... by Skapare · · Score: 1

      And how does blackholing the spammer IPs get them to stop trying?

      --
      now we need to go OSS in diesel cars
    4. Re:So how does this help me reduce the ... by Skapare · · Score: 1
      For cutting the bandwidth usage, you really need to implement 2 features on a site-wide basis. 1: Blacklists. *Harsh* blacklists, that bounce email from sites that not merely send spam but that allow spam or refuse to fix open relays.

      What about the providers that continue to keep the spammers connected? Is it too *harsh* to also block them (and thus make collateral damage of their other customers)?

      I understand SPF will allow me to refuse email from sites that are not designated (if the sender domain publishes appropriate SPF records), and allows me to publish records to allow those using it to refuse attempts to forge senders in my domains. I already do publish SPF data, and will soon be adding SPF checking in my mail servers. But this only stops spam (and backscatter) from getting into my mailbox. What can be done to keep spammers from even trying to connect to any of my servers?

      --
      now we need to go OSS in diesel cars
    5. Re:So how does this help me reduce the ... by Anonymous Coward · · Score: 0

      I am developing something to try to do just that and in my research during development I found this which claims to do that, too:
      http://www.turntide.com/

      No affiliation, so I don't have any hands on experience.

    6. Re:So how does this help me reduce the ... by Anonymous Coward · · Score: 0

      Actually, "Sender Preferred From" (or whatever they are calling it this month, maybe SPFMSCID) will increase your bandwidth usage to "check everyone's papers" for a very small return of spam reduction but the SPF astroturfers don't want you to know that.

    7. Re:So how does this help me reduce the ... by Antique+Geekmeister · · Score: 1

      SPF and blacklists are two distinct things. Blacklists that make collateral domage of spamhosting providers other customers are the most effective. It's literally impossible to keep track of the IP addresses a spamhosting company might re-assign to the spammer's machine as changes are requested. It's vastly simpler to block their entire hosted address range, such as the dialup address ranges they might serve. This worked extremely effectively when Netcom and later Earthlink faced "Usenet Death Penalties" for failing to act against spammers and message cancellers hosted at their services: both of them did 11th hour saves of their Usenet services by acting at the last possible minute to actually stop such abuses from their networks. You're right that SPF is certainly not complete. But it can help tremendously against certain *types* of spam in an amazingly efficient "don't even go the mail filters and waste my disk and CPU, just refuse it in the first 5 lines of SMTP communication". As it takes hold, filters that check SPF results that are marked "questionable" such as AOL right now, which lists their authorized SMTP servers but does not insist that all email come from those servers, will be detected as "likely spam", and can be caught by the later filters. Stopping spam from ever getting to your servers takes law, detection, policy and enforcement. Unfortunately, all have been severely lacking and only occurred as individual spammers get wildly out of control. Companies that sue spammers almost inevitably settle out of court, leaving the spammers to continue to ply their trade. (Look up the history of Cyberpromo for a case study of professional lspamming). So far, what finally gets a big commercial spammer out of business is either arrest for fraud (such as Canter&Siegel, who were eventually disbarred), or not finding any network providers that will host them (such as Cyberpromo).

    8. Re:So how does this help me reduce the ... by Skapare · · Score: 1

      And SPF also increases the server resource usage a small amount by going through the motions. So SPF is a "keep spam outa my box" solution, but it is not a "stop the spamming abuse" solution that (IMHO) too few people are making any effort at. Somehow, we need to get ISPs to stop letting spammers have access, but so far the only means to accomplish that being put forward results in lots of people whining about the collateral damage (instead of changing to another ISP like they should).

      --
      now we need to go OSS in diesel cars
    9. Re:So how does this help me reduce the ... by Skapare · · Score: 1

      SPFy isn't the total solution, but it certainly can help cut some spam out of my mailbox (and those of my users). I do think people should be made well aware that this isn't going to ultimately solve the problem. Instead, some providers need to have the "Email Death Penalty" applied to get them to carry out the proper enforcement against abuses from their customers. One problem is that many of the providers that host spammers are used by the "collateral damage" whiners seen in /. and elsewhere. But at some people we do need to apply the EDP to say the top 20 spam hosters and tell the whiners to go to {hell, another ISP}[their choice].

      --
      now we need to go OSS in diesel cars
  19. Re:client-side versus server-side anti-spam by Anonymous Coward · · Score: 0

    There is no such word as "administrate"! You can "administer" or you can "manage" but please do "administrate", at least while not in the privacy of your home...

  20. Does it still mess up mail contents? by lintux · · Score: 3, Interesting

    I wanted to try DSPAM some time ago, but I stopped as soon as I read that DSPAM puts an ID string in every mail it processes. In the mail body, that is. I have no problems with a program that adds headers, but it should leave the message body alone.

    Does DSPAM do that now? Can't find anything about it...

    1. Re:Does it still mess up mail contents? by Anonymous Coward · · Score: 1, Informative

      if you know how to bounce, you can --enable-signature-headers

    2. Re:Does it still mess up mail contents? by boards1_88 · · Score: 1

      See the following; looks like it still has the "serial number", but it looks like there is a way to remove it:

      http://www.nuclearelephant.com/projects/dspam/fa q. html#1.5

    3. Re:Does it still mess up mail contents? by humungusfungus · · Score: 2, Informative

      You can now set DSPAM to add headers with signatures etc instead of a tag in the body.

      The only thing to note is that users forwarding mail back to DSPAM for training must include the X-DSPAM headers. Apparently, some email clients do not do this by default.

      --
      No sig.
    4. Re:Does it still mess up mail contents? by asackett · · Score: 1

      Using DSPAM, you can forward the spam as an attachment and it'll find the headers it's added in the attachment.

      --

      Warning: This signature may offend some viewers.

  21. K9 by Anonymous Coward · · Score: 2, Informative

    An excellent spam filter for Windows is K9 found here.

  22. Unless you have false positives and such. by khasim · · Score: 3, Interesting

    I'm the one running the spam filter (SpamAssassin) at work. Overall, it has been VERY popular with everyone else. They don't receive the most obnoxious sex spams any more.

    On the other hand, there are a few false positives that reduce the overall savings in your post. I auto-delete anything about 10 and flag anything above 5.

    But the end users still have to look through the flagged stuff to see if there are any false positives. Then they drop them into the false positive folder. The users also have to identify all the missed spam and drop that into the spam folder.

    It's still work for them so the costs aren't as clear as in your post. But the non-tangible benefits are also important.

    I think we're at the point of dimishing returns on simple scanning processes. I think we need to look at actively seeding the spammer's lists with false names and tuning the spam filters with those.

  23. DSPAM ID by XanC · · Score: 4, Informative
    DSPAM uses the ID string because people send corrections by forwarding mail to a certain address. Other filters require you to move mail to a Spam folder, but that requires a fairly specific configuration (you must use IMAP, filtering mail gateways are difficult, etc).

    You can configure DSPAM to not use the ID, but this requires users to "bounce" the incorrect e-mails instead of forwarding them (as forwarding strips the headers).

    Is the ID really that inconvenient?

    1. Re:DSPAM ID by lintux · · Score: 1

      For one, I can imagine it to cause problems with PGP-signed mails... Or just be unreadable at all for some reason. You don't have problems like that when you just insert a little header.

    2. Re:DSPAM ID by XanC · · Score: 1
      I haven't tried it with any sort of encryption, but you're right, that may cause a problem.

      In any case, you can configure DSPAM easily to do just what you describe, as long as you bounce your corrections. That's really only a problem when a lot of users are using mail clients that don't support bouncing.

    3. Re:DSPAM ID by commander+salamander · · Score: 1

      RTFFAQ, it doesn't mess up PGP.

      --
      Is this rock and roll, or a form of state control?
    4. Re:DSPAM ID by Chief+Typist · · Score: 1

      So how long will it be before spammers start inserting bogus DSPAM ID strings in an attempt to break the system?

      I understand the need for the ID, and have no qualms about it being used to identify my usage, but it does seem like a potential point of attack for "the other side."

      -ch

    5. Re:DSPAM ID by Anonymous Coward · · Score: 0

      If the specific ID doesn't exist on the server, it will be ignored. It's only a serial #, not actual data.

  24. I love DSpam by AaronW · · Score: 1

    I've been running DSpam for several months now and have found it works much better than Spam Assassin at catching spam. Furthermore, unlike SA, I have yet to get any false positives.

    My only problem is DSpam was not easy to set up with Postfix, at least for me since I'm not an experienced mail administrator. While I now have it mostly working, I have not been able to get the alias accounts working so I can forward missed spams for automatic learning.

    I look forward to upgrading to DSpam 3.0 when it is fully released. So far it is working much better than even Mozilla 1.6's spam filter.

    I have Postfix running with DSpam and Cyrus IMAP, and by using sieve I have it automatically place spam messages into a spam folder.

    --
    This post is encrypted twice with ROT-13. Documenting or attempting to crack this encryption is illegal.
  25. Wild claims, no data to back up by Anonymous Coward · · Score: 0

    One thing that bothers me with this project is that the author has made wild claims about its accuracy in the past without backing them up. I mean everything the guy writes smacks of pure marketing and little technical.

    He's claimed that the program is uber-accurate but doesn't give details. Compare with the popfile guys who publish their statistics in real-time for all users. http://www.usethesource.com/popfile_stats.html

    Anyone done a real comparison of dpsam vs. popfile vs. spambayes?

  26. When "legitimate" sites spam by Randseed · · Score: 1

    The problem of UCE is bad enough, when you receive a bunch of incoherent gibberish, ads for bank loans, five thousand penis enlargement scams, and worse. What's worse, at least philosophically, is when "legitimate" sites spam the living fuck out of your addresses. Most of the time, this is because the guy who had the address before you signed up for all this crap, or because someone signed you up maliciously, or because someone typoed their address. The Cypherpunks list, may it rest in peace, was a good example. Over the course of a year or so, the entire list went to a signal to noise ratio that was negligable, because malicious parties signed the list addresses up for every bullshit mailing list they could find. I'm continuously spammed by davidbowie.com (I hate that no-talent shithead), a bunch of stock sites, and a bunch of "legitimate" Internet dating service sites. Of course, because they're "legitimate" sites, nobody places them under any obligation what so ever to remove my address from their lists, and they're free to spam me with impunity because it was supposedly requested. Complaints to their webmasters, postmasters, administration, and anyone else I can find always go without response, or I get some form letter telling me to use my userID and password to "opt-out." (The fact that they have a form letter should be a big clue here.) So why don't I just go to the website and remove myself? Do you honestly think I have the userID and password that Joe Numbnut used to sign me up for this shit? Unfortunately, email has become something that is destined to become useless. Even if we could control the spammers, such as by dragging them behind an 18-wheeler on I95 going 70 for, say, the entire trip up the coast, we'd still have to content with the mental midgets who run web sites that insist on badgering their users with mail on a continuous basis, and who won't honor complaints about it.

    1. Re:When "legitimate" sites spam by mikael · · Score: 1

      So why don't I just go to the website and remove myself? Do you honestly think I have the userID and password that Joe Numbnut used to sign me up for this shit?

      There is a simple way. Assuming you have a domain name that was previously owned by Joe Numbnuts, you will probably have a catch-all E-mail address, which is catching all of Joe's E-mails. In this case, you can go to the relevant website, and click the box that states that Joe Numbnuts has forgotten his password. A replacement password will be sent to Joe, ie. your domain, and you can then use that to cancel the subscription.

      --
      Vintage computer adverts: http://www.vintageadbrowser.com/computers-and-software-ads
    2. Re:When "legitimate" sites spam by JuggleGeek · · Score: 1
      What's worse, at least philosophically, is when "legitimate" sites spam the living fuck out of your addresses. Most of the time, this is because the guy who had the address before you signed up for all this crap, or because someone signed you up maliciously, or because someone typoed their address.

      The first case, where you have an address which used to belong to someone else, should be solved by unsubscribing.

      The other examples (malicious signups and typos) don't happen with legitimate mailing lists, because legitimate lists send a confirmation email when you first join. If you don't reply to that message, you don't get on their list. If they don't bother with confirmations, then they aren't running a legitimate mailing list, they are just spamming.

      Of course, because they're "legitimate" sites, nobody places them under any obligation what so ever to remove my address from their lists, and they're free to spam me with impunity because it was supposedly requested.

      In the US, the Can-Spam act requires them to remove you if you request it. They *are* under obligation to remove you. I can't speak for other countries.

  27. IMail by achaudhary · · Score: 1

    I run a small (~50 users) e-mail system, using Ipswitch's IMail Server (yes, I hate it too, but am not able to migrate away for several reasons) on Windows 2000 Advanced Server.
    Does anyone know if DSPAM can be plugged into this kind of setup? I have a MySQL installation running on the same machine which could be used as the database backend required by DSPAM.

  28. Other excellent filters by bigberk · · Score: 2, Interesting

    Others I've had direct experience with are spamprobe, spambayes, and CRM114.

    My best experience has been with spamprobe, because it compiles as a standalone app, is very fast (at one point I was filtering over 10,000 emails a day on a Pentium 200 MHz) and is completely command-line oriented, best for scripting/custom mail systems. Colleagues of mine who use CRM114 are very happy with it, but I got discouraged by its large database files. I'm now experimenting with spambayes, the only difficulty so far being installing the python/bsddb environment.

  29. My rights include.. by Inoshiro · · Score: 1

    NOT having companies advertise on my computer without my permission.

    This is also your right on line...

    --
    --
    Internet Explorer (n): Another bug -- that is, a feature that can't be turned off -- in Windows.
  30. Be sure to feed it ham. by Inoshiro · · Score: 2, Informative

    Otherwise your weights will be all wrong.

    Equal parts ham and spam will yield good spam catching. RTFAQ.

    --
    --
    Internet Explorer (n): Another bug -- that is, a feature that can't be turned off -- in Windows.
    1. Re:Be sure to feed it ham. by Desert+Raven · · Score: 1

      Equal parts ham and spam

      I don't know about you, but the ratio of spam to ham that I get exceeded 1:1 quite a few years ago. Currently, it's more like 250:1.

    2. Re:Be sure to feed it ham. by andersa · · Score: 0

      The important thing is to teach it regularly, or at least when you begin to get too many false negatives. Even if you get a lot of spam compared to ham, as long as you feed it all the ham you get, it will learn well in my experience.

      I use spamassassin, and get at least 99% accuracy. I get between 50 and 100 spam mails per day, and around 25-50 ham mails, most from boring mailing lists I subscribe to. I can't remember getting a false positive with it after the bayesian filter kicked in.

      Spamassassin will autolearn messages when it feels sure it has found a good positive or negative. You have to watch out for false negatives here, because spam which is incorrectly learnt as ham will really screw up your bayesian filter (surprise).

    3. Re:Be sure to feed it ham. by Anonymous Coward · · Score: 0

      What the fuck is an AQ?

  31. Re:client-side versus server-side anti-spam by daveashcroft · · Score: 1

    administrate....sounds like the result of an evil marriage between a management consultant and a dalek.

  32. The problem by IGnatius+T+Foobar · · Score: 2, Interesting

    ...is that spammers have access to the anti-spam tools.

    They have access to DSPAM. They have access to SpamAssassin. They have access to the Bayesian filters found in Mozilla and other products.

    When crafting their spams, they run them through these tools, and they keep obfuscating their spams until they get one through. Once they've got it perfect, they send a hundred million copies out to the world, and whammo! Your mo.rt-gage has been ap.prov/ed, and your v1ag---ra is ordered!

    --
    Tired of FB/Google censorship? Visit UNCENSORED!
    1. Re:The problem by Anonymous Coward · · Score: 0

      Adaptive statistical filters like DSPAM, SpamProbe, CRm114, etc., are all dynamic; their "rules" are basedon what it learns about a particular user's behavior. It's therefore impossible for a spammer to just download dspam and test their spam against it - each user has different training data.

    2. Re:The problem by SnowZero · · Score: 1

      That doesn't apply to encoding tricks however. Look at the html of a recent spam to see what I mean. They break up words with html tags, use all sorts of MIME hackery etc, to trick the filter into not using the right set of data. In this respect it will always be an arms race.

    3. Re:The problem by Antique+Geekmeister · · Score: 1

      Yes, of course the spammers tune their spam. That's why CRM114 is so much fun: the spammers can't predict who will have what rules. Also, with SpamAssassin it's fairly vital to lower the "spam" detection score by a few points to nail the spam that's tuned to SpamAssassin.

    4. Re:The problem by asackett · · Score: 1

      That hasn't been my experience, in nearly a year of using DSPAM. If the technique worked with DSPAM (as it does for SpamAssassin), I'd be seeing a lot more of the junk in my inbox. I'm not.

      I'm actually surprised on those one or two occasions per month when I find spam in my inbox.

      --

      Warning: This signature may offend some viewers.

    5. Re:The problem by austad · · Score: 1

      I was looking at this the other day. Why not just make something that runs the html email through a filter and removes all of the tags before analyzing it? Almost every spam that gets through my filters has this html trickery going on, wouldn't that put a stop to it rather quickly?

      --
      Need Free Juniper/NetScreen Support? JuniperForum
    6. Re:The problem by TheLink · · Score: 1

      "They break up words with html tags, use all sorts of MIME hackery etc, to trick the filter into not using the right set of data"

      Right, and grandma gets legitimate mail that does this all the time... That spam technique is short sighted.

      An antispam filter worth anything would start regarding a message as more spammy when it detects something like this.

      I don't write spam or antispam stuff but I bet a hard spam technique to catch would be those with a line of text (click here for more info) a link and optionally followed by a random joke or random legit text from the internet/wikipedia/some joke site/darwin award etc.

      Go ahead I bet you can think of even more devious methods. I'm sure tons of friends/relatives/colleagues/sites have sent you legit stuff that follows this style.

      Naive bayesian filters could start getting more false positives if users started telling them that this sort of stuff is spam. I daresay it would be better to categorize this as "unsure"/"indeterminable".

      You'd need whitelists and probably blacklists (known spammer websites/urls) to stop this. But then they'd use tinyurl and similar stuff.

      Heck they could use I'm feeling lucky on google with the right keywords. Fortunately I'm not a spammer.

      Disclaimer: The company I work for resells stuff like puremessage (and provides other IT securitystuff/services).

      --
  33. Gateway by XanC · · Score: 1
    I'm in a similar situation with Exchange 5.5, but I was able to set up a machine which runs incoming mail through DSPAM, then forwards it to the internal mail server.

    DSPAM is uniquely suited to this (compared to other statistical filters) because of the ID string it uses. Users can simply forward their corrections to the gateway machine.

    This has the added benefit of shielding the internal server from the outside. The only thing that appears to the outside is Exim (from Debian stable).

  34. Broken GPL by Anonymous Coward · · Score: 0
    The DSPAM site says:


    In order to keep DSPAM unencumbered by intellectual property abuses similar to SCO, all external contributors to the project are asked to release any rights to the submission. Please accompany your patch, code, or other submission with the following statement:

    The author or authors of this submission hereby release any and all copyright interest in this code, documentation, or other materials included to the DSPAM project and its primary governors. We intend this relinquishment of copyright interest in perpetuity of all present and future rights to said submission under copyright law.


    However, the GPL requires that authors retain their copyright in order to enforce the terms of the GPL. This statement instead releases code into the public domain. Once that happens, it's no longer GPL-able. The overall package includes a copy of the GPL, so presumably the authors think they're releasing a GPL product. But in fact, they seem to misunderstand the way the GPL works and its purpose.

    If they want a PD package, drop the GPL. If they want the GPL, then they need to change their requirements for submitters. For instance, they could require transfer of the copyright from the authors to the DSPAM "governors", much in the way the FSF encourages authors to give them the copyrights to GPL'd work.

    1. Re:Broken GPL by MassacrE · · Score: 1

      I'm sure what they are really saying is that the code has shared copyright between the DSPAM governors and the contributor of code - if the contributor of the code relinquishes their copyright interest, the DSPAM governors retain sole copyright interest

    2. Re:Broken GPL by ThreeDayMonk · · Score: 1

      The wording could be better, but they mean that they require contributors to assign their copyright to DSPAM. At least, that's my understanding.

      That isn't making it public domain, and it isn't incompatible with the GPL. The DSPAM "governors" become the rights holder.

      --
      If your comment title says 'Re: Foo', I'm not likely to read it.
  35. Confirmed opt-in by r_cerq · · Score: 1

    Or, as spammers like to call it, "double opt-in": It's when you get a challenge to your subscription, and must issue a response _before_ any other mail starts flowing in; single-submission subscription counts as illegitimate spam in my book.
    If a given site/company doesn't bother to confirm someone actually wants to read their "news", I don't want to bother reading them. And yes, I know the confirmation rate (even for legitimate subscriptions) is low: tough luck.

    Whenever I get some info "I requested" or end up in someone's list, I block them without giving it a second thought. The rejection message is explicit enough: show me a mail from me or any customer of mine confirming that subscription, and I'll let you in. Until then, all my customers (and we're talking a few million mailboxes) are off-limits to you.

  36. Obligatory by jonfelder · · Score: 3, Insightful

    Your post advocates a

    (*) technical ( ) legislative ( ) market-based ( ) vigilante ( ) lack of an

    approach to fighting spam. Your idea will not work. Here is why it won't work. (One or more of the following may apply to your particular idea, and it may have other flaws which used to vary from state to state before a bad federal law was passed.)

    ( ) Spammers can easily use it to harvest email addresses
    (*) Mailing lists and other legitimate email uses would be affected
    ( ) No one will be able to find the guy or collect the money
    ( ) It is defenseless against brute force attacks
    ( ) It will stop spam for two weeks and then we'll be stuck with it
    (*) Users of email will not put up with it
    (*) Microsoft will not put up with it
    ( ) The police will not put up with it
    ( ) Requires too much cooperation from spammers
    (*) Requires immediate total cooperation from everybody at once
    (*) Many email users cannot afford to lose business or alienate potential employers
    ( ) Spammers don't care about invalid addresses in their lists
    ( ) Anyone could anonymously destroy anyone else's career or business

    Specifically, your plan fails to account for

    ( ) Laws expressly prohibiting it
    (*) Lack of centrally controlling authority for email
    ( ) Open relays in foreign countries
    ( ) Ease of searching tiny alphanumeric address space of all email addresses
    ( ) Asshats
    ( ) Jurisdictional problems
    ( ) Unpopularity of weird new taxes
    ( ) Public reluctance to accept weird new forms of money
    (*) Huge existing software investment in SMTP
    (*) Susceptibility of protocols other than SMTP to attack
    ( ) Willingness of users to install OS patches received by email
    ( ) Armies of worm riddled broadband-connected Windows boxes
    ( ) Eternal arms race involved in all filtering approaches
    ( ) Extreme profitability of spam
    ( ) Joe jobs and/or identity theft
    ( ) Technically illiterate politicians
    ( ) Extreme stupidity on the part of people who do business with spammers
    ( ) Dishonesty on the part of spammers themselves
    ( ) Bandwidth costs that are unaffected by client filtering
    ( ) Outlook

    and the following philosophical objections may also apply:

    (*) Ideas similar to yours are easy to come up with, yet none have ever
    been shown practical
    ( ) Any scheme based on opt-out is unacceptable
    ( ) SMTP headers should not be the subject of legislation
    ( ) Blacklists suck
    ( ) Whitelists suck
    ( ) No-lists suck
    ( ) We should be able to talk about Viagra without being censored
    ( ) Countermeasures should not involve wire fraud or credit card fraud
    ( ) Countermeasures should not involve sabotage of public networks
    (*) Countermeasures must work if phased in gradually
    ( ) Sending email should be free
    (*) Why should we have to trust you and your servers?
    ( ) Incompatiblity with open source or open source licenses
    ( ) Feel-good measures do nothing to solve the problem
    ( ) Temporary/one-time email addresses are cumbersome
    ( ) I don't want the government reading my email
    ( ) Killing them that way is not slow and painful enough

    Furthermore, this is what I think about you:

    (*) Sorry dude, but I don't think it would work.
    ( ) This is a stupid idea, and you're a stupid person for suggesting it.
    ( ) Nice try, assh0le! I'm going to find out where you live and burn your
    house down!

    1. Re:Obligatory by AbbyNormal · · Score: 1

      Hahahah! If I may rebute:

      Tracability of the spammer always comes down to money. Money can easily be traced. Not every spammer would be nailed...just the big dogs.

      Making a company responsible for their marketing avenues would easily stop spamming.

      This would be stricly legal with no countermeasures involved from the tech community. We would provide answers and avenues to help the law track down some email messages.

      --
      Sig it.
    2. Re:Obligatory by HogynCymraeg · · Score: 1

      Stop Spamming!!! ;)

  37. Problems with DSPAM by gonz · · Score: 4, Informative

    I've been using DSPAM for about three months. A few criticisms:

    First, by default DSPAM wants to run as the "root" user and usurp delivery of e-mails. (With Exim, they actually want it to recursively reinvoke the mail server for actual delivery!) It took quite a bit of configuring to get it to work like SpamAssassin from procmail.

    This software is somewhat buggy, so running DSPAM as root would also introduce security concerns. For example, I'm using 2.10.6 because the 3.0.0 compiled and installed with no problems, but failed to classify anything. (Even with several hours of gdb tracing I was unable to determine why). Another bug is that if I run the "--falsepositive" on an e-mail that's lacking the "!DSPAM" signatures, the message should be ignored, but apparently this is not the case because the statistics counters are incremented.

    From the FAQ:
    "Q. Does DSPAM support whitelists?
    A. DSPAM doesn't have a whitelist manager, rather whitelisting is an automatic function of DSPAM's Bayesian filtering mechanism."

    This is crazy -- the whole point of whitelists is for when the Bayesian filtering fails! And DSPAM does fail. Twice now I've had to reset my database because the classifications were wrong and training wasn't helping. All I can say is I'm glad I've got procmail to rescue the important e-mails.

    I think one source of my problems was that the default training mode ("train on everything") causes incorrect learning when you fail to report a false positive. This was a big problem for me, since I get around 700-800 spams/day. While false negatives are easily caught, the false positives go unnoticed unless I happen to wonder why someone never responded, and invest some time to search my spam folders. (I'm still trying to figure out exactly how to deal with this problem. E.g. maybe I could have it challenge the sender with Turing Test or something.)

    I will say that DSPAM's basic technology is quite good. It's just that the software still has a "prototype" feel, and I'd caution you to do some experiments before unleashing it on your users. (For example, there's no manpage, and there isn't even a command-line option to print out the current version number!)

    -Gonz

  38. Obligatory by jonfelder · · Score: 2, Insightful

    Your post advocates a

    ( ) technical (*) legislative ( ) market-based ( ) vigilante ( ) lack of an

    approach to fighting spam. Your idea will not work. Here is why it won't work. (One or more of the following may apply to your particular idea, and it may have other flaws which used to vary from state to state before a bad federal law was passed.)

    ( ) Spammers can easily use it to harvest email addresses
    ( ) Mailing lists and other legitimate email uses would be affected
    (*) No one will be able to find the guy or collect the money
    ( ) It is defenseless against brute force attacks
    ( ) It will stop spam for two weeks and then we'll be stuck with it
    ( ) Users of email will not put up with it
    ( ) Microsoft will not put up with it
    (*) The police will not put up with it
    ( ) Requires too much cooperation from spammers
    ( ) Requires immediate total cooperation from everybody at once
    ( ) Many email users cannot afford to lose business or alienate potential employers
    ( ) Spammers don't care about invalid addresses in their lists
    ( ) Anyone could anonymously destroy anyone else's career or business

    Specifically, your plan fails to account for

    ( ) Laws expressly prohibiting it
    ( ) Lack of centrally controlling authority for email
    (*) Open relays in foreign countries
    ( ) Ease of searching tiny alphanumeric address space of all email addresses
    (*) Asshats
    (*) Jurisdictional problems
    ( ) Unpopularity of weird new taxes
    ( ) Public reluctance to accept weird new forms of money
    ( ) Huge existing software investment in SMTP
    ( ) Susceptibility of protocols other than SMTP to attack
    ( ) Willingness of users to install OS patches received by email
    ( ) Armies of worm riddled broadband-connected Windows boxes
    ( ) Eternal arms race involved in all filtering approaches
    (*) Extreme profitability of spam
    ( ) Joe jobs and/or identity theft
    (*) Technically illiterate politicians
    ( ) Extreme stupidity on the part of people who do business with spammers
    (*) Dishonesty on the part of spammers themselves
    ( ) Bandwidth costs that are unaffected by client filtering
    ( ) Outlook

    and the following philosophical objections may also apply:

    (*) Ideas similar to yours are easy to come up with, yet none have ever
    been shown practical
    ( ) Any scheme based on opt-out is unacceptable
    (*) SMTP headers should not be the subject of legislation
    ( ) Blacklists suck
    ( ) Whitelists suck
    ( ) No-lists suck
    (*) We should be able to talk about Viagra without being censored
    ( ) Countermeasures should not involve wire fraud or credit card fraud
    ( ) Countermeasures should not involve sabotage of public networks
    ( ) Countermeasures must work if phased in gradually
    ( ) Sending email should be free
    ( ) Why should we have to trust you and your servers?
    ( ) Incompatiblity with open source or open source licenses
    (*) Feel-good measures do nothing to solve the problem
    ( ) Temporary/one-time email addresses are cumbersome
    (*) I don't want the government reading my email
    ( ) Killing them that way is not slow and painful enough

    Furthermore, this is what I think about you:

    (*) Sorry dude, but I don't think it would work.
    ( ) This is a stupid idea, and you're a stupid person for suggesting it.
    ( ) Nice try, assh0le! I'm going to find out where you live and burn your
    house down!

  39. Obligatory by jonfelder · · Score: 4, Funny

    Your post advocates a

    ( ) technical ( ) legislative ( ) market-based (*) vigilante ( ) lack of an

    approach to fighting spam. Your idea will not work. Here is why it won't work. (One or more of the following may apply to your particular idea, and it may have other flaws which used to vary from state to state before a bad federal law was passed.)

    ( ) Spammers can easily use it to harvest email addresses
    ( ) Mailing lists and other legitimate email uses would be affected
    (*) No one will be able to find the guy or collect the money
    ( ) It is defenseless against brute force attacks
    ( ) It will stop spam for two weeks and then we'll be stuck with it
    ( ) Users of email will not put up with it
    ( ) Microsoft will not put up with it
    (*) The police will not put up with it
    (*) Requires too much cooperation from spammers
    (*) Requires immediate total cooperation from everybody at once
    ( ) Many email users cannot afford to lose business or alienate potential employers
    ( ) Spammers don't care about invalid addresses in their lists
    ( ) Anyone could anonymously destroy anyone else's career or business

    Specifically, your plan fails to account for

    (*) Laws expressly prohibiting it
    ( ) Lack of centrally controlling authority for email
    (*) Open relays in foreign countries
    ( ) Ease of searching tiny alphanumeric address space of all email addresses
    (*) Asshats
    (*) Jurisdictional problems
    ( ) Unpopularity of weird new taxes
    ( ) Public reluctance to accept weird new forms of money
    ( ) Huge existing software investment in SMTP
    ( ) Susceptibility of protocols other than SMTP to attack
    ( ) Willingness of users to install OS patches received by email
    ( ) Armies of worm riddled broadband-connected Windows boxes
    (*) Eternal arms race involved in all filtering approaches
    (*) Extreme profitability of spam
    (*) Joe jobs and/or identity theft
    ( ) Technically illiterate politicians
    (*) Extreme stupidity on the part of people who do business with spammers
    (*) Dishonesty on the part of spammers themselves
    ( ) Bandwidth costs that are unaffected by client filtering
    ( ) Outlook

    and the following philosophical objections may also apply:

    (*) Ideas similar to yours are easy to come up with, yet none have ever
    been shown practical
    ( ) Any scheme based on opt-out is unacceptable
    ( ) SMTP headers should not be the subject of legislation
    ( ) Blacklists suck
    ( ) Whitelists suck
    ( ) No-lists suck
    ( ) We should be able to talk about Viagra without being censored
    ( ) Countermeasures should not involve wire fraud or credit card fraud
    (*) Countermeasures should not involve sabotage of public networks
    (*) Countermeasures must work if phased in gradually
    ( ) Sending email should be free
    (*) Why should we have to trust you and your servers?
    ( ) Incompatiblity with open source or open source licenses
    ( ) Feel-good measures do nothing to solve the problem
    ( ) Temporary/one-time email addresses are cumbersome
    ( ) I don't want the government reading my email
    ( ) Killing them that way is not slow and painful enough

    Furthermore, this is what I think about you:

    (*) Sorry dude, but I don't think it would work.
    ( ) This is a stupid idea, and you're a stupid person for suggesting it.
    ( ) Nice try, assh0le! I'm going to find out where you live and burn your
    house down!

  40. Weapons of Massive Spam Destruction by wintermute42 · · Score: 1

    As time goes on DSPAM (and SpamAssassin for that matter) become more and more sophisticated, incorporating more complex algorithms. What I also find striking is that many of these algorithms appear to be compute intensive. These spam filters seem to be designed for server side ISP level email filtering. I would expect that a computer would have to be dedicated to running this anti-spam software.

    Also, as a number of posters have noted, configuring these spam filters takes some effort and education on the part of the user.

    This level of resource comsumption is fine for an ISP, but it seems problematic for a single user or someone using a shared system.

    I only use Linux shell based email to avoid worms and viruses. I've had my domain since 1995, so I got a lot of spam. As the tide of SPAM increased, overcoming the primative SPAM filter I was using I looked at both SpamAssassin and DSPAM. But these tools do not appear appropriate for a shared Linix system like the one that hosts my domain. So, in classic "reinvent the wheel fashion", I wrote my own SPAM filter. It is just a simple (compared to these tools) rule based filter. It filters out enough SPAM that email it not totally useless. This email filter can be found here. The email filter is written in C++ in an attempt to minimize resource usage. It is published as open source.

    1. Re:Weapons of Massive Spam Destruction by Anonymous Coward · · Score: 0

      According to the website, DSPAM is written in C, and has an execution time of 0.01s - 0.10s real time for classification - in most implementations - on average hardware. How is this unacceptable? RTFW.

  41. Re:Please please please by Anonymous Coward · · Score: 0

    no.

  42. Re:client-side versus server-side anti-spam by You're+All+Wrong · · Score: 1

    Hahah.

    OK, smartarse - of what is 'configurate' a conflation? ;-)

    YAW.

    --
    Your head of state is a corrupt weasel, I hope you're happy.
  43. Re:client-side versus server-side anti-spam by daveashcroft · · Score: 1

    Administer is the verb form for administration or administrator.

    The word administrate is an incorrect form of the verb created by some who drop the -ion suffix of administration.

    Incorrect: He did a great job of administrating the estate.
    Correct: He did a great job of administering the estate.

    Be careful when forming verbs from nouns that end in -ation, as the correct verb form may not end in -ate.

  44. Coincidence? by StormReaver · · Score: 2, Interesting

    Since this is a spam subject, this is at least partly relevant:

    I am a Direcway subscriber, and I was accustomed (angry, but accustomed) to receiving about 15-20 spams per day for as long as I can remember.

    Slashdot ran a story within the last 6 months (I don't remember which one exactly) about the FBI raiding one or two of the largest spammers and confiscating their setup.

    Almost to the day that the raid was to have occurred, all spam to my inbox instantly stopped. I haven't gotten a single spam message since the about the same time as the second raid.

    It seems to me that those guys may have been the sole sources of all the spam going through Direcway to my account. Are there any other Direcway subscribers here that had the same experience, was the whole thing just an extraordinary coincidence, or did Direcway find the holy grail of anti-spam?

    As far as I can tell, all my regular email is getting through and going out. No email that I knew was coming has yet failed to arrive, so any filtering at Direcway's servers, if such a tactic is being employed, is doing a great job.

    1. Re:Coincidence? by Phroggy · · Score: 1

      It seems to me that those guys may have been the sole sources of all the spam going through Direcway to my account. Are there any other Direcway subscribers here that had the same experience, was the whole thing just an extraordinary coincidence, or did Direcway find the holy grail of anti-spam?

      I would agree that those guys were probably the sole sources of your spam, but it has nothing to do with DirecWay, and you won't see any pattern comparing to other DirecWay subscribers. Spammers don't care what ISP you're on; they'll spam any e-mail address they can find. It just so happens that these guys had yours, and (fortunately for you) nobody else did (though don't be surprised if that changes). Other people may have a similar experience (they were also getting spam only from these two guys), but most people won't have noticed (they may have been getting spam from these guys, but they were also getting spam from others). It has nothing to do with your ISP (although some ISPs may block spam more successfully than yours).

      --
      $x='S24;r)>63/* h@<5+oZ)32"5cz';$me='phroggy'x$];
      $x=~y+ -xz+\0-Tx+;print$_^chop$me for split'',$x;
  45. A little dos goes a long way by robogun · · Score: 2, Informative

    I ^H^H a guy I know used to retaliate, stopped for a while when the spammers built up their defenses, and then tried it again last week against some spams which started leaking thru his filters.

    They are wide open again, brothers, because apparently no one else is dossing them anymore either and they have let down their guard.

    I would guess that they lost money when they overprotected their forms against that type of "response," which made too many legit buyers say fuck it instead of filling out some bossy form.

    1. Re:A little dos goes a long way by LehiNephi · · Score: 1

      My preferred method of retaliation? Attack the source of money for spammers.

      --
      Help find a cure for cancer. Join the [H]orde
  46. Re: false positive reduction by ubiquitin · · Score: 1

    SpamAssassin is a good start. If you're really wanting to reduce false positives, consider bringing
    dspam into the mix. "DSPAM presently peaks at 99.985% accuracy, which is ten times more accurate than a human being and is presently being used on implementations as large as 125,000+ mailboxes." bogofilter is another advanced project in the same functional space.

    --
    http://tinyurl.com/4ny52
  47. I'm waiting by BCW2 · · Score: 1

    For the anti SPAM system that returns it to sender, prints it out and shoves it up his ass.

    Now that will, by god, cut down on SPAM.

    --
    Professional Politicians are not the solution, they ARE the problem.
  48. dspam didn't work for me by Splork · · Score: 1

    i used it a month or so ago for about 10,000 emails and it consistently did much worse than spamassassin; both on the spams that got thru and the false positives. sorry dspam. good concept. try harder. and stop making false high percentage claims. thats totally invalid and smells of marketdroids.

  49. Not quite the same by Sycraft-fu · · Score: 1

    With drugs, there is a huge demand on the part of the consumer. People will pay great amounts of money to get drugs. That gives big incentives for suppliers. No matter how hard it is to get the drugs in and how much they end up costing, you can almost be assured that someone will buy them.

    Not the case with SPAM. There is, in fact, basically zero consumer demand for SPAM. I have never met a person that demands they get e-mail advertisments and would pay to do so. In factm everyone I know (tech savvy or not) is the opposite, they'd pay to NOT get SPAM e-mails.

    The reason that SPAM is profitable is because it is very low cost and, at least until receantly, was very low risk. So once and a while the spammer hits someone who is suckered in to buying what they are allegedly selling. Doesn't need to be all that often as costs are low.

    That's why things like SPAM filters and anti-SPAM laws can actually make a significant difference. Nothing will ever stop it, of course, there will always be some idiot willing to try it, but it can really help.

    You'll notice that all the top spammers are not super rich people. They do not have the millions of dollars that the drug lords do. They make plenty of money, but not an overwhelming amount. Thus if prision and loosing all their illgotten gains becomes a real possibility (and it has, the DOJ is prepping 50 criminal cases related to SPAM right now) most of them will stop. They will find the risk to be too high, and not do it.

    Filters also help in the regard of making it less profitable. There IS a cost to being a spammer, even if it is low. Let's say, for the sake of argument, that you need to make one sale per 100 million e-mail messages sent minimum to stay in bussiness. Now with little SPAM filtering, almost all of your messages get through and you find you get 1 sale for every million messages. You are doing great here. But what happens if everyone starts using filtering software that filters 99.95% of your messages before they ever reach the user? That means that only 1 in 5000 messages every reaches someone, so you only get 1 sale for roughly every 5 billion e-mails you send. Suddenly you are way below the line of profitibality.

    Now these are made up numbers, I don't know what the real level is, but the point is the better filters are, the less profitable SPAM gets. Combine that with it now being illegal, and therefore not a no risk bussiness, it is significantly less attractive.

    Just because we can't eliminate SPAM doesn't mean we can't make a large dent with laws and technology.

  50. How to stop spam by Anonymous Coward · · Score: 0
    The answer is with SPF, or Sender Policy Framework. This is how it works:

    SMTP has a security hole: any connecting client can assert any sender address. This flaw has been exploited by spammers to forge mail. The result: your mailbox fills up with bounces to messages that you didn't send. Close the hole, and we can easily block spammers by sender domain.

    SPF closes the hole by using a DNS record that says which hosts can send email with a from address in the domain. The record is a simple TXT record that looks something like this:

    <domain> IN TXT "v=spf1 ptr ip4:<address block> ~all"

    What most of you don't know is that this is a Microsoft technology. Remember when Bill Gates said that he'd solve the spam problem in two years and you all laughed? Read this for the all the technical details. As it is an internet draft, this is completely patent free and anybody can use it.

    1. Re:How to stop spam by Anonymous Coward · · Score: 0

      SPF doesn't prevent spam, it only prevents forgery. It's relatively easy to continue spamming simply by registering new domains periodically - or if you happen to own your own TLD you can just create new ones every day or two. SPF also breaks netiquette in that the proper behavior used to be if you're traveling is to use the mail server of the network you're on (for example a hotel) to send mail. It essentially breaks anyone with a virtual domain and the only remedy the SPF people have offered is, "well set up ASMTP or set up a tunnel into your company's mail server". Easier said than done. If the Internet community wants to change the proper netiquette for using mail servers - fine - but this is to be decided by the community and not the ASRG...and once again this isn't a solution to spam, only forgery.

  51. Bayesian is broken....Use heuristics instead. by iamcf13 · · Score: 1

    I got a message or two archived as spam by my program, CF13 that were deliberatly designed to poision and render ineffective Bayesian filters and their ilk. Instead, my program takes a heristic approach at filtering spam and has been very effective without the overhead of time and system resources that Bayesian-like filtering methods require to work properly.

    As an added benifit, my program renders malware inert and 'safe to handle'.

  52. Re: false positive reduction by TheLink · · Score: 1

    Just wait till the spammers start training their spam generators through dspam.

    Furthermore: some people/sites just write messages that look like spam.

    A legit sender could say this: "Activate your registration now - click here [url link]". I mean what else do you want them to say without wasting bandwidth?

    A spammer could send nearly the same message.

    So you'd probably have to blacklist/whitelist the urls they link to.

    I think having decoy email accounts to identify spam could be a useful tool.

    --
  53. Re:client-side versus server-side anti-spam by Anonymous Coward · · Score: 0

    my 1st question would be how many of the 100 actually need an external use / routable email address? ;)

  54. verbal viagra by trezor · · Score: 1
    • verbal viagra

    Maybe my spam-filter hooked that one, but I can't ever recall seeing advertisement for verbal viagra!

    Karma be damned: Please post, I can't wait!

    --
    Not Buzzword 2.0 compliant. Please speak english.