Slashdot Mirror


Using Statistics to Cause Spammers Pain

mlamb writes "Statistical mail classifiers like PopFile save time on the part of their users, but don't do anything to actively combat spam. I just published an article that suggests a way to use classifier output against a spammer while they're connected to your SMTP server, and I'm launching a project called TarProxy to implement it."

18 of 334 comments (clear)

  1. This is too complicated by dacarr · · Score: 3, Informative

    The simpler method is still SMTPAUTH. Now we just have to convince the world that this is a Good Thing.

    --
    This sig no verb.
  2. Re:Interesting idea by EnlightenedDuck · · Score: 2, Informative
    Also, forgot to mention before, its not the traffic that is being analyzed, but the spamminess of the message.

    Bayesian methods would work well for this (mind you, I'm a pretty staunch frequentist on most issues). You could set up a prior probability of a message being spam based on where it is being sent from (one could even create a centralized list somewhere, such as exist for which IP's send a lot of spam) - if the message is from a suspect server, start off suspecting its spam - if its from your friend's mail server, be more skeptical. Then taking any of the piece-by-piece approaches, update your probability of spam, and act accordingly. This should help minimize the delerious affects on innocent servers, who just happen to send the odd piece of mail that looks like spam.

    --
    Quack!Quack!.....QUACK!!
  3. OpenBSD's spamd by almeida · · Score: 5, Informative

    This is the same thing as OpenBSD's spamd, which Theo de Raadt wrote specifically to cause spam relays pain. spamd uses some new features of pf and blacklists from Spews to create a tarpit for incoming messages from known spam relays. It was even discussed on Slashdot in this article. Also, Daniel Hartmeier, pf developer extraordinaire and all around good guy, wrote a little piece about annoying spammers using pf, spamd, and bmf.

    1. Re:OpenBSD's spamd by almeida · · Score: 2, Informative

      Yes and no. spamd uses whatever list you give it. pf just forwards any incoming SMTP connections from a certain list of hosts to the spamd. Theo suggests using lists from Spews. However, Daniel uses bmf to build his own blacklist. If you want to get your point across to open relays, go the Spews route. If you want a solution with less collateral damage, use Daniel's approach.

  4. Re:Anti-Spam software by cyphem · · Score: 2, Informative

    Try to use SpamNet from cloudmark!
    This one bases on a kind of P2P system which allows users to block Spam while this is reported to the main servers.
    So if someone has blocked the message before, every SpamNet user doesn't have to do it again, because Spam is moved to a different folder automatically (they using checksums and stuff i think)
    A problem still might be then, that this software is for Outlook only.
    But nevertheless a good (though not perfect) system. I'm pretty satisfied with it.

    Hope that helped...

    cyphem

    --
    Reading this signature is senseless so don't do it.
  5. Daniel Hartmeier / OpenBSD / pf by sillobalso · · Score: 3, Informative
  6. the tarpits by spoonist · · Score: 4, Informative

    Here are some more spam tarpits:

    TarProxy
    ChuckMail
    OpenBSD's spamd (tarball)
    Google Search Results

  7. Re:Anti-Spam software by lboxman · · Score: 2, Informative

    This isn't exactly consumer anti-spam software anyway, unless you are a consumer running an SMTP server. The idea is that it slows down the spammer, and the few odd false positives that get slowed down as well should be relatively insignificant. So, even if it misses some spam and classifies a very small amount of non-spam as spam, it could still do the job because it will still make it harder for the spammer to spam.

    --
    Regexes are like cocaine. The first hit is pretty good, but afterwards you try to use them to solve all your problems.
  8. Re:but its usually from an open relay... by cpeterso · · Score: 2, Informative


    but the open relay is enabling the spammer. The people operating the open relay should really fix their server.

  9. Theo changed his mind about 550 by Anonymous Coward · · Score: 2, Informative

    Theo changed his mind about 550..

    It's now 450.. Hurts more..

    http://marc.theaimsgroup.com/?l=openbsd-misc&m=1 04 027378218501&w=4

  10. Re:What the hey by dbenhur · · Score: 2, Informative

    You just described BrightMail's approach, though they anticipated you by about 3.5 years and went and got a patent for your Step 3.

  11. Not a new idea. by chrome · · Score: 4, Informative


    Read about a method to get SpamAssassin to execute at SMTP time in exim (I'm about to impliment this on my own mailserver) and read about teergrubing which is basically the same idea as a tarpit.

    Unlike the original post, Marc seems to have a stable working version of this right now.

    That said, this is probably the most realistic method of causing spammers pain that we have right now, short of changing the way mail works in a fundamental manner.

    I'll definately be implimenting teergrubing/tarpitting. I might even impliment it on the multi-user hosting system that I helped to build. It probably wouldn't scale too well on a busy site though ;)

    I'm going back to splinter cell.

  12. Re:Bouncing? by lost_packet · · Score: 3, Informative
    send your thanks to Apple and OS X

    Mac OS X mail

    Yes, Mac OS X Mail can help you deliver a staggering blow to spammers. Simply pull down the Mail menu, choose Junk Mail, and select Automatic. The next time you receive email, Mail will move suspect email into a Junk folder. With that done, you're ready to deliver a real knockout punch to spammers by taking advantage of yet another potent spam-fighting weapon: 1. Click on the Junk folder. 2. Type Command-a to select all of the email in the Junk folder. 3. Choose "Bounce to Sender" from the Message menu. Mail will return the selected messages to the senders marked "User unknown," making them think your email address invalid, encouraging them to drop you from their lists, and, thus, eliminating spam at its source

    that's from the Feb 6 2003 issue of Apple eNews

    --

    BLOCK STRUCTURE breathing apparatus required for special maneuvers!!

  13. Doesn't Work in Java, Needs to Be in Kernel by jorhan · · Score: 2, Informative

    This won't work the way the author wants. Once the receiving SMTP server sends the 354 after the client issues a DATA command, there is no opportunity for the server to slow things down until it produces the 250 response at the end of the message. That is, at the application level, all the server can do is slow down the WHOLE message. During the transfer, the only way to slow things down would be to mess around with the TCP layer. The transport layer lives in the kernel. That means kernel module. That means not very portable. That means no Java. That means an SMTP server (by its nature a security risk) futzing with the security of the operating system itself.

    You can slow things down by waiting before you produce the 250, but that is not at all a new concept. Several people have referenced Sendmail milters for that purpose already.

  14. Re:but its usually from an open relay... by karlm · · Score: 2, Informative
    Open relays are necessary for spoofing the sending domain and also act as buffers connected to fat pipes. Several email trojans come with their own SMTP server. They're very easy to write. If having an SMTP server was the bottleneck, they would have put SMTP servers in all of the SPAM software long ago rather than wasting the effort of finding new open relays.

    An open relay allows a SPAMer to lie about his/her domain and ofload a batch of emails lighting fast. The SMTP server does the storing and the forwarding with faked headers.

    --
    Copyright Violation:"theft, piracy"::Anti-Trust Violation:"thermonuclear price terrorism"<-Overly dramatic language.
  15. Re:Spam, Spam, Go Away, Come out ANOTHER day. by anon*127.0.0.1 · · Score: 2, Informative

    Shutting down for a week won't do it. I had a secondary EMail account I set up for a job search a couple of years ago. Once I got a job, I deactivated the account. That was back in late 2001. Two weeks ago I reactivated it because I needed to let some site I was registered on EMail me my password. I left the account active overnight, and the next morning it had half-a-dozen Spams. This was after being inactive and bouncing messages for more then a year.

    --
    I am NOT a man!
    I am a free number!
  16. Re:Nice idea by rplacd · · Score: 2, Informative

    I don't see why adding heuristics to a spam throttling device will make it work worse. It should make it work a lot better.

    The package I use at the isp I do random consulting for is spamthrottle. It handles the case of multiple connections from a single address (or range of addresses), along with tarpitting. It works really well --
    there have been no incidents since I applied the patch, and no (legit) users have called in to complain about the mail server.

    I started using it because some customers would mailbomb remote users. Unfortunately the way the ISP's dialup auth stuff works, we really don't know who the users are, so we can't kick them off permanently. It's a combination of no caller-id (we have E1s, not PRIs), and a bad scratch card account scheme by the previous management.

  17. Re:Nice idea by winnetou · · Score: 2, Informative
    They are so shady that there are no records of anything.

    They aren't, they publish rather extensive proof why they list an IP address or range.

    I could show you unanswered emails, but they would be too easily faked to be relevant.

    From the SPEWS FAQ:
    Q41: How does one contact SPEWS?
    A41: One does not. SPEWS does not receive email

    I am surprised your mailserver didn't inform you that spews.org does not answer at port 25.

    The fact that you suggest booting a client AT ALL due to a technical error goes to show how ignorant you are. If a client is intentionally spamming we give them the boot right away. If they are an open relay, even if due to incompetence, they fix it or we fix it. Suspending their account would be stupid. We would lose the client.

    Not suspending the client means you are spamming lots of people. My clients don't like spam, hence I use SPEWS to stop the spam from your IP range(s).

    No, we kindly inform them of the problem, like people over the age of 15 interested in making money and retaining good business relationships.

    That decision is rather bad for your relationship with other providers. The Internet is a collection of networks, if you only care about your income and knowingly and willingly allow open servers to send spam, don't expect others to spend bandwidth and CPU time to filter the few legitimate messages from the flood of spam.
    Once again, I remind you that I am not listed by SPEWS, just like 99.8% of the Internet.