Slashdot Mirror


Fighting the Hydra -- A Spam Warrior's Tale

Selanit writes "Salon has an interesting article about the battle against spam from the viewpoint of Suresh Ramasubramanian, a sysadmin working in Hong Kong. His most interesting complaint concerns the fragmentation of anti-spam forces: not only does he have to deal with spammers, but also with anti-spammers who assume because his company is Chinese that he isn't doing anything about spam. Hmm ... decentralized opponents striking from the shadows against quarreling allies. Does this sound familiar to anyone else?"

26 of 302 comments (clear)

  1. Fight the good fight by rf0 · · Score: 4, Insightful

    I think this article does bring up a good point that people do tar Asia with the same brush in that you can just block them and have no problems. Its nice to see someone doing a decent job. For more fun on fighting spam see NANA

    rus

    1. Re:Fight the good fight by BrokenHalo · · Score: 3, Funny
      fighting spam is no fun at all.

      Tell me about it. I got so fed up with my spam that when I changed my ISP I made damn sure nobody I didn't want to hear from had my address. One travel firm (an Asian outfit) managed to get my address anyway, but I haven't heard from them since I put up a little web-page at Tripod saying "I am willing to opt-in to all bulk or commercial mail at..." and listed all of their contact addresses I could find.

      Childish, I know, but it did the trick.

    2. Re:Fight the good fight by Reziac · · Score: 3, Insightful

      Way back when, I used to get a ton of spam from one particular IP address in Taiwan. One day I took the trouble to whois it and noted that it belonged to a university. I forwarded one of the spams to the admin contact... and never got another spam from that server.

      Another point that brings up -- just because someone doesn't KNOW their system is being used for spamming doesn't mean they don't CARE. It pays to notify before you condemn.

      --
      ~REZ~ #43301. Who'd fake being me anyway?
  2. Welcome to the life of a helpdesk worker. by millwall · · Score: 5, Insightful

    No matter what he does, he can't please everyone. According to Tiffiany Mork, senior abuse engineer at Allegiance Internet, a very thick skin is a requirement for an abuse-desk worker. Her typical day includes verbal harassment, screaming, threats, and "all manner of nasty things."

    Like that is different from working in any other kind of helpdesk!

    1. Re:Welcome to the life of a helpdesk worker. by eatdave13 · · Score: 3, Insightful

      Hell yeah. Only problem is, one bad user can ruin a tech for everyone else.

      One user didn't like it when I told her that I couldn't send her a Win98 CD, so she called up Customer Service and told them I insulted her and made her cry and demanded that I be fired on the spot. The call wasn't recorded, and my company's policy is to belive the customer before the employee, so when I came into work the next day all my stuff was packed up in a box. Only after poking holes in her lies with other evidence, timestamps, previous calls, etc., AND treatening legal action against the company did I save my job. I wanted to punch each and every user I talked to in the face for the next month.

      This kind of thing happens on a daily basis. Well, maybe not to that level, but enough to keep our supervisors busy anyway. Half of the people that come on leave of their own free will within a couple weeks to go back to a job that pays half of what this one pays. Then again, I work for a shitty ISP whose main userbase is the scum of the earth from every backwoods trailer park in the US that other ISPs won't touch. This allows us to provide terrible service that customers continue to pay for because there isn't any other choice.

      I've gotten over that, but I've also gotten over thinking of the people I talk to as human beings, because they certainly don't think of me as one. I couldn't give less of a fuck what someone calls me over the phone. I also couldn't give less of a fuck when someone wishes me a nice day, because I know the second I tell them something they don't want to hear they're either going to turn hostile or try to get me to feel sorry for them. I smile a little when some retard deletes something important, but I'm careful not to let it show in my voice.

      It's all monotone now.

      --
      "Verbing weirds language." -- Calvin
  3. Sounds like Slashdot by product+byproduct · · Score: 3, Funny

    ... decentralized opponents striking from the shadows against quarreling allies. Does this sound familiar to anyone else?

    Yes, it's like the horde of trolls striking while other people are trying to discuss the subject at hand.

  4. Whitelisting is the answer by heretic108 · · Score: 5, Insightful

    This whole spammers versus spamblockers has proven to be a destructive arms race.

    Many legitimate machines and users - even whole ISPs - unfairly end up on blacklists, while the spammers just find another way through.

    The spamblocker tools and their heuristics get smarter, but don't forget that spammers keep up with these tools and constantly find new ways around them.

    I was using Razor and SpamAssassin for months. Formidable combination - networked blocklists plus pattern matching. Gave me a bit of peace. Very few false negatives. But in the last month, I've seen a whole new generation of spam coming through that the filters don't even touch.

    Peace has finally come from a package called Active Spam Killer, a package which works from a white list, and provides a convenient way for new correspondents to get themselves onto the whitelist.

    There are other whitelist-based packages, such as TMDA, but ASK is simple and painless to set up.

    Result?
    Spams to my mailbox have gone from 40 a day to zero.

    --
    -- In the beginning was the WORD, and the WORD was UNSIGNED, and the main(){} was without form and void...
    1. Re:Whitelisting is the answer by Tailhook · · Score: 3, Interesting

      Peace has finally come from a package called Active Spam Killer [paganini.net], a package which works from a white list, and provides a convenient way for new correspondents to get themselves onto the whitelist.

      You're adding an authentication layer to your specific mail account. Now, all we need to do is implement 4.1234E13 different mail account authentication systems. Each with it's own bugs, weirdo assumptions (HTML only, perhaps? Imagine how Mickysoft might do this...) and other deficiencies. Everyone you correspond with will have a different one. What fun!

      Authentication is the only feasible solution to spam. If we could collectively decide on a method of implementing it in a standard fashion we could avoid the mess.

      Don't hold your breath.

      --
      Maw! Fire up the karma burner!
    2. Re:Whitelisting is the answer by gujo-odori · · Score: 4, Insightful
      Many legitimate machines and users - even whole ISPs - unfairly end up on blacklists, while the spammers just find another way through.

      I spent five years working for ISPs, and during that time the only case of blocking I can think of that you could even possibly argue is unfair is the case of a certain major telco in the western United States which was (and AFAIK still is):

      * Lumping its business DSL customers and home DSL customers together in the same pool;
      * Not provding reverse DNS services to its business customers (their forward lookup might say mail.example.com, but the reverse still said host-aaa.bbb.ccc.ddd-spammydsl.sometelco.net)
      * Doing, as far as we could tell, nothing at all about spammers in their DSL pool, which was a major source of spam;
      * Doing, as far as we could tell, nothing about open relays & open proxies in their DSL pool.

      This led to the situation of us blocking their entire DSL pool based on reverse DNS.

      You could make the argument that it was unfair to said telco's business DSL customers to have their legitimate mail blocked, but I would then ask you, "Who was it that was being unfair to them? My employer, when we had no way to distinguish legitimate from illegitimate mail in that DSL pool from which most mail was illegitimate, or said telco, which was not providing proper service to its business DSL customers, who were paying a large premium over what residential DSL customers were paying and apparently getting little in exchange for their money?" My answer, of course, would be "Not my (then) employer."

      Please note that we did not consider blocking of residential DSL customers to be unfair in any way, ditto for ordinary dial pool customers. It is normal for ISPs (and the telco in question did so) to provide outbound SMTP hosts for use by their customers. All those affected, including the business DSL customers, could make use of them either directly or as a smarthost. It is not unfair to tell a residential customer "Use your provider's outbound SMTP hosts. That's what they are their for." I'm not convinced that it's unfair to say that to a business DSL customer either, although I understand how they would like to be able to send mail directly instead of smarthosting through their provider. However, if the telco's position is essentially that a DSL line, because it doesn't cost like a leased line, does not include the normal services that come with a leased line (such as reverse DNS service), that is an issue to be settled between the telco and the customer.

      I also question whether or not it is "unfair" to anyone to refuse their mail, on the grounds that delivering mail to any domain is a privilege, not a right. It is, of course, customary to extend that privilege to anyone who has not violated it or is not a member of a group of IP addresses where violation of that privilege is the norm (as in the case above), but no domain can be ordered to accept mail from any other domain. Refusing mail may have consequences for the refuser, of course, but that is their choice to make.

  5. One way to slow a specific flood by fanatic · · Score: 4, Interesting

    From the article: expert spammers can also switch IP addresses as quickly as the blocks are applied.

    A honeypot for spam - mentioned here previously, I think - would be one answer. It would recognize a spammer and, instead of disconnecting, it would accept all the spam - very sllloooowwwly, then discard it. It's not a trivial programming task, since the spam would have to be recognized, then treated differently from that point on from regular email. But it's feasible, I think and would help fight the large scale attack noted at the beginning of the linked article.

    --
    "that's not encryption - it's a new perl script that I'm working on..." - from some Matrix parody
    1. Re:One way to slow a specific flood by kasperd · · Score: 4, Interesting

      A honeypot for spam - mentioned here previously, I think - would be one answer.

      I have previously mentioned a honeypot here, but not the one you are talking about. I try to receive the spam as fast as possible in the hope that every spam ending up in my honeypot is one less spam to end up elsewhere. But I feel it is getting harder to attract spam. Though I have been working hard to make my honeypot attract lots of spam, and in the process managed to get my IP on OpenRelayCheck, I only got 1.3 million yesterday. My record from october 2002 was 36 million in 4 days.

      --

      Do you care about the security of your wireless mouse?
    2. Re:One way to slow a specific flood by flonker · · Score: 4, Interesting

      I run a program that just listen on port 25, pretending to be an open relay, and logs all relay tests to a file. I get scanned by testers using the following two email hosts constantly. The 21cn.com one has been using the same exact address for months now. Almost makes me want to mailbomb them.

      Mar 27 08:07:18 [210.222.196.141:27910]
      ehlo ll-nidaf2xx5kn9
      Rset
      Mail from:<china9988@21cn.com>
      RCPT to:<china9988@21cn.com>
      Data
      From: china9988@21cn.com
      Subject: 68.22.196.106
      To: china9988@21cn.com
      Date: Thu, 27 Mar 2003 23:20:51 +0900
      X-Priority: 3
      X-Library: Indy 8.0.25
      t_Smtp.LocalIP
      .
      Quit

      Mar 27 19:23:10 [210.222.196.133:58885]
      HELO hanmail.net
      MAIL FROM:<jkdsa@hanmail.net>
      RCPT TO:<mg0108@hanmail.net>
      DATA
      Message-ID: <20820-2200335282014339@hanmail.net>
      X-EM-Version : 6, 0, 0, 4
      X-EM-Registration: #0010630410721500AB30
      Reply-To: rolliey@hotmail.com
      From: "good" <jkdsa@hanmail.net>
      To: mg0108@hanmail.net
      Subject: 68.22.196.106
      Date: Fri, 28 Mar 2003 11:00:14 +0900
      MIME-Version: 1.0
      Content-Type: text/html; charset=KS_C_5601-1987
      Content-Transfer-Encoding: quoted-printable
      <HTML>
      <HEAD>
      <META NAME=3D"GENERATOR" Content=3D"Microsoft DHTML Editing Control">
      <TITLE></TITLE>
      </HEAD>
      <BODY>
      <P></ P>
      </BODY>
      </HTML>
      .
      QUIT

    3. Re:One way to slow a specific flood by kasperd · · Score: 3, Interesting

      I run a program that just listen on port 25, pretending to be an open relay, and logs all relay tests to a file.

      That is also what I do, and your probes sure look familiar. Occationally I actually relay the probes to see what they are actually up to, and then I get loads of spam. I also run another program on ports 1080, 3128, 6588, 8000, and 8080 that pretends to an open proxy which can be used to connect to an open relay. Next step would be to automatically report received spam to razor.

      --

      Do you care about the security of your wireless mouse?
  6. 75 million? by Lynn+Benfield · · Score: 3, Insightful

    Every day, 80 percent of all incoming mail to Outblaze is rejected as spam and filtered out before Ramasubramanian and his team have to deal with it. Out of the remaining 15 million messages per day that do pass through Outblaze servers

    So if 15 million messages is 20% of what they get, they receive 75 million individual messages a day? That seems a little high...

  7. Simple solution by azav · · Score: 3, Insightful

    Time for all responsible ISPs to assign their own anti spam reps, reach out, get a list of ALL isps, contact their anti spam reps and take action.

    Get organized and form a plan but first, get organized on a global level.

    Then kick some ass and pool for legal action against the thieves. :]

    --
    - Zav - Imagine a Beowulf cluster of insensitive clods...
  8. disgusting by danbuhler · · Score: 3, Interesting

    Just the thought of this makes me sick.. Almost as sick as those who make spamming profitable.

    Now that I've thought about it. How is spamming still profitable? Are there that many people out there that are into having sex with farm animals? Or believe their are pills that increase life span? Who the hell are these people?

  9. Outblaze, huh? by Pathwalker · · Score: 4, Interesting
    Those guys have to run the most annoying relay tester I've seen. Every time it tests you, it sends a burst of 30 messages or so, all with return addresses on the box they are testing so they don't have to deal with bounces.

    Now, some people may feel it's my own fault for taking advantage of the part of RFC 2821 which states that if a mailserver defers checking to see if it can relay or deliver the mail then "These servers SHOULD treat a failure for one or more recipients as a "subsequent failure" and return a mail message as discussed in section 6.".

    But, I guess they feel that everyone runs sendmail, so every time they test my mailserver, I end up with another batch of relay rejected messages intended for them sitting in my postmaster mailbox.

    There are two parts of this that bug me:
    1. If a mail server does not relay mail, it is rude for a test to result in mail to the administrators of that server
    2. It is possible for the username they use in their test to actually deliver mail to a real user. I consider it as bad as spamming if their test drops dozens of messages in the account of an innocent user with no idea of what is happening, or control over the mail server.
  10. Whitelisting is unethical by PigleT · · Score: 4, Informative

    "There are other whitelist-based packages, such as TMDA, but ASK is simple and painless to set up."

    And how do you feel about making all innocent senders of mail do extra work, while spammers simply ignore it and move on?

    I simply cannot justify that, based on the redistribution of workload and increased aggravation - you send me a bounce message, I consider your email address invalid whether that bounce is "500 address unrouteable" (a valid, understandable error) *or* "500 I Don't Like You" - which I consider frankly offensive.

    Go back to SpamAssassin, get 2.50 or better, which includes Bayesian analysis as well as all the above. Or just shove a Bayesian filter in the way after SA; here, I have outright regexp-based rejection and SA in exiscan, followed by bogofilter in procmail - very few spams get past the first hurdle (From: headers snarfed from Usenet) and those that do are caught either by SA and/or bogofilter.
    This way happiness lies.

    --
    ~Tim
    --
    .|` Clouds cross the black moonlight,
    Rushing on down to the circle of the turn
  11. The bounce problem by dmeranda · · Score: 5, Informative

    If 50% of all mail in the US is spam, then the other 50% must be the bounces for all that undeliverable mail!

    I run a mail gateway for a medium sized company, and although not on the scale of a large ISP, I see many of the same problems. Dealing with spam on a gateway level is quite different from dealing with a single personal mailbox. And spam flooding has gotten much worse in the last few months. Getting over a 1000 messages in under a minute can really start to tax your infrastructure. Actually from my own observations, I'd say that at least 75% of all mail is spam, and 80% of that is undeliverable.

    Of course one of the big problems as Ramasubramanian points out is that spammers are getting very sophisticated at impersonating other entities. This results in a large number of bounces being directed back to the wrong guy. So not only are you getting spammed, but you are also indirectly spamming the poor guy who is being impersonated with your flood of bounces. And the bounces also cause other problems because it tends to fill up your outbound mail spools, as well as making the required postmaster account near useless sometimes.

    One thing I've learned is that a mail administrator must be very careful about constructing blacklists and filters. I use sendmail and make heavy use of it's milter programatic filter interface. It's amazing how being able to analyze the mail at the protocol level (such as the HELO command) helps identify impersonated mail that can't just be done by only looking at mail headers or the message body. It is also possible to help correlate large volumes of nearly identical inbound mail from a large number of different servers, as well as correlate them with large number of undeliverable outbounds. I'm also very careful to check whois an other registrar databases before adding blacklist entries, to help prevent blacklisting the wrong guy. But I do admit that for a few of the most audacious flood attacks, I actually have to resort to iptables firewall blocks to stop it even before sendmail sees it. I really dislike having to disobey the SMTP standards, but spam floods are IMHO just as destructive as worms and viruses!

    The thing I fear most as a mail administrator is not the inbound spam, but that some spammer may start impersonating my company! We'd start getting placed on blacklists and blocked, plus we'd start getting flooded with all those bounce messages (probably an order of magnitude more than direct spam). How can one possibly protect against that?

  12. Teergrube by KjetilK · · Score: 3, Interesting
    I have a few honeypots (trollboxes or spamtraps, you may call them), and they do get a lot of spam. For example, I code things like

    <link rel="DoNotEmail" href="mailto:aa0u@kjernsmo.net" />

    (yeah, that's a real, living trollbox, spambots, do your worst! :-) ) Very few users will ever see this, but the spambots will harvest it. It is clear that many of them do.

    The other thing you mention, I think that is what is meant by a Teergrube. Marc Merlin has some good stuff on using Exim and SpamAssassin to reject messages or making spammers stick in a teergrube. He has some debs too.

    Unfortunately, I haven't had time and I haven't been feeling adventurous enough to try all this, but clearly, it works well.

    --
    Employee of Inrupt, Project Release Manager and Community Manager for Solid
  13. Re:Another world group? by BrookHarty · · Score: 4, Interesting

    I don't see how anyone is going to trust the USA in an international treaty any time soon. The USA will simply opt out of any regulation as soon as it hampers their economic well-being.

    First.

    Get off the USA bashing kick, all countries look after their own economic needs. (aka, sweat shops are illegal in the USA, but the WTO says that in 3rd world countries as its the only work available, they are legal...)

    Second.

    The USA (aka Federal Government) has nothing to do with Spam guidelines unless its a Federal Law. (Which could be considered a violation of Interstate Commerce, thats part of the reason no laws are passed at the Federal level... btw, IANAL...) This is also why we are trying to pass State level laws for Spam.

    But, if ISPs who want to deal with SPAM can join blacklists, whitelists, coalition, etc. Nothing is stopping them. But on the Other side, there is money to be made in Spam, and companies willing to make a buck will do it. (All around the world, not just the USA or Hong Kong.)

  14. Long time spamfighter by tsvk · · Score: 5, Interesting

    Shuresh is also a regular poster in the newsgroup news.admin.net-abuse.email, a discussion forum about e-mail abuse.

    Check his postings from the Google Groups archive.

  15. Roughly speaking... by Ethelred+Unraed · · Score: 4, Informative
    "Sturmbahn" means "path of the storm"; "Sturmbahnfuehrer" essentially means "leader of the path of the storm". It was a rank in the SS in WWII -- most of their ranks had similarly Wagnerian (Orwellian?) sounding titles.

    /me shudders

    Cheers,

    Ethelred

    --
    Everyone wants to be Ethelred. Even I want to be Ethelred.
  16. Filling referenced website logs with crap? by BigBlockMopar · · Score: 4, Interesting

    How do people feel about scripts to fill website logs with crap? Here's mine, quick and dirty, written in about 30 seconds because I was pissed off:

    #!/bin/bash
    COUNT=0
    while [ $COUNT -lt 10000 ]; do
    lynx -dump http://www.resumeagencies.com/recruiterspage.asp?Y OU_FILL_MY_MAILBOX_WITH_UNSOLICITED_CRAP_AND_I_WIL L_DO_THE_SAME_TO_YOUR_WEBLOGS
    sleep 1
    let COUNT=COUNT+1
    echo $COUNT
    done

    Note the fact that I'm calling what I hope is a dynamic page, so with luck, I'm wasting their server's processor time. The script is otherwise, as you can see, completely unrefined.

    Legality, anyone? Other problems (despite the obvious fact that I have to waste my bandwidth to fuck with spammers)? Obviously, it's a DoS attack of sorts, but then again, so is an unsolicited e-mail. If they want to challenge me legally on that point, then I will do the same to them. My website very clearly points to the policies which apply to all e-mails sent to my domain.

    --
    Fire and Meat. Yummy.
  17. Re:Something about the article bothers me.... by Anonymous Coward · · Score: 3, Interesting

    >According to the article, this guy is having to >block off a flood of mail from spammers to his >system. The way I read the article, this flood >is not for Outblaze users, but just for >relaying. Why the bleep does his mail server >even accept this mail? Any modern sensible set >up mail server should follow a ruleset like:

    Don't put words in Suresh's mouth. He said he was trying to deal with a flood of BOUNCES to his system because the spammers FORGED addresses serviced by Outblaze.
    >
    >if (sender is one of my users)
    > accept
    >else if (recepient is one of my users)
    > accept
    >else
    > bugger off spammer
    >endif

    Twit. Anybody who runs his server like this is bound to be abused by spammers because ANYBODY can FORGE the sender. Any modern sensible setup will NEVER use rules like this. All modern sensible setups use these rules:

    1) for ISPs who have dialup/broadband users:
    if email is from ISP network ips = RELAY
    if connection authenticates via POP-B4-SMTP or SMTP-Auth = RELAY
    if not, if recipient is ours = ACCEPT
    else DENY

    2) ISPs who do not have a bunch of ips to relay for:
    if connection authenticates via POP-B4-SMTP or SMTP-Auth = RELAY
    if recipient is ours ACCEPT
    else DENY

    >Having received spams relayed by Outblaze >servers, I don't think that's what is happening. >I think they are running open mail servers, and >trying to keep the spammers from using them.

    I think you are lying and not very good at it. 1) Post headers with proof that they are 'open mail servers'. 2) There are plenty of spammers out there who would love to make use of the delivery capacity of a system that can deliver 15 million emails daily and there are more who are anti-spammers who would immediately recommend Outblaze servers be listed on SPEWS, ORB, SPAMCOP and other RBLs but for some reason they haven't.

    >I could be wrong, but that's how I read the >article.

    Looks like you need to go back to school and take comprehension tests and I doubt that will help since the post you made shows an obvious attempt to badmouth Outblaze. Not much a school can do when the problem is not in the mind.

  18. I see! by HarveyBirdman · · Score: 3, Funny
    Hmm ... decentralized opponents striking from the shadows against quarreling allies. Does this sound familiar to anyone else?"

    Which, of course, raises the possibility of dropping "bunker busters" on the offices of spammers. ;-)

    I fully support this idea.

    --
    --- Ban humanity.