Slashdot Mirror


Risks of Partisan Spam Filtering?

Mike1024 asks: "Pete Klammer reported in RISKS 23.95 about spam filtering software filtering political e-mails - including Postini blocking certain anti-Schwarzenegger URLs and Comcast blocking e-mails mentioning afterdowningstreet.org. This could be caused by malicious action, misreporting of spam, 'joe jobs', or actual spamming. With many people using their ISP's default settings, and manual spam filtering being impractical for many users, what can be done to avoid giving ISPs and anti-spam companies extensive, fully automated censorship abilities?"

63 comments

  1. Gee, stop asking for donations? by Marxist+Hacker+42 · · Score: 3, Insightful

    That would seem to me to be the #1 cause of political spam being filtered. #2 would be the outlandish use of HTML when a text message would do just as well. If they stopped just those two behaviors, most of the spam filters would let the messages through just fine.

    --
    SJW: a person who perceives an injustice, and while correcting it, commits a greater injustice.
    1. Re:Gee, stop asking for donations? by legirons · · Score: 1

      So if I delete any email with HTML tags, am I a biased polititian?

      (I don't mind being biased, just interested to know)

      Secondly, since US political parties are, I believe, "licensed to spam", surely that means I delete them on principle anyway (as legalised spammers) regardless of the validity of their viewpoint (if any)

      i.e. if a group are given legal dispensation to spam, I'll do what I can to delete anything they send, simply because they might be spammers.

      (works for terrorists, may as well work for politicians...)

  2. Once again Slashdot is ahead of the pack by Neil+Blender · · Score: 1, Insightful

    What with the modding down of any conservative opinion and what not.

    1. Re:Once again Slashdot is ahead of the pack by Anonymous Coward · · Score: 0

      It's funny, 'cause they modded you down!

  3. Here's Your Answer.... by Anonymous Coward · · Score: 0

    This is Slashdot, bastion of left-wing long-haired dirty hippy Socialists. What do you expect?

  4. What the hell is the big deal? by pclminion · · Score: 2, Insightful
    I use Thunderbird's Bayesian spam filter, and guess what? It fucks up sometimes. Usually, it screws up on messages that contain HTML elements (the VAST majority of HTML email I receive is spam, so this is no surprise) or "spammy" words.

    Does political mail look like spam? Oh God, yes. Again, no surprise that a Bayesian style filter might get confused.

    Should we chuck automated email filtering? This problem has always existed. Important messages have a small chance of being miscategorized. If that's not acceptable to you, don't use those filters, or switch to an email provider that doesn't filter your mail that way.

    "Partisan" spam filtering is a farce. What the hell could the ISP possibly gain by surpressing political viewpoints? It's a software fuckup.

    1. Re:What the hell is the big deal? by krewemaynard · · Score: 3, Insightful

      False-positives are the reason why Thunderbird sends spam to the Junk folder and not directly to the Trash. Yeah, it sucks having to go through that stuff to make sure nothing accidentally got bundled in there, but it's better than a) having it all in the Inbox, and b) losing something important. But the good thing is, it's my choice. If the ISP starts blocking it, I may never know that I lost something that was supposed to get through. At work, that could cost money. Not good.

      --
      I saw it on Slashdot, it must be true!
    2. Re:What the hell is the big deal? by pclminion · · Score: 1
      But the good thing is, it's my choice. If the ISP starts blocking it, I may never know that I lost something that was supposed to get through. At work, that could cost money. Not good.

      Very true, but once again, it's merely a failure of the system. There's absolutely no reason to assume that ISPs are purposefully blocking certain political viewpoints. It's ludicrous.

    3. Re:What the hell is the big deal? by krewemaynard · · Score: 1

      Very true, but once again, it's merely a failure of the system. There's absolutely no reason to assume that ISPs are purposefully blocking certain political viewpoints. It's ludicrous.

      I agree. But the second some political mass-mailer or form letter gets dropped or bounced, the assumption will be conspiracy.

      Besides, I wasn't even speaking to political mail. At work, we had a machine running Norton AntiSpam and Thunderbird Junk controls. Norton was overly aggressive, flagging nearly everything as spam; Thunderbird didn't catch spam right away until it was told what spam looked like. The common thread here: WE were the ones training the systems, and filtering through the good and bad decisions they made. If it had been up to the ISP, we may have lost work, and therefore money. No conspiracy, just a bad choice. Same with politics.
      --
      I saw it on Slashdot, it must be true!
    4. Re:What the hell is the big deal? by Greg_D · · Score: 1

      I agree. But the second some political mass-mailer or form letter gets dropped or bounced, the assumption will be conspiracy. Well, that should tell you all you need to know about the source of the emails in question. I don't see spam in any form as any different than a guy walking up to you and sticking a flyer in your pocket, and I don't care whether I share in the political sentiment involved or not. In both politics and religion, those who want to hear what you have to say will seek you out, those who don't will avoid you, and proselytizing to the latter group will incite them to ignore you no matter how good your intentions or how much evidence you have to support your viewpoint.

    5. Re:What the hell is the big deal? by Kelson · · Score: 1

      Absolutely. A few years ago, someone posted to the razor-users mailing list that everything MoveOn.org sent out got tagged as spam by Razor. (Vipul's Razor is the original open-source client for what has since become CloudMark SpamNet.) The poster was concerned that Razor was unwittingly being turned into a censorship tool.

      As I recall, it degenerated quickly into a... discussion of whether it was just people putting old addresses on auto-report, or whether the site was actually sending out unsolicited mail.

      But the first instinct was, as you said, to call "conspiracy!"

    6. Re:What the hell is the big deal? by Mike1024 · · Score: 1

      Does political mail look like spam? Oh God, yes. Again, no surprise that a Bayesian style filter might get confused.

      Perhaps the sub was unclear. What I'm particularly interested in is ISPs blocking e-mail based on lists of spamvertised URLs.

      It would be pretty trivial for an ISP employee to add arbitrary URLs to such lists. Someone in AOL's anti-spam department could stop AOL users receiving e-mails referencing www.anncoulter.com or www.michaelmoore.com.

      The referenced article implies that this has happened:-

      Now we hear that messages regarding the Downing Street memos have been blocked from Comcast.net customers (one of the largest high-speed cable internet providers in the U.S.), based on content of the message -- a URL -- rather than subject line or sender address or domain.

      Now, I'll admit the blocking could have been done by a Bayesian filter seeing HTML e-mail, or might have been in response to genuine spamming. If that's the case, we'll call this discussion hypothetical.

      The point is: If we allow ISPs to block e-mails based on content, how can we make sure abuse does not take place?

      At the moment, we seem to be relying on the professionalism of administrators and abuse desk workers. Is this good enough?

      "Partisan" spam filtering is a farce. What the hell could the ISP possibly gain by surpressing political viewpoints? It's a software fuckup.

      I took the word 'partisan' from the referenced article; with retrospect, I agree it isn't the right word.

      I agree that a 'software fuckup' is the most likely explanation for these isolated incidents, but I think it's pretty clear why an ISP (or ISP employee) might want to suppress political viewpoints: To influence the political process.

      Just my $0.02,

      Michael

      --
      "Goodness me, how unlike the FBI to abuse the trust of the American public." -- The Onion
    7. Re:What the hell is the big deal? by Mr.+Slippery · · Score: 1
      What the hell could the ISP possibly gain by surpressing political viewpoints?

      Perhaps you missed this?

      --
      Tom Swiss | the infamous tms | my blog
      You cannot wash away blood with blood
  5. It wasn't that long ago... by krewemaynard · · Score: 3, Interesting

    ...that folks were clamoring for ISPs to do MORE to prevent spam. Now they're doing more, and we're wondering if it's too much and they should do less. decicive bunch, aren't we?

    --
    I saw it on Slashdot, it must be true!
    1. Re:It wasn't that long ago... by fm6 · · Score: 1
      People aren't indecisive. They just have a short attention span. It's like that episode of the Simpsons where a bear gets loose in Springfield, and people storm the Mayor's Office insisting that he make sure it never happens again (never mind that it never happened before). So he spends a lot of money on an Anti-Bear patrol, passes a tax to pay for it -- and they storm his office again, demanding that he do something about high taxes.

      I forget how the episode ends, but it probably wasn't pleasant.

  6. ISPs shouldn't block anything by i.r.id10t · · Score: 1

    ISPs shouldn't block anything at all except by protocol/standard - for example dropping mail not properly sent when using SPF or similar. But blocking based on content, etc. is not proper.

    --
    Don't blame me, I voted for Kodos
    1. Re:ISPs shouldn't block anything by pclminion · · Score: 1
      ISPs shouldn't block anything at all except by protocol/standard - for example dropping mail not properly sent when using SPF or similar. But blocking based on content, etc. is not proper.

      Oh, so now you're the judge of what is and is not a "proper" service for a company to offer to its customers? I believe Bayesian mail filtering is a perfectly reasonable service to offer to those customers who want it. But hey, according to you that isn't "proper," so I must be a moron.

      If the customer doesn't like it, he/she can ask for the service to be discontinued or switch to another company.

    2. Re:ISPs shouldn't block anything by walt-sjc · · Score: 1

      Content filtering is by far the most effective mechanism. Looking for known spam URLS via SURBL (for example) is Highly accurate. 419 scams generally come from REAL accounts on REAL email servers (mostly the free ones...) Are you saying that those shouldn't be filtered? That's nuts!

    3. Re:ISPs shouldn't block anything by i.r.id10t · · Score: 1

      Should be the other way around... if the customer asks for the filtering, then put it in place.

      --
      Don't blame me, I voted for Kodos
  7. It's only email that gets filtered like this by badfish99 · · Score: 2, Interesting
    Suppose I set up a service described like this:
    All your (snail) mail gets delivered to me. I will read it, and throw away anything that looks like junk, and then send the good stuff on to you. I won't tell you what I've thrown away, or what criteria I use.

    You wouldn't sign up for that, would you? So why do people put up with third-party spam filters that do the same thing? I know that spam is a big problem, but everyone ought to take control over their own communications. It's one thing for me to decide to throw some email away unread; it's quite a different thing to give someone else that power over me.

    1. Re:It's only email that gets filtered like this by pclminion · · Score: 1
      You wouldn't sign up for that, would you? So why do people put up with third-party spam filters that do the same thing?

      You said you won't explain what criteria you use. There are some mail filtering systems where this indeed is the case, but a Bayesian or other statistical system is open for examination. The criteria are probabilities. As somebody who has designed these kinds of filtering systems, I have absolutely no problem handing the decision-making over. I know how it works. And I know how it screws up, when it does.

      The fact of the matter is that political email is rife with HTML and requests for donations (as an insightful poster pointed out below). In fact, a reasonable person would probably conclude that most political email *is* spam, albeit spam that you might actually want to see. Since the filter is not a mind reader, it can't tell the difference.

      If you want to receive political email, why not create an unfiltered email account specifically for that purpose?

    2. Re:It's only email that gets filtered like this by rabbit994 · · Score: 1

      Spam is also different then most snail mail. Snail mail is delivered once a day and most people don't get 1/10th junk mail that they do spam. If you got the amount of junk mail that you do spam and it was delivered even 4 times a day where the post man opened your door and dropped it on the kitchen counter, most people would pay for a service to filter.

      Remember, ISPs are doing spam filtering because customers ask for it. You may not use it but other people will and are.

    3. Re:It's only email that gets filtered like this by badfish99 · · Score: 1

      I totally agree with you. I use a Bayesian filter myself. My point is, I trained the filter myself, and it does what I want it to do. It doesn't follow the (possibly hidden) agenda of a third party.

  8. Nothing? by Anonymous Coward · · Score: 1, Interesting

    Spam filtering is by its very nature censorship. You're agreeing to have your incoming email censored so you don't have to deal with spam. If you don't like the terms of that, well, it's up to you. Set up your own mail server and customize the spam settings how you see fit. Or even find a decent host with SpamAssassin and tweak that to your liking. Or just find an ISP/mail host with no spam filtering, and handle it on your client with Bayesian training.

  9. I've read... by daviq · · Score: 0

    Of a guy who gave up isp's all together. And it's practical for your email. Buy a domain for about $15/yr and find hosting anywhere from $1-$10 per month. This gives you no filtering, and so then you can go and download and/or write your own spam filter.

    --
    Go to the w3.org and put Slashdot.org through the validator.
  10. What's the issue? by HD+Webdev · · Score: 1

    With many people using their ISP's default settings, and manual spam filtering being impractical for many users, what can be done to avoid giving ISPs and anti-spam companies extensive, fully automated censorship abilities?"

    Well, there you go.

    They shouldn't use the default settings.

    The Masses are getting what they want. The least amount of spam possible.

    If some people are really interested in their email then they would be well advised to spend a few minutes looking at the filtering options.

    --
    This is not a dream, not a dream...we are transmitting from the year 1-9-9-9.
  11. Answer by 4of12 · · Score: 1

    what can be done to avoid giving ISPs and anti-spam companies extensive, fully automated censorship abilities?

    Making them openly disclose exactly what spam filtering policies they use.

    After all, if people have no idea about what they're not getting, they won't even know.

    For example, I lost out on a wonderful opportunity to help out a government official in Nigeria that my friends are pursuing right now.

    --
    "Provided by the management for your protection."
  12. Use slashdot to report it by follower_of_christ · · Score: 1
    I don't fully understand how the spam filters work, but I assume it has something to do with a certain percentage of users reporting that an email was spam that caused an ISP to begin filtering it as spam. If its not and the ISP is filtering certain domains because of its politics and not allowing their user base to decide, then this should be reported on and allow users to make up their own minds and allow capitalism to work. I no longer use google because of their filtering of conservative ads. I'd do the same for yahoo, msn, .mac, you name it.

    This is where I believe capitalism can be used to pursuade the company to make wise choices.

    This can be accomplished now with blogs and easily searchable news.

  13. Obvious by Intron · · Score: 0, Flamebait

    Just put spam filtering in the hands of a large, trusted organization with experience in secure systems such as Diebold.

    --
    Intron: the portion of DNA which expresses nothing useful.
  14. the political lists could help out by snorklewacker · · Score: 3, Insightful

    Starting by running some decent lists. These folks run some amazingly slipshod lists, usually unconfirmed optin, and sometimes outright buying addresses. What do they expect? They're spamming!

    But they figure that since they're not commercial, that they have a cause and a message, that they don't really have to pay attention to running a clean list, and anyone who blocks them must be a political censor.

    I'm a left liberal, but I find myself blocking the DNC more often than the RNC, simply because the former has less stringent mail practices.

    --
    I am no longer wasting my time with slashdot
  15. Yeah, but ... by gstoddart · · Score: 1

    Unsolicited e-mail from someone not on my address book has a huge likelihood of being spam.

    The fact that a bulk-mailing to a bunch of people happened to be political in nature doesn't change the fact that those messages smell shockingly like spam.

    --
    Lost at C:>. Found at C.
  16. Just Face It by marcus · · Score: 1

    Come on, anytime you hire someone else to handle your responsibilities, they are going to screw up sometimes.

    You could hire someone to point out all of the interesting TV shows for you. They will miss some good ones and they will give you some that are boring.

    You could hire someone to push the FF button on the remote to skip the commercials on the DVR. Will they skip over the 1 in 100 that is actually advertising something interesting? Yes.

    People do hire others to teach their kids and listen to the noise about schools today!

    Why do complaints about crappy SPAM filters make it onto /.?

    --
    Good judgement comes from experience, and experience comes from bad judgement.
    - W. Wriston, former Citibank CEO
  17. If your not on my list your probably SPAM. by Shivetya · · Score: 2, Informative

    The spam system I use is the challenge/response type. You get told you can ask for access to my mailbox and I can decide to allow it.

    As for other automated systems like Postini, which we use at work it all comes down to the content. A lot of time configuration errors will creep in as well like the time all mail a guy named Dick H... was being deleted without notice! You can guess why.

    PostIni has actually blocked some political mail to me and I can give you a few hints.

    Certain political emails contain verbage that gets labeled as porn or hate speech. That second category is so broad and abused that companies will throw about anything that might hint of insensitivity under it just to keep themseleves safe.

    The second category they got caught by? Money. There is a $$$ category that attempts to weed out money requests and the like.

    Do I care one way or another? No, I particulary did not like how the government excluded the rules of spam from acting on elected officials and I really couldn't care less about any unsolicited spam from either aisle.

    --
    * Winners compare their achievements to their goals, losers compare theirs to that of others.
    1. Re:If your not on my list your probably SPAM. by legirons · · Score: 1

      "The spam system I use is the challenge/response type"

      Good luck buying anything from a shop which emails you once to say "can we check your address?"

      I was looking at the greylist system, until I realised how many false-positives it would generate. Even today, when I auto-delete about 99.8% of my email, I still have to fish-out internet shops and add them to the relevant whitelists...

      Maybe I should allocate one To: address for all the shops, rather than a different one for each shop (which tells me who leaked the address... But even then, I suspect greylists wouldn't work.

  18. Coincidence? by skintigh2 · · Score: 0, Troll

    I seem to recall reading stories that most cyber-nanny type products block access to liberal sites like NOW and PETA and bloack access to democratic candidates, but never block traffic to sites like the NRA...

    Can't find an original story right now, but http://www.washingtonfreepress.org/46/urban_work.h tml

    1. Re:Coincidence? by Detritus · · Score: 2, Informative

      You would be misinformed. Anything having to do with guns or weapons is a commonly blocked category.

      --
      Mea navis aericumbens anguillis abundat
  19. How sites/messages end up as "spam". by khasim · · Score: 1

    #1. The sending address is on a blacklist because that address sent a message to a spam trap.

    #2. The sending address is on a blacklist because people received the email and submitted it as spam.

    #3. If #1 or #2 apply, web links inside the message can be classified as "spammy" content. This includes links to graphics, articles, and so forth.

    #4. See #3, but key words can be classified as "spammy" content. The easy way around this is to use the "this is not spam" function that should be available to you.

    So, the "problem" can be broken down as: The sender is an idiot for sending the crap to people who don't want to receive it.

  20. Tag spams, don't drop them by Motherfucking+Shit · · Score: 2, Interesting

    If you're worried that you're missing emails of any sort (politics is a red herring as far as I'm concerned), go with an email provider that tags messages instead of deleting them. This is a simple configuration in SpamAssassin, and any competent mailhost will set it up on a user-configurable basis. I'm not saying that ISPs will be so kind as to offer this option, but if you can afford it, you've probably already got your own domain at a webhost somewhere.

    The webhosting company I use for my personal stuff does this (not going to mention names, because I don't want this to sound like a plug). I can set up unlimited POPs and forwarders, and adjust the SpamAssassin settings on each one; not only the scoring gestalts, but also whether messages that are considered spam get deleted, or simply have a [SPAM] tag added in the subject line.

    I opt for the tagging. This means that I get all of the email, but with a single filter rule on my mail client (i.e. matching "[SPAM]" in the subject header), I can sort all the questionable stuff to a "Junk" folder and go through it later.

    If your ISP drops or deletes spam mail, set your mail up elsewhere, or bitch heavily to your ISP requesting that your spam be tagged instead of nuked. I hate spam as much as the next guy, but there's no reason that any ISP should be risking false positives and having their customers lose legit email.

    --
    "BSD: Free as in speech. Linux: Free as in beer. Windows 10: Free as in herpes." --Man On Pink Corner in #52607549.
  21. It could be worse... by Anonymous Coward · · Score: 0

    It could be worse, you could be using some sort of e-mail provider, whether ISP based or web based, which automatically deletes certain e-mail before it even reaches your inbox. It doesn't matter what your junk mail settings are. *cough* Hotmail *cough*

  22. Analog Spam by daspriest · · Score: 1

    Now if I can just convince the USPS to filter out the ads that clog my mail box.

  23. Genetic algorithm for realistic spam by SgtChaireBourne · · Score: 1
    #1. The sending address is on a blacklist because that address sent a message to a spam trap.
    It's not so simple since many return addresses are forged. And unless the spam gets bounced to the forged return address, the owner is likely unaware that their address is being forged and can't pursue corrective measures.
    #4. See #3, but key words can be classified as "spammy" content. The easy way around this is to use the "this is not spam" function that should be available to you.
    All this filtering does is selectively breed spam generators with more realistic content, sort of like a slow, manually operated genetic algorithm. Already most spam uses well formed headers and fully standards compliant messages. As unpopular as it is to say, you have to go after the source of the spam: those advertising via spam.

    Mostly it looks like an issue of enforcing and/or clarifying United States Code, Title 47, Chapter 5, Subchapter II, Part I, Sec. 227:

    It shall be unlawful for any person within the United States ... to use any telephone facsimile machine, computer, or other device to send an unsolicited advertisement to a telephone facsimile machine ...
    That stopped the junk fax problem which some here may be old enough to recall. Spam costs. It costs schools, it costs businesses and it costs individuals. Sure electrons are 'cheaper' than fax paper, but time costs and weeding spam or messages lost due to false positives cost lots of time, especially the latter.
    --
    Beta is broken and the link to classic doesn't work. Stop wasting our time or there won't be anybody left here.
    1. Re:Genetic algorithm for realistic spam by khasim · · Score: 1
      It's not so simple since many return addresses are forged. And unless the spam gets bounced to the forged return address, the owner is likely unaware that their address is being forged and can't pursue corrective measures.
      Sorry, I should have said "sending IP address". There is no way to forge the IP address of the machine sending you the message and still receive the message.
      All this filtering does is selectively breed spam generators with more realistic content, sort of like a slow, manually operated genetic algorithm. Already most spam uses well formed headers and fully standards compliant messages.
      You would think that, wouldn't you? But it doesn't seem to be working.

      I guess that's because what looks "realistic" to you would not be "realistic" to me. So the spammer would have to tailor his spam to the recipient.

      Note, this does not work well in large ISP situations, but works incredibly well in single person situations. I use it at a small office (150 employees) and it works pretty good.
      That stopped the junk fax problem which some here may be old enough to recall.
      Yeah, it did. But with junk faxes it was easy to find the phone number that was faxing you.

      With spam, the machine sending it is probably a zombie.
      Spam costs. It costs schools, it costs businesses and it costs individuals. Sure electrons are 'cheaper' than fax paper, but time costs and weeding spam or messages lost due to false positives cost lots of time, especially the latter.
      I agree. But with the CAN-SPAM act, it is very difficult to make a FEDERAL case out of the spam. We need to get rid of that and allow each state to set their own laws.

      Sure, that would drive up the cost for the legitimate email advertisers, but why should I have to put up with spam just so they can keep their costs down?
    2. Re:Genetic algorithm for realistic spam by Marxist+Hacker+42 · · Score: 1

      That stopped the junk fax problem which some here may be old enough to recall.

      It did? I commonly get 3-4 pieces of fax spam a week, despite all my phone numbers being on the federal "do not call" list. And the station numbers always lead to disconnected lines.

      --
      SJW: a person who perceives an injustice, and while correcting it, commits a greater injustice.
    3. Re:Genetic algorithm for realistic spam by SgtChaireBourne · · Score: 1
      I commonly get 3-4 pieces of fax spam a week, despite all my phone numbers being on the federal "do not call" list. And the station numbers always lead to disconnected lines.
      Then you can start collecting money from them, if you're both in the US. Junk fax is illegal according to 47USC227, so look into "(b) Restrictions on use of automated telephone equipment". IANAL, but maybe small claims court is the way to go. If they don't show up, you win by default.
      --
      Beta is broken and the link to classic doesn't work. Stop wasting our time or there won't be anybody left here.
    4. Re:Genetic algorithm for realistic spam by SgtChaireBourne · · Score: 1
      By realistic, I mean that the headers are now mostly RFC compliant. In 1999, nearly 100% of the spam I filtered had malformed headers. However, the filler in the body is getting more realistic too, or at least difficult to filter automagically.

      Yes, most spam is probably sent via zombies, but that's not who I recommend going after. (Though a blanket ban on MS-Windows by all ISPs would help there.) Who I do recommend going after in my earlier post are the businesses advertising via spam. If they want your money for whatever purpose, they have to provide some contact information there. I'm sure even with a small group of say 150 employees, you would even get some repeat violators of the do not spam list.

      However, no one is willing to stick their neck out and instead sit passively by as the spam problem gets worse.

      --
      Beta is broken and the link to classic doesn't work. Stop wasting our time or there won't be anybody left here.
    5. Re:Genetic algorithm for realistic spam by Marxist+Hacker+42 · · Score: 1

      Good luck trying to find out who sent the spam though- if the station ID information is spoofed and the 1-800 number denies sending the spam, who do you collect FROM? Who do you SUE?

      --
      SJW: a person who perceives an injustice, and while correcting it, commits a greater injustice.
    6. Re:Genetic algorithm for realistic spam by cjm182 · · Score: 1

      I use a "mark" function (usually *67) to flag the last incoming call as harrassing. Then after a certain number of times you've been faxed, wardialed, etc by the same company, call the cops and tell them to get in touch with the phone-company, which at that point has to submit to the police the list of "flagged" phone numbers. I'd like to see the 1-800 # come up with an explanation/denial at that point...

      My worry is that with VoIP, how easy will it be to spam call without being traced?

    7. Re:Genetic algorithm for realistic spam by Marxist+Hacker+42 · · Score: 1

      Very easy- and the standard caller ID system (my phone company doesn't include *67- but others do) is pretty easy to spoof also, all you have to do is program a computer to count the rings and send a burst of static at RE6 voltage down the line at the proper second after the 2nd ring, at which point all the recieving phoneco's computers (and any other caller ID equipment) recieves is "O" for "Out of Area". I know this because I keep a database log of all phone calls recieved at my house.

      --
      SJW: a person who perceives an injustice, and while correcting it, commits a greater injustice.
    8. Re:Genetic algorithm for realistic spam by cjm182 · · Score: 1

      Interesting. I don't think I've ever gotten an "out of area" listing on my caller id. "unknown #" sometimes, but that usually means it's a private #, or being blocked by the caller. But in those cases the phone company is still recording the originating phone call's # (otherwise how would it be able to connect the call?)

      I wonder why the phone company has never fixed this? You'd think they'd get in trouble from police departments trying to trace harrasing calls...

    9. Re:Genetic algorithm for realistic spam by Marxist+Hacker+42 · · Score: 1

      Depending on your equipment, there are three possibilities for any given caller ID record data: O, P, and an up to 32 char string. The first is Out of Area, the second is Privacy Mode, the third of course is just the standard caller ID data. How your machine interprets it is up to the manufacturer- Unknown # could be either an O or a P. You can look at it raw with any caller-ID aware modem.

      O calls are by defintion coming from a different exchange than your local phone company- a different town, say, or sometimes a different country- and are just another anonymous call coming in on the trunk line, just one that doesn't happen to have any callerID info acompanying it.

      There IS a way to trace an O call- but it takes a MINIMUM of about 30 seconds, sometimes as long as an hour and a half, and the call has to be CURRENTLY connected when you do it.

      You can find a good discussion on the technical aspects in Clifford Stoll's "The Cookoo's Egg", which is something I encourage anybody researching computer security to read (it's rather outdated now- but there ARE still a few mechanical exchanges out there).

      Basically, the answer on why an O call can't be traced easily is because it's an anonymous call comming in on a long-distance trunk line- and thus doesn't HAVE a local phone number, nor need one, to be connected to your phone. While it is connected, a simple lookup on a computer can give you which line it's coming in on- which will lead you to the original switching station, requiring a call to there to do the same database lookup. If they really want to get messy, there can be as many as 256 switching stations in this line, and if they REALLY don't want to be found, the originating call will be from a town like Chiloquin OR, which still has a mechanical switch. For tracing a call through a mechanical switch, you need to get a technician with a multimeter to open up the switch- and read the states of the relays one digit, in binary, at a time.

      In other words- it's not a legal issue, it's a technical issue. And your average 14.4kbaud fax call doesn't last long enough to do it.

      --
      SJW: a person who perceives an injustice, and while correcting it, commits a greater injustice.
    10. Re:Genetic algorithm for realistic spam by cjm182 · · Score: 1

      Wow, I didn't realise the phone companies were so far behind when it came to preventing fax spam. Maybe the phone companies need to start collaborating on a sort of IPv6 equivalent...
      *choke*snort*spewcoffee* sorry, I can't believe I actually suggested that phonecos would collaborate to improve security...

      Anyway, you'd think the phonecos (the major ones at least) would want to be able to track the phone calls coming in, otherwise who would they bill for those long distance calls? I can't believe the phoneco's wouldn't care who was using their phone-lines.

      As for the trace having to come *during* a phone call, don't the phoneco's (the ones that don't use mechanical switches anyway) keep logs of calls passing through? Seeing as you can't just hack the phone switch to spoof your phone #, as some email spam does, *somebody* must have records...

    11. Re:Genetic algorithm for realistic spam by Marxist+Hacker+42 · · Score: 1

      Anyway, you'd think the phonecos (the major ones at least) would want to be able to track the phone calls coming in, otherwise who would they bill for those long distance calls? I can't believe the phoneco's wouldn't care who was using their phone-lines.

      They simply charge the next phone company up the line- who charges the phone company up the line from them. It's basically a huge game of "not my problem", until you get to the final one- and even then the system that records long distance billing information is likely *NOT* the same company as the local phone comany. This is what we get from the breakup of AT&T back in the early Reagan administration.

      As for the trace having to come *during* a phone call, don't the phoneco's (the ones that don't use mechanical switches anyway) keep logs of calls passing through? Seeing as you can't just hack the phone switch to spoof your phone #, as some email spam does, *somebody* must have records...

      The logs are pretty much on an old punch tape, and but only list that a long distance call was made, for this many minutes, not what circuit it was on. Of course, with more modern computerized switches you CAN always hack the switch to spoof your phone number temporarily. It's amazing how many telespam companies have caller ID information that goes to a currently disconnected number. Of course that way you can call out, but nobody can call *in*.

      The one I really like is the phone systems where a less-than-fully-trained receptionist answers the phone and you ask them to transfer your call to extension 9+ the area code you really want to call. Then you can fax spam somebody by merely dialing the last 7 digits of the phone number and you'll avoid both the long distance charges AND any ability of anybody to trace the call AT THE SAME TIME (yes, people really fall for that one).

      --
      SJW: a person who perceives an injustice, and while correcting it, commits a greater injustice.
    12. Re:Genetic algorithm for realistic spam by cjm182 · · Score: 1

      I wonder how hard it would be to build a better phone, one that could "ring" silently, until it got the caller id, and then if the id says "O" or if it's not on your whitelist or if it's on your blacklist (however you choose to set it up), it would just keep ringing silently until the machine at the other end gave up.

      Same way I deal with spam. My whitelist is now at the point where if it does go into my "junkmail" box, I likely didn't ask for it to be sent to me.

    13. Re:Genetic algorithm for realistic spam by Marxist+Hacker+42 · · Score: 1

      I wonder how hard it would be to build a better phone, one that could "ring" silently, until it got the caller id, and then if the id says "O" or if it's not on your whitelist or if it's on your blacklist (however you choose to set it up), it would just keep ringing silently until the machine at the other end gave up.

      These days- not to hard. You can do it with software and a voice modem. My only problem is getting it to *intercept* the call before it gets to other phones in the house or the fax machine. I do have it to the point where it pops up a cartoon character on a computer screen in the living room and tells me who is calling or if I should screen the call using the answering and fax machines ( using Microsoft Agent Voice Synthesis, since that's a Windows 98 box).

      Same way I deal with spam. My whitelist is now at the point where if it does go into my "junkmail" box, I likely didn't ask for it to be sent to me.

      Yep- basically the same idea.

      --
      SJW: a person who perceives an injustice, and while correcting it, commits a greater injustice.
    14. Re:Genetic algorithm for realistic spam by cjm182 · · Score: 1

      My only problem is getting it to *intercept* the call before it gets to other phones in the house or the fax machine.

      I wonder how hard it would be to set up a digital "phone switching" service, just like you get most businesses. Something you could set up where the phone line enteres the house, and then any authorized calls it would pass on to the rest of the house.

    15. Re:Genetic algorithm for realistic spam by Marxist+Hacker+42 · · Score: 1

      Less hard than *expensive*- your cheapest PBX system runs to about $300 and it's not the type of thing you're going to put together out of spare parts. Plus there's the danger of that whole "dial 9 to get out thing"- training kids not to try to transfer calls to extensions begining with 9 (because they don't exist), teaching the whole family that the real number for emergency is 9911, etc.

      --
      SJW: a person who perceives an injustice, and while correcting it, commits a greater injustice.
    16. Re:Genetic algorithm for realistic spam by cjm182 · · Score: 1

      Too bad it's so expensive. Although I imagine I'd just disable the whole "dial 9 to get out" (my work system doesn't require it), as well as disable call transferring. It would be nice if they came out with a linux app that could do it with 2 modems. I wonder how hard it would be...

      I've heard of devices that send a certain voltage back down the phone line when the phone rings that somehow confuses modems into thinking they've been disconnected, ever heard of it?

    17. Re:Genetic algorithm for realistic spam by Marxist+Hacker+42 · · Score: 1

      2 such items- one you can build yourself from any spark-gap cigarate lighter (such as the script electro), and the other is based on the standard tones for a disconnected phone line.

      --
      SJW: a person who perceives an injustice, and while correcting it, commits a greater injustice.
  24. What can be done? Well.. by Hal9000_sn3 · · Score: 1
    If the question is:
    what can be done to avoid giving ISPs and anti-spam companies extensive, fully automated censorship abilities?

    Well.. I would have to say one of the services TFA complains about is actually an example of an acceptable way for an ISP to have balance. Postini does not 'delete' any spam, it only quarantines it. And not only that, but when you release a quarantined message, it asks if you wish to make the sender 'approved'. Not only that, but it correctly handles mailings lists because it will use the 'To:' address, rather than the from address to stop filtering approved messages when appropriate. In fact, you can put any approved addresses into Postini in advance of it ever seeing email from those addresses.

    Standard disclaimer: I do not work for, or have any financial relationship with Postini.

    But, I did work for an ISP and was part of the decision making process when we decided to use Postini as a solution to the complaints we had from some customers about spam.

  25. 2nd reply- the real problem is spam is new by Marxist+Hacker+42 · · Score: 1

    And the phone system is over 100 years old. All the phone company cared about in the early days was one-way- they cared that you accessed the long distance line, they didn't record who the call was TO. Besides, when these mechanical switches were created- long distance operators were still *manual* switches. You'd call the operator and ask her to connect you and she'd write down the connection. No computer records at all- and at best tracing backwards you might find that five or six people on a given exchange were using the trunk line at the time.

    --
    SJW: a person who perceives an injustice, and while correcting it, commits a greater injustice.
    1. Re:2nd reply- the real problem is spam is new by cjm182 · · Score: 1

      And the phone system is over 100 years old.

      IPv6 doesn't have any plans for IP packet origin verification, does it? Just curious because I wonder if phone/fax spam will get worse once VoIP becomes popular.

    2. Re:2nd reply- the real problem is spam is new by Marxist+Hacker+42 · · Score: 1

      IP packet orgin is different- if it's TCP protocol anyway instead of UDP. TCP/IP *requires* handshaking, which means at worst you might get a syn flood or an ack flood, but unless all addresses are correct you won't get the syn/act in the correct order to produce a complete connection to let the VOIP call through. IPV4 implements this quite nicely. It doesn't stop all attacks- but it does stop any attack that has information in it. I haven't messed around with IPV6- but I imagine it's similar. Of course, the other problem is with NAT routers and DHCP, an IP address does not match a given computer anymore, just a given bank of maybe 256 computers- but it's closer.

      --
      SJW: a person who perceives an injustice, and while correcting it, commits a greater injustice.