Slashdot Mirror


Repurposing Anti-Spam Tools For Detecting Mutations In HIV

chicksdaddy writes "Security researchers often use language and metaphors from the natural world to describe problems in the virtual world. (Consider 'virus,' and 'worm.') Now it turns out that the links may be more than just rhetoric. Microsoft Researchers say that tools they developed to detect spammers' efforts to avoid anti-spam filters were also great at spotting mutations in the HIV virus. A report from Microsoft Research in honor of World AIDS Day yesterday described how Microsoft Researchers David Heckerman and Jonathan Carlson were called upon to help AIDS researchers analyze data about how the human immune system attacks the HIV virus. To do so, they turned to tools and algorithms developed at Microsoft to detect and block spam e-mail in the company's Hotmail, Outlook and Exchange e-mail products."

35 of 67 comments (clear)

  1. Never mind that! by 93+Escort+Wagon · · Score: 4, Funny

    The really big news here is - Slashdot has finally ditched the Gates "Borg" icon!

    --
    #DeleteChrome
    1. Re:Never mind that! by Anonymous Coward · · Score: 2, Insightful

      Really for a joke that was 'kinda' funny back in 1992.... It needed to go a long time ago...

    2. Re:Never mind that! by masternerdguy · · Score: 1

      They ditched it weeks ago dude.

      --
      To offset political mods, replace Flamebait with Insightful.
  2. Maybe the "natural world" by Spy+Handler · · Score: 4, Insightful

    is also a created simulation. If so, then of course viruses in both computers and nature will share common characteristics.

    BUDDHA: All is illusion
    NEO: There is no spoon

    1. Re:Maybe the "natural world" by cultiv8 · · Score: 3, Funny

      MICROSOFT: We have an API for that

      --
      sysadmins and parents of newborns get the same amount of sleep.
    2. Re:Maybe the "natural world" by fahrbot-bot · · Score: 4, Interesting
      --
      It must have been something you assimilated. . . .
    3. Re:Maybe the "natural world" by masternerdguy · · Score: 2

      I would believe a holographic doctor.

      --
      To offset political mods, replace Flamebait with Insightful.
    4. Re:Maybe the "natural world" by Ihmhi · · Score: 1

      Okay then. When are you open source cocksuckers gonna get a working version of Adblock for my goddamned brain? If I hear "4G Wonderland" one more time I'm going to start doing drive-bys on T-Mobile stores.

    5. Re:Maybe the "natural world" by symbolset · · Score: 2

      ... But it's undocumented.

      --
      Help stamp out iliturcy.
    6. Re:Maybe the "natural world" by mcrbids · · Score: 1

      Stephen Wolfram: is that you?

      --
      I have no problem with your religion until you decide it's reason to deprive others of the truth.
    7. Re:Maybe the "natural world" by shutdown+-p+now · · Score: 2

      It was undocumented 20 years ago.

      Nowadays it's documented but deprecated, and has been that was for the last 15 years. But everyone's still using it, anyway.

      That said, we're rolling out a new framework that'll have a brand new API to do the same exact thing. But don't worry, the old one is still supported. So are the three preceding new ones. ~

    8. Re:Maybe the "natural world" by shutdown+-p+now · · Score: 2

      When I say "we", I actually mean it. See the profile.

      And trust me on this: if any developer in Office (or other product division) tries to use an undocumented Windows API, they'll have someone from legal knocking on their door real soon. It's a very, very big no-no in the company. I know, because it's actually part of things like code reviews and such. Simply put, no-one wants to be the guy responsible for another multibillion dollar fine in EU or other places which actually take such things seriously. For the same reason, a lot of previously undocumented protocols are now documented here and/or here.

      So, no, you don't have to worry about MS apps unfairly competing with third-party ones by using some undocumented magical "make it better" APIs these days.

    9. Re:Maybe the "natural world" by shutdown+-p+now · · Score: 2

      You'd be surprised how getting sued and losing can turn things around. One of the reasons why I've grown to believe that regulation of businesses is beneficial is because I witnessed the effects of it first-hand, and they are much bigger than many people on /. imagine. It just takes time for the changes to have an effect outside, especially when you start with a monopoly as entrenched as that.

      You are, of course, free to disbelieve anything I tell you. But keep in mind that I post here as a fellow geek, not as an employee (I've had a /. account for years before going to work at MS); and, no, you don't get wired up to the Borg when you sign up.

    10. Re:Maybe the "natural world" by shutdown+-p+now · · Score: 1

      I haven't read that email before. Having seen it now, in what way did it "define my response"? It's rather vaguely worded, and the only thing I can gather from it is that they admit that MS has an image problem - but it's something any random guy in the industry knows. Can you be more specific in your reference?

    11. Re:Maybe the "natural world" by shutdown+-p+now · · Score: 2

      I'm sorry that the facts that I have to share are not to your liking. I don't have any other, on this subject - I can only state that which I've seen. If you feel that they threaten your deeply held beliefs, feel free to ignore them, and lets get back to meaningful discussions on less flamebaity topics.

    12. Re:Maybe the "natural world" by Anonymous Coward · · Score: 1

      Shouldn't you be at GNU/Church about now?

  3. Insightful by TaoPhoenix · · Score: 4, Insightful

    Come on gang, this is pretty cool.

    To re-adapt the tech that picks up Nigerian Scams and send it to pick up HIV strains is pretty neat. I sure as **** didn't see that app.

    --
    My first Journal Entry ever, in 8 years! http://slashdot.org/journal/365947/aphelion-scifi-fantasy-horror-poetry-webzine
    1. Re:Insightful by masternerdguy · · Score: 5, Funny

      Personally I find some of those nigerian spams awesome. I got one that claimed that the first Kenyan on the moon was trapped in orbit and they needed money to build a rescue vehicle.

      --
      To offset political mods, replace Flamebait with Insightful.
    2. Re:Insightful by JSG · · Score: 3, Interesting

      Yes, I've seen some classics too.

      For a while I actually deliberately allowed stuff from the "Lads from Nigeria" through and put in its own inbox for everyone at the firm to laugh over. I created a second specially trained SA Bayesian classifier in front of the main filter to siphon this stuff off.

      It was trained on a hand crafted corpus gleaned from a mailbox of stuff behind a sacrificial Exim daemon on its own connection that strangely runs really slow but not too slow to put off the spammers.

      SA can be made to work in very strange ways. Perhaps I ought to get out more ...

      Cheers
      Jon

  4. But Microsoft doesn't detect spam?! by Anonymous Coward · · Score: 1

    Once my university decided to switch to MS as their email provider, the span in my inbox has gone up. They don't even have to use the trick of changing spellings, I get lots of junk about penis enlargement, hot Russian girls, and Viagra every day. What I do NOT get are emails from the registrar, the university police, and the Dean. Those all go to the junk folder. I suggest they take whatever data they get from these MS researchers and do the opposite.

    1. Re:But Microsoft doesn't detect spam?! by armanox · · Score: 2

      I'd say your university didn't setup Exchange correctly then.

      --
      I'm starting to think GNU is the problem with "GNU/Linux" these days.
    2. Re:But Microsoft doesn't detect spam?! by JSG · · Score: 2

      Have you ever tried it (I can't speak for 2010)? The Intelligent Message Filter is dreadful.

      You pretty much only get two knobs to turn: 0-10 for either block or quarantine. On the switches front you get to use someone else's service ie DNSBLs or you can (naively) fill in blocked address lists.

      That's why have been doing a roaring trade (10 odd years) in tiny Gentoo (VMs nowadays) machines with Exim 'n' Spam Assassin + Clam AV doing the stuff that Exchange just can't.

      So yes his Uni probably did cock up the config of Exch but if they turn the knobs up too far he wont see any mail out side of his Junk folder. Catch 22 matey

      Cheers
      Jon

  5. I Read the Full Article by Anonymous Coward · · Score: 2, Insightful

    It would have been nice if some sort of example of how these things (spam and virual mutations) are alike was actually presented. The full article is no more useful than the abstract posted here.

  6. Holy mixed metaphors Batman! by ceoyoyo · · Score: 2

    Spam filters, viruses. Yeah, I can see the connection there. Now, if they were doing quality control on canned meat products....

    Assuming Microsoft uses some form of naive Bayesian classifier to do spam filtering like everyone else does, their spam filtering technology was in use by a lot of other people for a lot of other things before it came to be a spam filter anyway.

    1. Re:Holy mixed metaphors Batman! by Tyrannosaur · · Score: 1

      yes! The Bayesian filter (if I recall popularized by paul graham) is amazing for spam. And did not originate there... Bayesian tools have been here a long long time

  7. Making a spam filter play chess. by Colin+Smith · · Score: 3, Informative
    --
    Deleted
  8. Sounds great by Anonymous Coward · · Score: 1

    But they should call google about the spam detecting algorithm...

    If hotmail's spam filter is what they have to show for, thanks but I'll keep using condoms.

  9. Re:waste of money by Runaway1956 · · Score: 1

    What's sad is, people still think like that. It's a shame that few people know where AIDS came from. Short version, it's a result of overpopulation. AIDS has always existed, but when population density was lower, it wasn't transmitted between humans. Go ahead, look it up. See where AIDS actually came from. It most definitely was not divine intervention, in retribution for homosexuality. If that were so, it would have killed off all the queers, and left everyone else alone, right?

    --
    "Windows is like the faint smell of piss in a subway: it's there, and there's nothing you can do about it." - Charlie Br
  10. The ever escalating war... by Commontwist · · Score: 1

    So the war on spam and computer viruses has become as or more complex than figuring out how HIV mutates? How soon before it reaches cancer-level? lol

  11. Look the other way by ripdajacker · · Score: 2

    Maybe they should look at viruses and the immune system when designing spam filters.

  12. Re:waste of money by lightknight · · Score: 1

    Why not both?

    If the programmer is lazy enough, he'll write one tool that does both.

    --
    I am John Hurt.
  13. Re:HIV is not the cause of 'AIDS'... by Tyrannosaur · · Score: 1

    thanks for linking to the article. now i will read it and consider the points your angry anonymous comment instead of just blowing it off as a stupid angry internet comment.

  14. Re:Noooo! Hotmail filtering sucks bad!!!! by randyleepublic · · Score: 1

    Google's anti-spam is pretty good but is, of course, not perfect. Then where it really bites the big one is when you (the user) tries to manually tune it. The ui is beyond retarded. Also it's pretty bad about false positives. Attention Google analysts: If I send someone an email, I probably don't think they are a spammer! Duh...

    --
    Social Credit would solve everything...
  15. Re:HIV is not the cause of 'AIDS'... by randyleepublic · · Score: 1

    The linked paper does a wonderful job of exposing the greasy circle jerk that passes for oversight and regulation of big pharma, but it debunks two drugs, AZT and Nevirapine, out of how many? How does that prove that AIDS is not caused by HIV?

    --
    Social Credit would solve everything...
  16. Re:HIV is not the cause of 'AIDS'... by squidflakes · · Score: 1

    Wow, your angry rant is fascinating and displays a complete lack of understanding of what you're talking about.

    HIV = Human Immunodeficiency Virus, like rotavirus or rhinovirus or cytoplasmic polyhedrosis virus, is the name we give to the retrovirus entity with a very narrow and specific set of viral proteins, very specific physical characteristics, and the unique reverse transcriptase enzyme method used by viral entities in the same family to unbind host cell DNA and copy in their own RNA strand.

    AIDS = Acquired immune deficiency syndrome, like the common cold or diarrhea, it is a set of symptoms and physiological changes to the body, characterized by the drop in CD4+ T cells below the threshold that confers cellular immunity to pathogens. (I can't remember the exact number this takes, look it up.)

    So, could AIDS be caused by something else in the body that targets the CD4+T cells in the immune system? Yes, that is possible. However, no research to date has shown any vector that attacks our immune system so specifically.

    However, decades of research has shown that a majority of persons infected with HIV, the human immunodeficiency virus that attacks a specific set of helper T-cells in the body's immune system, will develop... are you read for this... ACQUIRED IMMUNE DEFICIENCY SYNDROME or AIDS, a set of symptoms and changes to the body characterized by the drop in CD4+T cells below a certain threshold.

    So, is that simple enough for you? Do I need to get out the crayons and a special sheet of science paper and draw you pretty pictures of googly-eyed virus phospholipids shooting little DNA guns at similarly googly-eyed CD4+T cells?

    Though, that probably won't help. One of the worst things that the internet has brought the world of science has been the ease with which crackpot conspiracy theories can be distributed to a gullible public that is either too stupid, lazy, or unconcerned to look it up for themselves. Rather than believe the people who spend their entire lives dealing with deadly pathogens for little money and even less recognition, the people who have sunk small fortunes in to an education system full of ideologues who often do require you to parrot their preferred theories in order to get a degree thereby depriving you of some of the best opportunities for research, the people who already have to deal with a whole raft of ignorant fucksticks with MBAs who spout such winners as "I'm not sure we have the budget for basic research after spending so much on administrator bonuses" and "Can't you pick a more profitable topic for study"; they believe the mouth-foaming twonk who spouts utter bullshit, anonymously, on the fucking internet.

    Demonize you? Gladly. You deserve it. My hope for you sir is that you develop a disease that your tin-foil hat wearing friends convince you is from chem trails, or fluoridated water, or government mind control lasers on the moon and you spend your entire estate on quack doctors who prescribe drinking your own urine and sell you ten thousand dollar machines chock full of magnets and blinky lights, and make sit under a pyramid shaped tent while a large Turkish man gives you an enema with a ten horse-power pressure washer. After all of this, you die in a fashion most agonizing and painful, while fully aware that a seventy-nine cent dose of antibiotics from some "evil big pharma" company with their "science" and their "research" that you distrust so much would have knocked that thing out in a couple of days.