Slashdot Mirror


Repurposing Anti-Spam Tools For Detecting Mutations In HIV

chicksdaddy writes "Security researchers often use language and metaphors from the natural world to describe problems in the virtual world. (Consider 'virus,' and 'worm.') Now it turns out that the links may be more than just rhetoric. Microsoft Researchers say that tools they developed to detect spammers' efforts to avoid anti-spam filters were also great at spotting mutations in the HIV virus. A report from Microsoft Research in honor of World AIDS Day yesterday described how Microsoft Researchers David Heckerman and Jonathan Carlson were called upon to help AIDS researchers analyze data about how the human immune system attacks the HIV virus. To do so, they turned to tools and algorithms developed at Microsoft to detect and block spam e-mail in the company's Hotmail, Outlook and Exchange e-mail products."

67 comments

  1. Never mind that! by 93+Escort+Wagon · · Score: 4, Funny

    The really big news here is - Slashdot has finally ditched the Gates "Borg" icon!

    --
    #DeleteChrome
    1. Re:Never mind that! by Anonymous Coward · · Score: 0

      Grr, I liked that thing.

    2. Re:Never mind that! by Anonymous Coward · · Score: 2, Insightful

      Really for a joke that was 'kinda' funny back in 1992.... It needed to go a long time ago...

    3. Re:Never mind that! by masternerdguy · · Score: 1

      They ditched it weeks ago dude.

      --
      To offset political mods, replace Flamebait with Insightful.
    4. Re:Never mind that! by Anonymous Coward · · Score: 0

      Maybe it's for the best. Just imagine how smug Bill must look about now...

    5. Re:Never mind that! by Anonymous Coward · · Score: 0

      Cyborg Gates has been replaced by Zombie Jobs.

  2. Maybe the "natural world" by Spy+Handler · · Score: 4, Insightful

    is also a created simulation. If so, then of course viruses in both computers and nature will share common characteristics.

    BUDDHA: All is illusion
    NEO: There is no spoon

    1. Re:Maybe the "natural world" by Anonymous Coward · · Score: 0

      Apparently - single copy of virus per single machine model of current computer viruses do not create mutation rates good enough to construct self-modifying computer viruses. Maybe we need the rise of parallel processor with core count in thousands in every consumer PC, each running as well self modifying copy of a simple core operating system together implementing the services we commonly expect from an OS.

      It would be "freaking awesome", as the contemporary youth puts it.

    2. Re:Maybe the "natural world" by Anonymous Coward · · Score: 0

      You need to put My Big TOE down and go outside and get some fresh simulated air.

    3. Re:Maybe the "natural world" by cultiv8 · · Score: 3, Funny

      MICROSOFT: We have an API for that

      --
      sysadmins and parents of newborns get the same amount of sleep.
    4. Re:Maybe the "natural world" by fahrbot-bot · · Score: 4, Interesting
      --
      It must have been something you assimilated. . . .
    5. Re:Maybe the "natural world" by masternerdguy · · Score: 2

      I would believe a holographic doctor.

      --
      To offset political mods, replace Flamebait with Insightful.
    6. Re:Maybe the "natural world" by Ihmhi · · Score: 1

      Okay then. When are you open source cocksuckers gonna get a working version of Adblock for my goddamned brain? If I hear "4G Wonderland" one more time I'm going to start doing drive-bys on T-Mobile stores.

    7. Re:Maybe the "natural world" by symbolset · · Score: 2

      ... But it's undocumented.

      --
      Help stamp out iliturcy.
    8. Re:Maybe the "natural world" by mcrbids · · Score: 1

      Stephen Wolfram: is that you?

      --
      I have no problem with your religion until you decide it's reason to deprive others of the truth.
    9. Re:Maybe the "natural world" by shutdown+-p+now · · Score: 2

      It was undocumented 20 years ago.

      Nowadays it's documented but deprecated, and has been that was for the last 15 years. But everyone's still using it, anyway.

      That said, we're rolling out a new framework that'll have a brand new API to do the same exact thing. But don't worry, the old one is still supported. So are the three preceding new ones. ~

    10. Re:Maybe the "natural world" by shutdown+-p+now · · Score: 2

      When I say "we", I actually mean it. See the profile.

      And trust me on this: if any developer in Office (or other product division) tries to use an undocumented Windows API, they'll have someone from legal knocking on their door real soon. It's a very, very big no-no in the company. I know, because it's actually part of things like code reviews and such. Simply put, no-one wants to be the guy responsible for another multibillion dollar fine in EU or other places which actually take such things seriously. For the same reason, a lot of previously undocumented protocols are now documented here and/or here.

      So, no, you don't have to worry about MS apps unfairly competing with third-party ones by using some undocumented magical "make it better" APIs these days.

    11. Re:Maybe the "natural world" by shutdown+-p+now · · Score: 2

      You'd be surprised how getting sued and losing can turn things around. One of the reasons why I've grown to believe that regulation of businesses is beneficial is because I witnessed the effects of it first-hand, and they are much bigger than many people on /. imagine. It just takes time for the changes to have an effect outside, especially when you start with a monopoly as entrenched as that.

      You are, of course, free to disbelieve anything I tell you. But keep in mind that I post here as a fellow geek, not as an employee (I've had a /. account for years before going to work at MS); and, no, you don't get wired up to the Borg when you sign up.

    12. Re:Maybe the "natural world" by shutdown+-p+now · · Score: 1

      I haven't read that email before. Having seen it now, in what way did it "define my response"? It's rather vaguely worded, and the only thing I can gather from it is that they admit that MS has an image problem - but it's something any random guy in the industry knows. Can you be more specific in your reference?

    13. Re:Maybe the "natural world" by shutdown+-p+now · · Score: 2

      I'm sorry that the facts that I have to share are not to your liking. I don't have any other, on this subject - I can only state that which I've seen. If you feel that they threaten your deeply held beliefs, feel free to ignore them, and lets get back to meaningful discussions on less flamebaity topics.

    14. Re:Maybe the "natural world" by symbolset · · Score: 0

      As a parting gift: It's probably OK to try to dick with other people to push your memes. Don't mess around with symbolset and this would probably have gone better for you. I figured you'd have known that by now though. You've seen this go down a hundred times at least and the end was always the same. I don't have any sockpuppets - this is really me. You don't have to reply to comments.

      BTW: Flohawks has openings. I'd look into that before I went your way. It's honest work.

      --
      Help stamp out iliturcy.
    15. Re:Maybe the "natural world" by Anonymous Coward · · Score: 1

      Shouldn't you be at GNU/Church about now?

  3. News at 11: Bayes classifiers classify stuff. by Anonymous Coward · · Score: 0

    Honestly...

  4. Insightful by TaoPhoenix · · Score: 4, Insightful

    Come on gang, this is pretty cool.

    To re-adapt the tech that picks up Nigerian Scams and send it to pick up HIV strains is pretty neat. I sure as **** didn't see that app.

    --
    My first Journal Entry ever, in 8 years! http://slashdot.org/journal/365947/aphelion-scifi-fantasy-horror-poetry-webzine
    1. Re:Insightful by masternerdguy · · Score: 5, Funny

      Personally I find some of those nigerian spams awesome. I got one that claimed that the first Kenyan on the moon was trapped in orbit and they needed money to build a rescue vehicle.

      --
      To offset political mods, replace Flamebait with Insightful.
    2. Re:Insightful by JSG · · Score: 3, Interesting

      Yes, I've seen some classics too.

      For a while I actually deliberately allowed stuff from the "Lads from Nigeria" through and put in its own inbox for everyone at the firm to laugh over. I created a second specially trained SA Bayesian classifier in front of the main filter to siphon this stuff off.

      It was trained on a hand crafted corpus gleaned from a mailbox of stuff behind a sacrificial Exim daemon on its own connection that strangely runs really slow but not too slow to put off the spammers.

      SA can be made to work in very strange ways. Perhaps I ought to get out more ...

      Cheers
      Jon

    3. Re:Insightful by Anonymous Coward · · Score: 0

      "Cool" with a tinge of "irony"...

      How many rednecks would have predicted Africans could save Africans? Beyond the non-PC jokes, beyond the soft-bigotry of condescending foreign AID(S) packages, and beyond the half-hearted efforts of Big Pharma, it's the Internet that is saving the word.

      One otherwise-unencountered paradigm of information-ology at a time.

  5. Lawsuit by Anonymous Coward · · Score: 0

    Thank god microsoft have not taken the Apple approach.
    Lawsuit in 3-2-1....

  6. But Microsoft doesn't detect spam?! by Anonymous Coward · · Score: 1

    Once my university decided to switch to MS as their email provider, the span in my inbox has gone up. They don't even have to use the trick of changing spellings, I get lots of junk about penis enlargement, hot Russian girls, and Viagra every day. What I do NOT get are emails from the registrar, the university police, and the Dean. Those all go to the junk folder. I suggest they take whatever data they get from these MS researchers and do the opposite.

    1. Re:But Microsoft doesn't detect spam?! by armanox · · Score: 2

      I'd say your university didn't setup Exchange correctly then.

      --
      I'm starting to think GNU is the problem with "GNU/Linux" these days.
    2. Re:But Microsoft doesn't detect spam?! by JSG · · Score: 2

      Have you ever tried it (I can't speak for 2010)? The Intelligent Message Filter is dreadful.

      You pretty much only get two knobs to turn: 0-10 for either block or quarantine. On the switches front you get to use someone else's service ie DNSBLs or you can (naively) fill in blocked address lists.

      That's why have been doing a roaring trade (10 odd years) in tiny Gentoo (VMs nowadays) machines with Exim 'n' Spam Assassin + Clam AV doing the stuff that Exchange just can't.

      So yes his Uni probably did cock up the config of Exch but if they turn the knobs up too far he wont see any mail out side of his Junk folder. Catch 22 matey

      Cheers
      Jon

  7. Wait, what? by Anonymous Coward · · Score: 0

    They are using Microsoft's algorithms for this? Their horrible spam filters were the reason I abandoned Hotmail nearly a decade ago.

  8. I Read the Full Article by Anonymous Coward · · Score: 2, Insightful

    It would have been nice if some sort of example of how these things (spam and virual mutations) are alike was actually presented. The full article is no more useful than the abstract posted here.

  9. Holy mixed metaphors Batman! by ceoyoyo · · Score: 2

    Spam filters, viruses. Yeah, I can see the connection there. Now, if they were doing quality control on canned meat products....

    Assuming Microsoft uses some form of naive Bayesian classifier to do spam filtering like everyone else does, their spam filtering technology was in use by a lot of other people for a lot of other things before it came to be a spam filter anyway.

    1. Re:Holy mixed metaphors Batman! by Tyrannosaur · · Score: 1

      yes! The Bayesian filter (if I recall popularized by paul graham) is amazing for spam. And did not originate there... Bayesian tools have been here a long long time

    2. Re:Holy mixed metaphors Batman! by Anonymous Coward · · Score: 0

      Microsoft (think the FOPE product) catches the overwhelming majority of spam (98%) using IP address blocking. Most of the remaining spam is caught using long lists of regular expressions managed by humans. There is only a little bit of Bayesian, etc after those two techniques because Microsoft's product cannot scale to handle the algorithmic load (or so the sales person told me). I would not expect researchers to be crafting regular expressions or mapping blocklists to protein sequences. Maybe they are, but the article makes it sound like something else.

    3. Re:Holy mixed metaphors Batman! by Anonymous Coward · · Score: 0

      If they're so damn great, why do I so much damn spam?

  10. Making a spam filter play chess. by Colin+Smith · · Score: 3, Informative
    --
    Deleted
  11. ok how many.. by s0litaire · · Score: 0

    ... of you guys have made a lame "Blue screen of death" joke?

    --
    Laters Sol "Have you found the secrets of the universe? Asked Zebade "I'm sure I left them here somewhere"
    1. Re:ok how many.. by Anonymous Coward · · Score: 0, Funny

      Hey buddy look how great this OS is. Remember that deadline your asshole boss gave you? Remember that report you were typing frantically in OpenOffice? Remember that half written email in Thunderbird? Well guess what ?! As usual.. the buggy piece of crap called X.org just died on your ass but THANK FUCKING GOD you now have the chance to type some crap you know nothing about into a text mode interface. (Lucky you !) so that.. um.. you get your report back? uh.. no that's gone... you get to recover your email? uh... sorry that vanished when X died too. Wait.. hmm.. hey look on the bright side.. you have spinning cubes inside your window manager. That counts for something right? right? :D

  12. Sounds great by Anonymous Coward · · Score: 1

    But they should call google about the spam detecting algorithm...

    If hotmail's spam filter is what they have to show for, thanks but I'll keep using condoms.

  13. I'd rather die of AIDS... by Anonymous Coward · · Score: 0, Troll

    I'd rather die of AIDS then use some treatment developed using Microsoft's closed source algorithms.

    1. Re:I'd rather die of AIDS... by Anonymous Coward · · Score: 0

      You don't need to worry about either, Richard.

  14. Re:waste of money by masternerdguy · · Score: 0

    You're probably just trolling, but it isn't just a 'fag disease'.

    --
    To offset political mods, replace Flamebait with Insightful.
  15. Re:waste of money by Runaway1956 · · Score: 1

    What's sad is, people still think like that. It's a shame that few people know where AIDS came from. Short version, it's a result of overpopulation. AIDS has always existed, but when population density was lower, it wasn't transmitted between humans. Go ahead, look it up. See where AIDS actually came from. It most definitely was not divine intervention, in retribution for homosexuality. If that were so, it would have killed off all the queers, and left everyone else alone, right?

    --
    "Windows is like the faint smell of piss in a subway: it's there, and there's nothing you can do about it." - Charlie Br
  16. The ever escalating war... by Commontwist · · Score: 1

    So the war on spam and computer viruses has become as or more complex than figuring out how HIV mutates? How soon before it reaches cancer-level? lol

  17. Look the other way by ripdajacker · · Score: 2

    Maybe they should look at viruses and the immune system when designing spam filters.

  18. Noooo! Hotmail filtering sucks bad!!!! by Anonymous Coward · · Score: 0

    They picked the wrong service! Hotmail allows soooo much spam through it's hard to believe they're filtering at all.

    They should have gone with Google's anti-spam algorithms instead. I never get spam in my inbox, ever. But, my Hotmail inbox is full of it.

    1. Re:Noooo! Hotmail filtering sucks bad!!!! by Anonymous Coward · · Score: 0

      Pro tip: it's not spam when you sign yourself up for mail from your favorite chicks with dicks website.

    2. Re:Noooo! Hotmail filtering sucks bad!!!! by randyleepublic · · Score: 1

      Google's anti-spam is pretty good but is, of course, not perfect. Then where it really bites the big one is when you (the user) tries to manually tune it. The ui is beyond retarded. Also it's pretty bad about false positives. Attention Google analysts: If I send someone an email, I probably don't think they are a spammer! Duh...

      --
      Social Credit would solve everything...
  19. Re:waste of money by lightknight · · Score: 1

    Why not both?

    If the programmer is lazy enough, he'll write one tool that does both.

    --
    I am John Hurt.
  20. HIV is not the cause of 'AIDS'... by Anonymous Coward · · Score: 0

    ... and none of the idiot Slashdotters even know what 'AIDS' means. How embarrassing. You parrot whatever the T.V. tells you, making out that you are so 'caring' and 'kind', for refusing to THINK about alternative hypotheses - you know, ones that actually accurately predict the spread (or lack thereof) of 'AIDS'...

    Where to begin? How can one even hope to reach such arrogant idiots, who can't even begin to question what they've been told by the controlled media, in spite of the fact that all the evidence proves it's wrong?

    Here's a clue: the number of people with STDs has been rising year upon year for DECADES, yet we don't see a massive increase in so-called 'AIDS' deaths among any groups in the Western world. What happened to the 'deadly' virus, that was killing gay men in the tens of thousands every year, in the U.S. alone?

    Before you (stupidly) say 'it's the drugs that are keeping them alive', try reading the article 'The Trouble with Nevirapine'. (I won't hold my breath waiting for any of you to actually READ it, that would be too much like hard work. Just get on with vilifying me, and defending the 'Party meme' which you have been brainwashed with. How pathetic. And you actually think you're intelligent.)

    1. Re:HIV is not the cause of 'AIDS'... by Tyrannosaur · · Score: 1

      thanks for linking to the article. now i will read it and consider the points your angry anonymous comment instead of just blowing it off as a stupid angry internet comment.

    2. Re:HIV is not the cause of 'AIDS'... by randyleepublic · · Score: 1

      The linked paper does a wonderful job of exposing the greasy circle jerk that passes for oversight and regulation of big pharma, but it debunks two drugs, AZT and Nevirapine, out of how many? How does that prove that AIDS is not caused by HIV?

      --
      Social Credit would solve everything...
    3. Re:HIV is not the cause of 'AIDS'... by squidflakes · · Score: 1

      Wow, your angry rant is fascinating and displays a complete lack of understanding of what you're talking about.

      HIV = Human Immunodeficiency Virus, like rotavirus or rhinovirus or cytoplasmic polyhedrosis virus, is the name we give to the retrovirus entity with a very narrow and specific set of viral proteins, very specific physical characteristics, and the unique reverse transcriptase enzyme method used by viral entities in the same family to unbind host cell DNA and copy in their own RNA strand.

      AIDS = Acquired immune deficiency syndrome, like the common cold or diarrhea, it is a set of symptoms and physiological changes to the body, characterized by the drop in CD4+ T cells below the threshold that confers cellular immunity to pathogens. (I can't remember the exact number this takes, look it up.)

      So, could AIDS be caused by something else in the body that targets the CD4+T cells in the immune system? Yes, that is possible. However, no research to date has shown any vector that attacks our immune system so specifically.

      However, decades of research has shown that a majority of persons infected with HIV, the human immunodeficiency virus that attacks a specific set of helper T-cells in the body's immune system, will develop... are you read for this... ACQUIRED IMMUNE DEFICIENCY SYNDROME or AIDS, a set of symptoms and changes to the body characterized by the drop in CD4+T cells below a certain threshold.

      So, is that simple enough for you? Do I need to get out the crayons and a special sheet of science paper and draw you pretty pictures of googly-eyed virus phospholipids shooting little DNA guns at similarly googly-eyed CD4+T cells?

      Though, that probably won't help. One of the worst things that the internet has brought the world of science has been the ease with which crackpot conspiracy theories can be distributed to a gullible public that is either too stupid, lazy, or unconcerned to look it up for themselves. Rather than believe the people who spend their entire lives dealing with deadly pathogens for little money and even less recognition, the people who have sunk small fortunes in to an education system full of ideologues who often do require you to parrot their preferred theories in order to get a degree thereby depriving you of some of the best opportunities for research, the people who already have to deal with a whole raft of ignorant fucksticks with MBAs who spout such winners as "I'm not sure we have the budget for basic research after spending so much on administrator bonuses" and "Can't you pick a more profitable topic for study"; they believe the mouth-foaming twonk who spouts utter bullshit, anonymously, on the fucking internet.

      Demonize you? Gladly. You deserve it. My hope for you sir is that you develop a disease that your tin-foil hat wearing friends convince you is from chem trails, or fluoridated water, or government mind control lasers on the moon and you spend your entire estate on quack doctors who prescribe drinking your own urine and sell you ten thousand dollar machines chock full of magnets and blinky lights, and make sit under a pyramid shaped tent while a large Turkish man gives you an enema with a ten horse-power pressure washer. After all of this, you die in a fashion most agonizing and painful, while fully aware that a seventy-nine cent dose of antibiotics from some "evil big pharma" company with their "science" and their "research" that you distrust so much would have knocked that thing out in a couple of days.

  21. Newsflash: Abstractions are Useful by Anonymous Coward · · Score: 0

    "Hashing is being used in as diverse fields as oil drilling and pet retail stores". "Regexps show a deep link between creative accounting and scuba diving".

    C'mon, man. Pattern matching is pattern matching. Abstraction is the staple of our profession. Sheesh.