Slashdot Mirror


Microsoft's Vista AV Fails Certification

An anonymous reader writes "Microsoft's much-hyped anti-virus solution, Live OneCare and three other Vista AV products failed to achieve the Virus Bulletin's VB100 certification. The other products are McAfee's VirusScan Enterprise, G DATA's AntiVirusKit 2007, and Norman's VirusControl. All failed to pass a series of tests that are required to display the VB100 badge. 'With the number of delays that we've seen in Vista's release, there's no excuse for security vendors not to have got their products right by now,' said John Hawes, technical consultant at Virus Bulletin."

43 of 161 comments (clear)

  1. excuses... by solstice680 · · Score: 5, Interesting

    What about "We didn't have access to Vista's internals until two months ago?"

    That would be a good excuse for most security vendors...

    1. Re:excuses... by ThinkFr33ly · · Score: 5, Informative

      Actually, the details on implementing anti-virus for Vista, and other low level filters, have been available for well over a year. Some documentation has been avilable for more than 2 years.

      That's how companies like Kaspersky and AVG came out with fully Vista compliant versions of their software months ago. Software which works extremely well, by the way. (Kaspersky passed this test. It says so right in the article.)

  2. I wonder how a Free anti-virus program would do by mrchaotica · · Score: 3, Interesting

    Maybe the ClamAV people ought to submit their program for testing.

    --

    "[Regarding the 'cloud,'] ownership was what made America different than Russia." -- Woz

    1. Re:I wonder how a Free anti-virus program would do by aztracker1 · · Score: 3, Informative

      There is no resident/active file scanning with ClamAV, at least not from the clamav/clamwin developers afaik.

      --
      Michael J. Ryan - tracker1.info
    2. Re:I wonder how a Free anti-virus program would do by xiong.chiamiov · · Score: 2, Informative

      There is winpooch, which can be hooked up with clamwin to provide real-time av protection.

  3. A very good excuse... by bhirsch · · Score: 4, Interesting

    A VB100 badge means little or nothing to these companies, much less their consumers.

    1. Re:A very good excuse... by zCyl · · Score: 3, Funny

      A VB100 badge means little or nothing to these companies, much less their consumers.
      Most users would just assume that's the next version of Visual Basic.
    2. Re:A very good excuse... by BlackRookSix · · Score: 3, Informative

      Wrong. I was in an AV company for a while, and this is like the Oscars to them. Everything rides on their reputation, and this rating (along with The Pundits Choice Awards: Garner reports) can make or break a small company trying to break into corporate clients. Their sales people now face a HUGE uphill battle that they may never surmount, even if they make the VB100 next test phase.

    3. Re:A very good excuse... by Apathist · · Score: 2, Informative

      You're spot on with how important it is to their reputation, but the fact is that the VB100 award had become something of a rubber stamp, due to the way it was being tested (ie. all the AV vendors knew in advance exactly what they were being tested against).

      What is important about this particular round of VB100 tests is that this was the first round of tests after they changed the way the test was done (to make it more representative of what AV protection needs to actually be out in the wild, and hence more difficult to just coast through). This new testing methodology came unannounced, and caught everyone by surprise... which is why other major vendors missed it, including McAfee.

    4. Re:A very good excuse... by Aryeh+Goretsky · · Score: 2, Insightful

      Hello,

      I think it is a bit disingenuous to say that the reason some of the tested programs failed to receive a VB100 award had anything to do with changes to the test procedures used by Virus Bulletin Magazine. The tests consist of ItW (In The Wild), macro, polymorphic, file infector virus "zoos," with ItW and macro tests being repeated for both scheduled on-demand scanning and on-access (file I/O wedge) scanning, plus a set of clean files which are used to test for false positives. You can view information about the test sets here on Virus Bulletin's web site.

      The tests performed are basically those of detection (or lack of detection in the case of the false positive set—remember, a false positive report can be just as damaging to productivity in a corporate environment as an actual viral outbreak), along with some sometimes-snarky comments about the program being tested (usually related to usability issues). The VB100 award means that a product passed the ItW and false positive tests; it could still have faired poorly on the other tests and received the award.

      The idea that you can somehow "optimize" a product for these tests is a bit silly; ItW viruses are the ones which affect a vendor's customers and their technical support department receive calls about all the day. The idea that a vendor was somehow not concentrating their detection efforts on these is ludicrous; the ability to handle these types of threats is how they generate their revenue. As for avoiding a false-positive report against a clean set, well, I cannot think of a practical way to engineer a virus scanning engine's signature database for that.

      Computer Associates and Symantec received VB100 awards in this test and they are enterprise vendors, so claiming that the "major vendors missed it" this time around is incorrect. Conversely, vendors which specialize in anti-malware like Norman did not receive a VB100 award this time around. While there may be some correlation between the size of a vendor and their detection rate, I do not know if it is as linear a mapping as you imagine.

      Regards,

      Aryeh Goretsky

      --
      Dexter is a good dog.
  4. Nothing to do with Vista by ThinkFr33ly · · Score: 5, Interesting

    This has nothing to do with Vista, and everything to do with crappy anti-virus products. Neither OneCare or McAfee for XP have ever tested well, so why would anybody think that they would test well on Vista?

    If you read the entire article, you'll notice a little blurb at the end that several vendors passed the test, one of which was Kaspersky. Another excellent vendor for Vista is AVG.

    Kaspersky consistantly beats all the other major anti-virus vendors, but I guess the story wouldn't be quite as Slashdot-worthy if it ready "Kaspersky Anti-Virus on Vista Works Great!".

    1. Re:Nothing to do with Vista by Utopia · · Score: 2


      Neowin has more details on the report.
      Apprently only 0.01% of the viruses were not detected by these "failed" product.

    2. Re:Nothing to do with Vista by figleaf · · Score: 4, Informative

      Did you notice that report was created a company which sells its own anti-virus product?

    3. Re:Nothing to do with Vista by zx-15 · · Score: 5, Funny

      Kaskpersky is certainly a very effective antivirus, a lot of security comes from using 100% of CPU when browsing network folders, thus preventing the user from downloading viruses.

    4. Re:Nothing to do with Vista by Lehk228 · · Score: 2, Insightful

      which virus from the .01% would you like on the machine handling your credit card number and social security number?

      --
      Snowden and Manning are heroes.
  5. OH NO, NO VB100??!? by madsheep · · Score: 5, Funny

    I heard they also didn't earn the WTF200 or the LOL500. Based on failing to get the three of these certifcations and seeing how all three of them are as equally popular..this software will surely be going no where.

  6. Great Sales Pitch by Zonnald · · Score: 3, Informative
    Tried to follow the links to the report to see what the fuss was about. First I was told I had to register for Free. I did that then clicked on the report - only to be told I had to subscribe. Not going to happen.

    For obvious reasons I will leave it to the reader to decide if they want to go and have a look, no links will be provided.

  7. Exactly right by Freaky+Spook · · Score: 2, Insightful

    Most home users wouldn't even knew the VB100 badge exists.

    In that market, anti-virus sales are all about glossy packaging on shelves and fancy flash advertisments.

    If their AV fails and windows gets a virus, its Windows problem, not the AV problem.

    Microsoft are in a loose/loose market, but they stand to make money off joe-sixpack so they don't care.

  8. *What* VirusControl? by SeaFox · · Score: 4, Insightful

    The other products are McAfee's VirusScan Enterprise, G DATA's AntiVirusKit 2007, and Norman's VirusControl.
    Norman's VirusControl. Yeah, that doesn't look like an attempt to market a product that deliberately sounds like a competitor...

    Now, if you're excuse me, I need to get back to setting up my Linkskey router...
    1. Re:*What* VirusControl? by DeeZee · · Score: 5, Informative

      Norman was founded in 1984, well before Peter Norton made an antivirus utility.

      Thanks for playing, though!

  9. Re:Remind me.... by wordsnyc · · Score: 5, Funny

    They rang the fucking bell days ago. Salivate, dammit.

    --
    Sent from the iPad I found in your car.
  10. Re:Hate to say it by Creepy+Crawler · · Score: 3, Informative

    ---I hate to say it, but Microsoft were right for once in their earlier VISTA policy of locking down the practice of hooking into the kernel.

    Locking down along with no source code is simply security by obscurity. There WILL be bugs found, and those bugs will have kernel rights. Do you think that is good? Guess what, I dont.

    Vista will only reassure that bug releasers should not publish bugs, but rather sit on them. BTW, how do you clean out a kernel-infected Windows machine?

    ---It's that feature in XP that allows malware to flourish.

    Is there an executable preventer on Linux? Nosiree, there's nothing preventing a user from affecting his own dataspace. What do you think is bad: Trashing the whole system, or trashing your ~ ? A system can be reinstalled, but most people dont back up their data.

    Now, why dont Linux malwares work? They do, if the user lets them. It's just that much harder to make a program run from a browser window or from bad servers on various ports. Linux machines are usually more locked down to prevent evil stuff on the outside.

    --
  11. Re:microsoft by megaditto · · Score: 3, Insightful

    Well, how many people run AV on their linux/BSD boxes?

    Now, since Vista is securebydesign, it too no longer needs any anti-viruses!

    --
    Obama likes poor people so much, he wants to make more of them.
  12. No excuse, like no excuse... by djupedal · · Score: 4, Funny

    "With the number of delays that we've seen in Vista's release, there's no excuse for security vendors not to have got their products right by now..."

    Security vendors. They're all alike. They say they come to help...to save us from all things dark, but in their black hearts, they all want the same thing. They all want to RULE the earth!

  13. Better Solution by MikeDataLink · · Score: 2, Informative

    I think the better solution is to get noobs to be better educated on how to avoid spyware and viruses, etc in the first place.

    This website has a great video I think all noobs should be required to watch BEFORE owning a computer.
    http://www.my-pc-help.com/video/v10017.htm

    An ounce of prevention is always better than the cure.

    --
    Mike @ The Geek Pub. Let's Make Stuff!
  14. This is just one review... by Aryeh+Goretsky · · Score: 4, Informative

    Hello,

    I shared my thoughts on this over here on Neowin.Net's forums, so I really don't just want to do a cut-and-paste job and post what I wrote in verbatim here.

    This is one of the first of a series of comparisons to include Microsoft Windows Live OneCare that Virus Bulletin Magazine has been doing for many years. While I suspect it is more frustrating than embarrassing at this point for the team responsible for Microsoft's Windows Live OneCare, this is really Microsoft's first attempt at providing their own comprehensive anti-malware solution—MSAV, the product which shipped with DOS does not count, it was licensed from Central Point Software (who was later acquired by Symantec) who, in turn, had licensed the software from Carmel Software—and it is going to take some time and lots of signature release cycles in order to get their detection rate fine-tuned.

    I don't expect this first Virus Bulletin product comparison to be the last, and the question really isn't how Microsoft did this time: It is how their product does over the next year or two that matters. If it gets worse or stays the same, they are just another competitor in the space (albeit the one with the deepest products). If, however, their detection rate improves, it is going to make it just that much more difficult for their competitors to compete against them.

    As a disclaimer of sorts, I should mention that happen I work for one of the computer security companies that Microsoft competes against with this products, so this dicussion is far from academic for me. Frankly, though, I'm not expecting Microsoft's entry into this space to have any effect on my employer—we are good at what we do and have a very loyal customer base. Also, we tend to compete against other, similarly-sized companies in the field. What I do worry about, though, is how some of my friends and colleagues at the largest companies are going to handle Microsoft's entrance as they are going to be competing head-to-head against Microsoft for marketshare.


    Regards,

    Aryeh Goretsky

    --
    Dexter is a good dog.
  15. Strange... by Critical_ · · Score: 4, Informative

    Has anyone bothered to do some fact/typo checking before posting this stuff?

    Microsoft's offering was one of four suites which failed to detect all malware. The others were G-Data AntiVirusKit 2007 v.17.0.6353, McAfee VirusScan Enterprise 8.1i and Norman Virus Control 5.90.

    See, I run McAfee VirusScan Enterprise on Desktops and Servers here without problems. The latest version in the 8.0 line is 8.0i patch 15. The Vista-compatible version is 8.5i which also works on Windows XP. There is no version 8.1i that I know of. Obviously this doesn't change the message that McAfee didn't earn the seal but I've never had problems with the VirusScan Enterprise line. To be frank, I've never encountered a single infection or uncontrolled virus problem on our network.

    Plus, who honestly uses just *one* virus scanner on the perimeter of their Microsoft Server-system based network? I certainly don't. For example, Exchange 2003 server on the perimeter runs software from GFI which has three separate virus scanning engines. This coupled with application executable hash-based protection offered in BlackICE takes care of the rest of the problems at the desktop/server level. It's the price we pay for using MS software.

    1. Re:Strange... by sporkmonger · · Score: 2, Interesting

      I've had problems with it. Namely this problem. We ended up having almost every install of Office corrupted, as well as huge numbers of random system files as a result. My previous employer had to run System Restore on virtually every single computer on the network. The only computers that weren't down that day were the servers that were running Solaris and the Macs in the QA department. After that experience, I swore I'd never willingly install any of McAfee's products again.

  16. Actually, cure is now worth more by ChromeAeonium · · Score: 3, Funny

    Prevention may be better than cure, but did you know that, contrary to the popular adage, an ounce of prevention is actually worth much less than a pound of cure? Its simply the law of supply and demand. Most people lack the foresight to use prevention, so they run for cure when the shit hits the fan. This leaves large quantities of prevention just sitting in warehouses, collecting dust. They even buried a few tons of it next to those E.T. games for the 2600. Due to this oversupply, and the huge demand for cure, the cure-prevention exchange rate is one ounce of cure is now worth 5.78 pounds of prevention.

  17. Re:Sensationalism at its finest by sadsfth · · Score: 2, Insightful

    "Live One care failed the test because it only detected 99.91% of the malware rather than 100%. "

    If we extrapolate the data does this mean that of the known 100,000+ pieces of malware targeting windows we're only in danger of 9,000+ pieces.

    If so what a relief;-)

  18. Re:Umm.. by Anonymous Coward · · Score: 2, Informative

    Virus Bulletin is a major newsletter in the anti-virus/malware/spyware/etc industry. They publish disections of new "threats", various studies, and reviews of the latest products. It's not really a resource for the general population because subscriptions are expensive and many of the articles are quite technical (source code, executable disassembly, "kernel hacking", etc). It's more of a trade publication where people in the industry can keep track of the latest trends and what new technologies are coming around. You should care about what they think because they are one of the de facto authorities on these kinds of things. It is distributed in PDF form so it is probably floating around somewhere out there. If you can get a copy and read some of the technical articles you'll get a better idea of what they are all about.

  19. Terrible Tagging by Guanine · · Score: 3, Insightful

    This may be tough on my karma, but I have to get it out: goddammit what's with the worthless tagging? I know the feature's beta, but if I see "haha" or "yes" followed by "no" one more time ... (ok I have no recourse). But seriously guys this feature is supposed to, as far as I can tell, eventually provide a useful augmentation or even replacement for search. Please try not to screw it up.

  20. Re:microsoft by Duhavid · · Score: 4, Funny

    Who cares which lib they used? glib, libc, etc, etc.

    --
    emt 377 emt 4
  21. New tag by arpy · · Score: 2, Funny

    defectivebyaccident

  22. Re:bad logic by The+Ham+of+Truth · · Score: 2, Interesting

    You're calling him a little girl because he has bad logic? Then... ipso facto, you're proclaiming to us a love for unicorns and Barbie dolls?

    In an unrelated topic: I don't think the statement is baseless. IIRC, Gates responds to "OSX had it first" with "yeah, but we got delayed in order to secure the product first" (paraphrased, of course). Shouldn't we then expect a higher level of security then?

  23. Re:Sensationalism at its finest by ThinkFr33ly · · Score: 2, Funny

    Does slashdot not even *want* to have any credibility? You must be new here.
  24. Re:microsoft by value_added · · Score: 2, Informative

    Well, how many people run AV on their linux/BSD boxes?

    Huh?

    For starters, lots of people.

    How else to protect Windows systems?

  25. Re:Hate to say it by the_womble · · Score: 4, Insightful
    What do you think is bad: Trashing the whole system, or trashing your ~ ? A system can be reinstalled, but most people dont back up their data.

    If we talking about trashing the system instead of trashing ~, you would be right in the case of a single user system.

    However, we are talking about trashing everything, against trashing just ~. Obviously just ~ is better.

    In the case of a multi-user system, trashing one users ~ is much better than trashing everything. Most home PCs are multi users. Office PCs are invariably single user, but they should get backed up.

    It is much easier to back up a single user's directory than an entire system.

    Finally, limited access to the system makes it harder for viruses to propagate. How is it going to run again after a log out? Most people do not regularly run executables from their own directories: the executables they do run will not be infected. Certainly something like bash_profile or an autostart directory, but cleaning these up should be trivial. Am I missing anything here?

  26. Re:Hello Symantec... by BCoates · · Score: 5, Insightful

    ... Symantec and McAffee to get their shit together and make an antivirus that doesn't suck.

    I'm not sure such a thing is even possible anymore. The usefulness of AV software has always been pretty questionable, and they never seem to have gotten over the threat model of months or years-old viruses being passed from floppy to floppy. Most threats are one-off now, like social engineering spam, one-day long trojan horse attacks, adware, and exploiting OS vulnerabilities to run spam zombies. As far as I can tell, my resource-hogging, system-destabilizing virus scanner does effectively nothing against any of those and there's no reason to believe it can be changed to do so.

  27. Re:Best AntiVirus Still.... by meridian · · Score: 2, Informative

    F-Secure is in there because it uses the Kaspersky engine and another one as well for twice the resources.
    F-Secure - highest detection rate, 4x the resources of nod32
    Kaspersky - highest detection rate bar F-Secure, less chance of false positives but, 2x resources of nod32
    nod32 - Pretty damn good and fast

    Most vendors seem to sit somewhere between Kaspersky and F-Secure for resources from many reviews I spent time reading about 12 months ago, and below nod32 for scanning ability from what I have read. Haven't seen any Vista based reviews but I am sure it hasn't changed too much.

    And of the three only F-Secure supports NAC. I have used the F-Secure demo and I wouldn't buy it myself. If I needed enterprise with NAC support I'd look at either Panda, Trend or Sophos (McAfee if the others weren't decent for enterprise solutions) (sorry shameless Cisco plug :)

    For home I would use nod32 if I had a Windows box of my own

    Mum uses AVG cause ITS FREE :) I did delete her windows once and put debian on but she reinstalled windows herself heh

    --
    meridian at tha.net
  28. Re:Remind me.... by jonadab · · Score: 2, Interesting

    I don't salivate when bells ring. I only salivate when I hear the word "Pavlov". (This is the result of an experiment we did in Intro to Psych (in the fall of 1993, IIRC) and it still works without fail every time.)

    --
    Cut that out, or I will ship you to Norilsk in a box.
  29. AVG by egandalf · · Score: 2, Interesting

    AVG has earned this certification, as noted on their website, for their professional version at least. Their website doesn't specify whether the free version is VB100 also, but I would assume it does since they both should run on the same AV engine.

    Did I mention they have a free version? For 9x/XP/Vista AND Linux?

    Yeah.

    --
    Those who have telepathy have no need to RTFA.
  30. Re:Hello Symantec... by Kazoo+the+Clown · · Score: 3, Insightful

    As far as I can tell, my resource-hogging, system-destabilizing virus scanner does effectively nothing against any of those and there's no reason to believe it can be changed to do so.


    ABSOLUTELY. I gave up on AV programs some time ago. A good firewall, firewall-like execution protection such as Process Guard, not using the most popular email programs or web browsers, and severely restricting web-based application execution (i.e., boycott ActiveX and hamstring Java and Javascript) are far more effective techniques for tripping up a virus as such attacks will almost always try to 1) exploit networking applications most common to the OS, 2) try to run some kind of executable that you haven't run before, and/or 3) attempt some kind of network operation in order to propagate itself. Trying to recognize virus signatures is a lousy use of CPU resources, and has not been seen to be very effective.


    AV software companies are addicted to the subscription model that signature-based AV provides, and consequently are in a serious conflict-of-interest with regards to best security practices. Symantec in particular seems to be short of ideas for an alternative business model, and have opted instead to whine like a six-year-old who's mommy won't let them buy candy at the checkstand.