Slashdot Mirror


Researchers Use Machines To Analyze Malware

Krishna Dagli writes to mention a Register article about a mechanical process for analyzing malware. Using an automated system, researchers are able to more accurately classify the often randomly-named bots and viruses that plague us. From the article: "The researchers modeled a piece of malicious software as the series of actions that the software takes at the operating system level. Referred to as 'events' in a paper written by Lee and anti-malware program team manager Jigar Mody, the actions can include data copying, changing registry keys and opening network connections. The researchers then trained a recognition engine using an adaptive clustering algorithm - similar to self-organising maps - and classified a previously unseen subset of malware using the trained system. Using more clusters typically resulted in better classification. When the software samples were classified based on 100 events, accuracy fell below 80 per cent, while classification based on 500 and 1,000 events typically has accuracy rates above 90 per cent."

19 of 55 comments (clear)

  1. The future is now by Umbral+Blot · · Score: 4, Insightful

    Obviously solutions like this will be the way of the future, combined with a finer grained permission system. I just hope you can manually exempt programs. For example bittorrent opens a lot of network connections, and copies a lot of data around; I could see a tool such as this reasonably coming to the conclusion that it was malware. I am also curious if their system could defeat a rootkit, which will do its best to hide its activity and existence almost completely from the system.

    1. Re:The future is now by ciroknight · · Score: 2, Funny

      New classification system eh? Sounds good to me...

      "Pandavirus/2006Tokyo is in Domain Malware, Kingdom Microsoft, Phylum Spyus Maximus, Class Claria, Order Adicus Wearicus, Family Panda."

      --
      "Victory means exit strategy, and it's important for the President to explain to us what the exit strategy is." G.W.Bush
    2. Re:The future is now by bmo · · Score: 4, Insightful

      "Why cant I just sue the owner of that IP?"

      Because the owner of the IP is not always the originator of the malware, but a victimized third party? Ya think? Haven't you ever looked at your phishing spam URLs?

      Only a seriously stupid criminal would illegally collect information at a machine that he owns himself.

      That said, the prisons are not full of geniuses.

      --
      BMO

  2. Advantages? by bsdluvr · · Score: 4, Insightful

    Does this new classification method really have any advantages for the average user? I'm sure most people just want to keep their systems malware-free, and could care less about the names of the individual threats.

    1. Re:Advantages? by Aneurysm · · Score: 3, Insightful

      If you can group malware threats together it may be easier/quicker to come up with methods to remove them. Common system actions probably means common steps to get rid of the malware. Also, having a database of actions that a piece of malware takes when infecting a system could help identify an infection sooner. If you had an anti-malware package running on your computer and intercepting reg key changes, directory creations etc. before they happened, it could step in to alert the user and eradicate the threat before it had even finished installing itself. Admittedly many people wouldn't want an anti-malware system constantly monitoring every API access, but if it was made transparent this is the sort of thing that would greatly benefit the less technically minded user.

    2. Re:Advantages? by happyemoticon · · Score: 2, Interesting

      Any mechanized approach to classifying malware is a good thing. I've heard anecdotally that the process of getting a program declared as a virus or malware is (or has been) as follows at major security firms:

      • Client gets infected with virus.
      • Client calls vendor when vendor's app refuses to clean it off.
      • Vendor's tech support gradually escalates the ticket until somebody with half a brain gets ahold of the problem.
      • Non-clueless support person dissects the malware and commits it to the week's definitions.

      Oh, and of course:

      • Client's data is screwed.

      Of course, this is purely anecdotal, and as someone who's never been employed at one of these firms I have no firsthand experience. But I suspect it's something like this, or at the very least something which requires a screaming client and a lot of human effort.

      Also, a common thing to do with malware is to change a few lines of code here and there until a matching engine can no longer recognize it and then send it out again over the net. It sounds like their technology has the possibility of dealing with this as well, if it can intelligently sort together related infections. However, the guy who gets a virus first is still probably screwed - but it's an imperfect world.

  3. Better classification means better naming by mrogers · · Score: 5, Funny

    Now instead of obscure names like W32/worm.169/06A they can give them meaningful names like W32/fucks.your.harddrive.and.emails.itself.to.all. your.friends.169/06A.

  4. Bugged? by Anonymous Coward · · Score: 2, Funny

    I think the program is bugged, it keeps telling me that something called Windows is malware.

  5. Re:One-sentence summary by ozmanjusri · · Score: 3, Insightful
    So, basically, we'll have another anti-virus-like program monitoring our systems.

    That's the most attractive option for the big malware prevention/removal companies, and is the most likely scenario in the near future.

    The opportunity this type of forensic analysis creates though, is that it exposes and classifies the methods the malware uses to insinuate itself into the host operating system. That means OS vendors can analyse the failure points of their products and harden them against the malware. At the moment, the two key problems with malware removal are

    1. Recognising its presence
    2. Removing the malware and returning the computer to a safe state
    If you minimise the number of places where programs can start at boot time and make any auto-starting program clearly visible and easily removable, for example, you will have made it easier for users to block or remove an infection and have reduced the motive for crackers to write the malware in the first place.

    It's also an example of why an OS vendor who also sells malware tools has such a dangerous conflict of interests.

    --
    "I've got more toys than Teruhisa Kitahara."
  6. Re:One-sentence summary by jacksonj04 · · Score: 3, Interesting

    Is it worth having a core just to do background tasks like this?

    Since multicore systems are starting to take off, perhaps there should be a method for applications to flag themselves as 'supporting', and then have a seperate lower power core dedicated to 'supporting' applications such as AV, system monitors etc?

    --
    How many people can read hex if only you and dead people can read hex?
  7. Hmm... by Ichigo+Kurosaki · · Score: 3, Funny

    Researchers Use Machines To Analyze Malware

    as opposed to punch cards?

  8. 90% isn't good enough by m874t232 · · Score: 3, Insightful

    Attempts at classifying malware automatically have been around for a number of years. Trouble is: 90% isn't good enough--it's too many false alarms. You need something that works almost perfectly in order to deploy it on real machines.

  9. Wow by ms1234 · · Score: 2, Insightful

    Maybe it could be trained to categorize my socks?

  10. what is that new malware subset? by gbjbaanb · · Score: 2, Funny

    and classified a previously unseen subset of malware using the trained system

    automated systems determined that the new worm, W32.setup/install.exe is the most prevalent ever, due to the success of its social-engineering attack vector.

  11. "us" ???? by Wingsy · · Score: 4, Funny

    "...bots and viruses that plague us" What's this "us" shit Kemosabe? I've never experienced any bots and/or viruses in the past 5 years or more. What kinda system are you running that has this affliction?

    --
    If I didn't have absolutely NOTHING to do, I wouldn't be here.
  12. I now present... the Polymorph by packetmon · · Score: 5, Insightful

    After reading 12 of the 17 page MS document I shake my head... Some malware do not run properly in VM. Some packers are known to detect VM environment and prevent the file from normal execution. What about smarter polymorphs which change and adapt not to mention their analysis', tests, etc., did not include a full scope of what malware targets: "Runtime environment simulation is still primitive. For example, we have not implemented Instant Messaging or P2P applications/servers." Couple this with: "The biggest benefit is more rapid response to complex threats. As the synergy between viruses, Trojans, worms, rootkits and exploits grows, waiting for a solution becomes more dangerous." And lest I forget "This two-part article series looks at how cryptography is a double-edged sword: it is used to make us safer, but it is also being used for malicious purposes within sophisticated viruses. Part two continues the discussion of armored viruses and then looks at a Bradley worm - a worm that uses cryptography in such a way that it cannot be analyzed. (source). So what happens when malware writers get a clue and start creating their own forms of crypto to hide their actions. For any company to create a product whether its hardware or software based, they'd only be lying to a degree about their ability to detect complex threats no matter what engine their malware snoopers were using.

  13. You can already buy a product that does this by Anonymous Coward · · Score: 4, Informative

    Internet Security Systems already provides a product that does this called "Proventia Desktop". Whenever the user tries to run a program, it first boots a virtual machine, runs the program, looks at all these behaviors (opening connections, setting itself as the Run entry in the registry, etc.). When the right combination of behaviors are detected, it marks it as malware and refuses to run it in the real machine. The entire process takes as much time as it would for anti-virus to scan it. It's about 99% effective, which means that it catches almost all 0-day viruses, but it will occasionally let something through (which is why you should probably also have traditional anti-virus as well).

  14. Re:One-sentence summary by cp.tar · · Score: 2, Insightful

    The point is, however, that malware mostly (ab)uses perfectly legal system instructions.

    Therefore, whatever it is that will be running in people's backgrounds, it will have to have a heuristic algorithm and monitor every single system activity.

    To abuse the good old car analogy, it's as if more and more safety measures were introduced in cars instead of teaching people to drive safely.
    Wait, where was I going with that one?

    Anyway, I do not want (at the times when I'm using Windows) another program which will protect me some of the time and hog resources all of the time.

    But to discuss one of your points:

    If you minimise the number of places where programs can start at boot time and make any auto-starting program clearly visible and easily removable, for example, you will have made it easier for users to block or remove an infection and have reduced the motive for crackers to write the malware in the first place.
    Now, that I can't really agree with.

    People mostly do not write malware as a programming exercise or 'because they can'.
    The romantic days of great hackers seem to be long past.
    The reason people do write malware is, as /. meme goes, 4) Profit!!!1one
    You may make it more difficult, but as long as the motive is plain and simple profit, the motive will remain.

    --
    Ignore this signature. By order.
  15. The past is out future. by TeamSPAM · · Score: 2, Interesting

    Back in the days when Macs had viruses (yes they do exist or existed), I was using a program called Gatekeeper. Instead of knowing about certain virus it monitored system activity and alerted you when virus type activity was happening. You the user would either deny or grant the action.

    So given my experience with GateKeeper, the ideas of this malware detection seem obvious. Why did it take this long to apply these ideas to windows malware? Is the problem commerical anti-virus software? They prefer you to keep paying for updates, instead to shut down potential malware until they software knows about it?

    --
    Brought to you by Team SPAM! where we believe: "Information in the noise!"