Slashdot Mirror


NETI@home Data Analyzed

An anonymous reader writes "The NETI@home Internet traffic statistics project (featured in Wired and Slashdot previously) has a quick analysis on the malicious traffic they observed. It's a rough world out there." Perhaps not suprising, but still disheartening, the researchers find among other things that a large portion of typical end-user traffic consists of malicious connection attempts.

40 of 155 comments (clear)

  1. But did they find intelligent life? by miracle69 · · Score: 5, Funny

    That's what we need to know.

    --
    Linux - Because Mommy taught me to Share.
    1. Re:But did they find intelligent life? by eobanb · · Score: 5, Funny

      Well, they found people with a bunch of Windows Services on and all their ports open. Does that answer your question?

      --

      Take off every sig. For great justice.

    2. Re:But did they find intelligent life? by netcrusher88 · · Score: 4, Funny

      Coming soon: NETI@home discovers sentient penguins and daemons... "Penguins were seen to be working alongside daemons, cultivating apples and mischievously breaking windows..."

      --
      There's an old saying that says pretty much whatever you want it to.
  2. Considering.. by Renraku · · Score: 4, Insightful

    Considering these malicious programs aren't following any kind of 'standard' to reduce bandwidth utilization when checking over entire subnets of IPs that have been checked by 100000x other copies of the virus, it doesn't suprise me one bit.

    It would be like setting up a massive feedback loop on a mail server. When user X gets message X, he passes message X to user Y, who upon receiving message X sends it back to user X.

    --
    Job? I don't have time to get a job! Who will sit around and bitch about being broke and unemployed then?
    1. Re:Considering.. by Nos. · · Score: 2, Interesting

      Oh, so there should be a central hub where the virus/worm can talk to other copies of itself. Any place it could talk to itself would quickly be located and shutdown. Besides, I don't think the writers of these kinds of programs are really concerned with your network utilization.

      Most of the malicious type traffic I'm seeing lately (aside from SPAM) is ssh worms trying to log into my boxes. Most boxes are set to only allow ssh from a few IPs or subnets, but I have one that I block class A's anytime I see a worm trying to get in. I've got about 1/2 the IP space blocked right now.

      It would be like setting up a massive feedback loop on a mail server. When user X gets message X, he passes message X to user Y, who upon receiving message X sends it back to user X
      I remember a Banyan mail system I worked with. In the event that you set up a vacation (while I'm out) type mail minder and we're near your mailbox limit, it was possible to start and endless loop of a mailbox full notifications (mailbox full notifications were allowed even if the limit was reached).

    2. Re:Considering.. by TheOtherChimeraTwin · · Score: 2, Funny
      Considering these malicious programs aren't following any kind of 'standard'

      Not true! For example, they follow RFC 3514

  3. RBL of infected/malicious sites? by nizo · · Score: 4, Interesting

    Does anything like this exist already? It would be nice if I could filter, say, ssh traffic coming from "known" naughty sites, and report sites that portscan me, though probably I should look at using smartcards or something more secure at this point. I can't just restrict the ssh port at the firewall, since people could be coming in from pretty much anywhere because of travel to remote sites. Aside from complaining to upstream providers (which so far has yielded zero responses) when I see people banging away at ssh, I don't see much else I can do.

    1. Re:RBL of infected/malicious sites? by 14erCleaner · · Score: 2, Informative
      It would be nice if I could filter, say, ssh traffic coming from "known" naughty sites

      From the abstract of their paper:

      Finally, we look at activity relative to the IP address space and observe that the sources of malicious traffic are spread across the allocated range.

      So the answer is no, you can't filter effectively for bad sites.

      --
      Have you read my blog lately?
    2. Re:RBL of infected/malicious sites? by Nos. · · Score: 2, Interesting

      It might be worthwhile to look at setting up some sort of a webbased authentication system that would dynamically allow an IP address or subnet for a certain amount of time. Block everything, but if your customer/employee/whatever needs in, they can authenticate via a webpage which would then update your firewall rules.

    3. Re:RBL of infected/malicious sites? by delirium+of+disorder · · Score: 4, Insightful

      Why can't you restrict access to ssh from the firewall? One solution could be port knocking. You only let your firewall open up ssh after a series of connections on pre-defined parts are made. So say you choose "233 457 69 876 2094 576" to be your "password". You would make a client that would connect to those ports in that order and only after that initiate an ssh connection on port 22.

      --
      ------ Take away the right to say fuck and you take away the right to say fuck the government.
    4. Re:RBL of infected/malicious sites? by glesga_kiss · · Score: 3, Informative
      There are some. This site has several different blocklists, such as ad-hosts, anti-p2p bodies, spyware companies, hackers, trackers, trojans etc. The link above lists what's available. Sure, the lists aren't 100% acurate, but they are a lot better than nothing.

      Very highly recommended. With the case of p2p, it's good to keep your head down. It's the tall ones that get their heads chopped off...

      They also have software to convert the lists to various formats for use in different firewalls. iptables fans should check out "linblock". Beware though, a large list can take an hour to parse on your typical recycled firewall box, but the tool merges the ranges to keep the tables as short as possible.

  4. Not necessarily a Bad Thing... by KC7GR · · Score: 3, Insightful

    ISPs could use this data to great benefit, if they'd put out some effort.

    Assuming that the statistics show which IP address ranges are the worst offenders for malicious traffic, the ISP(s) responsible could simply shut down the outbound connection(s) of the "problem" users until they de-virus their systems and KEEP THEM THAT WAY.

    Perhaps that will help to finally clue people in that having Internet connectivity is a privilege, not a right, just like driving. If you're going to enjoy an Internet connection you need to show some responsibility for making sure your own system isn't going to be a problem to others.

    I -still- think there should have been Internet user licenses, just like we have driver's licenses...

    Keep the peace(es).

    --

    Bruce Lane, KC7GR,

    Blue Feather Technologies

    1. Re:Not necessarily a Bad Thing... by eheldreth · · Score: 2, Insightful

      The problem is a large portion of those IPs are home users with dynamic addresses which means when if I am the next to get the IP my outgoing ports will be blocked because thelast person ran windows, er, I mean because they could not keep there pc's clean. And I am assuming the last part about internet usage licenses is troll baiting so I don't think I'll respond to that one.

      --
      The perversity of the Universe tends towards a maximum. - O'Toole's Corollary
    2. Re:Not necessarily a Bad Thing... by Anonymous Coward · · Score: 4, Insightful

      I'm pretty sure internet connectivity is neither a privilege nor a right. It's just a service, plain and simple. You pay ISP, they provide internet connectivity. You don't pay, you don't get internet. No rights or privileges involved.

    3. Re:Not necessarily a Bad Thing... by Mr.Sharpy · · Score: 4, Interesting

      The ISP KNOWS the physical addresses of the cable/dsl modem a home user has. It's not like the ISP has no idea which ip addresses are home user or account is using at any given time. How do you think they can reliably (for the most part) identify people for the likes of the RIAA when they ask. Likewise, with modern hardware and software its a pretty trivial task for an ISP to turn your internet access down to a crawl or off with the click of a button. They can do this, they just don't want to.

      Maybe it would be a good idea to throttle the users down to a bare minimum and redirect all http traffic to a gateway page to tell them they have a problem with their computer they need to correct. It seems to work for wireless access points in hotels/airports/coffeeshops. Why can't big ISPs do the same thing?

    4. Re:Not necessarily a Bad Thing... by Brushfireb · · Score: 2, Insightful

      Would you really want to piss of 40% of your client base in one swoop? Average joe doesnt care about thsi kind of crap, and he doesnt want his ISP forcing him to care either. He will cancel his account, and move to someone else, or he will drive up support calls by calling to complain about the change.

      Any ISP who puts something like what you described in place is likely to lose customers in a hurry. Hotels/Airports/Coffeeshops have transient, non-recurruing customers, or the customers are there for something else other than internet, so its not as big of a deal there.

    5. Re:Not necessarily a Bad Thing... by Mr.Sharpy · · Score: 2, Interesting

      It seems like ISPs are going to have to make a choice between increased costs due to the insane amounts of traffic caused by spyware and malware, or the cost of the loss of some customers. The whole point of such a strategy is to notify the customer and help him correct the problem if necessary. Customers with problems that would be caught by the gateway page would probably call support anyway, wondering why their connections are so slow. If they're not calling, they're probably complaining quietly about the ISPs crappy service. Tools like the one this article covers can be used to reduce to a minimum the number of false positives identified by the ISP because they have a good profile of problem traffic.

      This should be an issue the industry should tackle together. Due the nature of broadband in most markets, these customers aren't really going to have many service alternatives either if they don't like the way their ISP is trying to help them help themselves. If the major players make it known that they won't let their customers unknowingly crush the internet under the load of their spyware and malware riddled boxen, it would go a long way to making a dent in the problem.

  5. In other news... by Anonymous Coward · · Score: 5, Funny

    Yeti@home has yet to yield conclusive results.

  6. Root of the problem by SamMichaels · · Score: 5, Insightful

    Ignoring all complaints about Windows, the root of the problem goes back to having access to the network in the first place. If ISPs would spent a few bucks on implementing passive traffic analyzers to search for the viral/trojan patterns and null route offenders, we'd clean things up pretty quick. Why do we have all these piracy probes going on to sue people and no infected probes going on to cut people's access?

    Now, stepping back to the Windows complaints...wouldn't the ISP turning off your access motivate you to get a BASIC education in computing and maintain your PC?

    To make an analogy, in most states you need to have your car inspected (and some require emissions inspection, too). PUBLIC roadways means you share it with other people...an unsafe car affects more than just you. When you're connected to the net, your PC affects everyone else. I'm not suggesting the ISPs make an inspection system or a law passes to force ISPs to monitor traffic, but the same logic applies....someone should be doing checkups and flagging the offenders.

    1. Re:Root of the problem by Wolf2989 · · Score: 2, Informative

      Ahh but herein lies the problem. As a previous employee of an ISP we'd be willing to bend over backwards to make a customer happy. This means NOT turning off their access when we detected a worm/trojan etc. Sure, we would null route their IP's if they were partaking in a DDOS or something, but a simple virus we'd *help* them by informing them. You don't make money in this world by shutting people off. I for one say null route them, but you have to think of it from a reality standpoint (Regardless of how askew that standpoint may be).

    2. Re:Root of the problem by Politburo · · Score: 2, Insightful

      To make an analogy,

      You should have just stopped there. Analogies are fucking stupid. Car analogies even moreso. Just stop it.

      The reason why your analogy doesn't hold? Computers with viruses can't kill people. Cars with bad brakes can.

      someone should be doing checkups and flagging the offenders.

      If you want to pay for it, go right ahead. I don't experience any significant negative effects from zombie machines, so I am not willing to pay for such a system.

    3. Re:Root of the problem by nagora · · Score: 2, Insightful
      Computers with viruses can't kill people.

      Oops! Someone hasn't noticed the number of trains and ships running Windows. No danger of a virus killing anyone there, then.

      I don't experience any significant negative effects from zombie machines, so I am not willing to pay for such a system.

      Someone also hasn't noticed the amount of effort that goes into protecting his system from zombie machine. Perhaps he thinks firewalls were a gift from unknown stellar travellers and spam filters require no effort to create and update.

      Perhaps someone is a troll.

      TWW

      --
      "Encyclopedia" is to "Wikipedia" what "Library" is to "Some people at a bus stop"
    4. Re:Root of the problem by EvilTwinSkippy · · Score: 4, Funny

      Amen to that. Car analogies have just plain run out of gas. People get too much mileage on them. They start more flamewars than a Pinto.

      --
      "Learning is not compulsory... neither is survival."
      --Dr.W.Edwards Deming
    5. Re:Root of the problem by glesga_kiss · · Score: 4, Insightful
      If ISPs would spent a few bucks on implementing passive traffic analyzers to search for the viral/trojan patterns and null route offenders, we'd clean things up pretty quick.

      Bollocks.

      The aren't running a network in their parents basement you know. Their networks are massive, with nodes LITERALY spanning thousands of miles. The volume of traffic they deal with is HUGE. They use cutting-edge routers just to keep up with the demand.

      How on earth do you do traffic analysis on that level? You might be able to catch some of the more obvious spammers, but how do you differentiate (on the IP level) between: a) a residential user b) a commercial user who maildrops willing customers c) a zombie d) a community group or e) blah. Blocking someone based on traffic is not possible, unless you want to lose your valid customers.

      What they should do is be more responsive to complaints. If a customer of theirs is a zombie spambot or acting as a stepping stone for some script kiddie, they should have their connection suspended until it is remedied. But they can only do this based on a complaint.

      Besides, what's the profit in spending any resource on the problem in the first place? Until that is affected, they won't care about it.

  7. In a few minutes... by vectorian798 · · Score: 4, Funny

    ...they will realize that there isn't anything more malicious than the traffic from Slashdot.

  8. Standards for viruses? by MarkByers · · Score: 4, Insightful

    You can't impose a standard upon viruses. What will you do if a virus doesn't follow the standard? Find the author and punish them unless they fix it and release a new version that fully supports the standard?

    The only way viruses will ever get standards is if the authors agree that they will get a considerable benefit by working together. I can't see that happening.

    --
    I'll probably be modded down for this...
  9. Comment removed by account_deleted · · Score: 2, Insightful

    Comment removed based on user account deletion

  10. malicious? by delirium+of+disorder · · Score: 2, Informative

    I've only scimmed the paper, but from the looks of it, a lot of not all that harmful trafic could be labeled "malicious", for example nmap port scans. I use them all the time, not to find valunerable services, but for more general sysadmin stuff.

    --
    ------ Take away the right to say fuck and you take away the right to say fuck the government.
  11. Flow observation conclusions... news u can use by GPLDAN · · Score: 3, Interesting

    It's good to know the IP addresses of machines active searching dark IP space. If you can see those statistics in real time, you have useful information.

    ISPs are already starting to work together on this type of information. If an ISP sees malicious worm spreading behavior, it can upload the offending IP into a global db that all ISPs can use to block at their borders.

    Again, the authors conclusions are that nothing beats having a nice dark block to trigger alerts.

  12. Next Step? by merlin_jim · · Score: 3, Insightful

    Modify the Neti@Home client to do dynamic blacklisting?

    The biggest problem in Intrusion Detection Systems (buzzword for firewalls with more intelligence than a typical rule-based firewall) is that metrics gathering is occuring at a specific site, making it difficult to discern malice intent from dropped packets or bad coding.

    Any time the central server sees a certain threshold of malicious attempts from a single IP, it adds it to a short term blacklist... Make the term length just slightly longer than the reporting period so if it persists it'll remain on the list but if it stops, the IP is cleared in short order.

    --
    I am disrespectful to dirt! Can you see that I am serious?!
  13. DSL/modem/router by FidelCatsro · · Score: 4, Insightful

    Its insane the ammount of bandwidth this is sucking up (i remember a time when virus's and worms were relativly well programed, still as bad but less collaterol dammage).
    I would like to see more ISP isntead of suplying basic DSL modems with those overpriced sign up deals but instead a proper firewall/router/Dsl modem.
    This would save us all alot of pain in the long run .

    --
    The only things certain in war are Propaganda and Death. You can never be sure which is which though
  14. Time to drag out this old chestnut by This+Old+Chestnut · · Score: 4, Funny

    "Those willing to give up a little security by using a little obscurity deserve neither security nor root privileges".

    -Benjamin Franklin

  15. Cheap access means unsafe computing by jfengel · · Score: 4, Interesting

    Sadly, while some customers might get motivated to learn something, others would just be motivated to switch ISPs. Which costs the ISPs money, which means that they won't do it.

    At least such is their thought process as often presented. I suspect it's bad cost-benefit analysis; if your dumber customers leave, it's probably a net win for you. Smarter customers mean less bandwidth (at least, they don't act as spam zombies maxing out the bandwidth) and fewer tech support hours explaining how to fix the cup holder.

    The big players (AOL, Comcast) are the best targets for this logic, but they live for those left-side-of-the-bell-curve customers. They're the "default" ISPs that people get because they're so readily available, so they get all the customers who don't know better. (Hell, I don't know better; I use Verizon for my DSL but I don't let them do anything but provide me bits.)

    So AOL and Comcast are in a bit of a bind; they don't want these customers, but they don't want to lose them, either. I think that they're probably going to have to use gentle persuasion to say, "Hey, it looks like you've a spam zombie. Please call your cousin's best friend to clean the crap off your computer again and give you a stern talking-to. And please stop downloading Bonzi Buddy."

  16. proposal by ocularDeathRay · · Score: 3, Funny

    I would like to submit this proposal for your review. I am seeking funding for a new research project. Please grant me the funds needed so that I can deploy rain sensing equipment to every residence in the Seattle area.

    This project will record 3 years of data and prove once and for all whether or not it actually rains in seattle.

    sincerely,
    Kelly H.
    Head research scientist
    Darington Univeristy of Heretics

    --
    Obama is a twitter sock puppet
  17. The Most Illegible Graphs. Ever. by dohboy · · Score: 3, Funny

    Shouldn't there be a butt-ugly histrograph warning?

    1. Re:The Most Illegible Graphs. Ever. by UnknowingFool · · Score: 2, Funny
      Shouldn't there be a butt-ugly histrograph warning?

      This is /. Pretty is for Windows users. [ducks]

      --
      Well, there's spam egg sausage and spam, that's not got much spam in it.
  18. Don't use SSH password authentication by SIGBUS · · Score: 4, Insightful

    You really should be using RSA or DSA keys instead of passwords. Hardly a day goes by that my systems don't get at least one script-kiddie SSH password guessing scan. Since I'm requiring keys for authentication, they're wasting their effort; if someone manages to crack a public key, we have far worse problems than password guessing.

    --
    Oh, no! You have walked into the slavering fangs of a lurking grue!
  19. Recent Worms DO organize to manage utilization by billstewart · · Score: 3, Informative
    Most of the interesting recent viruses *do* have some level of organization to reduce duplication of effort, and the postulated "Warhol Worms" designed to take over the entire Internet in 15 minutes would need to do so, because otherwise they're not as effective. Some of them pre-scan the net to find a list of vulnerable machines to infect first, and then haul around parts of the list. Others partition the address space quasi-deterministically (e.g. Phase 1 scans all of the valid /8 address spaces until it's infected some machine in each one, Phase 2 scans all of the 256 /16 address spaces within its /8 until it's affected one in each, Phase 3 scans all of the 256 /24 addresses within its /16, Phase 4 scans all the 256 addresses within its /24.

    Code Red II implemented a randomized variant on this: "1/8th of the time, CodeRedII probes a completely random IP address. 1/2 of the time, CodeRedII probes a machine in the same /8 (so if the infected machine had the IP address 10.9.8.7, the IP address probed would start with 10.), while 3/8ths of the time, it probes a machine on the same /16 (so the IP address probed would start with 10.9.)" It means the worms don't have to keep track of phases, but it gets similar effects, and while there is more chance of overlap, it's not too high until the worm's infected most of the net, and the added random searches help make up for machines that didn't successfully infect their netblocks due to firewalls or failures or simple slowness.

    At least one worm that took this sort of approach had a bad random number generator, so it kept hitting the same territory too hard and missing other wide-open spaces, which protected a few parts of the net from infection.

    --

    Bill Stewart
    New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
  20. List of Zombie Blocklists (+ other Bad-Site-BLs) by billstewart · · Score: 2, Informative

    Spamlinks's list of Zombie Blocklists also has other types of block lists on that page (RBLs, Open Proxy blocklists, Known Spammer blocklists, etc.).

    --

    Bill Stewart
    New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
  21. PDF, ack by SamSim · · Score: 2, Insightful

    A PDF warning would be nice next time around, folks.