NETI@home Data Analyzed
An anonymous reader writes "The NETI@home Internet traffic statistics project (featured in Wired and Slashdot previously) has a quick analysis on the malicious traffic they observed. It's a rough world out there." Perhaps not suprising, but still disheartening, the researchers find among other things that a large portion of typical end-user traffic consists of malicious connection attempts.
That's what we need to know.
Linux - Because Mommy taught me to Share.
Considering these malicious programs aren't following any kind of 'standard' to reduce bandwidth utilization when checking over entire subnets of IPs that have been checked by 100000x other copies of the virus, it doesn't suprise me one bit.
It would be like setting up a massive feedback loop on a mail server. When user X gets message X, he passes message X to user Y, who upon receiving message X sends it back to user X.
Job? I don't have time to get a job! Who will sit around and bitch about being broke and unemployed then?
Does anything like this exist already? It would be nice if I could filter, say, ssh traffic coming from "known" naughty sites, and report sites that portscan me, though probably I should look at using smartcards or something more secure at this point. I can't just restrict the ssh port at the firewall, since people could be coming in from pretty much anywhere because of travel to remote sites. Aside from complaining to upstream providers (which so far has yielded zero responses) when I see people banging away at ssh, I don't see much else I can do.
I Am My Own Worst Enemy
Hmmmm, must be time for a new computer and a better ISP
/. is not to be used by individuals with high blood pressure or a history of heart attacks
ISPs could use this data to great benefit, if they'd put out some effort.
Assuming that the statistics show which IP address ranges are the worst offenders for malicious traffic, the ISP(s) responsible could simply shut down the outbound connection(s) of the "problem" users until they de-virus their systems and KEEP THEM THAT WAY.
Perhaps that will help to finally clue people in that having Internet connectivity is a privilege, not a right, just like driving. If you're going to enjoy an Internet connection you need to show some responsibility for making sure your own system isn't going to be a problem to others.
I -still- think there should have been Internet user licenses, just like we have driver's licenses...
Keep the peace(es).
Bruce Lane, KC7GR,
Blue Feather Technologies
malicious traffic? You mean computer virus is not a myth? Duh!
fuvoo: watch something
Yeti@home has yet to yield conclusive results.
Ignoring all complaints about Windows, the root of the problem goes back to having access to the network in the first place. If ISPs would spent a few bucks on implementing passive traffic analyzers to search for the viral/trojan patterns and null route offenders, we'd clean things up pretty quick. Why do we have all these piracy probes going on to sue people and no infected probes going on to cut people's access?
Now, stepping back to the Windows complaints...wouldn't the ISP turning off your access motivate you to get a BASIC education in computing and maintain your PC?
To make an analogy, in most states you need to have your car inspected (and some require emissions inspection, too). PUBLIC roadways means you share it with other people...an unsafe car affects more than just you. When you're connected to the net, your PC affects everyone else. I'm not suggesting the ISPs make an inspection system or a law passes to force ISPs to monitor traffic, but the same logic applies....someone should be doing checkups and flagging the offenders.
...they will realize that there isn't anything more malicious than the traffic from Slashdot.
You can't impose a standard upon viruses. What will you do if a virus doesn't follow the standard? Find the author and punish them unless they fix it and release a new version that fully supports the standard?
The only way viruses will ever get standards is if the authors agree that they will get a considerable benefit by working together. I can't see that happening.
I'll probably be modded down for this...
Comment removed based on user account deletion
I've only scimmed the paper, but from the looks of it, a lot of not all that harmful trafic could be labeled "malicious", for example nmap port scans. I use them all the time, not to find valunerable services, but for more general sysadmin stuff.
------ Take away the right to say fuck and you take away the right to say fuck the government.
It's good to know the IP addresses of machines active searching dark IP space. If you can see those statistics in real time, you have useful information.
ISPs are already starting to work together on this type of information. If an ISP sees malicious worm spreading behavior, it can upload the offending IP into a global db that all ISPs can use to block at their borders.
Again, the authors conclusions are that nothing beats having a nice dark block to trigger alerts.
Modify the Neti@Home client to do dynamic blacklisting?
The biggest problem in Intrusion Detection Systems (buzzword for firewalls with more intelligence than a typical rule-based firewall) is that metrics gathering is occuring at a specific site, making it difficult to discern malice intent from dropped packets or bad coding.
Any time the central server sees a certain threshold of malicious attempts from a single IP, it adds it to a short term blacklist... Make the term length just slightly longer than the reporting period so if it persists it'll remain on the list but if it stops, the IP is cleared in short order.
I am disrespectful to dirt! Can you see that I am serious?!
Its insane the ammount of bandwidth this is sucking up (i remember a time when virus's and worms were relativly well programed, still as bad but less collaterol dammage).
I would like to see more ISP isntead of suplying basic DSL modems with those overpriced sign up deals but instead a proper firewall/router/Dsl modem.
This would save us all alot of pain in the long run .
The only things certain in war are Propaganda and Death. You can never be sure which is which though
Can someone post a resume of TFA with nice color graph? As a average /. user there is no way I will read something longer than 3 lines. Abbrev. more than welcome.
To collect data, Internet users must volunteer to run the software package on their end hosts. Once the package is installed, the NETI@home client will collect net- work statistics from the end host and periodically send a report back to the NETI@home server. Volunteer by downloading the NETI@home toolbar with new "we are watching you" emoticons
"Those willing to give up a little security by using a little obscurity deserve neither security nor root privileges".
-Benjamin Franklin
Sadly, while some customers might get motivated to learn something, others would just be motivated to switch ISPs. Which costs the ISPs money, which means that they won't do it.
At least such is their thought process as often presented. I suspect it's bad cost-benefit analysis; if your dumber customers leave, it's probably a net win for you. Smarter customers mean less bandwidth (at least, they don't act as spam zombies maxing out the bandwidth) and fewer tech support hours explaining how to fix the cup holder.
The big players (AOL, Comcast) are the best targets for this logic, but they live for those left-side-of-the-bell-curve customers. They're the "default" ISPs that people get because they're so readily available, so they get all the customers who don't know better. (Hell, I don't know better; I use Verizon for my DSL but I don't let them do anything but provide me bits.)
So AOL and Comcast are in a bit of a bind; they don't want these customers, but they don't want to lose them, either. I think that they're probably going to have to use gentle persuasion to say, "Hey, it looks like you've a spam zombie. Please call your cousin's best friend to clean the crap off your computer again and give you a stern talking-to. And please stop downloading Bonzi Buddy."
hahahahahahaha :D
lmfao
rofl
ttyl
I would like to submit this proposal for your review. I am seeking funding for a new research project. Please grant me the funds needed so that I can deploy rain sensing equipment to every residence in the Seattle area.
This project will record 3 years of data and prove once and for all whether or not it actually rains in seattle.
sincerely,
Kelly H.
Head research scientist
Darington Univeristy of Heretics
Obama is a twitter sock puppet
...use this info to better the world, and not just bitch about it in verious blogs...
We all dance, we all sing.
-The Streets
Shouldn't there be a butt-ugly histrograph warning?
You really should be using RSA or DSA keys instead of passwords. Hardly a day goes by that my systems don't get at least one script-kiddie SSH password guessing scan. Since I'm requiring keys for authentication, they're wasting their effort; if someone manages to crack a public key, we have far worse problems than password guessing.
Oh, no! You have walked into the slavering fangs of a lurking grue!
What really ought to happen is that lusers who don't secure their boxen should be held liable for all the damage they cause through their reckless irresponsibility.
Especially if their boxen have virii!
This paper looks almost exactly like
one of the randomly generated research papers
i got from that MIT research groups website..
(Questions...)
I passed the randomly generated paper around campus to a bunch of C.S. kids and they all bought it without thinking.. Quite amusing...
And I'm sure it was meant to be spelled properly...
From what I've seen the real challenge would be to find significant samples. I don't imagine crackers would go for the neti software.
Been to Borders and seen the honeypot books on the shelves amongst the rest of the become-a-security-guru-in-$29.95-easy-steps books?
Does it prove or disprove simple A==B logic to note that these incidences of spyware and insecurity are growing at the same time as adoption of Linux variants? Just musing on the "l33t win script kiddie finds Linux religion" phenomenon I've been seeing lately.
Anyhow, this does suggest further that security is where it is at for the future skillset of interest at interview time.
If my grammar and spelling are off, I am [distracted/tired/careless] (take your pick)
It can't be good to have a 8731x1276 GIF as a logo on their first page, especially when being slashdotted.
Apparently this site will be linked to by Slashdot in two days, but it hasn't been yet...
Just what we need more monitoring of traffic. Let's make a passive monitor that looks for phrases like "Terror", "WMD", "Bush sucks", "Bit-Torrent", "porn", etc. That way we can snoop on dissidents and turn off their internet connection making America a safer better place.
Problem is Windows for all it's flaws is an OS. Gentooo is an experimental buggy strain of a thing called Linux which is a plaything of hobbyists and masochists and which has no application or meaning for 99% of people in everyday life.
I've been doing neti at home for several days trying to shake a sinus infection brought on by allergies. :-)
It remains to be seen if I'll find positive results.
-Peter
. Penguins Surely Ca
I've been using neti for years to improve my nasal bandwidth. I had no idea they made it into a distributed.project...
Escher was the first MC and Giger invented the HR department.
"difficult to discern malice intent from dropped packets or bad coding."
Bad code is full of malice, intended or not. (blubster, for example)
Code Red II implemented a randomized variant on this: "1/8th of the time, CodeRedII probes a completely random IP address. 1/2 of the time, CodeRedII probes a machine in the same /8 (so if the infected machine had the IP address 10.9.8.7, the IP address probed would start with 10.), while 3/8ths of the time, it probes a machine on the same /16 (so the IP address probed would start with 10.9.)" It means the worms don't have to keep track of phases, but it gets similar effects, and while there is more chance of overlap, it's not too high until the worm's infected most of the net, and the added random searches help make up for machines that didn't successfully infect their netblocks due to firewalls or failures or simple slowness.
At least one worm that took this sort of approach had a bad random number generator, so it kept hitting the same territory too hard and missing other wide-open spaces, which protected a few parts of the net from infection.
Bill Stewart
New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
Spamlinks's list of Zombie Blocklists also has other types of block lists on that page (RBLs, Open Proxy blocklists, Known Spammer blocklists, etc.).
Bill Stewart
New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
Why not use the bandwidth cap software that's already in place and target those who consistently hit the limit. You'd sure as hell get most of the clueless wonders to either clean up their systems or cut-em off at the neck. As to whether the could do it? Sure can. Most ISP's have something useful in their TOS that allows them to do this for any cause. In this case you're eithe abusing the service and could then be forced to upgrade to a more expensive plan or cut off
Now wouldn't Clueless Bob just love to get a bill for a $gazilla bucks due to exceeding his bandwidth allotment? He'd either clean his system or find a new ISP and I don't care which route he takes as he'd no longer be a problem on my service.
Some cable companies already do block internet use from known infected machines - typically by redirecting all their web pages to a "You're infected. Here's how to install anti-virus software and a hardware firewall" page, but sometimes by giving them very restricted Internet access (e.g. only retrieving ports 80/443 web pages and only sending/receiving mail on the ISP mailserver.)
AFAIK, none of the cable companies have started switching their users's TVs to the "Anti-Virus Cleanup Channel" to *really* get their attention...
Bill Stewart
New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
Okay, I've watched my active logfiles from time to time, and it's obvious when spam hits my mailserver to accounts that are long gone. I've then done an nmap of a few of these IP addresses, and found that they are usually Windows machines with ports still open. Now, what I would really like to do is to craft a program that exploits any ports they have, and change the boot sector of their hard drive that tells them their computer has a virus, and they should take it to some repair shop to get it cleaned up. Hell, even tell them they can use fdisk /mbr or whatever equivalent to get their computer back. My guess is these people wouldn't even be able to accomplish this. The computer stays offline, their data is safe, we are happy.
Now, I'm not so sure about the legality of this. However, would it be legal if the computer in question is outside of the US?
This doesn't prevent all network problems by any means, but it cuts down on lots of annoyances. You can prevent forged UDP packets and forged TCP SYN packets, so there are a number of attacks that don't work. (Forging TCP sessions was already much harder.) Forgery can still happen within a subnet, e.g. a packet claiming to be from 1.2.3.4 might be from some other machine at 1.2.3.0/24, but you can go find the right wire to look at, so you can trace problems reliably and add extra filtering/detection in the right place. Forgery can still happen on other ISPs that don't do spoof-proofing, but you can at least trace it if it's within your network and you can work with other ISPs to clean up their acts as well.
Bill Stewart
New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
A PDF warning would be nice next time around, folks.
qntm.org
Needless to say, it's a rather specialized database system, designed for problems on the order of "record all the event data needed for phone bills"; you're not going to run it on MYSQL in your basement. And it's not a complete sample of headers, much less message bodies (AT&T carries about 2 Petabytes/day of traffic), but it's an interesting start for detecting many kinds of weirdness. There are other ways to collect lots of traffic - routers mainly do packet counters of various sorts, so you're only getting aggregates rather than details, but they're good for other kinds of problems.
Bill Stewart
New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
So you're now pouring water in your nose. There's also been some possibly relevant marketing research done by Golgafrinchians about "Do people want fire that can be fitted nasally?". But Yetis? Probably not what you need.
Bill Stewart
New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
so who "owns" these packets?
Sounds like echelon in a new suit.
I am not an AOL customer, have never been, never will be (at least, not by choice), but I am glad AOL is there to serve the unwashed masses. Because a huge portion of their customer base is, shall we say, "uninformed," AOL has taken a number of measures to protect them (and their network) from malicious traffic. Based on anecdotal observation, it seems to be working.
Because hundreds of people have my "public" email address in their address books, I recive dozens (sometimes hundreds) of virues per week whenever there is an outbreak. However, I cannot recall the last time I received one from an AOL user.
I receive hundreds of (filtered) spam messages daily, but again, cannot recall receiving any from an AOL machine. (This based on source IP address, not the forged FROM line.)
On the flip side, 30-40 percent of spam comes from zombied Comcast and RoadRunner accounts (most from Comcast). The rest come from non-North American IP addresses.
Like I said, limited anecdotal observation, but it appears to me AOL is doing something right, and is the perfect ISP for the "uninformed" user.
Considering the size of their customer base, imagine how much more junk/malicious 'net traffic there would be without AOL.
Ignorance is curable, stupid is forever.
I've seen the same thing, anecdotally. I don't know what it is AOL does to keep its users from infecting the world. I've never heard of somebody being told "we're closing your AOL account until you clean up."
Some of it must be filtering (blocking viral messages before they hit the user) on incoming mail. They may even be censoring outgoing mail. As for other worms, like sasser, I suspect they blocked the relevant ports long before XP SP2 came out.
But that's supposition. I'd love to know for sure.
Has anyone managed to compile this on OS X? I am trying but I get 4 errors on line 469.
I believe they do block ports, yes. Anicdotal evidence suggests that when a dude asked me how to hack, and I pointed him to sub7 so I could get back to C++ coding, it refused to work giving the symptons of a firewall port block.
My firewall figures slashdot checks my ports for open proxies and bans it for 20 hours, I added slashdot to my trusted networks because of it.
:)
If I didn't know it/ ignorant etc, I would see 100s of port scans from a huge , evil T class machine.
Oh btw CmdrTaco, don't hack my machine