Slashdot Mirror


Ongoing Linux/Solaris Compromise Epidemic

An anonymous reader writes to point out that Stanford's Information Technology Systems and Services "has written a summary of a series of compromises that have been happening at universities, research institutions, and high performance computing centers, for the last month or more. The attackers are using known vulnerabilities in Linux and Solaris, along with compromised user accounts, to gain access and control of systems, from standalone servers to HPC clusters ... (the attacks are still ongoing)."

33 of 366 comments (clear)

  1. Nothing to worry about by Rapid+Home+Offer · · Score: 5, Funny
    From the article:
    The attacker appears to be deliberately targetting machines in academic and high performance computing environments, rather than attacking systems indiscriminately.
    I wouldn't worry too much. It's sounds like some guy is trying to boost his SETI@home ranking.
  2. I'm just glad... by Anonymous Coward · · Score: 4, Funny

    I'm running Windows XP!

    aQazaQa

  3. In other words by Rosco+P.+Coltrane · · Score: 5, Insightful

    a variety of local exploits, including the do_brk() and mremap() exploits on Linux

    In other words, Stanford doesn't keep its Linux boxes up to date. These exploits have been fixed. Linux too requires maintenance and patching, not just Windows.

    --
    "A door is what a dog is perpetually on the wrong side of" - Ogden Nash
    1. Re:In other words by winkydink · · Score: 4, Insightful

      Maintaining a large, heterogenous environment (where administrative control may be decided by political or monetary reasons) is not easy to do. This may explain why you see so many really bright sysadmins at .edu's, but even they have difficulty breaking the political & financial layers.

      --

      "I'd rather be a lightning rod than a seismometer." -Ken Kesey

    2. Re:In other words by ameoba · · Score: 5, Informative

      A cluster is almost always _not_ a heterogenous environment. On top of that, the individual cluster machines should not have, nor do they need, access to the network as a whole. Compared to things like computer labs, HPC clusters should be the easiest thing to secure, since you -can- firewall the hell out of them.

      There's no excuse, when putting up a several hundred node cluster to not get an extra machine through which it needs to be accessed that is not part of the cluster. That machine can trivially be kept secure & the cluster can then be updated as is convenient (IE - not replacing the kernel in the middle of a 3-week long computation; even at that, tho, anything that's going to take 3wk should be able to checkpoint itself without loosing much).

      --
      my sig's at the bottom of the page.
  4. If you read to the VERY end of the article... by oldosadmin · · Score: 5, Informative

    It says that good passwords are a good defense.
    We know this.
    No more default last 4 digits of SSN as a password.
    Make them use something more secure! And disable telnet, for goodness sakes.
    Inconvieience (sp?) your students in order to secure your system. It's all fun and games until someone uses a rootkit to play with GPAs.

    --
    Jay | http://oldos.org
  5. IMO all of these attacks are related by bersl2 · · Score: 4, Interesting

    going back to the back-door insertion attempt on the Kernel, the rooting of gnu.org's ftp server, the compromise of Debian's servers... it's the same people doing this.

    Just a feeling.

  6. Washingtonpost.com has the complete story by tsu+doh+nimh · · Score: 5, Informative

    on just how widespread this attack really is. The story IS HERE

    --
    ...because you never know who you're dealing with.
  7. Hmm, doesn't seem very unusual. by mtnharo · · Score: 4, Informative
    Someone is sniffing passwords off the network (telnet or http sessions probably) or cracking badly chosen ones, and then using privilage escalation vulnerabilities that have been known and patched for quite a while. However, this kind of thing can work at an academic environment or other large network, since it is often not possible to upgrade the kernel on every single system without proper testing. Still, come things can be done to prevent this kind of attack.

    Don't send passwords in plain text on the network, and enforce proper password policies (8 char minimum, numbers, letters and symbols etc).

  8. Note to self by UnknowingFool · · Score: 4, Funny

    Change Linux root password from 1234 to something harder to guess

    --
    Well, there's spam egg sausage and spam, that's not got much spam in it.
    1. Re:Note to self by RussDavisDotCom · · Score: 5, Funny

      No Worries. I've already changed it for you.

      --
      My favorite phrase: You have 5 Moderator Points! Use 'em or lose 'em!
  9. Sloppy work all around by fastpage · · Score: 5, Insightful

    What gets me is that you can tell the white hats and black hats are both lazy.

    If the sysadmins had actually patched their servers with the appropriate security patches the "hackers" would have never gotten in, in the first place. If you read the counter measure section this isn't anything new that they shouldn't be doing every day and enforcing.

    If you look at the section entitled Evidence of compromise you can see that the people breaking into the systems are leaving a pretty big trail to follow. In my job, when customers start complaining that their servers are working quite right, when you take a look at whats going on you can see a root kits been installed. The whole idea of a root kit is to cover your tracks. If these guys did a better job you'd never know you were hacked. Its quite sad really. Laziness is the biggest security problem if you ask me.

  10. Been hitting Caltech too by Anonymous Coward · · Score: 4, Informative

    Servers were down much of last week. The ITS website has a few brief details.

  11. Yeah, so? by ameoba · · Score: 4, Interesting

    The entire (up to date) Windows lab here gets compromised & backdoored to hell and everyone just says "Have it working by tommorrow". A Linux cluster gets compromised and they issue a press-conference.

    --
    my sig's at the bottom of the page.
  12. Re:Windows is not the only vulnerable OS by morelife · · Score: 4, Insightful

    You're joking.

    All the vulns mentioned have patches/fixes/replacements for the faulty code.

    The System Administrators are at fault FOR NOT MAINTAINING THEIR SYSTEMS PROPERLY.

  13. they wanna know WHAT? by ChipMonk · · Score: 4, Insightful

    If you believe your Unix computer has been affected by these intrusions, please contact the Information Security Services office (650-723-2911 or security@stanford.edu). Please include the name or IP address of the affected machine, as well as any compromised userIDs.

    Never mind the compromised machines. Let's try social engineering instead. I know! We'll make a security alert, get it on Slashdot, and the poor trusting souls will beat a path to our POP3 account!

    Seriously, you might as well just hand them your hard drive and credit card number.

  14. Re:Windows is not the only vulnerable OS by FrYGuY101 · · Score: 5, Insightful

    How does that differ from the worms which get released for Microsoft almost a year after the patch was released? I hear people railing Microsoft all the time for not 'getting it right the first time' when THAT happens...

    --
    "If we let things terrify us, life will not be worth living."

    - Seneca
  15. Libsafe protects against buffer overflow exploits by tjmather · · Score: 5, Interesting
    Does anyone use Libsafe This library protects against buffer overflow vulnerabilities, and is very easy to install (basically you just install the RPM and you're done)

    If more sysadmins installed this, perhaps we wouldn't have problems with so many Linux compromises? Of course it's no substitute for patching, but seems like a good additional security measure.

    This is from the gnu.org software directory

    The exploitation of buffer overflow and format string vulnerabilities in process stacks are a significant portion of security attacks. 'libsafe' is based on a middleware software layer that intercepts all function calls made to library functions known to be vulnerable. A substitute version of the corresponding function implements the original function in a way that ensures that any buffer overflows are contained within the current stack frame, which prevents attackers from overwriting the return address and hijacking the control flow of a running program.

    The true benefit of using libsafe is protection against future attacks on programs not yet known to be vulnerable. The performance overhead of libsafe is negligible, it does not require changes to the OS, it works with existing binary programs, and it does not need access to the source code of defective programs, or recompilation or off-line processing of binaries.

  16. Imagine... by Odin's+Raven · · Score: 4, Funny

    From the Stanford article:

    Stanford, along with a large number of research institutions and high performance computing centers...

    And further down...

    ...the compromised user account is typically used to run a password decoding application called John the Ripper...

    To paraphrase a cliche without any attempt at humor:

    Imagine a Beowulf cluster running John the Ripper.

    /me runs and hides in cellar...

    --
    A marriage is always made up of two people who are prepared to swear that only the other one snores.
  17. Now, wait a moment ... by JMZorko · · Score: 5, Interesting
    Just an observation, but this story has the "Security" icon, while the story about Windows critical flaws has the "Bugs" icon. Both stories deal with bugs or "vulnerabilities" that compromise security on the affected machines.

    Now, my opinion of MS is not that great, but this just seems wrong.

    Regards,

    John

    --
    Falling You - beautiful
  18. Re:Windows is not the only vulnerable OS by morelife · · Score: 4, Interesting

    How does that differ from the worms which get released for Microsoft almost a year after the patch was released? I hear people railing Microsoft all the time for not 'getting it right the first time' when THAT happens...

    Wrong. People rail because Microsoft rarely gets it right the first time, and are damned slow and arrogant about fixing security holes. Oh, sorry. They did speed up their response time on security issues after realizing that the public was noticing and they were losing a little market share in IIS.

  19. Re:Windows is not the only vulnerable OS by jarich · · Score: 4, Interesting
    Perhaps an alternative view...?

    The p;roblem, among others, is that we don't have enough real punishment going on for hacking activities.

    The internet has become the equivalent to living in a slum. Sure, the property is cheap, but if you don't have bars on your windows, you can count on a break in. And lots of people will tell you it's your own fault for not putting bars on your windows and living in a walled compound with broken glass on the tops of the walls.

    I agree that the systems should be patched, but the real problem is that there are communities of thugs who feel at liberty... NO, who ARE at liberty (due to the lack of a cohesive international enforcement) to do what ever they want to you machine.

    I vote for real international difficult (I know that's not going to be trivial) and hard jail time when people are caught. And, just like Kevin Mitnick, they should not be allowed to work with computers when they get out.

  20. Re:Windows is not the only vulnerable OS by EvilTwinSkippy · · Score: 4, Insightful
    I am a religious patcher. Hell, I've almost gotten a fired a few times when patches went wrong. Bosses just don't understand that machines don't just "work". They require constant intervention. The computers, that is, not the bosses.

    Now that said, you have an interesting slant on ethics. By that mindset, a burglar is perfectly entitled to break into your apartment because your door could be kicked in. A theif can swipe your radio because, hey, it was only glass between him and what he wanted.

    Yes, there is a certain amount to be said for not painting a target on yourself. But regardless of how much you "had it coming" it's still a crime to break into your dwelling, steal your property, or damage your person or posessions. System intrusion is a crime, and a matter for law enforcement.

    --
    "Learning is not compulsory... neither is survival."
    --Dr.W.Edwards Deming
  21. Re:Libsafe protects against buffer overflow exploi by EvilTwinSkippy · · Score: 4, Interesting
    On gentoo I compile everything with -fstack-protector. A nifty new feature in GCC that compiles it into all me binaries.

    I still use libsafe. It is the greatest thing since sliced bread. Ok, that and distcc. Distcc and rsync... and ssh... DOH!

    --
    "Learning is not compulsory... neither is survival."
    --Dr.W.Edwards Deming
  22. this just in... by medelliadegray · · Score: 4, Funny

    PC's get compromised if security patches are not applied!

    and in other news...
    cheerio's get soggy in milk

    --
    Troll, Troll, go away and flame again some other day
  23. Sad Mind by Neo-Rio-101 · · Score: 5, Funny

    I was looking at one of the Solaris vulnerabilities, and I saw "sadmind".

    I thought it was some kind of nasty name for a hacking daemon - until I found out that sadmind was the "Solaris ADMIN Daemon"

    --
    READY.
    PRINT ""+-0
  24. Re:Attempts easy to guess passwords by Anonymous Coward · · Score: 5, Interesting
    From "/var/log/messages" on a 64-processor cluster at our university (unrelated to the parent post):
    Apr 12 09:51:24 xxx sshd[32583]: Illegal user alias from 210.166.208.97
    Apr 12 09:51:24 xxx sshd[32583]: Failed none for illegal user alias from 210.166.208.97 port 34243 ssh2
    Apr 12 09:51:26 xxx sshd[32583]: error: Could not get shadow information for NOUSER
    Apr 12 09:51:26 xxx sshd[32583]: Failed password for illegal user alias from 210.166.208.97 port 34243 ssh2
    Apr 12 09:51:35 xxx sshd[32587]: Illegal user info from 210.166.208.97
    Apr 12 09:51:35 xxx sshd[32587]: Failed none for illegal user info from 210.166.208.97 port 34695 ssh2
    Apr 12 09:51:35 xxx sshd[32587]: error: Could not get shadow information for NOUSER
    Apr 12 09:51:35 xxx sshd[32587]: Failed password for illegal user info from 210.166.208.97 port 34695 ssh2
    Apr 12 09:51:41 xxx sshd[32598]: Illegal user backup from 210.166.208.97
    Apr 12 09:51:41 xxx sshd[32598]: Failed none for illegal user backup from 210.166.208.97 port 35292 ssh2
    Apr 12 09:51:41 xxx sshd[32598]: error: Could not get shadow information for NOUSER
    Apr 12 09:51:41 xxx sshd[32598]: Failed password for illegal user backup from 210.166.208.97 port 35292 ssh2
    ...
    The attempted logins appear to be in the exact same order, so it's safe to say the attack was done with a script. The attacking IP address also starts with "210" and resolves back to "ns.himanainu.jp" (not necessary the attacker's machine, but rather a compromised host).
  25. Re:Windows is not the only vulnerable OS by RT+Alec · · Score: 4, Insightful

    There is a well founded fear many Windows admins have about MS patches. They tend to break things. Patch Win2k, and MS-SQL does not work upon reboot. Or that third party medical charting software suddenly does not work.

    Windows is very complex (many would say "too complex"), and certainly suffers from the "integration" of its parts. Therefore, unintentional side effects of patches are envitable. With Unix(ish) systems, the descrete parts can be patched, well, descretely. You can patch Sendmail, or MySQL, or OpenSSL all by itself (although sometimes you must recompile applications that depend on shared libraries, such as OpenSSL).

  26. The Washington Post has more coverage by Doofus · · Score: 4, Informative


    Washington Post has more coverage in this article, Hackers Strike Advanced Computing Networks.

    --
    If the Government becomes a lawbreaker, it breeds contempt for law; ... it invites anarchy. - Brandeis
  27. Win 95 to the rescue! by CaptainPinko · · Score: 5, Funny

    Heh, I'm running Windows 95. I figure by now the hackers are just bored of hacking me.

    Security through boredom, my new secret weapon take th^454&*%2^$^^^B

    --
    Your CPU is not doing anything else, at least do something.
  28. Re:Windows is not the only vulnerable OS by Anonymous Coward · · Score: 5, Insightful
    The problem with patching is that it's not reasonable to take some slab of code that's been put on the 'Net by the software manufacturer and throw it on the computer.

    Why not?

    Well, what happens if that system just happens to be the payroll system, for example? What happens if the patch just manages to break the system so that the fortnightly payroll run doesn't happen? What happens when that money, which you expected to be in your bank account, doesn't appear? What happens when your mortgage provider goes to pull out your fortnightly mortgage repayment, and finds that there's no money in there to grab?

    It isn't as simple as "Here's a patch, you're now secure as long as you apply it." We're talking real-world systems, with real-world conflicts and requirements. If you step outside the known and tested, you're liable to break things.

    In other words: have a second system which you can throw patches onto and pound away on for a week or two, to make sure that those patches don't break anything important. Then throw the patches onto the live, production system. Doing it any other way could cause serious problems.

    Sometimes, it's a case of having a choice: either you're secure, or your business is functioning. This is not a choice that I would want anybody to have to make, but you need to know that that choice is entirely possible, every time a new patch is released from your vendor, whether that vendor be Microsoft, Sun, IBM, HP, SGI, Apple, or Linus. Note that I'm not talking about deliberately (or through slacking off) avoiding application of patches; I'm talking about verifying that the patches still let you function as a business.

    Or, in other words: IT exists to serve the business. The business does not operate to serve IT. Most of the time, there is no conflict between the two, but when there is, you need to make damn sure that the right one wins.

  29. Re:Does anyone on the inside... by drmerope · · Score: 5, Interesting

    Yeah, I've been involved in some of the staff discussions at one of the compromised institutions. The vulnerabilities listed seem old because these attacks have been ongoing for a while now. Some of those vulnerabilities were actually discovered originally in relations to this situation. What's important to realize is that this situation is very unlike what's happened to windows machines recently. Most of the Windows intrusions have been remote exploits via services. We've been facing primarily local-root exploits. These people are breaking into accounts--usually by password sniffing, key-stroke logging, etc from other compromised machines. Those accounts are then used to launch various known (and previously unknown) local-root exploits. These people appear to be after other systems for an unknown purpose rather than just "games" or DoS attacks. Most of the targeted institutions have substanial DARPA/government research contracts. It's reasonable that these attacks are being used to steal information. The focus has not been on High Performance Clusters but rather on interactive clusters. These people are after information not computing power.

  30. A few things to try..... by Mercury2k · · Score: 5, Informative

    Here is a list of some things that I feel are worth considering:

    1. Patch your system! As soon as a patch comes out, get it applied and reboot if you have to! Also, stay up to date on security issues by subscribing to mailing lists that are related to the software your using. One good general purpose site is cert.org. Keep in mind that while mailing lists are great ways of being notified, they arent fool proof. If your subscription expires and you dont know about it, you wont be exactly up to date in the community now will you?

    2. Use grsecurity. This is a kernel patch that is briefly lagged behind official Linux kernel versions. It has many great features for protecting against stack attacks/buffer overflows. ie: Those latest greatest scripts your local script kiddie just downloaded wont likely do anything against you since special addresses are randomised. It can also hide files on your computer such as intergrity checkers so nobody except you know they exist. Plus it can stop insert code into a running kernel by making kernel memory readonly (which btw, would have prevented at least one of the attacks they mentioned).

    3. Install a filesystem intergrity checker. Aide, integrit and tripwire all come to mind and essentially all do the same thing but with different config file syntax. Besides, how can you tell if a file is changed if you dont actually check? Also, dont forget to hide the existence of this program using something like grsec's gradm filesystem ACL util and be careful of automating checks in the crontab!

    4. Read a good linux securing article. One such article I have read is called Securing & Optimizing Linux: The Ultimate Solution. It will teach you how to lock a system down a fair bit and how to remove unused/unneeded services from your computer.

    5. Watch those logs! Log files provide a wealth of information, but administrators rarely check them (well, not all). If you dont know what a log entry means, research it, or else you may be looking at an attack and not even realise it. Now I know some of you are thinking I am nuts considering just how many logs even a small system generates, but there are tools to help you. One way is to use a program called swatch (a perl script). It can parse existing and old archived log files using a perl regex syntax and trigger actions based on found text. Start by configuring the system to ignore any log entries that are known to be friendly and show you everything. Then slowly eliminate each friendly entry one at a time. What will be left is a list of purely evil enteries :). Next configure swatch to alert you upon recieving such messages! Of course you can always use perl or even grep -v to parse logs, but for repeated use I think a specialised tool would save you some trouble in the long run.

    Now I know I could go on forever with suggestions, but I think that these few things should give anyone a kick in the right direction. I hope this has been helpful.