Slashdot Mirror
Putting Linux Reliability to the Test
Frank writes "This paper documents the test results and analysis of the Linux kernel and other core OS components, including everything from libraries and device drivers to file systems and networking, all under some fairly adverse conditions, and over lengthy durations. The IBM Linux Technology Center has just finished this comprehensive testing over a period of more than three months and shares the results of their LTP (Linux Test Project) testing."
You want to put any OS to the ultimate test, you should run cheap generic hardware. I swear it's an industry conspiracy that generic parts struggle a boat load. If your parts don't come from the big boys (DELL, gateway, etc), you are likely going to see issues down the line.
Get some ECS motherboard, generic RAM... bang. You're in for the evening.
Why do you trust IBM's Linux Technology Center to evaluate Linux?
This is nice to hear, but it would be even more valuable if the same tests were performed on a variety of operating systems in order to compare the results.
Brian
My Company
This is based on a quick scan of the paper.
Because this test appears to be a fully documented test. It doesn't appear to be a test rigged to make one platform look better than the other.
Why shoudn't we trust this test?
Because what would they have to gain by lying? The true power of opensource is that when someone does point out the weaknesses, they are fixed quickly. IBM knows that if they tell the opensource world "Hey, LINUX is pretty good but it kinda struggles in the (foo) area." that the opensource community will redouble their efforts to fix that. Microsoft is only trying to say "Windows rules, Linux sux. See, this evaluation we did proves it. Buy windows"
Second off, If this were M$ testing 2k3 and publishing the paper, everyone here would be crying foul. But because its, "Linux" it must be 100% unbais and true.
I've been using Linux for 8 years now including under high stress enviroments, 3d graphics rendering mainly, and from experiance I have see very good things from Linux. We have had software glitches before, but the core software maybe has caused 3 - 5% of our downtime. Over 70% of our downtime involves human error and about 25% of failures are due to hardware giving out.
Still what my customers are wanting to see isn't benchmarks as "So easy Grandma could use it" in Linux. While the people in the datacenters want to know how well Linux will bear under a load, most end-users and SMB's don't need to worry about it, they just need something easy to use that works.
"The problem with socialism is eventually you run out of other people's money" - Thatcher.
They have much to gain: more corporate customers and more respect and funding by greater IBM. Just because IBM supports Linux doesn't mean its motives are pure (not financially driven). Another reason for bias is the division also stood to have huge setbacks if the tests were unfavorable. How could they justify expansion and better funding if their previous statements about Linux being enterprise-ready were unfounded?
I am pretty sure that kernel 2.6 can't be considered "enterprise ready", for one, it hasn't gone through that level of testing.
Don't knock "yesterday's news". Far be it from some geeks to understand this, but there are times that "tried and true" is more important than having the latest and greatest. This testing started well before 2.6.0 was released! They can probably get started wit 2.6 as soon as an enterprise Linux distribution incorporates it.
The full hardware/software details of the test are there. If you don't trust it, you have the ability to rerun the tests yourself.
So, ya reply to one point but ignore the rest? I think his (ultimate) point is valid. If the test was rigged, the folks involved with developing the kernel would catch on and take IBM to task for fudging the results. No, I'm not talking about the Slashdot/Fark crowd. I'm talking about REAL developers.
Also, Linux has weathered some unfavorable (and honost!) critiques before. Linus Torvalds said it best when he said (and I paraphrase since I am too lazy ATM to look up the actual quote) that it doesn't matter if there's negative publicity in the press about Linux. It just meant he got his bug reports from the Wall Street Journal as opposed to the regular kernel mailng list.
--- Journals are boring; Go to my web page instead
I think IBM used SuSE instead of Redhat because IBM Global Services and SuSE have been partners for almost two years.
Maybe you should stop hmmmmm'ing about these great mysteries and start googling.
Beware blue cats moving at
Hardware fails in random patterns (bits flipped by beta radiation, for example), software fails the same way in controlled instances (the same flawed logic fails the same way each time).
So when you run a test 5 times, and you get 5 results, the hardware is broken. When you run the same test 5 times, and it gets to the exact same point before sig11ing, you have a software flaw.
This is also why you do multiple tests to ensure you're getting an accurate picture of what's going on (flawed or not).
--
Internet Explorer (n): Another bug -- that is, a feature that can't be turned off -- in Windows.
I think it's more human than that. If a company or group releases results completely against their interests, integrity is the only reason such a group would go forward. Why would anyone skew results to spite themselves?
I think the moderators can decide for themselves what they find good or bad. :)
Thank you though for assuming you know how everyone else in the world feels
specifically because you'll now trust their future results?
"wow, last year, they had to admit their product just wasn't up to the task. but now, dang, look at 'em go!"
yes, it's quite human indeed. you don't know what all they're up to -- what seems to be self-defeating isn't always. and sometimes, well, you honestly find out that you're doing the job you had hoped you were doing, trouncing the competition. go figure: you might actually manage to not suck! but you don't get to tell anyone? and your only solution is to pay someone else to announce it? oh, wait, that's not allowed either!
any publicity is good publicity. if you can't get good publicity by announcing your product is good, just say it isn't. close enough. it's not like anyone pays attention anyway.
Before you roll something out into production, you hammer on it for a while. The crappy parts will fail or generate errors and you can have them replaced.
In my experience, most of the no-moving-parts hardware will fail within the first week, or last for years and years.
The stuff with moving parts will eventually fail. But that's harder to predict.
FTA
The tests demonstrate that the Linux system is reliable and stable over long durations and can provide a robust, enterprise-level environment.
Ok, now i dont mean to troll here, so mod down if you wish, i really dont care.... BUT...
I am a linux user/programmer/lover for the past few years now, and i wanna see a company that is not SO IN LOVE with linux say what have just been said by IBM above.
In other words, i dont want to see companies who sell Linux, or who have benefit in selling Linux praise it. Does any one of you know of someone who fills in these criteria. Sun for one is not very fond of Linux, nor is MS ofcorse (despite the fact sometimes i doubt they have code in their stuff from Linux...)...to make a long story short
It would be really nice if such a judgment came from someone else besides IBM/REDHAT/ORACLE...
The lunatic is in my head
"The Linux kernel properly scaled to use hardware resources (CPU, memory, disk) on SMP systems."
Sorry, but how can the scaleability of the CPU resource be proven on a 2 CPU system? Show incremental results on 1, 2, 4, 8, 16, 32 etc. etc. and then CPU scaleability may be proven.
This is NOT an anti-Linux troll, rather the evaluation needs to justify it's outcomes or it starts to look like something from a company starting with M.
Espically for thigns like this. If a company isn't the one performing the research, chances are they are bankrolling the company that is. This means that generally thigns will be stacked in the favour, and unfavourable results will often be suppressed.
Even true independants are often not unbiased. For example some individual, with no teis to and OS developers or vendor, might decide to test OSes. Of course it might be that they are a huge Linux or Mac or Windows zealot so again stack things in their favour. You see this fairly frequently with independent Mac test sites. They are MAc heads that work to make thigns look good for the Mac.
YOu see this in research too. I can't count the number of times I've seen articles, in respected journals, where the researchers have glossed over or ignored something that could contest or invalidiate their findings. They want their hypothesis to be true and so are prone to look at the data that supports it.
So when you deal with something involving money, you are just going to see some biased results. In scientific research, you generally get other labs testing findings, so the truth is eventually revealed, despite biases. However in bussiness, espically something with quick life cycles like software, forget about it. All tests are going to be biased. Read the results and take them for what they are worth, don't use them ot generalize. Do your own testa, and use what works best for you.
All that this shows is that a Linux based system works in the way that it should. Would you expect anything else if you ran your: TV, central heating, ... for a long period ?
The trouble is that, after a period of increased stability in the 1980's, in the last decade people have come to expect that computers fail, and they wonder with amasement if they don't.
OK: 30 years ago I remember it being a good day if the mainframe stayed up 12 hours. But things have moved on, today you expect your: MVS, VMS, Unix, Linux machine to stay working. The only OS vendor who's products have not matured is the one in Redmond - largely because of rampant infestation with new features.
The above is not intended to belittle the fantastic efforts of all those involved.
Are you locked out of your virtual consoles too? Are you running SATA drives? What are your logs saying after the crash?
I'm running Suse 9 also, and X has only hung on me once(some other apps hang occasionally, but I'm still able to kill them). The only time it hung, I was still able to switch to a VC and restart the Xserver without a reboot.
I use the system as my main devel machine, so it gets about 4+ hours of heavy use a day. My latest uptime is over 3 weeks...
Also, are you running a stock kernel? Recompile and strip things out. I highly recommend people recompile any kernel from any distro before using it regularly. It's just a good idea...
but with package and dependency madness.
I couldn't tell you the number of times I tried to install something and it fails because I was missing "X-Widget-2.41.so.1", so I try to install that "X-Widget-2.41" package and the "X-Widget-2.41-devel" package and they fail because they are missing several other depends as well.
Linux stability is fine. The GNU software stability is fine. We need a better way to install and maintain software.
LK
"Hi. This is my friend, Jack Shit, and you don't know him." - Lord Kano
MS is running ads saying how windows XP is so reliable. It is kinda hard to believe when you hear the ad because you a getting a cup of coffee waiting for XP to reboot. Same with 2k3. It crashes. Not as often as XP same as XP doesn't crash as often as 98 and so on. But it still crashes.
Now on to my linux machines. Wich don't crash. I only run in total about a dozen of them and not one of them has crashed.
I also have had some experience with AIX. Typically on machines everybody had forgotten about that ran some app that everyone just used and they only noticed its importance when someone unplugs an old useless cable.
So from my daily experience I will find any report coming from MS saying that they are reliable suspect. From my experience with AIX and Linux I will be far more willing to believe a report from IBM about reliabilty because THEY HAVEN'T BEEN TELLING ME TO MANY LIES BEFORE.
You of course may have different experiences. Linux if nothing else seems capable of generating wildly conflicting emotions in people. So does MS software come to think of it. Funny that we can get so worked up over a collection of bits.
MMO Quests are like orgasms:
You may solo them, I prefer them in a group.
Two of the three authors were women. Time for a new Barbie doll: "Linux is fun!"