2.4 vs 2.6 Linux Kernel Shootout
FyRE666 writes "Infoworld are currently running an interesting comparison of the 2.4 series kernel against the new 2.6 release on Xeon, Opteron and Itanium CPUs with some surprising benchmark results for common server-related tasks. Basically the new scheduler helps the 2.6 kernel to cream the old 2.4: Samba tests showing up to 73% speed increases, MySQL showing up to 29% and Apache serving dynamic content up to 47% faster!"
tried to get this in before you posted it... but dynamic only went up 22% for apache.... static went up 47%
...a stunning 129% increase on SPEClawsuit!
Sheesh, evil *and* a jerk. -- Jade
But how much of an improvement does it get on older hardware and/or software packages?
Sorry, my karma just ran over your dogma.
Okay, who's been feeding 2.6 speed?
Giving IE users a taste of their own medicine since 2005 - http://pods.-is-a-geek.net/
I was wondering about upgrading to 2.6 from 2.4 with XFS on my box, with the improvements to SCSI support and the CPU speed ups it sounds promising :D
Then again BSD is very nice on the same hardware. Wonder how 2.6 linux & (free)BSD compare for those tasks.
These are impressive improvements.
Its actuallly hard to believe that there is that much more improvement to be gained - it will leave the microsoft servers even further behind as I don't think that they are improving their kernel that fast.
One question:
Does this mean that we can see improvements in low end systems for desktop use, or is the benefit only for servers. Because if this helps low end machines, it extends further the number of machines that can move from (say) win 98 to a real OS, whose hardware has long been abandoned by microsoft.
Michael
There is no cryptographic solution to the problem where the intended receiver and the attacker are the same entity.
What I'd like to see is Linux that could run entirely within cache on the higher end chips. Even dated UltraSparcII chips can have up to 8M/cache. That's 64M in an 8-way box, allowing for some truly awe-inspiring performance on mathematical problems if RAM is ignored.
I haven't looked into sparc assembly enough to know if this is possible.
You can't judge a book by the way it wears its hair.
Slackware with Dropline, btw. I do notice that Java tends to take up 250MB of RAM every once in a while while running Firebird. I didn't have that problem with 2.x.x.
Those benchmarks are nice, but who runs kernel 2.6 on production servers that need every speed they can get? It will be a few more 2.6.x releases until I consider running one of my servers with a 2.6 kernel.
How does 2.6 compare to Free or Open BSD & how do they compare to windows 2003 server doing the same job?
The chart on the first page says that 2.6 supports read and write for NTFS. Is this really the case? Does anyone trust NTFS writing if it's in the kernel?
Computers are useless. They can only give you answers.
-- Pablo Picasso
It's not Linux 2.6.x, it's SCO/Linux 2.6.1.
..is the parformance of the Opteron. Looks like Linux 2.6.x and Opteron are a great combo. Okay, I admit, I was a bit skeptical regarding Linux 2.6, but it seems it might actually deliver.
I'm looking forward for Solaris + Opteron servers. Should be another interesting combo, performance wise. For one, Solaris 9 has some fantastic scheduling for multiprocessor machines. Additionally, it has been implemented in 64 bit for many years.
Sigged!
Wow, you need to quit bitching. 2.6 will be in the distros 'when they're ready', do you remember all the really broken 2.4.x stuff? It was REALLY bad press for folks who COULDN'T UNMOUNT DRIVES safely.
Let the ubernerds self-build 2.6 systems for a while and work out more bugs. If you want it you can have it, but mass-distribution before we even hit 2.6.2 might be a BIG mistake.
"Sometimes, I think Trent just needs a cup of hot chocolate and a blankie." -Tori Amos on Nine Inch Nails
So if I use the new and improved herbal 2.6 kernel my processing power will be UP TO 150% BIGGER and my UPTIME will be 200% LONGER!! ;-)
And it's only $699 a box!
Pain is merely failure leaving the body
Debian/Unstable can install 2.6.0 a regular apt-get install at this very moment. Its just something like:
apt-get install kernel-image-2.6.0-1-processor type
If you're running stable, you shouldn't be running a 2.6 kernel anyway.
I guess it's important to ask the following question: was 2.4 ever designed to run on those kinds of processors? I mean, the O(1) scheduler is a pretty cool, processor independant change; but was 2.6 designed with specific optimizations for newer processors (and newer instructions) in mind? I'd be interested to see benchmarks from old hardware -- i.e., stuff like I've got sitting around. (If only I had a bit more time. Maybe I can borrow some cycles from 2.6 Linux boxen.)
Actually, it wouldn't suprise me if this is correct. If you notice, he was reading the 500MB file while a continuous streaming write was going on in the background. On 2.4.x, a write streamout will kill read performance drastically. Mostly due to the way the I/O scheduler schedules the read. Which, most of the time, is to stash it at the end of the writes.
The two new I/O schedulers in 2.6.x help to resolve this. For more info, check here.
OS X is far better than either "kernel". With OS X you get a better GUI, more apps, and an OS that is backed up by a fantastic corporation, rather than a bunch of hackers who have dubious backgrounds and sketchy credentials.
You aren't comparing like with like. I have windows, linux and OSX running on different laptops at home (ok, I have a problem with needing toys, but at least I have insight).
OSX is very nice - but you don't buy it for speed. In fact, the sort of people who buy it often gloat at how you don't need to worry about that sort of thing with a Mac. I don't doubt that for many windows users, they would be much better off with a mac, as they are pretty clueless, and Mac's are a very nice implementation of the BSD core.
However, this isn't what this post is about. It could be argued that any server that runs a GUI is wasting resources. It depends on what you are asking your server to do.
There are clear improvements in the 2.6 kernel, especially with regard to Disk access from what I can see in the article.
This is totally different to which OS provides the better GUI. In any case, OSX doesn't run on a vast amount of hardware out there, and your attitude is that all that intel stuff is only good for landfill. If you accept that there is alot of hardware out there that will NEVER run OSX, then you should also accept that for those people, its very useful to know if 2.6 is a better performer.
Michael
There is no cryptographic solution to the problem where the intended receiver and the attacker are the same entity.
These are some pretty encouraging results. The hard work put in by all the kernel developers has obviously paid off in a big way. However, after reading the article I still have a few questions about kernel 2.6 performance, namely filesystem performance. Rapid random read/write access is obviously highly critical for enterprise type applications, such as apt-get package management and package database updates. Basically with the 2.4.x series of kernels, filesystem performance using either the ext2 or ext3 schemes could drop to below 5 apt-get package installs per second, even on large SMP/RAID systems. I have been investigating the use of raw disk I/O (similar to that used for high performance table spaces in products like Oracle and DB2) to reach my target of 100 apt-get package installations per second on commodity level hardware, via custom kernel level ATA and SCSI chipset drivers. But I'd love to hear that FS speeds have been improved in the 2.6 kernel. Has anybody benchmarked this aspect of the new kernel? And if so, when could we expect to see Debian start shipping with the 2.6 kernel? I look forward to reading the community's response.
for those who dont know, you've been able to get a back port of 2.6 on woody for the last month (almost).
:)
so go get it, and tell me how it will effect my surfing, emailing, mp3ing and general userish behavour on my P2 400 128RAM...
Go on, get to it!
Giving IE users a taste of their own medicine since 2005 - http://pods.-is-a-geek.net/
So it's not such a big leap for real users. Mind you, still a big improvement - especially for interactive use, and also considering that there are so many patches for 2.4 that are now integrated into 2.6, lessening compatibility worries (try patching Red Hat's pre-FC1 2.4 kernel source).
Michel
Fedora Project Contribut
I can't wait until the year 2007 when 2.6 finally moves to Debian stable.
on low end hardware at least. I've got an old Dell with a p200 and 64 megs of ram running Slackware 9.1. The processor could keep up but there's just not enough ram, even running a lightweight window manager like blackbox or XFCE. I'm not exactly trying to run uber-apps here (Abiword and Firebird mostly). Switching to 2.6 from 2.4 helped some, but not nearly enough. Funny thing is, I ran RH 6.2 on simularily configured I guess it bugs me because I was looking forward to showing my friends how I've got a modern desktop and applications running on an old P200. hardware. When did Linux become such a memeory hog? And to think I laughed when I saw Lindows' min sys requirements where a PIII 800.
Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
I am what most people would consider a highly trained technical professional. Unlike most people who spout off at this site, I have the certificates to prove this, and furthermore they're issued by the biggest software company in existence.
I know how to tell facts from marketing fluff. Now, here are the facts as they're found by SEVERAL INDEPENDENT RESEARCH INSTITUTES:
Expenses for file-server workloads under Windows, compared to LinuxOS:
They compared Microsofts IIS to the Linux 7.0 webserver. For Windows, the cost was only:
Application development and support costs for Windows compared to an opensores solution like J2EE:
A full Windows installation, compared to installing Linux, on an Enterprise Server boxen:
Compared to the best known opensores webserver "Red Hat", Microsoft IIS:
These are hard numbers and 100% FACTS! There are several more where these came from.
Who do you think we professionals trust more?
Reliable companies with tried and tested products, or that bedroom coder Thorwalds who publicly admits that he is in fact A HACKER???
--
Copyright (c) 2004 Mike Bouma, MCSE, MCDST, MS Office Specialist
Permission is granted to copy, distribute and/or modify this document
under the terms of the GNU Free Documentation License, Version 1.2
or any later version published by the Free Software Foundation;
with no Invariant Sections, no Front-Cover Texts, and no Back-Cover
Texts. A copy of the license is included in the section entitled "GNU
Free Documentation License".
Actually the OS X kernel is about half as fast in lmbench (UNIX benchmark) as Linux 2.4. The OS X kernel is really antiquated. Much of it is 4.4BSD and Mach code. The GUI is modern, but the guts are ancient.
A deep unwavering belief is a sure sign you're missing something...
Maybe one of them, maybe both...
1) The new kernel is really very good.
2) The old kernel is really very bad.
Really, if such huge increase was possible, there must have been a lot of room for it. If you face a really well written program, you have a hard time to speed it up by 5%. If you can speed it up by 50% without loss in other domains, it must have been seriously flawed.
Yeah, mod me flamebait. But first think if I'm really wrong.
45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2
Yesterday I started a new Gentoo install with the 2.6.1 kernel. I used GCC 3.3.2 and glibc 2.3.2 with NPTL support. I have to admit, the naked eye can see a major diferance with the new kernel. With my XP computer and the new gentoo install (exact same computers .. P4 512MB) I ran a simple boot up and lanch a web browser test. And supprise supprise, Gnome is screamming fast. I had already booted and opened up mozilla 1.6 befor xp was even done booting! Also, simple stuff like opening up email, browsing, etc. is all noticable faster than XP. Soo... before I get slammed by the XP folks.. my XP box was also a clean install. (yes, I have no life!) I am happy to say I am one step closer to completely weening myself off of windows XP.
Raw c&p, please forgive random spam.
/dev/sda3 has a major number of 8, since it's a SCSI device, and a minor number of 3.) On servers with a large number of real or virtual devices, device allocation can become problematic. The v2.6 kernel addresses these issues in a big way, moving to 4,096 major devices with more than one million subdevices per
Linux v2.6 scales the enterprise
Bigger, stronger kernel sizzles in our performance tests
By Paul Venezia January 30, 2004
If commercial Unix vendors weren't already worried about Linux, they should be now. Linux has seen wide deployment in datacenters, generally as a Web server or a file server, or to handle network tasks such as DNS and DHCP, but not as a platform for running mission-critical enterprise applications. Solaris, AIX, or HP/UX typically get the nod when an application demands the highest levels of performance and scalability. The recent release of a new Linux kernel, v2.6, promises to change that.
ADVERTISEMENT
DOWNLOAD PDF
Click here to download the InfoWorld Special Report on the 25 most influential CTO's of 2003.
Brought to you by Qualys
DOWNLOAD PDF
Click here to download InfoWorld's special report Linux looms large
RELATED LINKS
Compiling the v2.6 kernel
How the Linux kernel gets built - Infoworld Staff
Platforms RSS feed
>> MORE
IDG ENTERPRISE NETWORK
Sun preps second version of Java desktop (ComputerWorld)
Draft EC ruling finds Microsoft guilty in antitrust case (ComputerWorld)
EC circulating final draft of antitrust ruling in Microsoft case (ComputerWorld)
TOP STORIES
Oracle to cut price on lower-end database
Oracle's U.S. midmarket apps bundle delayed
PeopleSoft pushes forward meeting for board vote
Top News RSS feed
>> MORE
TOP SITE REFERRALS
Microsoft: change to IE will block some Web URLs.
(Secure IT)
Changes in IE's URL handling
(Information Management Weblog)
SIGN UP FOR THE MAGAZINE
FREE EMAIL NEWSLETTERS
IT SOLUTION SEARCH
The v2.6 kernel ushers in a new era of support for big iron with big workloads, opening the door for Linux to handle the most demanding tasks that are currently handled by Solaris, AIX, or HP/UX. The new kernel not only supports greater amounts of RAM and a higher processor count, but the core of device management has changed. Previous to this kernel there were limits within the kernel that could constrain large systems, such as a 65,536 process limit before rollover, and 256 devices per chain. The v2.6 kernel moves well beyond these limitations, and it includes support for some of the largest server architectures around.
Will the new Linux really perform in the same league as the big boys? To find out, I put the v2.6.0 kernel through several real-world performance tests, comparing its file server, database server, and Web server performance with a recent v2.4 series kernel, v2.4.23.
Linux Meets Big Iron
A primary focus of the v2.6 kernel is large server architectures. Support for up to 64GB RAM in paged mode, the ability to address file systems larger than 2TB, and support for 64 CPUs in x86-based SMP systems brings this kernel and Linux into the more rarified air of truly mission-critical systems. The included support for NUMA (Non-Uniform Memory Access) systems; a next-generation SMP architecture; and PAE (Physical Address Extensions), providing support for up to 64GB of RAM on 32-bit systems, is also new.
There is much more to v2.6 than just bigger numbers in processor and RAM counts, however. This kernel breaks apart some of the artificial limitations that have been present in Linux from the beginning, such as the number of addressable devices and total available PIDs (Processor Identifiers). The v2.4 kernel supported 255 major devices with 255 minor numbers. (For example, a volume on a SCSI disk located at
Won't be a long wait; 2.6.2-rc3 is out now.
FC2 test1 should be out next week with a post-2.6.1 kernel as default. With SELinux to boot, though it's recommended to disable it at boot time for test1. Mandrake 10.0 beta1 has 2.6.1 too.
Michel
Fedora Project Contribut
2.4 is the old and busted
2.6 is the new hotness
The GeekNights podcast is going strong. Listen!
Oh yeah? Well, you're locking yourself into commodity hardware and a cycle of free software upgrades!
Hmm... that comeback doesn't seem as potent as I thought it would be. Oh, wait, I know! You're locking yourself into an eternity of vigilance.
Garg
Garg
Alumnus, Xavier's School for Gifted Youngsters
Maybe they were in the process of switching to 2.6.
In Soviet America the banks rob you!
The comparisons won't make much real-world sense until the evaluation is done using Intel's compiler for the Itanium tests. The GNU compiler is just not up to snuff at optimizing for Itanium's EPIC instruction set.
I would like to see Intel contribute Itanium optimizations to GNU, but I doubt this will happen since they sell a competing product.
the growth in cynicism and rebellion has not been without cause
THIS IS NOT AN INVITATION TO A FLAME WAR.
Does anyone have factual comparisons of a reasonably-tweaked Linux (2.6 kernel) with a reasonably-tweaked [x]BSD (whatever kernel)?
--
Don't like it? Respond with words, not karma.
I wonder what the response would be if someone posted similar numbers about Microsoft's next OS. I'm sure they'd find creative ways to diminish the results.
One thing I've learned is not to take tech writers too seriously. Most of them are writers for a reason.
-- You see, there would be these conclusions that you could jump to
AFAIK there arn't even any hard drives in existance that can actually pull data off their platters that fast. Unless this was a RAID setup something is wrong with the test.
i dont know if it's been posted already but check this. Aint no joke mister.
Therefore I assume #1 is much more likely than #2.
It would seem as though the 2.4 focussed on getting a number of feature in the kernel while the 2.6 series allowed the developers to work towards making those new feature faster. Programming a new feature from scratch while also aiming to optimize it for speed can often lead to buggy code. Optimized code is rarely as straightforward and easy to debug as a more general (but slower) algorithm. When it comes to something as important as a kernel I'd much rather have clean, clear code which can later be optimized than a confusing kludge meant to squeeze out the last little bit of processing power.
Just my humble opinion
It may be faster, it may be smoother, but I bet it still won't be able to handle the full power of the terrible hordes of slashdotters.
-
Roses are #FF0000, Violets are #0000FF, find / -name '*base*' |xargs chown -R us && mv zig greatjustice
Does anyone know the Linux system requirements for 2.6? I.e. what gcc, libc, etc. are required to run it?
I'd rather be a conservative nutjob than a liberal with no nuts and no job.
ftp ://ftp.dc.aleron.net/pub/linux/fedora/linux/core/d evelopment
C|N>K
The hardware specifications weren't very complete, but from what I can see from IBM's x335 configuration they were using the no-L3 cache Xeons. A 3.2GHz Xeon with 1MB of L3 cache could easily boost the performance 10-20% over a 3.06GHz Xeon with no L3. Of course, the Opteron could still end up leading in a lot of the tests. What's more, the Opteron seems to really come into it's own in 4-processor configurations, where the Xeon scales poorly. In short, the Opteron is a heck of a good chip.
Where this really looks bad for Intel though is with their Itanium systems. Assuming that those 1.5GHz I2 processors are of the 6MB L3 cache variety, this is Intel's top-end chips. The servers probably won't have the performance of HP or SGI's I2 servers (IBM doesn't care much for the Itanium so they don't invest nearly as much time and effort in the designs as HP or SGI do), the chip still looks pretty weak.
Intel's saving grace here may be that the Itanium line of chips are VERY dependant on a good compiler, and chances are that these applications were compiled with GCC. Using Intel's ICC instead probably would boost performance by a noticeable margin, though a number of applications still won't compile with ICC from what I understand.
How is that informative? The kernel is Mach and modern *BSD, mostly FreeBSD from what I can tell - not ancient 4.4BSD. While in the latest benchmarks I've seen show Linux leading OS X in server benchmarks on the same hardware, the margin is smaller then the 2.4 > 2.6 margin in the above mentioned article. That is to say, OS X hardly sucks. It can easily keep pace, but not yet surpase. Maybe it never will, but to be even close with a Mach-based kernel is quite impressive. The Mac OS X kernel is called Xnu, and its a melding of of BSD and Mach - its no longer a pure micro-kernel and a lot of the weaknesses of Mach are offset by having many important bits, like TCP/IP, in kernel space rather then some floating server. I've seen those lmbench scores before, and the last ones I saw was comparing a rather old release of OS X to Linux. Try Panther, its noticably faster across the board.
I'd like to see how much of -mm ends up in the RH kernels in a year or so. I did try 2.4.20 with the -ck patches; 2.6 still felt better. Dunno if the info helps at all, but figured I'd mention it.
FWIW, 2 machines here:
Dual PPro at 200 MHz, 1Mb caches, 128 megs EDO
Dual P3 Coppermines at 1GHz, 1024 megs PC133.
C|N>K
http://people.redhat.com/arjanv/2.6/readme.txt
Sweet! This was my one pet peeve when using Linux on a production server, such as a tape backup systems.
For every problem there is a solution that is simple, obvious and wrong.
Read the OpenDarwin FAQ: here.
The code is mostly 4.4BSD-Lite2. There is a good thread on OSNews about OS X that goes into comparing the source code, and it supports the idea that, while there are many changes, most parts of the BSD subsystem is still plain 4.4BSD-Lite2 code.
A deep unwavering belief is a sure sign you're missing something...
I may be the only one to feel this way... but haven't the completely unrelated SCO jokes gotten a little old? They are completely offtopic 99% of the time and most of them are just "Where do I send my 699 dollars".
I'd love to browse around sources without having to download a tarball using only my web browser.
That is possible. The best place I know is The Linux Cross-Reference.
Do you care about the security of your wireless mouse?
This is what the 2.4. kernel had to say about this:
Bang bang it shot me down
Bang bang I hit the ground
Bang bang that awful sound
Bang bang my brother shot me down
I was 2.4 and he was 2.6
We rode on horses made of sticks
He wore black and I wore white
He could always win the fight
...
Yeah, I know it's pretty crappy, but it's past my bedtime and I'm tired ^_^
My other UID is 1337
I am using a P4 hyperthread processor. Back in the 2.4.x days /proc/cpuinfo showed me two processors.
Now it shows me only one!
Where is the lost one? Linus, give it me back! Maybe this is the reason his mozilla is faster now?
Anyway, the PCs seems as fast as before, that means that the 2.6.x kernel is able to gain a 100% performance with only one processor ? :)
M.
In fact, some of the more server-oriented developers were so content with the stability of 2.5 early on that they started making mild pushes towards a 2.6.0 release almost a year ago.