Slashdot Mirror
2.5.65 On 32-way NUMA-Q with Preempt Enabled
_iris writes "I think the subject speaks for itself. Here is the link to the story on KernelTrap." In case you have a spare 32-processor machine munching grass in the back 40.
← Back to Stories (view on slashdot.org)
Here is the complete article, the fscking lameness filter made it quite a struggle to get it posted here. Anyway:
;)
;)
;)
Zwane Mwaikambo announced today on the lkml that he's successfully boot the 2.5.65 development kernel on a 32-way NUMA-Q server with -preempt enabled. Speaking to Robert Love [interview], the kernel preemption maintainer, he began his announcement saying, "Robert, I suppose you can add another notch on your erm.. bedpost(?) and congratulations to all the kernel developers!" NUMA awareness in the scheduler was added into the development kernel in late January [story].
William Lee Irwin III [interview] explained the significance of this achievement:
"This has had a hard time historically. I'm really glad NUMA-Q's are now immune (in the sense of correctness) to this config; previously it was believed that preemption points in printk(linux_banner) would take out the machine early in boot if preemption was enabled. Congratulations rml! If you're booting without issues on these things, you are a _very_ long way toward being race-free. This is incredibly good news, both for the preemption support, and for the general stability of the i386 bootstrap."
Read on for the full thread.
From: Zwane Mwaikambo
Subject: 2.5.65-preempt booting on 32way NUMAQ
Date: Sun, 6 Apr 2003 06:48:33 -0400 (EDT)
Robert i suppose you can add another notch on your erm.. bedpost(?) and congratulations to all the kernel developers! It survived some local networking stress tests, but there is more fun stuff like tty layer to completely obliterate
(Hardware courtesy of OSDL)
Running configuration
32 Processors, PIII 500
32G RAM
Patches required:
2.5.65 (only because isp1020 decided to get huffy)
Purge assign_irq_vector panic - Zwane Mwaikambo
[boot messages]
From: Robert Love
Subject: Re: 2.5.65-preempt booting on 32way NUMAQ
Date: 06 Apr 2003 14:28:42 -0400
On Sun, 2003-04-06 at 06:48, Zwane Mwaikambo wrote:
> Robert i suppose you can add another notch on our erm.. bedpost(?)
> and congratulations to all the kernel developers! It survived some
> local networking stress tests, but there is more fun stuff like tty
> layer to completely obliterate
Excellent, Zwane.
Congratulations! Good work.
Robert Love
From: William Lee Irwin III
Subject: Re: 2.5.65-preempt booting on 32way NUMAQ
Date: Sun, 6 Apr 2003 04:23:40 -0700
On Sun, Apr 06, 2003 at 06:48:33AM -0400, Zwane Mwaikambo wrote:
> Robert i suppose you can add another notch on our erm.. bedpost(?)
> and congratulations to all the kernel developers! It survived some
> local networking stress tests, but there is more fun stuff like tty
> layer to completely obliterate
Wow!
This has had a hard time historically. I'm really glad NUMA-Q's are now immune (in the sense of correctness) to this config; previously it was
believed that preemption points in printk(linux_banner) would take out the machine early in boot if preemption was enabled.
Congratulations rml!
If you're booting without issues on these things, you are a _very_ long way toward being race-free. This is incredibly good news, both for the preemption support, and for the general stability of the i386 bootstrap.
All that's really left is driver and non-i386 arch coverage if I'm right.
-- wli
From: Zwane Mwaikambo
Subject: Re: 2.5.65-preempt booting on 32way NUMAQ
Date: Sun, 6 Apr 2003 07:25:09 -0400 (EDT)
On Sun, 6 Apr 2003, William Lee Irwin III wrote:
> This has had a hard time historically. I'm really glad NUMA-Q's are now
> immune (in the sense of correctness) to this config; previously it was
> believed that preemption points in printk(linux_banner) would take out
> the machine early in boot if preemption was enabled.
Which kernel version was that from
Microsoft just set the #2 TPC-C result in the non-clustered category using Windows Server 2003 and a 32-way Itanium 2 machine. They did this, of course, because Oracle publicly derides clustered results as not counting (and really setting up horizontally partitioned views across a huge federation of serves is not the easiest thing, and it's far from transparent for the database developer: You have to specifically design around it), so now there's a SQL Server 2000 result higher than any Oracle result.
So there you have it: A 32-way machine that's actually useful (when available on 2003-06-30).
Preemt means preemtive in kernel space, you are talking about userspace. kerneltrap has an interview IIRC with Robert Love where the ins and outs are explained, if not, try google.
Taco's Law: any story about massive scalability will be posted on a web server which craps out due to 'too many connections'.
Anyone got a mirror?
-- Ed Avis ed@membled.com
http://www.kerneltrap.org/node.php?id=628
Have fun!
Daxy's Networking Blog
Yup, Linux, so up to date it's just beginning to suport hardware that hasn't been built for 2 years
The point is that 2.5.65 booted with preemtion patches on a 32 processor machine
That is preemtion of kernel threads. If there is a deadlock or race condition it would be more likely to show up un a beast like that than in your average dual athlon. So this is really not about supporting 32 processors (which is old news) but about the quality of the work that has gone into kernel preemtion
I have no idea if any other OSes out there support preemtion of kernel threads running on multiple cpus. Anyone care to enlighten me?
- We are the slashdot. Resistance is futile. Prepare to be moderated -
Is that occasionally there are headlines like this that I can read, re-read, and still have no clue what the article's actually about. I don't know what ANY of that stuff means.