Linux Gains Support for NUMA
soosterh writes "CNet has an article about a NUMA patch from IBM. It says that the improvement adds some support in Linux for nonuniform memory access, or NUMA, a design for higher-end servers with many processors. Linus Torvalds, the original creator of the operating system and still its top authority, accepted the update this month into version 2.5, the current test version of the software."
I thought that I'd seen some other NUMA stuff in previous runs of 'make menuconfig'-- Can anyone explain what's already there and what this patch adds?
get 0wned. irc.w30wnzj00.com
first post, doubt it
Will this help with both 32 bit and 64 bit desktop platforms? It seems that in the future there won't be much distiction between the current server machines and desktops...
Seriously, this is something that will close one of the last remaining gaps between Linux and Solaris. Not that it will do much good for 99% of users out there, but if you need this, you *really* need it.
And, of course, also support for the Hammer architecture, which is (smaller scale) NUMA. Each processor in an x86-64 system has its own memory bus, so time to access memory depends on whether the memory is directly connected to a given processor, or whether another processor needs to mediate, the definition of NUMA.
I've had this sig for three days.
There's been a lot of talk about NUMA on Slashdot every now and then. I don't fear to say that I believe the majority of Slashdot readers don't have a clue about NUMA. ..And that's me included. What exactly is NUMA? Could somebody step forward and explain it clearly. Please.
My humble guess is: NUMeric Arithmetic.
I just heard this on the radio today..
Popular OS Linux was found dead at the age of 15 on computers of internet dweebs worldwide. Prelimary autopsy reports indicate that the cause of death was massive irrelevence and inferiority of the source code. Truly a great loss to the world of insignificant software...
--OK, got a noob ram question then. Does this NUMA allow for upgrading total RAM beyond the original specs? Any sort of add-ons? I ask this from noticing it's used because of the physical distances it can access (among others).
thanks in advance to yon knowledgeable ones
Linux is dead.
Oh crap, not again, "IBM, the saviour" gave us NUMA support. my ass. we'd have support anyway. someone would wrote it even if IBM never helped. and you know what? I'm sick of them. It's so fucking obvious what they are doing. They're trying to convince us how they love us.
But to me, they only sound like 50 year old pederasts that try to seduce little kids.
No just kidding, now if only i can find where i put those Quad XEON HP Netservers, I knew they were here somewhere....
Seriously i would love to have a computer that had massive amounts of processing power and ram, and i would try this shit out.
---
Someone correct me if I'm wrong.
This is a clear explanation of NUMA.
Dirk Pitt is going Linux! Does Clive Cussler know about this?
I WANK OVER IBM'S LINUX SITE
This article says the code was submitted by Martin Bligh, not Dirk Pitt.
Clearly it's a typo. I'll have to e-mail Clive about this.Rot-13 my address to e-mail me.
"So I hurry back to little earth / For another life another birth"
Not only is this beneficial for large computers, but also on smaller SMP systems with hyperthreading. On CPU's with hyperthreading,
it's often faster for a process to reside on the same CPU but not necessary the same 'virtual' CPU when accessing memory.
And alot of 8way+ systems are NUMA whether or not they are advertised as such.
Linux has NUMA support since it runs on the SGI ccNUMA architecture (look for Altix 3000). This is nothing really new now, though!
First of all, this is not a troll even if I criticize Linux (although I'm sure some Linux fanboy will no doubt mod me down).
I wonder why more people are not complaining about the autocratic nature of Linux development. To me it is unconceivable people can be content with one single man running the show with "top authority".
Wouldn't a more democratic system like that used in developing *BSD suit better these times when the soviet communism has collapsed and the remaining undemocratic institutions (Taliban, Cuba soon, ...) are quickly eradicated and replaced by democratic ones?
IBM should do all this work for BSD. Oh, wait.
It already did. AIX is BSD-based. It's a shame all this effort is going into re-inventing the wheel. linux has really set back the state of computing by 10 years and 10 more to come.
Ah... one must just admire the depth of professionalism in the Linux community. Linus only accepted the patch because HE liked it. It really doesn't matter if he liked the code or just the kickbacks he must be receiving from IBM.
And of course feature freeze is not code freeze. How else would you fix the bugs in the code?!
It does not, however, mean that you can bring in a patch of untested code and just lump it in with the rest of it. Only by resorting to really twisted logic could one argue that feature freeze actually allows you to introduce new features!
For chrissake, feature freeze doesn't mean anything anymore if you still can bring in things like new scheduler.
For a great adventure story, read some of Clive's books.
~S
Oh wiat. You mean _that_ NUMA.
[Please type your sig here.]
More information can be found here
more information can be found here
As long as you get whatever the heck you need to get done on whatever O/S or platform, everything after that is fun and games.
~S
Sad News might have heard . . .
.
erm, excuse me comrade, I'll be right back.
*flushes toilet*
okay, now where was I? Oh yes . .
Sad News might have heard YOU!
Now pardon me while I get some clean underwear.
I just heard some sad news on the AP Radio News Network - Eddie Van Halen, legendary guitarist of the rock band "Van Halen", has died at Mt. Siani Hospital in Los Angeles today. The cause was said to be a reoccurance of lung cancer. No other details have been released at this hour. He will surely be missed by all in the music world.
the MIPS/Itanium systems the parent refers to are (I assume) the SGI Origin and Altix multiprocessor servers, both 64bit, the first MIPS/IRIX, the second Itanium/Linux:
Origin
Altix
"we demand rigidly defined areas of doubt and uncertainty!"
Thank you for explaining who Linus Torvalds is.
One thing that still really concerns me with Linux is things like this - should the fact the great man himself (and dont get me wrong - I have heaps of respect for the guy) determine what should or should not be "included" with the kernel?
This thing sounds good (and to be honest I really dont understand the implications of it fully) but doesent this sound a bit like we have an imposed gateway to delivery (no pun intended)? Or single point of failure?
I'm glad soosterh explained who this Linus guy is, I've been wondering about that.
~~~~~ BigLig2? You mean there's another one of me?
GOATSEX!
Linus Torvalds, the original creator of the operating system and still its top authority.
You know Slashdot is going "mainstream" when people have to explain who Linus is.
----- rL
Wow, that guy called Linux changed his name to be just like that computer thing!
SGI must have added NUMA support for their Itanium-based Altix-servers as well. On their web-page it says: "Enhanced Operating System for High-Productivity Computing" [aka Linux] with "High-performance NUMA support".
Anyone ever seen a patch for this?
- jarman
...can be found here.
they are copying Linux related news from CNET.
Gee, when you have to -remind- us of Linus' claim /.er's mind...
to fame, it seems a sign that the History of Linux
must be fading from the modern
I really -doubt- that it has...
"More recently, the NUMA scheduler patch has been reworked (by Martin Bligh, Erich Focht, Michael Hohnbaum, and others) around a simple observation: most of the NUMA problems can be solved by simply restricting the current scheduler's balancing code to processors within a single node. If the rebalancer - which moves processes across CPUs in order to keep them all busy - only balances inside a node, the worst processor imbalances will be addressed without moving processes into a foreign-node slow zone. A simple (three-line) patch which did nothing but add the within-node restriction yielded most of the benefits of the full NUMA scheduler; indeed, it performed better on some benchmarks. Real-world loads, however, will require a scheduler which can distribute processes evenly across nodes. Occasionally it is necessary, even, to move processes to a slower node; a lot of CPU time on a lightly-loaded node will give better performance than waiting in the run queue on a heavily-loaded node. So a bit of complexity had to be added back into the new scheduler to complete the job."
Extracted from:
http://lwn.net/Articles/20741/
hey people, linus torvaalds created only the kernel. the entire O.S. is GNU/Linux, and his top authority it seem to be a guy called Richard Stallman asbesto http://www.freaknet.org
You know Slashdot is going "mainstream" when people have to explain who Linus is.
Or when they have to even use his last name.
My journal has hot
I was waiting for someone to jump all over this...
T
---- It puts the lotion on its skin or else it gets the hose again. It does this whenever it's told.
Or when they claim that Linus created the OS GNU/Linux.
We are everywhere.
Could this mean that IBM will provide a distribution of Linux for their former Sequent boxes, and we can dump MP-RAS?
Sort some snow? Eat ice cream too fast? At any rate, you've experienced BRAIN FREEZE.
Why bother.
IBM not replacing AIX with Linxu? Yea rigth we really believe that type of FUD...:)
Don't Tread on OpenSource
Once again we see evidence that the Linux
community just can't hack it and make it
without feeding off of the proprietary
companies that it so despises. What
hypocrisy. If your development model
and community are so wonderful why do
you accept handouts from proprietary
companies? Why don't you put your money
where your mouth is and take a community
position that no contributions will be
accepted from proprietary companies?
Kent
Richard Stallman has sent an angry e-mail demanding a name change to GNUMA.
You can only drink 30 or 40 glasses of beer a day, no matter how rich you are.
-- Colonel Adolphus Busch
Sorry if this seems rude, but it sounds like someone crying 'sour grapes.' Do a little research and you can easily find news group discussions about the profiteer who wanted to charge people to use the name Linux. The parent post is correct about your opportunity to fork a better implementation. It's a good thing my moderation points elapsed. I would have been looking for a crybaby option ;-)
I think it's becoming more obvious that articles (sorry, links to articles) about Linux aren't really crash hot news worth material.
--
There is no hatred more pure and true than that expressed by children.
You know Slashdot is going "mainstream" when people have to explain who Linus is.
Actually, I saw that and just assumed that the submission was written by a journalist at CNet. The submission uses the same structure and idiom that journalists tend to use.
On that note, does one also need a hyperthreading mobo? I've searched, but after reading several linux kernel archives that google pointed me to, I'm still not sure whether my lowly 1.8 GHz P4 can hyperthread.
make world, not war
Contrary to what is said in the post, NUMA support has been in Linux for quite a while already. The recent patches accepted by Linus merely add NUMA awareness to the scheduler, which, while certainly being a prerequisite for Linux being used on production NUMA boxen, is not at all required for NUMA support in general.
quidquid latine dictum sit altum videtur.
Since when were Dirk Pitt and Al Giordino kernel hackers? I thought they were marine engineers?
I wonder if this isn't some of the technology they snarfed from Sequent? I worked there in the late '80s and they were one of the top Unix technology shops around (or at least we thought so of ourselves at the time).
SGI has also integrated NUMA technology into the linux kernel to support their new Altix servers. How do these two efforts relate? Is SGI's code generic enough that it could also be considered for inclusion in the mainstream kernel? Or is it specific to SGI's NUMA architecture? Is IBM's code generic enough that it would work on an Altix? What functional characteristics distinguish the two?
--Lawrence Lessig for Congress!
...now I can put Linux on that 256-node NUMA cluster sitting in my spare bedroom...
Seriously, though, this is one of the strengths of the GPL and is proof that the Linux kernel can only advance in time as it sucks up more and more features that will never go away (I hope 'refactoring' is in the developers' vocabularies!).
Healthcare article at Kuro5hin
I want to see this in a cluster. If the kernel can understand NUMA then it should be able to handle a cluster over a network, such as gigabit ethernet, IMO. Craylink is only what 800Mbps/full duplex? But, dammit Jim, I'm a Sys Admin, not a programmer.
If it were possible to scale a cluster of PCs easily and keep a single concurrent system image there would be no limits to what we're capable of doing. Encode a video in 30 minutes or less, play the latest games with 2 year old hardware, etc.
Make it so.
Clive Cussler? Dirk Pitt? Linux? What?
Soosterh, when you copy text directly from an article, you're supposed to put it in quotes or but it in italics and set it apart from the rest of the text. Expaining who Linus is on /. is quite unnecessary and just sounds dumb.
It stands for Naked UMA, so the linux kernel now has naked pictures of Uma Thurman.
"Linux could just run on big IBM boxes (bare metal)"
Well, on big IBM boxes Linux run emulated whereas they actually do run on "bare metal" on weenies' x86 machines.
Any word on whether OpenMoxis can utilise this functionality? Now *that* would be useful "for 99% of users out there". Need speed? Just plug in another $500 new box!
The best executive is one who has sense enough to pick good people to do
what he wants done, and self-restraint enough to keep from meddling with
them while they do it.
-- Theodore Roosevelt
- this post brought to you by the Automated Last Post Generator...