Slashdot Mirror
Japan's Newest Linux Supercluster: 13TB RAM
green pizza writes "Following its sale of a 10240 processor cluster to NASA, Silicon Graphics Inc has announced that it's supplying a 2048 processor Altix 3700 Bx2 to the Japan Atomic Energy Research Institute. Aside from running Linux on Itanium2 processors, the beast also features 13 TB of RAM!"
I guess that'll be enough to run Longhorn then.
I remember back in my electronics course when we had to design the flip-flop grid for memory... the teacher said he'd give 100% to anyone that could draw out 64K of memory... 13TB just makes me cringe...
---
Programming is like sex... Make one mistake and support it the rest of your life.
I agree. These rather wasteful supercomputers are getting less and less impressive.
You know what would be impressive? Published results!
I mean they consume gobs of resources [power, material, waste]. That's not impressive. That's an American city block. What would be impressive is having to show for it at the end of the day.
Tom
Someday, I'll have a real sig.
Do all processors share 13TB? Because if they don't the bottleneck is that subprocesses have only 13TB/1024 available ( a mere 13GB each), and still have to communicate a lot.
In theory there is no difference between theory and practice. In practice there is. - Yogi Berra
I hear this is the reccomended base configuration for Windows Longhorn...
it's 13TB, not 3TB. Which is according to the article: "over 13 terabytes of memory - the world's largest memory capacity"
Szo
Red Leader Standing By!
So it says 13TB of RAM... that's a cool 6.5 GB per processor. Beats anything i run :)
The puter will be used for nuclear research (bushspeak: nucjular reesatch) by the Japan Atomic Energy Research Institute. More info about the organisation, their projects, etc. can be found at: http://www.jaeri.go.jp/english/index.cgi.
SIG: TAKE OFF EVERY 'CAPTAIN'!!
2048 processors, 13 terabytes of ram, AND it comes with a smaller, more ergonomic controller.
"If you think you have things under control, you're not going fast enough." --Mario Andretti
So an American company is selling a computer to a Japanese organization that is ideal for simulating nuclear explosions. Interesting.
I'm wrong and so are you.
I was actually refering to the fact that it was impossible to read or post comments on this article for a few minutes. When trying to enter the article slashdot replied "Nothing to see here, move along".
I guess the moderators didn't find it too funny, though, it's been modded -1.
SIG: TAKE OFF EVERY 'CAPTAIN'!!
running Linux on Itanium2 processors
But isn't Itanium kinda evil (as opposed to slashdot darlings PPC/Power and Opteron)?
While Linux is super cool? So should I like it?
I don't need a signature.
I think the line should be: now that's one impressive Beowulf cluster... In Japan
Linux is a good choice for a supercomputing cluster? No shit sherlocks. This isn't front page news, it's barely news at all. No wonder readership figures are declining.
13TB should be enough for anyone
A whooping sale of 2048 Itanium2 processors in one shot - is this the BIGGEST sale for the Itanium2 chip, so far ?
Muchas Gracias, Señor Edward Snowden !
Haven't we had enough rudeness the last four years? I happen to be pleased by most of those results (though not, for example, that anyone still uses Windows). But you're a cowardly troll for anonymously posting such off-topic flamebait. - Get some stones and at least use a pseudonym - Stay on topic - Avoid calling people names like "Eurotrash" - In short, show a little class
sigs, as if you care.
I hear gobs about huge clusters and Linux as the OS that makes it all happen but I don't think I've ever heard other OSes uses like this.
Could someone make an "off the top of their head" list of SuperComputing cluster and OSes that are used in them?
I *am* a Linux user and I'm actually kinda curious if Microsoft has an answer to this area of computing?
is this thing faster than the Big Mac?
Interesting question. Especially considering they have roughly the same number of processors...
But from the article I get the idea the SGI is kind of... less clustered. It seems to share its memory while on the Big Mac, each G5 computer has its "private" 4 GB of memory.
I don't need a signature.
Sorry, the gloves come off when Europeans dare to judge us unfairly just because our country (and Britian) has the cojones to oppose evil in the world. Just because you guys have given up trying to change the world for the better, doesn't mean we will.
I would post under my account, but the moderators have seen to it that I never get to post my opinions anywhere. I am here to help destroy the anti-reality shield around the slashbots. You guys need to WAKE UP and see what is really going on out there. It isn't pretty.
SGI has been working through this in hardware for over 10 years.
The distributed shared memory concept of the Altix (first seen on Origin 200 / Origin 2000 in the commercial space, and previously based on the Standford DASH/FLASH projects) uses a hardware based memory router.
Each PE has local ram and local CPUs and a "MAGIC" chip that routes cache invalidations, memory block "ownership", etc messages to other PE's as necessary. Unlike SMP designs, cache coherencvy doesn't destroy the whole shebang because its not a shared bus, it's a heirarchial directory system. I.e. PE0 knows it only needs to contact PE3, PE6, and PE13 to invalidate a cache block. Turns out that thats much more efficient than broadcasting a message to PE0-PE63 saying "invalidate this block!"
Now, as far as _all_ processor sharing the full 13TB - i am not sure.
The memory density / system image equation is sort of a tradeoff, as more PE's require more router hops in the topology. More router hops increase latency. SGI has sold 256 and 512p single-image systems, and may have gone up to 1024 or 2048p / system.
To be perfectly honest, the system-system latency is different than the intra-system latency, but nothing like it would be on an x86-with-ethernet shared nothing cluster.
SGI's big installations are cool as they have advantages of both SMP and MPP designs.. each autonomous machine gives you signle-image benefits but with really high proc counts.. . and then you link a bunch of those together to get this outrageously sized machine.
My opinions are my own, and do not necessarily represent those of my employer.
13Tb of RAM, but how much swap?
The more advanced the technology, the more open it is to primitive attack
Sorry to spoil the excitement for everybody but actually, Columbia far exceeds the Japanses system's memory capacity at 20 TByte. See this description for details of Columbia's config.
You don't suppose they ever do any weapons research, do you? Hmmm, what to do...
sigs, as if you care.
Actually, that'd be 13TB/20480, not 13TB/1024.
:)
so, 0.000634765625 TB's per machine... too lazy to do it properly right now
feh. stuff.
isn't it recommended you have 2x ram as your swap? so that'd be *does difficult calculations in head* 26TB of swap. You really don't want the kernel killing off processes because you run out of ram....that'd be bad.
Now all they need is a *4d* accelerated video card with 512GB memory and they'll be at the minimum hardware requirements for the (up until now) highly secretive pre-beta version of Doom 4.
-- In Soviet Russia, a Beowulf cluster of these would imagine YOU!
I wonder if they gave this one away free too?
I call for a US export ban on Memory to protect the Homeland's national security.
Ow! Dr. Condoleezza just informed me they make Memory all by themself, lets pre-emptively nuke 'em!
"The likes of Facebook and WhatsApp are free to those whose privacy is of zero value."
Wonder what linux they run, probably they need the RAM for something, so Damn Small Linux would be the right distro for them.
About JAERI
Devoted to comprehensive research on nuclear energy since1956, JAERI challenges research and development in the realm of frontier science and engineering with focus on the realm of nuclear research and developments. Projects include the establishment of light-water reactor power generation technology in Japan through its endeavors including the success in Japan's first nuclear power generation and achievement of the leading and systematic research on nuclear safety. JAERI has also attained the world's foremost level of R&D in nuclear fusion and has applied radiation to the field of industry, agriculture and medicine, supported by extensive basic research to underscore the advancement of all its R&D activities. For additional information, visit www.jaeri.go.jp.
Of course, GNOME developers are still trying to work out how to make GNOME not crash with an out-of-memory error.
And you bit. So, I'm sorry to say:
YHBT. YHL. HAND.
I want to delete my account but Slashdot doesn't allow it.
pah... when I were a lad building my first machine... I had to gang nine 1Kbit chips together to make 1 Kbyte + parity... aye, they were the days... and you could cram a full chess playing program into that 1 Kbyte as well. A 4K ram expansion cost an arm and a leg... well it felt like that having to give up beer and ciggies for ages to scrape up the wonga...
Donald 'Duck' Dunn: We had a band powerful enough to turn goat piss into gasoline.
a Japanese Atomic Energy Research foundation would need that kind of computing power...Godzilla!
My other sig is extremely clever...
The Japan Nuclear research team who just acquired a 13TB RAM supercluster also gained a nuclear power plant to power this bad boy. Projections speak of a 2.5 hour battary life, although Limrick Power Plant has offered their Nuclear facility which will generate a whopping 5.5 hour battary life span.
I mod down so you can mod up. Your welcome.
... strikes again.
No, with Linux you don't need twice as much swap as RAM (and iirc didn't need it from the very first beginning).
Actually, with such big swap you waste a lot of kernel-mem for the bitmaps (managing the swapspace) and so on.
You'll be a lot more effective if you keep your tone civil. In this forum, it's not what you say, it's how you say it that counts. The slashdot crowd, whom you hope to influence, quits listening and clicks "flaimbait" when you start calling names (except some comments directed at conservatives or ).
Sorry for the formatting of the first reply.
sigs, as if you care.
Reading through both links, I fail to see where it mentions that SGI & Intel *gave* the system to NASA for free.
l eases/2004/october/columbia.html mentions NASA having to put together a business case and justification for Congress and that normally means asking for funds.
The SGI press release http://www.sgi.com/company_info/newsroom/press_re
Even if they did just give it away for the press (and I dount it). When dealing with the gov't, the support contracts are separate. No one but SGI could properly support the system, so I'm willing to bet they got a fat support contract out of it.
-Charles
Learning HOW to think is more important than learning WHAT to think.
Sorry, the gloves come off when Europeans dare to judge us unfairly just because our country (and Britian) has the cojones to oppose evil in the world. Just because you guys have given up trying to change the world for the better, doesn't mean we will.
I will not go into a discussion about the methods you use to better the world, but will share you a consideration a lot of Europeans have about the US foreign policy: have you ever considered why some of these evils in the world don't turn to Europe, only to the U.S.?
Z
And I thought 640k memory was enough for everyone. Wait a minute, was it me or...?
This
Man this shit makes me feel old.
I worked on a machine that had 24k (that 24,576) bytes of wire-wrapped, core memory. At the time though I new where RAM was trending. I had an Apple][ with 32 K of semi-conductor memory.
I wrote a Pascal-like HLL compiler and a payroll system for the damn thing. In 24k bytes of memory.
What the [expletive deleted] do you DO with all those terabytes or high-speed RAM? Lets pretend something goes KABOOM!
I don't know wether to be wow-ed or depressed.
MSBPodcast.com The opinions expressed here are my own. If you don't like 'em... Think up your own stuff.
I can't believe any of you didn't do a single doom 3 joke yet!
..they should just run everything from a RAM disk.
Hope they didn't forget the $6.4 million startup cost and $2.2 million annual fee for linux licenses (assuming 8 CPU systems).
SGI has a layered approach to the max number of CPUs in a supercomputer.
I guess 256 is what they call "ultrastable" - kinda like the Linux kernel 2.2.
But the NASA monster already has 512 CPU machines, and who knows what the japanese system has.
Apparently, SGI sells bigger systems to customers who "know what they are doing" and who work closer with SGI. If you want something that 100% no-frills, then probably the 256 CPU is the current absolutely stable limit.
in the domain this system is to be used for (3d modeling of nuclear blasts)
I read on Ain't It Cool, that this is actually going to be used for the production of a live action version of Urutsokidoji: Legend Of The Overfiend. Knowles said he could only describe what he saw of the preproduction and concept art as "eye popping."
0.000634765625 TB's per machine
Then you're assuming each machine has just one CPU. That is not correct, and it's the biggest difference between SGI supercomputers and commodity clusters.
An SGI system has hundreds, if not thousands of CPUs per machine.
But yeah, it should be enough to display all my porn at once provided they can find a big enough monitor....
is this thing faster than the Big Mac?
Yes it is.
The Big Mac is just like any other commodity cluster. It's just a bunch of machines tied together in a closed network.
The SGI supercomputers keep all CPUs in a single machine, sharing all the memory over extremely fast, proprietary interconnects. In such a system, the CPUs talk to each other as fast (if not faster) as the CPUs in a dual-CPU server.
Assuming the total CPU power is the same, the SGI supercomputer is faster than any cluster (Big Mac included) for all problems that are not 100% parallelizable. For those few problems whose algorhitms are 100% parallel, a SGI system and a cluster will probably be equal.
...but not quite enough to hold my...friends'...entire pr0n collection in memory.
" our country (and Britian) has the cojones to oppose evil "
Oh, the same evil *you* SELL weapons to??? That's a new definition of 'oppose', I guess.
These rather wasteful supercomputers are getting less and less impressive.
:-)
You know what would be impressive? Published results!
The results are already "published", just not explicitly.
The gas price is twice smaller than it could be? That's because supercomputers such as those made by SGI are used to do simulations related to oil drilling and stuff.
The car prices are smaller than they could be? That's because car crashes are simulated on supercomputers instead of performed actually during the design process.
Nuclear weapons are more powerful than they could be? That's because... oh, wait.
It's a single-OS-image supercomputer.
:-)
But yeah, nice joke.
if this will help safety out at the power plants. Japan has a (comparatively) horrible safety record when it comes to nuclear power compared to Western Europe and the US....
Monstar L
... enough to run Longhorn ... ... compile Gentoo ... ... Beowulf cluster ...
I hear they will be using it to test the new release of After Dark. It will be running it 24 hours a day.
I never liked you
The super-clusters built around Apple's Xserve (17 and 25 TFLOPS) both use OS X...the same one as on the desktop. Yes, they do turn off the GUI for the cluster nodes but that is it.
Europeans dare to judge us unfairly just because our country (and Britian) has the cojones to oppose evil in the world.
Noblesse oblige me to correct you, sir.
We dare to judge you just because (the government of) your country and (the government of) Britain are the cojones who claim to oppose "evil" in the world.
How can one actually have many Central Processing Units?
I mean, I know there are multiprocessor computers nowdays, but what is then central there?!
it sounds good, but can it run the Duke Nukem 3D Atomic Edition in 800x600 VESA mode?
The higher the technology, the sharper that two-edged sword.
Having been born in Japan, I believe a Beowulf cluster in Japan is more commonly called a "godzilla cluster". And having said that I'm wondering what that amount of money would cost in toto? Oh, BTW, this machine is really going to be used to create the next Gozilla movie, only animated. Sig? Ok. Sig.
If you can stay calm, while all around you is chaos... then you probably haven't completely understood the question.
Cray XT3: up to 239TB RAM
. ht ml
http://www.cray.com/products/xt3/configurations
2048 is nothing... They've got everyone beat with 10,240 processors!
http://github.com/gbook/nidb
http://christiancarling.com/snoopy.htmlThis is what the british government needs
...have no influence in Japanese big business or government...or so Jon Lovitz told me.
Yes, I find it interesting also.
Collaterally damaged Iraqis would be so happy about this better world. If they still were around, that is.
NASA's Columbia system cost $45M. SGI charges money for their products. This Japanese system is probably on the order of $10M.