Slashdot Mirror
Japan's Newest Linux Supercluster: 13TB RAM
green pizza writes "Following its sale of a 10240 processor cluster to NASA, Silicon Graphics Inc has announced that it's supplying a 2048 processor Altix 3700 Bx2 to the Japan Atomic Energy Research Institute. Aside from running Linux on Itanium2 processors, the beast also features 13 TB of RAM!"
I guess that'll be enough to run Longhorn then.
This nation is FUCKED
That thing should play Doom 2 pretty well, no?
printf($randomline(sigs.txt) \n "-- "$randomline(authors.txt));
-- myself
Move along.
SIG: TAKE OFF EVERY 'CAPTAIN'!!
It's about time to shut down politics.slashdot.org, aka Kerry/Edwards for President.
Slashdot Moderation: From positive to terrible in 2 "insightful" posts.
What about Doom3 benchmarks?
I can't even imagine a beowulf cluster of these babies!
John
Why is this news ? 3TB of ram on 2K processors amount to 1.5GB of ram per processor. Is this so ridiculous ? It's about as stupid as mentioning transistor count on a multiprocessor machine.
Oh well, we all now it's a slow news day, right
When will I end this grieving ? When will my future begin ?
Unix to Linux migration makes sense.
Just remember: not all Linux platforms are created equal. Just consider:
Moving from Unix to the world of Linux gives you new control over your compute environment, at a lower cost. However, not all Linux platforms are created equal.
What are the growth/scalability limits for your platform?
Can you increase only the compute resources that you need?
Will you have to call multiple vendors for support?
The SGI Altix family of servers lets you run Linux with no limits. Unlike other systems, Altix scales from 2 processors up to 256 processors in a single Linux system image, and enables you to independently increase I/O, memory, and processors for perfectly right-sized systems. Altix is also easy on your budget, with the ability to start small and grow big, all in a unified architecture - no more "forklift upgrades"! With over 20 years of industry leadership in developing high performance systems, we know what it takes. We've helped to extend the Linux kernel with performance optimizations. We also know that you want to go to a single vendor if you have a system problem, so will be your single point of contact for system problems - regardless of the source.
So, expect the best - SGI Altix.
An Indian-American Hindu committed to non-violent thought/speech/action alarmed by the global explosion of radical Islam
I remember back in my electronics course when we had to design the flip-flop grid for memory... the teacher said he'd give 100% to anyone that could draw out 64K of memory... 13TB just makes me cringe...
---
Programming is like sex... Make one mistake and support it the rest of your life.
How fast can this thing do SETI@HOME and Distributed.net computations? Thats a lot of processors and what do they need 6.5Gigabytes of Rame perprocessor for anyway?
Fly me to the moon Let me sing among those stars Let me see what spring is like On jupiter and mars
Do all processors share 13TB? Because if they don't the bottleneck is that subprocesses have only 13TB/1024 available ( a mere 13GB each), and still have to communicate a lot.
In theory there is no difference between theory and practice. In practice there is. - Yogi Berra
I hear this is the reccomended base configuration for Windows Longhorn...
That's pretty darn cool 13 TB of Ram. But too bad that won't be enough to run longhorn........
Imagine a Beowulf cluster of these!
Oops!
Ricardo da Silva Lima
The puter will be used for nuclear research (bushspeak: nucjular reesatch) by the Japan Atomic Energy Research Institute. More info about the organisation, their projects, etc. can be found at: http://www.jaeri.go.jp/english/index.cgi.
SIG: TAKE OFF EVERY 'CAPTAIN'!!
And KDE is still slow.
2048 processors, 13 terabytes of ram, AND it comes with a smaller, more ergonomic controller.
"If you think you have things under control, you're not going fast enough." --Mario Andretti
So an American company is selling a computer to a Japanese organization that is ideal for simulating nuclear explosions. Interesting.
I'm wrong and so are you.
This just in: CNN is reporting that Kerry has conceded the election to Bush. That means:
1) Bush wins the majority of electoral votes
2) Bush wins the popular vote by approximately 4 million votes
3) Bush wins a majority of popular votes (51%)
4) Republicans gain in numerous House seats
5) Tom Daschle (the LEADER of the Democrats in the Senate) LOSES his election and gets kicked out of office by his electorate
6) The Democratic Vice Presidential candidate LOSES his HOME STATE by a wide margin of votes
7) Same sex marriage and other extreme liberal ballot measures fail
8) Very few issues reported from either side regarding electronic voting machines
9) 91% of people still use Windows. Less than 1% use Linux
10) Americans still don't care about the irrelevant Eurotrash opinion
running Linux on Itanium2 processors
But isn't Itanium kinda evil (as opposed to slashdot darlings PPC/Power and Opteron)?
While Linux is super cool? So should I like it?
I don't need a signature.
Linux is a good choice for a supercomputing cluster? No shit sherlocks. This isn't front page news, it's barely news at all. No wonder readership figures are declining.
13TB should be enough for anyone
A whooping sale of 2048 Itanium2 processors in one shot - is this the BIGGEST sale for the Itanium2 chip, so far ?
Muchas Gracias, Señor Edward Snowden !
I hear gobs about huge clusters and Linux as the OS that makes it all happen but I don't think I've ever heard other OSes uses like this.
Could someone make an "off the top of their head" list of SuperComputing cluster and OSes that are used in them?
I *am* a Linux user and I'm actually kinda curious if Microsoft has an answer to this area of computing?
is this thing faster than the Big Mac?
Interesting question. Especially considering they have roughly the same number of processors...
But from the article I get the idea the SGI is kind of... less clustered. It seems to share its memory while on the Big Mac, each G5 computer has its "private" 4 GB of memory.
I don't need a signature.
I figure this might meet the minimum requirements.
SGI has been working through this in hardware for over 10 years.
The distributed shared memory concept of the Altix (first seen on Origin 200 / Origin 2000 in the commercial space, and previously based on the Standford DASH/FLASH projects) uses a hardware based memory router.
Each PE has local ram and local CPUs and a "MAGIC" chip that routes cache invalidations, memory block "ownership", etc messages to other PE's as necessary. Unlike SMP designs, cache coherencvy doesn't destroy the whole shebang because its not a shared bus, it's a heirarchial directory system. I.e. PE0 knows it only needs to contact PE3, PE6, and PE13 to invalidate a cache block. Turns out that thats much more efficient than broadcasting a message to PE0-PE63 saying "invalidate this block!"
Now, as far as _all_ processor sharing the full 13TB - i am not sure.
The memory density / system image equation is sort of a tradeoff, as more PE's require more router hops in the topology. More router hops increase latency. SGI has sold 256 and 512p single-image systems, and may have gone up to 1024 or 2048p / system.
To be perfectly honest, the system-system latency is different than the intra-system latency, but nothing like it would be on an x86-with-ethernet shared nothing cluster.
SGI's big installations are cool as they have advantages of both SMP and MPP designs.. each autonomous machine gives you signle-image benefits but with really high proc counts.. . and then you link a bunch of those together to get this outrageously sized machine.
My opinions are my own, and do not necessarily represent those of my employer.
13Tb of RAM, but how much swap?
The more advanced the technology, the more open it is to primitive attack
Sorry to spoil the excitement for everybody but actually, Columbia far exceeds the Japanses system's memory capacity at 20 TByte. See this description for details of Columbia's config.
though, I haNve to recent Sys Admin
You don't suppose they ever do any weapons research, do you? Hmmm, what to do...
sigs, as if you care.
Actually, that'd be 13TB/20480, not 13TB/1024.
:)
so, 0.000634765625 TB's per machine... too lazy to do it properly right now
feh. stuff.
isn't it recommended you have 2x ram as your swap? so that'd be *does difficult calculations in head* 26TB of swap. You really don't want the kernel killing off processes because you run out of ram....that'd be bad.
Now all they need is a *4d* accelerated video card with 512GB memory and they'll be at the minimum hardware requirements for the (up until now) highly secretive pre-beta version of Doom 4.
-- In Soviet Russia, a Beowulf cluster of these would imagine YOU!
I wonder if they gave this one away free too?
I call for a US export ban on Memory to protect the Homeland's national security.
Ow! Dr. Condoleezza just informed me they make Memory all by themself, lets pre-emptively nuke 'em!
"The likes of Facebook and WhatsApp are free to those whose privacy is of zero value."
About JAERI
Devoted to comprehensive research on nuclear energy since1956, JAERI challenges research and development in the realm of frontier science and engineering with focus on the realm of nuclear research and developments. Projects include the establishment of light-water reactor power generation technology in Japan through its endeavors including the success in Japan's first nuclear power generation and achievement of the leading and systematic research on nuclear safety. JAERI has also attained the world's foremost level of R&D in nuclear fusion and has applied radiation to the field of industry, agriculture and medicine, supported by extensive basic research to underscore the advancement of all its R&D activities. For additional information, visit www.jaeri.go.jp.
40,,,0 workstations but with Netcraft here, please do Mr. Raymond's FreeBSD used to and what supplies would you like to supplies to private
And you bit. So, I'm sorry to say:
YHBT. YHL. HAND.
I want to delete my account but Slashdot doesn't allow it.
pah... when I were a lad building my first machine... I had to gang nine 1Kbit chips together to make 1 Kbyte + parity... aye, they were the days... and you could cram a full chess playing program into that 1 Kbyte as well. A 4K ram expansion cost an arm and a leg... well it felt like that having to give up beer and ciggies for ages to scrape up the wonga...
Donald 'Duck' Dunn: We had a band powerful enough to turn goat piss into gasoline.
a Japanese Atomic Energy Research foundation would need that kind of computing power...Godzilla!
My other sig is extremely clever...
The Japan Nuclear research team who just acquired a 13TB RAM supercluster also gained a nuclear power plant to power this bad boy. Projections speak of a 2.5 hour battary life, although Limrick Power Plant has offered their Nuclear facility which will generate a whopping 5.5 hour battary life span.
I mod down so you can mod up. Your welcome.
... strikes again.
No, with Linux you don't need twice as much swap as RAM (and iirc didn't need it from the very first beginning).
Actually, with such big swap you waste a lot of kernel-mem for the bitmaps (managing the swapspace) and so on.
Reading through both links, I fail to see where it mentions that SGI & Intel *gave* the system to NASA for free.
l eases/2004/october/columbia.html mentions NASA having to put together a business case and justification for Congress and that normally means asking for funds.
The SGI press release http://www.sgi.com/company_info/newsroom/press_re
Even if they did just give it away for the press (and I dount it). When dealing with the gov't, the support contracts are separate. No one but SGI could properly support the system, so I'm willing to bet they got a fat support contract out of it.
-Charles
Learning HOW to think is more important than learning WHAT to think.
Sorry, the gloves come off when Europeans dare to judge us unfairly just because our country (and Britian) has the cojones to oppose evil in the world. Just because you guys have given up trying to change the world for the better, doesn't mean we will.
I will not go into a discussion about the methods you use to better the world, but will share you a consideration a lot of Europeans have about the US foreign policy: have you ever considered why some of these evils in the world don't turn to Europe, only to the U.S.?
Z
And I thought 640k memory was enough for everyone. Wait a minute, was it me or...?
This
Man this shit makes me feel old.
I worked on a machine that had 24k (that 24,576) bytes of wire-wrapped, core memory. At the time though I new where RAM was trending. I had an Apple][ with 32 K of semi-conductor memory.
I wrote a Pascal-like HLL compiler and a payroll system for the damn thing. In 24k bytes of memory.
What the [expletive deleted] do you DO with all those terabytes or high-speed RAM? Lets pretend something goes KABOOM!
I don't know wether to be wow-ed or depressed.
MSBPodcast.com The opinions expressed here are my own. If you don't like 'em... Think up your own stuff.
I can't believe any of you didn't do a single doom 3 joke yet!
..they should just run everything from a RAM disk.
Hope they didn't forget the $6.4 million startup cost and $2.2 million annual fee for linux licenses (assuming 8 CPU systems).
SGI has a layered approach to the max number of CPUs in a supercomputer.
I guess 256 is what they call "ultrastable" - kinda like the Linux kernel 2.2.
But the NASA monster already has 512 CPU machines, and who knows what the japanese system has.
Apparently, SGI sells bigger systems to customers who "know what they are doing" and who work closer with SGI. If you want something that 100% no-frills, then probably the 256 CPU is the current absolutely stable limit.
in the domain this system is to be used for (3d modeling of nuclear blasts)
I read on Ain't It Cool, that this is actually going to be used for the production of a live action version of Urutsokidoji: Legend Of The Overfiend. Knowles said he could only describe what he saw of the preproduction and concept art as "eye popping."
0.000634765625 TB's per machine
Then you're assuming each machine has just one CPU. That is not correct, and it's the biggest difference between SGI supercomputers and commodity clusters.
An SGI system has hundreds, if not thousands of CPUs per machine.
But yeah, it should be enough to display all my porn at once provided they can find a big enough monitor....
is this thing faster than the Big Mac?
Yes it is.
The Big Mac is just like any other commodity cluster. It's just a bunch of machines tied together in a closed network.
The SGI supercomputers keep all CPUs in a single machine, sharing all the memory over extremely fast, proprietary interconnects. In such a system, the CPUs talk to each other as fast (if not faster) as the CPUs in a dual-CPU server.
Assuming the total CPU power is the same, the SGI supercomputer is faster than any cluster (Big Mac included) for all problems that are not 100% parallelizable. For those few problems whose algorhitms are 100% parallel, a SGI system and a cluster will probably be equal.
...but not quite enough to hold my...friends'...entire pr0n collection in memory.
And now it's going to be slashdotted. :rolleyes:
It's a single-OS-image supercomputer.
:-)
But yeah, nice joke.
if this will help safety out at the power plants. Japan has a (comparatively) horrible safety record when it comes to nuclear power compared to Western Europe and the US....
Monstar L
... enough to run Longhorn ... ... compile Gentoo ... ... Beowulf cluster ...
I hear they will be using it to test the new release of After Dark. It will be running it 24 hours a day.
I never liked you
The super-clusters built around Apple's Xserve (17 and 25 TFLOPS) both use OS X...the same one as on the desktop. Yes, they do turn off the GUI for the cluster nodes but that is it.
How can one actually have many Central Processing Units?
I mean, I know there are multiprocessor computers nowdays, but what is then central there?!
it sounds good, but can it run the Duke Nukem 3D Atomic Edition in 800x600 VESA mode?
The higher the technology, the sharper that two-edged sword.
2048 is nothing... They've got everyone beat with 10,240 processors!
http://github.com/gbook/nidb
http://christiancarling.com/snoopy.htmlThis is what the british government needs
...have no influence in Japanese big business or government...or so Jon Lovitz told me.
Yes, I find it interesting also.
NASA's Columbia system cost $45M. SGI charges money for their products. This Japanese system is probably on the order of $10M.