Slashdot Mirror
Shell and the World's largest Linux Supercomputer
thefullmonty writes "Yahoo! News is reporting that Royal Dutch/Shell is going to install the world's largest Linux supercomputer. Shell's Exploration & Production unit will use the supercomputer, consisting of 1,024 IBM X-Series servers, to run seismic and other geophysical applications in its search for more oil and gas. The article goes on to talk about how larger companies are moving towards Linux and some of the advantages of making such a move. ."
Hmm, and I just read the most Moronic post Supercomputer.
Where's the beef?
A little more detail would be nice.
We currently run the VERY latest "z" series IBM server with 1100 MIPS and are considering running Linux on it as soon as kernal 2.4 is out of beta.
Technology is only a vehicle. People are the ones that drive it.
It's not cost, it's *hassle*. If you want to plug in an extra node, you just do it. No need to phone up (insert software vendor) to buy another 'Flexible Licensing Extension Pack' or to sign another contract. And no need to worry about random audits and threats from anti-piracy organizations.
-- Ed Avis ed@membled.com
There are other clusters that have similar numbers of nodes. Down at Sandia National Labs, they have Cplant Antarctic. It is a Linux cluster of > 1024 nodes and growing. The nodes are Compaq DS10s, which are faster than the Intel nodes the article above talks about. See http://www.sandia.gov/LabNews/LN08-11-00/cplant_st ory.html
i work for a Fortune 200 company, we're kinda big but not overwhelmingly huge...we just had a whole gaggle of lawyers pour over our license agreements while our internal IT dept had to assess all of our machines to make sure we were compliant...that all cost $$ that could have gone into my profit sharing!
anything that makes it easier for us to do our jobs and saves money - double word score. i feel good that Royal Dutch/Shell had to see this too which will add some relevance to the truth that Linux is not the TCO nightmare the MS purports it to be.
/* Half alive and half dead too, work is for suckers and the sucker is you. - "Half-life" by Local H*/
anything that causes your employees to divert their time and attention from the task at hand is a cost.
that said, dealing with licensing *is* a royal pain in the ass.
--
Is this REALLY Shell deciding Linux is the end all be all of high powered computing? Or is it just cost effectiveness? Think about it a fucking second, this bad boy is being provided by IBM, IBM also has a little product they like to call AIX. AIX as opposed to Linux has quite the pricetag. IBM has a pretty cheap charge attached to sticking Linux on their big iron. If you want a new big iron box do you really want to shell (teehee) out the big bucks for hardware and high priced OS licenses? No fucking way. I really doubt this has anything to really do with Linux being the best thing since sliced bread and has more to do with it being cheap and working well enough to get the job done.
I'm a loner Dottie, a Rebel.
Does anyone know who's providing the software (besides the OS)?
Google claims to be running a 4000+ plus Linux cluster(RedHat)... http://linuxtoday.com/news_story.php3?ltsn=2000-05 -30-022-04-PR
I think I remember Google saying that they'll have 10,000 nodes by the end of the year.
Even if you're talking processors in this new "Linux Supercomputer" the x330s only takes 2. So now were at 2048...
Nice try IBM.
Oh, how? By dumping the entire cluster on him? I can't see how else they would use all that hardware to kill somebody...
--
Slashdot didn't accept your submission? hackerheaven.org will!
Sorry, that link should have been...
BW: Red Hat Linux Powers Google's Award-Winning Search Engine
What shell are they using?
--Joe--
Program Intellivision!
Program Intellivision!
? You have been recruited by the Star League to defend the frontier from Xur and the Ko-Dan Armada. ? Where when what Star League,Xure ..
Do not underestimate the power of the Dark side
You would be amazed at how many people didn't know the name Sun until they started their StarOffice buy and .COM marketing. Linux being used by a large company for a very niche program won't get as much play as a system being used by a huge retail chain for an application most businesses need.
Click here or here.
No no, they need the oil to generate power to run the computer to find oil to generate power to run the computer to find oil to generate power to run the computer...
Why don't you take a minute to look at who actually wrote this article (Reuters) before blaming Yahoo for seemingly minor technical details. You know, there are people out there who don't know the difference between (gasp!) the WWW and the Internet, or even what an operating system is. That is why mainstream news sites shouldn't need to worry about minor technical details such as the ones you point out.
It hurts to see something I love being used to help one of the biggest corporate monsters (for example accused of having hired Nigerian troops to kill peasants because they got in the way) to drain our earth from its last oil resources.
but you're just spouting off inaccurate Linux propaganda here
I don't even use Linux. And I was talking about Windows 9x which, believe it or not, is still a very popular workstation.
"Free your mind and your ass will follow"
Worlds Largest supercomputer? Largest as in
processing power, or number of boxes? I thought
Google had the largest cluster!
My experience with supercomputers is pretty limited to say the least. But I'm curious let's say you got some time on a Cray, what OS would it be running when you showed up?
From their activities in Nigeria (and, I'm sure, elsewhere) Shell is a terrorist organizaion. The question isn't whether you want oil, it's whether you want your oil supply controlled by a terrorist organization.
(just because they make a profit doesn't mean that they're not a terrorist org. Drug dealers and hitmen make a profit too.)
`ø,,ø`ø,,ø!
Free Software: Like love, it grows best when given away.
Be disgusted, read: about Ken Saro Wiwa and Shell's recent record
Another myth from Microsoft's page whacked. (Free Operating System Does Not Mean Low Total Cost of Ownership) Sheesh. Does anyone have a "Microsoft Myths" page?
El riesgo vive siempre!
1024 computers - Interesting number. a new unit, the Penguin. One Penguin, two Penguins. Anyway M$ will never reach half Penguin...
According to the text we know know the place of Linus Torvalds in the development of Linux. It occurs he is just a "Fin" of the Penguin... And a group of volunteers on the Web helped him... Yeah Alan Cox upgrading a new patch through a web form...
Interesting licensed OS they found - UNIX. And it seems Linux is an alternative to it. I wonder how interesting is to be an alternative to itself...
The latest biggest Cray machines have all been Alpha clusters probably running some clusterable DU variant.
I think you mean the T3E, and while it's based on Alphas, it's about as far from a cluster as you can get and still have a parallel machine. It also runs UNICOS/mk (a microkernel version of UNICOS), not Digital/Tru64/name-of-the-week Unix.
"My life's work has been to prompt others... and be forgotten." --Cyrano de Bergerac
That's only half of the story. Consumers like that crap partly because it is being presented as cool by the advertising industry. Environmental propaganda in Europe presents these abominations as uncool, and consequently much less demand exists.
Producers are responsible for what they produce, they cannot eschew their responsibility by saying "but lots of people want to buy it!". Lots of people want to buy child porn.
--
AFAIK, CPlant at Sandia is ~1600 Alpha nodes and counting. I think one of the genetic research companies has a 1000+ Intel node cluster (although it's used as a job farm rather than for parallel applications, IIRC).
--Troy
"My life's work has been to prompt others... and be forgotten." --Cyrano de Bergerac
After Mr. AC posted this comment from his mostly-plastic encased PC, which runs on electricity from the (probably) coal-fired power plant, he put on his rubber-soled shoes and hopped in his gas burning, plastic-part-filled auto to hop down to the 7-11 to buy some more Jolt in the plastic bottles. He then returns to his (probably) gas-heated vinyl-clad home to take a hot (probably gas-heated) shower, the water of which probably passes through PVC to get to him.
Dude, unless you're willing to strike a deal with the Amish to let you into their fold, don't even sit there and preach bullsh*t about ethics.
Big Oil Companies(tm) are one of the places that Linux is *needed* as they are so very ingrained in the 'old ways' of doing things. Including software, and spending exhorbitant amounts of cash on damn near anything.
I for one applaud Shell for taking this route.
(posted anonymously since I'm a part of one of these Big Oil Companies(tm))
Actually plastic bottles are better than the glass ones as long as an efficient recycling system exists. In the Scandinavia approximately 90 % of the glass bottles and 80 % of plastic bottles are recycled. Germany might have even higher rates.
Seriously, Royal Dutch/Shell have a shitty envirinmental record, and some rather questionable dealings with the gov't of Nigeria. Off topic? Maybe, but quite relevant on a larger scale.
Just where, pray tell, did I say that we should judgs success as "dominating the technical market?"
My point, as I thought I made very clearly, and others have said, as well, is that with the acceptance of linux into the mainstream market by such players as IBM, Shell, and Sam Goody, linux as a whole gains momentum and "mindshare" (ugh, marketingspeak) as well as credibility.
That makes it easier for IT personnell to convince silly management types to use linux as an alternative to OTHER COMMERCIAL OS'ES. This does not necessarily mean M$, but that is something that I would like to see.
As linux gains support as a desktop/server/research platform, it is valid to assume that it will begin to make a dent in M$'s share of the desktop/server marketplace, as well as other manufacturers big iron OS'es. This, in turn, forces these companies to work to supply better product to maintain their profit. (basic economics, if you can get the same functionality for free, why pay?)
I guess what I'm saying is that I don't define linux's success as dominating any market. I feel that success will bring more competition and innovation, a-la the Intel-AMD competition (well, maybe not so much innovation.)
Yeah, not to mention Shells nasty habit of making their friendly governments (nigria) murd^H^H^H^Hexecute the people in their way. Sure, im just as happy about free software used fort such a big real world computer , but did have to be _shell_ ?
Shell is basicly the enemy of the world...
Ok, slight irony, most companies put profit in the first room, but Shell really is extremly nasty.
You are the same decaying organic matter as the rest of us.
oops, s/nigria/nigeria s/fort/for
You are the same decaying organic matter as the rest of us.
http://www.essentialaction.org/shell/era/era.html
Yay linux and all, but lets be careful how much we cheer these guys on....
mhhh and i thought i'll get a shell on this bady .... ;-)
Like them or hate them, Shell didn't kill Ken Saro-Wiwa. The Nigerian GOVERNMENT killed Ken Saro-Wiwa, ignoring pleas by Shell and the rest of the world to stop it. The former Chairman of the Shell group even sent a personal letter appealing to the Nigerian Head of State to show clemency for Ken on humanitarian grounds to no avail.
http://www.shellnigeria.com/frame.asp?Page=hr
Of course, Greenpeace is known for lying when it wants to. Take the Brent Spar case: "Tests by an independent Norwegian foundation, Det Norske Veritas, disproved claims by Greenpeace that the Spar was a 'toxic timebomb'. Greenpeace later apologized."
Believe what you want. The facts are on Shell's side, but don't let that stop you.
I have a friend that works in graphic design and won't even consider the gimp
Along with many friends, I too work in graphic design. Most of us have had contact with Linux at some time or another (I played around with GIMP quite a bit last summer) and I've only heard one opinion: Linux is not ready for prime time as a graphics design platform.
Why? Problems with fonts. A total lack of graphic card support (especially for the ultra-high-end graphics cards). An appaling lack of software. Where I can chose among two excellent vector editing apps on the PC (Freehand and Illustrator) Linux gives me Corel Draw. Corel Draw is crap, it's one of the most unstable and buggy software packages I've ever seen. (The running joke is that we've all been Corel Beta Testers since Corel Draw 3.0 because every release since then has been a beta.) Two 3D modeling packages (as opposed to at least *FOUR* excellent packages on the Wintel platform). GIMP's serious lack of pre-press tools... The list goes on.
Anyway, I think that Linux is great as far as server/programming stuff goes. Hell, I use it myself - always SSHing into servers, writing PHP scripts.
But to do graphics professionaly... No. Not gonna do it.
BTW, as far as stability goes, I've run Photoshops 3.0 -> 5.5 on my NT box and have had something like 10 crashes over the past three *years*. Somehow, that downtime doesn't scare me.
jedrek
-- polish ccs mirror
Silicon Valley apparently used to be a fantastic fishing spot but now is barren of fish due to chemical pollution.
Additionally I would like to point out that the real dangers of the Shell corporation is not the products they create but their activities in African and Asian countries. Ordering the deaths of local activists who oppose Shells presence in their land.
"I'll take the red pill. No! Blue! AAAaaaahhhhhhhhh"
- Monty Python meets the Matrix
I am more impressed with Sam Goody using Linux with Java cash registers than with the large supercomputer. I mean, Sam Goody using it will put Linux more in the public eye, and using a platform for which more Linux people will be developing. Not everyone has an IBM X-series server.
Click here or here.
...make me drool on my keyboard this early in the morning!
---------
And don't try to bribe me to shut up with any of your funny-money. I know where you get your crayons.
Okay, so the oil co.s can use The Penguin to find ways to destroy the habitats of penguins.
http://overwhelmed.org
Look how much they saved in licensing fees. That alone is reason enough to warrant the project. Talk about immediate ROI.
Yep, I never spell check.
More incorrect spellings can be found he
It does my heart good to see the "Mainstream" media (OK, OK, it's only Yahoo, but come on, Joe Schmoe is more likely to read Yahoo than Wired or ZDNet right?) giving linux some good press. Even the purists have to believe that good things will come from the growing big business support that Linux is getting. When people start hearing that IBM, Sam Goodey, and now Shell Oil are using linux, that adds credibility to those of us who've been saying that linux wasw a viable alternative to MS for quite some time now.
;> )
Yes, yes, I think that MS does have its place. I have a Win98 machine on my desk (flame away, I can handle it.) I also have a dual linux machine that acts as my firewall/masq. and I've tried for quite some time to convince people that linux has its place. I have a friend that works in graphic design and won't even consider the gimp on relatively inexpensive hardware (even though he's used it on my boxen and LOVES it) because linux isn't "solid" enough for his business needs. Never mind that he's paying exorbinant(sp?) fees for that badass machine with photoshop etc. etc. and it spends more time crashed in a week than I've ever seen my linux boxen down. Granted it's different service, but still.
My point is, big companies embracing linux is a good thing for our collective credibility, as well as making it easier for managers to justify spending nothing on OS'es (and therefore more on sysadmins
great news for the "movement" but an overall boring read.
basic information that we always hear, used here -- used there, developed by, seeing more use, coming of age, the end.
a step in the right direction for sure.
You sure about that? What will happen to all the "zealots" once they figure out "their" OS has become mainstream? There's nothing like living for a cause that all of a sudden turns out to be accomplished...
People replying to my sig annoy me. That's why I change it all the time.
Rio Tinto Zinc, British Aerospace & McDonnell-Douglas for aiding and abetting the mass-murder in East Timor; Total/Unocal for (allegedly) taking advantage of forced labour provided by the Myanmar government; various international clothing companies for using companies that employ children in appalling conditions in sweatshop factories. The international corporates have a pretty disgraceful record when it comes to human rights abuses.
...run Linux?
Oh, wait, yeah, I guess it will.
Doh.
Well, picture a Beow... err... nevermind.
-Chris
...More Powerful than Otto Preminger...
Wrong! I would have accepted IG Farben or any of the companies that used to be part of it (BASF, Bayer, etc.). Good guesses though, thanks for playing.
-nme!
How dare you insult my Jewish roots! You are nothing but an anti-semite nazi, who should have been killed for his war crimes long ago. It's people like you that cause all of the hatred, pain, and suffering in this world.
It may look like I'm doing nothing, but I'm actively waiting for my problems to go away.
--Scott Adams
Well, apparently what corporations look for in a desktop OS is something that is:
So, no... I don't think we can convince a fortune 500 that Linux is a viable OS for use on the desktop.
"Free your mind and your ass will follow"
Thanks for helping me lose karma. I must drop away from karma cap to make my whoring games fun again. However, I found the reaction to my pitiful amateur troll attempt quite humourous. Perhaps I should switch to the dark side of the force.
It may look like I'm doing nothing, but I'm actively waiting for my problems to go away.
--Scott Adams
I mean:
"Linux..., the free computer operating system..."
Free? Open-source, maybe, but without cost?
"Data collected in Shell exploration surveys will be fed into the computer, which will then analyze it."
And this is remarkable how? (I hope noone gets bitten when the computer gets fed...)
"Linux, developed by the Fin Linus Torvalds and a group of volunteers on the Web..."
Of course, there is *only* "the Web". The Internet is "the Web" -- I keep forgetting.
(hmm.. I thought most of the work on Linux was done through maillists, but I could be wrong..)
Anyway..
"...as a flexible alternative to licensed software systems such as Microsoft's Windows or the Unix platforms..."
uh.. Well. If you say so. It's on "the Web" so it must be true.
"...indicate that Linux usage is becoming more versatile, with the operating system moving into many different applications..."
An operating system "moving into applications" -- isn't this what got Micro$oft into trouble?
Or was that moving applications into the operating system? I forget..
Anyway, good job Yahoo!
t_t_b
--
I think not; therefore I ain't®
I'm on PJ's "enemies" list! Are you?
This is *not* about linux vs MS.
MS was never in the business of providing OS's for supercomputers.
This is linux vs commercial unices.
Forget TCO, think $/flop.
99% of seismic applications are "embarassingly parallel" - a natural fit for beowolf-type machines. You dont gain much from fancy architectures, so there's no point paying for it.
Clearly Linux is better than Windows but I have a few questions directed at Linux OS..... a)Are there certifications for Linux programmers or engineers? b)How can you manage and upgrade 1024 Linux computers? c)Since this clearly underminds the capabilities of Microsoft operating systems i)Is Microsoft going to try its hand at attempting the same feat that IBM did to keep its competition alive as far as supercomputers and Linux vs. Windows is concerned?
Yeah, well I have a supercomputer with 2048 Pentium 4s, just wait 'till I get Linux running on that one! BTW, what's a CPUID?
The only acceptable defense of scientific results is to say that they were the product of the Scientific Method.
at CNNfn
I am not positive this is a good thing.
Ceci n'est pas un post
----
Don't get me wrong, I'm not promoting M$ , I use Linux at home...but you're just spouting off inaccurate Linux propaganda here.
...in terms of Linux gaining mindshare (sorry for the buzzword...just came out of a meeting with sales. Yick).
Hmmm...guess Micro$oft is gonna have to update that "Linux Needs Real World Proof Points Rather than Anecdotal Stories" part of it's Linux Myths page.
:)
--Just Another Pimp A$$ Perl Hacker
El riesgo vive siempre!
the one part that stood out to me was this line:
With Linux companies can quickly add or remove computers without worrying about licenses for the operating software.
i know it has been debated that some companies think MS is better for lower TCO b/c of their huge programming staff and vast CS minions, but it appears that Royal Dutch/Shell is leaning towards proving Linux is more cost effective. a step in the right direction for sure.
/* Half alive and half dead too, work is for suckers and the sucker is you. - "Half-life" by Local H*/
In the other article about IBM's 1 billion dollar Linux investment, Lou Gerstner (IBM's President) is quoted as saying "Businesses should not settle for proprietary systems".
Deven Phillips, CISSP
Network Architect
Viata Online, Inc.
Wherever you go, there I am...
Now I can finally go to my boss and say, "See, Shell is using it to find oil. I think we'll be safe running our webserver on it."
Hey, now that they are using a free OS maybe gas prices will finally go down.
Now, can we convince a fortune 500 that this is a viable OS for use on the desktop?
AF-Design, web development.
Apparently, (according to the article), "Data collected in Shell exploration surveys will be fed into the computer, which will then analyze it." What an incredible idea! I suppose it will run better then the Micros~1 'equivilent', in which "Data collected in Shell exploration surveys will be fed into the computer, which will then crash." -Peter Sahlstrom I am failing chemistry
I was going to put a sig here, but I had already submitted the message.
Many companies have not used Linux for lots of reasons, but not wanting to be the first was definately one reason. Being first screams "risk".
Now, Shell is setting a "first" in the eye of many uninformed decision makers. Doing this in an environment which has few and very well trained persons working the system makes it relatively "safe", but the example is set anyway: You can use Linux for hassle-free and powerfull computing.
This is just the marketing the linux-community needs to make the break for Linux in the corporate world!
Sig (appended to the end of comments I post, 54 chars)
Not a particularly hard claim by Avis. Given the amount of hot grits that get poured down her pants, there is bound to be some residue on the sheets.
It may look like I'm doing nothing, but I'm actively waiting for my problems to go away.
--Scott Adams
It's called Slashdot. That's just one of the advantages of being open source, ANYONE can contribute FUD :)
"The question of whether a computer can think is no more interesting than that of whether a submarine can swim" -EWD
Don't follow that link. Who the fuck are these goatse-linking jerks anyhow?
something i didn't consider.
/* Half alive and half dead too, work is for suckers and the sucker is you. - "Half-life" by Local H*/
If you put 77345 into your supercomputer and turn it upside down, it spells SHELL.
Shut up, be happy. The conveniences you demanded are now mandatory. -- Jello Biafra
Ovbiously you have noooo clue as to how the world works, oil is always going to be used, it's simply so easy to use, now the thing is that they'd find it either way, now would you rather they emptied all the big ones destrying the landscape there or went and only got half of it and then had to go and destroy so much more landscape in the proccess of getting the little ones?
Oops....you'll know what I'm talkin about in a bit.
jacked up on Java. *shudder*
I love the smell of Karma in the morning
I can answer a) with a 'yes' - look at the RedHat training & certification program, for instance. I've heard that other distro providers offer something similar, but I've only looked at RedHat so far - maybe I'll take a GNOME programming course and certification myself once I convince my boss that I need that enough to make him cough up the dough.
Black holes are where God divided by zero
It's nice to hear that Shell is using Linux to run that SuperComputer.
But to me, my own experience with Shell is HORRIBLE, ABSOLUTELY HORRIBLE !
Shell seems to like to build petrol stations RIGHT NEXT DOOR TO SCHOOLS ! In Malaysia, for instance, Shell constructed a gas station RIGHT NEXT DOOR to a primary school with a student body over ONE THOUSAND CHILDREN !
Let's not talk about the danger of EXPLOSION which will LEVELED the FOUR-STOREY BUILDING which houses the OVER ONE THOUSAND SCHOOL CHILDREN - even if we talk about the DANGER POSED BY DEADLY CHEMICALS SUCH AS BENZENE AND TOULENE, and the effect these chemicals will have on the CHILDREN, for the children have to ENDURE THE EXPOSURE TO THESE DEADLY CHEMICALS FOR A PERIOD OF SIX FULL YEARS !!
Malaysia is a THIRD WORLD COUNTRY, a country whereby there is NO LAW preventing construction of potentially DANGEROUS gas station right next to high-density buildings like Office Towers or Hotel or Hospital or Shopping Malls or Schools.
It happens that Malaysia is situated in the TROPICS, with the temperature CONSTANTLY ABOVE 85 degrees F, which is WAY ABOVE THE BOILING POINT of Benzene, which is 82 degrees F.
That means, the BENZENE (and other toxic chemicals) would be VAPORIZED into the air in such a hot climate, and the VAPORS will get into the lungs of the school children right NEXT DOOR !
There were a group of people opposing the building of the gas station right next door to the school building, but Shell DOES NOT CARE and they continue that construction.
I have NO PROBLEM with Shell making a buck selling gasoline, but I DO HAVE MUCH PROBLEMS when someone, including Shell, want to make bucks WHILE HARMING THE HEALTH AND LIVES OF OVER ONE THOUSAND INNOCENT LITTLE CHILDREN !
Here's where Shell is constructing the gas station in Malaysia which harms the lives of over one thousand children - It is situated at the Farlim District, in the State Of Penang, Malaysia.
I have emailed Shell's HQ, and Shell's subsidiary in Malaysia concerning the danger, I've called the Shell's Malaysian officies, I've faxed them, I've written them letters, I've even paid visit trying to meet with Shell's officers in Malaysia, but they JUST DO NOT CARE !
If there is anyone here know what to do next, I'm all ears. If you have any suggestion, please write to me at knive@newmail.net.
Thank you.
Muchas Gracias, Señor Edward Snowden !