Virtual Grid Supercomputer Goes (Partly) Online
hotsauce writes "The BBC is reporting that CERN (the guys who invented the Web) are working on a virtual supercomputer called the Grid. The Grid taps computing power from 12 countries to process data from a new supercollider that will simulate parts of the Big Bang. Phase One of the Grid just went online."
I have heard from some people involved in the grid that it is a triumph of PR over substance, and that it is not going to be as well-used and participated in as the press releases suggest...
Distributed computing has been a long time coming. Sure, grids are cool, but when can we download a safe piece of software which to use for distributed calculations? When I'm not it need of doing stuff myself it would use my idle time for other people's calculations, and vice versa.
Sure it doesn't work for any type of calculation, but there's still a huge potential.
Distributed backups is another thing I'd like to have now, rather than tomorrow...
.: Max Romantschuk
http://eu-datagrid.web.cern.ch/eu-datagrid/
$ strings FTP.EXE | grep Copyright
@(#) Copyright (c) 1983 The Regents of the University of California.
Al Gore did
Time for a lot of That sounds like the Matrix jokes
Jason
ProfQuotes
Get out of there now Gordon!
I know it sounds like the world domination scheme from a bond film, but I've seen what it can do.
A friend of mine is working on part of the grid for his PHD in the uk
and once you have watched him transfer 700 MB files from the uk to
Switzerland in under a minute you realise that they aren't joking.
I guess their next step is running quake over it!
It's My Tea and I'll Drink it if I Want To!
And electrical power from how many?
Money for nothing, pix for free
Imagine a beowulf cluster of... oh wait.
Your credit card information wants to be free.
In fact, distributed computing and "grids" are older than you are.
;)
Care to elaborate? Making claims is easy, but I'd like to know what you mean
.: Max Romantschuk
give the best bang for the buck?
Desi Noise, Live!
...you have to see it for yourself.
From Reference.com:
Entry: matrix
Function: noun
Definition: origin
Synonyms: cast, forge, form, grid, model, mold, origin, pattern, source, womb
Concept: origin/source
Source: Roget's Interactive Thesaurus, First Edition (v 1.0.0).
"Accept that some days you are the pigeon, and some days you are the statue." - David Brent, Wernham Hogg
who's Ben Launched? ... and how do we get him back?
john.e.boy
Is it just me, or is referring to CERN as "the guys who invented the web" a bit like referring to Paul McCartney as "the guy from Wings"? To a lot of people, CERN is probably better known as "the guys who know more than anyone about particle physics".
And obviously haven't updated their website since. Jeez.
I've been a big fan of distributed computing ever since distributed.net came out with their first client. The TCA Internet team used to be hot stuff back in the day as far as number crunchers (due primarily to me sticking the RC5 client on all three of the NOC's e450's as well as all the cube farm machines). So naturally, this interests me. I wanted to see what it took to get a grid-enabled machine. Costs involved. Scope of the project. The article's fine and all, but I knew I could go direct to the source. Not found. In fact, all of googles top 25 links to .ch sites seem to be down. Is this just me or did CERN disconnect their webserver and absorb the circuits into their grid or something?
goto http://rizzn.com
No big deal. You can get almost a Tb on to a single tape these days.
Government of the people, by corporate executives, for corporate profits.
Melius mori in libertate quam vivere in servitute.
I think one thing that distinguishes the USA from Europe (and in fact many other countries) is that, in the USA, you're really good at hyping stuff.
Over here in Europe we're crap at it, or rather, it's not seen as being so important - which I believe is a mistake.
I was once knew a marketing person at CERN who said that as they had invented the web, they were thinking of putting up some good web pages about it to let the world know what they had achieved. Later I found out that she had been told that it had been decided that it wasn't a priority and so no budget was allocated to it. So outside of techy fields most people in the world don't know that the web was invented in Europe. (Yes, I know the Internet network was an American invention).
This is true of many other achievements in Europe. For instance, everyone in the world knows lots about NASA and yet very little about the achievements of the European Space Agency, which has also done some really impressive things.
The USA also has a good way of claiming innovations as its own, by "Americanising" everything. So, for instance, most people - Americans and non-Americans - think that most technological innovation during the last century has been American, whereas in actual fact much of it was just "absorbed" by America. Example - landing on the moon is seen as a purely American achievement but was actually significantly based on German work. Another example - Einstein was of course European but many people believe he was American.
Don't get me wrong. I'm not really criticising the USA, I'm actually criticising Europe for not promoting its achievements or those of its citizens. And of course one of the great things about the USA is that it has the money and drive to make things happen, which is why many projects initiated in other places end up taking off in the USA. But it is frustrating to meet Americans that believe that everything is invented in America.
Not particularly. If you can't be bothered to perform Google searches I'm not going to do it for you.
Being able to perform Google searches is within my abilities, but I fail to see why you seem to wish to hold on to a piece of information which is freely available.
I'm sure I could find the references you originally implied, but I would be unable to determine if what I find is indeed what you were referring to in the first place. Your comment was far too ambiguous to make it clear what you meant.
I'm sure your arrogance serves you in some way, but I dare say you might find that being helpful instead of arrogant can be quite fulfilling as well.
.: Max Romantschuk
I'm getting a hadron just thinking about it.
I know about OpenMosix, but what I just wondered about was this...
Why not run a VPN for a worldwide network of "trusted" OpenMosix machines? OpenMosix is tunable, so you could tell it if you're on a slow-as dial-up link, so it only gives you long running jobs. You could use a chain of trust approach if required, or just sign up via the OpenMosix website for example.
That might even actually work.
Forget thrust, drag, lift and weight. Airplanes fly because of money.
He heard a story a while back (in the good old days), about grid computing, and thought it was neat at the time. That is the extent of his memory and knowledge about pre-existing distributed computing grids.
There are no karma whores, only moderation johns
Excuse my fat fingers and monsterous head cold.
He tried to kill me with a forklift!
This would mean that silly frivilous things like email apps etc would literally jump to attention regardless as to the size of the file I am working on, rather than as now everything slowly to treacle...
Question is paying for it. It would have to be cheap, built into the operating system and require fast broadband to transfer the data to the servers... Few year yet probably...
---- The Open Source Record Label : : LOCARECORDS.COM
I think the real question is: "How does he know how old you are?"
That should instantly be followed by: "And why does he go to the trouble of finding your age yet can't post the pertinent results of the Google search himself?"
for business and home users.
Grid Supercomputing: The Next Push
The Internet's nature is peer to peer - 20050301_cs_profs.pdf
hmm. which some say... yes, I suppose some may say that. Understand though, that these 'some' aren't informed and don't understand the physics involved.
(not that I do)
but... The researchers and physicists around the world waiting expectantly for this data assure us that not only are the black holes to be generated far to small to do any damage (they evaporate in far less than a second) but thousands of similar holes are "grown" organically in the atmosphere when cosmic rays strike with far more energy than what this device can produce.
Don't Panic. (it's not just for hitchhikers anymore)
yes, it is.
But the mass of the black hole will be very small,
so hawking radiation will vaporize it in a fraction of second. The mass is also too small
to be any danger. (it is very rare that i suddenly get sucked across the room by the gravitaional pull from my socks in the corner and they approx 10^30 times more massive than the black holes )
I can tell you it is not a waste of time, or some glorified PR exercise. The establishment I work at specialises in large-scale carbon growth modelling, and we have seen computational time for whole-Europe models fall from 48 hours on a dual P4 Xeon to a mere 5 minutes using MPI Fortan/C++ on a 64-node GRID machine.
If that's true, then so is Einstein's theory of relativity... universe starts with a Big Bang, ends with black holes...
Dut dut DUT!!!
Hehe :) Despite his manner he's right: certainly other particle physics experiments have been using distributed computing to analyse their data, not using a Grid (BaBar for example, eh Grid Geek? ;)). Like the LHC, the initial aim is data distribution rather than accessing processing resources...
Where are all the supercollider and skynet jokes, shit? /me passes tim a mikes /me gives the rest of the moderators a miller /me passes out
Well, some people say this, but they don't really know what they're talking about. (I seem to recall some people saying that RHIC would be the downfall of all human civilization, by the way, yet we're still here.) Black holes decay via Hawking radiation. The smaller they are, the faster they decay, and the ones that might be produced at LHC would be mighty small. (...if they could even be produced at all, which is sort of doubtful in my mind) They would decay long before they even reached the inner wall of the detector.
I think that in general, it's a good idea to be sceptical about end-of-the-world scenarios like this. If it were possible to destroy the world by smashing particles together, it would have happened long before humans ever existed - Earth is continuously bombarded by cosmic rays that have **much** higher energies than anything we could ever hope to create in a lab. Any kind of strangelet, black hole, or whatever that could ever be produced in an accelerator has been produced by cosmic rays in the upper atmosphere. So don't worry about this sort of thing.
-Bill
no, afaik.
..
the experiment to create artifical black holes is another story, but yes, it will take place in this Collider (LHC).
Anyway, you don't have to be afraid, black holes which doesn't reach the critical mass will "eat up" themselves (radiating out their energy to the environment), so they'll eventually evaporate ( according to Prof. Hawking. The experiment will only create very-very-very small black holes, which will "live" only for some nanosecundum or less
)
you should check out http://www.hawking.org.uk/ for more info.
-- "Turn and Draw!"
Shit, that was the cause of the power surge we just experienced...
From an Australian perspective b/w costs are prohibitive ATM for this kind of collaboration. Australia has GrangeNet which is a high b/w backbone linking capital cities and a PetaStore in Canberra. Traffic on this backbone is free after paying an annual fee but joining the European grid is still somewhat of a pipedream (yuk, yuk, yuk...)
In fact, distributed computing and "grids" are older than you are.
I'm 76, you insensitive clod!
but according to ICDCS, it is older than my lesbian granddaughter.
Note that the article didn't say conclusively whether this computing power would be available for home users... But, it would be useful to use the power of all those computers that are left on all night by companies (the ones that use 5% of the total US power consumption).
-StarMaven
Rob de Graaf
Unmotivated? Depressed? Don't want to live?
Look on the bright side: you have nothing to lose!
Now is your chance to live out your dreams, sell everything you own, steal enough to survive for the rest of your life, kidnap a few beautiful members of the opposite sex, flee the country, and go into hiding in the jungle of your choice! Excitement, adventure, and more await you. And what would you be giving up in the process? Nothing, because what you have now is worth nothing! You can only win! If you don't want to live, then it's time to live!
I remember when a particle colider that generated 10MB of data was a beast, and a usefull particle colider could be built to fit and run on a tabletop. Now this beast is online, discovering new particles and whole new laws of physics, but my microwave still takes 30 sec to heat up my leftovers on High! Where is my particle accelerator, bacteria killing, INSTANT (300ms) Nuke-ro-wave! Is that to much to ask?
md5sum
d41d8cd98f00b204e9800998ecf8427e
I thought Al Gore invented the Web as part of that Internet invention thingy of his.
If you don't understand anything I post, please accept that I ate paste as a small boy...
Black holes can only be created at the LHC if extra (Kaluza-Klein) dimensions exist on the microscopic scale. It is gravity acting through these extra dimensions that will give the extra oomph needed to create black holes in a proton/proton collision. If Kaluza-Klein dimensions do not, in fact, exist, the LHC's center-of-mass energy is far too low to make even such small black holes.
To follow knowledge like a sinking star, / Beyond the utmost bound of human thought. ("Ulysses", Tennyson)
http://news.bbc.co.uk/2/hi/technology/3152724.stm
"...
'Profound effect'
The first phase covers processing resources from research institutes in 12 countries - the UK, the US, Switzerland, the Czech Republic, France, Germany, Hungary, Italy, Japan, Russia, Spain, and Taiwan. "
http://www.aphis.usda.gov/NCIE/country.html#BSE
Countries/areas affected with BOVINE SPONGIFORM ENCEPHALOPATHY(BSE)
9 CFR 94.18
Austria Italy Belgium Japan Canada Liechtenstein Czech Republic Luxembourg Denmark Netherlands Finland Oman France Poland Germany Portugal Greece Slovakia/Slovenia Ireland Republic of Spain Israel Switzerland United Kingdom
i think not.
SPOILERS Didn't you see T3? A particle accelerator saved the day! 5.76 TeV baby! Hello to any Summer Students who may be reading this.
To follow knowledge like a sinking star, / Beyond the utmost bound of human thought. ("Ulysses", Tennyson)
Aah yes, that may be so. I was however referring to the first 2 movies, I haven't seen T3 either. What was that you say? In the movie the governor of California was armed with a 5.76TeV something and saved the day?
...another language is that it's very hard for many of us to find opportunities to use it. I wish I could speak more than one language. I also like the concept of everybody learning Esperanto and making that the universal tounge. The problem is, in the entire course of my life, I've met only a handful of people who speak a language other than English. I've tried to learn German, but because I very rarely get to use it, I can't remember it.
Because of this, circumstances do sort of require that if you're going to be living and working in America, you probably need to learn English. As for looking at people who don't speak English as stupid; I can't speak for everyone but I think you've got that backwards. I tend to look at multi-lingual people with a certain degree on envy.
A goal is a dream with a deadline
Actually we thought to be responsible... atleast if you are in italy. The French electrics needed more power and patched the italian one to have more capacity. But it blown out some kinda something with a cascading effect. ... sweet ...
Which parts? The "BA..." or the "...NG!" or the "What the f**k was that?" 8-)
Go permanent? In your dreams and my worst nightmares.
"Grid computing" is just the new buzzword for PHBs and arts graduates (yes, that's you, that is). So, no I can't truly say that I ever heard any stories about grid computing "in the good old days".
I could tell you all about network queueing systems though, home grown, freely available open source stuff and commercially available systems.
As I said, "Grid computing" is nothing new, it's been in use for decades by those of us who know better than to waste 95% of the computing power they've purchased.
Distributed computing and "grids" are only new to you.
Government of the people, by corporate executives, for corporate profits.
He told me that most Americans can't speak another language and expect you to learn English, but not speaking another language themselves don't realise that learning another language isn't easy. And they treat you like crap and think you're stupid if you can't speak English. I don't know if what he said is true or not, but unfortunately I don't find it hard to believe.
All Americans processed through the public school system generally take 3-6 years of a second language, and Spanish is the most popular one. This isn't to say that any of them remember enough to get by in conversation, but the attempt was at least made...
People treating you like you're stupid because you can't speak the local lingo is hardly an American phenomenon. And hardly nonexistent in European countries, no matter how multilingual they are forced to be because of the poor shape of their individual markets.
And, it's not so bad an assessment IMO - minus language, the scope of things humans can do with one another is dramatically reduced, so while the other person may not actually be stupid... effectively, in most cases (especially in cases of brief social interaction such as direction-asking) there's no difference between a gibberish-speaker and a retarded person, or a lower animal.
Having survived in Japan and Brazil for a year each starting as a novice in both languages at first, I feel sympathy for non-English speakers that have to deal with life in English-speaking countries, but my feelings don't change anything tangible. You should learn (and strive to master) the language(s) of your host country or expect to be received as a retarded person or an animal would.
Is it just me or does this story sound earily like the Dan Brown book "The Davinci Code", in which anti-matter (created by big-bang experiment in a particle accelerator) was used as an explosive to try and blow up the Vatican.
Hmmm. Maybe life does immitate art.
LHC is the collider. LHC is being used by atleast 4 projects. These projects make the 8~10 PB of data a year. This is already filtered data ;-)
Grids are to divide the load and distributed the computational tasks as the storage tasks for the experiments.
Also biomedical tasks and Earth observation use the Grids for there data intensive jobs.
His "computer superhighway" bill in the late 1980s finnnced the connection of the miltary network with several disaparate academic networks.
Coincidentally, I just finished reading "Angels & Demons" by Dan Brown last week. The book talks a little about CERN's work in "recreating the Big Bang" and anti-matter and all that fun stuff. It's a pretty good book about the Illuminati, and it gives you a little look into art history in and around the Vatican as well.
It wasn't as good as "The DaVinci Code" though. (Possibly one of the most interesting books I've ever read.)
NOTE: If you want to read the books, don't look at the pictures on the website until AFTER you read the book(s).
Karma: NaN
And by the way... CERN IS THE DEVIL!
;-)
What's their logo all about? 2 rings and 5 lines going out from it?? Rotate the logo and you'll see three 6's!!! SATANISTS!!!
Karma: NaN
that's right. yOUR kode base is growing exponentially.
the ?pr? ?firm? stock markup FraUD bullshipping feechurn has raised the momeNTdumb insignificantly.
as for using the eyecon0meter for meteorological reporting: we're using the ONstarGazing&HandWaving system, which appears to give more accurate results than the model rocket cam we were using.
not only are we building a vessel that floats on almost any suBStance, we're also developing a support net...(actually)working devise for it.
I used to work in the computer centre at CERN, and they've been using distributed computing (read "clusters") for a long time (at least 10 years) now. By the time I left, there were already some 500 2 CPU Linux PCs in the computer centre, and a serious amount of thought was being given to building a mezzanine level within the computer centre to create more floor space for PCs. CERNs problem was always one of scale.
:) I hope it all works out. What I'm wondering is what sort of network they have connecting the sites - the work load of these machines is very simple - but mostly IO bound. What sort of bandwidth do they need to make 15,000 TB available all over the world?
:)
Now it seems they want to buy floor space at other institutions around the world.
More fun facts - at the time I left they had 5 STK Powderhorn silos, holding their current data. Prediction for LHC requirements (including better tape storage densities) was that they would need another 40 silos. If you've seen an STK Powderhorn, then you know just how ig the things are. So another building was to be built just for these silos.
Oh, and as someone pointed out, the 15,000 TBs a year is just the data that gets kept - the live data from the detectors is preprocessed in the computer centre and "thinned out". The data rates coming into the computer centre are truly mind-boggling.
It sounds more like "Colossus: The Forbin Project," a movie made in the 70's when the net was just a twinkle in Bernard-Lee's eye. The movie is about a defense department computer that links up with a russian computer and together they take control of all the world's nuclear missles. Eventually they take over the world for the "good of humanity."
This movie, like may others assume that machines will one day become sentient. Something that hasn't happened yet, but who knows what will happen as computers and computer networks become more complex.
more at: http://imdb.com/title/tt0064177/
TANSTAAFL
I think you're missing something here. To a lot of physicists and other scientists, CERN is probably known as "the guys who know more than anyone about particle physics". But, to the average guy, CERN is probably a totally unknown quantity.*
If you were to mention particle physics then Mr. Average would probably still be none the wiser - to him it would still be "men in white coats with massive dome-shaped heads" stuff. However, if you mention the world wide web, the chances are that he'll know what you're talking about.
People relate to things by association, especially by association with their own lives and experiences. Most people have no clue what a quark is, let alone know what flavours mean in this context, but they do know what a web page looks like.
(*That's not to say that only scientists know about CERN, only that relatively few non-scientists know about it. I'm sure there are some non-scientists that know CERN backwards, but they're in a very small minority.)
"Accept that some days you are the pigeon, and some days you are the statue." - David Brent, Wernham Hogg
no further comments...
The Matrix just isn't right for this. Tron is.
"Hey, hey, hey! It's the big Master Control Program
everybody's been talking about."
"C'mon big fella, let's see what 'ya got!"
"I want him in the games until he dies playing."
"I'm going to have to put you on the gamegrid."
End of Line
So at what time did it become self-aware?
sarchasm: The gulf between the author of sarcastic wit and the person who doesn't get it.
This is not a supercomputer. It is just a collection of individual laboratories and universities running plain old batch systems on Beowulf (or beowulk-like) clusters. To transfer jobs and data between sites they're using Globus. It's really not interesting stuff, certainly not newsworthy. This Grid is held together with duct tape and spit. The Globus software is woefully immature (Expect complete rewrites years. Expect refusal to fix crippling bugs because the next complete rewrite due out next year might fix it.) The Globus software is only a partial solution, it really only cares about moving data and jobs between sites. Anything more complex like automatically assigning jobs to the least busy site, distributed management of user accounts, or even ensuring that jobs eventually finish requires piling more software on to. This additional software is also constantly changing. The result is a system that is at best frustrating to install and configure, assuming someone else has assembled a known working package. If you're doing it by hand, expect days of effort. When things go wrong the system is a nightmare to debug as the many, many layers of software don't propogate errors (that is, when the error is logged at all, sometimes they'll just silently fail).
It was a small collider but unfortunatley not small enough to be carried, not even by the GOVERNATOR. ...The only summie who actually thought that T3 was as good as the other two movies
<br>
This article should no boubt be mandatory reading for all summies.
<br>
Question authorities
I am working on the group that work on the Grid behing the LHC. The name of this Grid is LCG.
:
: :
A grid is
+ connectionn between large cluster
+ distributed mass storage system
+ dynamic reallocation of the ressources
+ And lot of other services for transparent usage of ressource trough the world.
If you want precise url to get info read this
LCG (itself) : http://cern.ch/lcg/
Eu Datagrid (European Grid Software use in LCG)
http://eu-datagrid.web.cern.
Globus Toolkit : http://globus.org/
If you need other info ask (i will try to follow).
PS : Cern create http protocol.
Datagrid was long and hard to devellop, but the actual result is *good*.
Unfortunately, no one can be told what The Grid is... You have to see it for yourself.
I apologize in advance if this is stupid, but isn't what you're talking about exactly what SETI does? The question is not at all stupid. SETI@Home does this
Well not quite. The distinction that needs making is that SETI@Home, etc. Is a parallel implimentation of a serial code. Whereas the GRID that CERN is talking about is a parallel implimentation of a parallel code, or even just a single parallel code. Where the calculations that are taking place are done on such huge datasets that they require thounsands of processors to work together on the problem.
So the code would split the calculations between the processors, but interprocessor communication would be an essential part of the program. Meaning that it could only be done on machines with fast interconnects, ie super-computers. Each of the computers in the GRID will have around a TFlop max output, and when there linked together, it should give some awesome power....
Just imagine a beowolf cluster of those things ;)
My spelling isn't bad, I'm evolving the language
Am i the only one with a dirty mind or does the name "the large hardon collider" sound a little inappropriate?
Press: so... what's the name of your new supercomputer?
PR: the large hardon collider
Press: the large hard on collider??!!
PR: yes
This is unbelievable...
A *large hardon* collider that will simulate the *big bang*!!!
LOL
who named this thing!
You can compare countries by giving students the same test. That's exactly what the The Third International Math and Science Study (TIMMS) did.
To get around your objection that some countries segregate students after 8th grade, they tested 4th and 8th graders in all the participating countries. Bottom line was that if you are an American who scored in the top 5% on your math tests, you're just a bit above average compared to Taiwan, Japan and Singapore.
Wonder why all the IT jobs are going overseas? There's one very good reason.
CERN will hit a brick wall with this project. The infinite number of calculations required to predict the ripple effect caused in the big bang can not be calculated using conventional brain based computers. In theory it is a good idea, but with quantum computers still in the concept phase, CERN will find that they cannot accurately complete this project without a computer that can make calculations an infinite number of times.
There is no market for this thing (yet).
:))
Grid is good for science where people intend to
share data and results. I doubt that big industry
or military would trust their tasks to a world
distributed network.
For the rest of the people the power of one PC
is still enough. There is no "killer application"
which would make them use home delivered computer
power and pay for it (unless MS will decide to
add some extra features
Entertainment industry and gaming with heavy
MMORG worlds simulations are probably a good
candidates.
I thought it was Al Gore???
can somone give me a link for "the web"?
Neat. So the LHC is also an "extra dimension tester"? That's really cool. I wonder what we can do once we find extra dimensions? Could we somehow pull energy out of them?
I feel fantastic, and I'm still alive.
"The part where the article is completely off is where they describe CERN as the people who invented the Web."
We know this is true. Al Gore invented the Internet. At least he said he did. No, this was not made up by Rush Limbaugh and his EIP Network (Excellence in Pill-Popping), nor was it the right-wing that brought Gore's silly claim to light. It has been in CNN archives for ages.
"of a bug in PAW (pronounced Poor). "
Does this mean Law is now pronounced "Lore"? Sounds like some sort of cockney thing going on.
I'd use it to find out how to find a cause and effect combination to make spears and madonna kiss on command
Well, the LHC has many things it is supposed to find, extra dimensions among them. Honestly, I'm not terribly familiar with the Kaluza-Klein theory. Basic physical laws would still hold, so no energy could be created. Furthermore, in order to have the extra gravity at small dimensions, you first have to accelerate your particles enough so that they overcome any Coulombic (or strong force) repulsion, more than offsetting any gains you might get from gravitational potential. So nah, I don't think so.
To follow knowledge like a sinking star, / Beyond the utmost bound of human thought. ("Ulysses", Tennyson)