Slashdot Mirror


Playstation 2 Linux Cluster at NCSA

Mr. Spock writes "The National Center for Supercomputing Applications is looking at scientific computing on the Sony Playstation 2. They've set up a cluster with 65 compute nodes. They're running Linux for Playstation 2. What will they think of next?"

45 of 232 comments (clear)

  1. More info by cascino · · Score: 5, Informative

    More info on the processing power of the PS2 as applied to computational chemistry.
    Basically, this study shows the PS2 has roughly the computational linear algebra power of a PIII-600 (the then fastest processor on the market).

    1. Re:More info by jean-guy69 · · Score: 4, Interesting
      ahem... not exactly if you read carefully:

      45MFLOPS, which is better than the 36MFLOPS obtained for the Intel machine using assembler that has been heavily optimized. If anything, this performance estimate is conservative in favor of the PS2, because our primary goal was a working assembly dot product in macromode and we have made no attempt to optimize the code. For example, our code uses only three of the VPU registers, and a speedup of up to 4x (the latency of the floating point multiply instruction) may be obtained by using all of the available registers.


      so, using *unoptimized* ASM on PS2, PS2 is 25% faster that the intel machine using *heavily optimized* ASM.. and optimizing code would probably earn BIG performance gains (400% !?) on the PS2.

      taking the sentence the the letter there is a potential of 500 % the speed of the PIII 600 on the PS2 for this particular calculation.
  2. Wow! by d3kk · · Score: 5, Funny

    Imagine a cluster of...

    Oh.

  3. imagine.. by Anonymous Coward · · Score: 5, Funny

    imagine two thirds of the comments mentioning a beowulf cluster of something!

    oh wait..

  4. Well. by Pres.+Ronald+Reagan · · Score: 5, Interesting

    This seems like a fairly expensive way to make a cluster. $200 for each PS2 and $200 for each Linux kit? That comes out to $26,000. You could buy computers with more RAM and faster processors (than a 400MHz MIPS) for about the same amount.

    --

    Abortion is advocated only by persons who have themselves been born.
    --Ronald Reagan
    1. Re:Well. by htmlboy · · Score: 4, Insightful

      This seems like a fairly expensive way to make a cluster. $200 for each PS2 and $200 for each Linux kit? That comes out to $26,000. You could buy computers with more RAM and faster processors (than a 400MHz MIPS) for about the same amount.

      the benefit comes with problems that can be highly optimized to work on the ps2's vector processor. for pure vector operation, the graphics system in the ps2 provides better bang for the buck than chips with less specific capabilities. it doesn't do much, but what it does, it does it pretty quickly.

    2. Re:Well. by computechnica · · Score: 2

      Except that M$ doesn't want any one to use there precious X-crap for anything other than what Bill says. Sony opened up it's platform for Linux almost from the start.

      Check out this fun use for a PS2 - Qcast . All without Uncle Bills promission or a Mod chip.

    3. Re:Well. by Henry+Stern · · Score: 2, Interesting

      US$26k for a cluster is DIRT cheap. The prof next door to my supervisor made a 32-node Xeon cluster last year for a modest $125k by using commodity parts, an extraordinary feat of frugality. Most new clusters used for scientific computing cost US$500k or more.

      Unfortunately for me, the kind of work that I like to do does not easily fit into a node with only 32MB of memory. This rules out any excuse I could have to apply for a grant to build a desk out of a cluster of PS2s. ;)

  5. damn you! by Anonymous Coward · · Score: 3, Funny

    What do we have left to imagine _now_?

  6. Is this legal? by BitterOak · · Score: 2, Interesting
    I know Microsoft claims XBox modding is a DMCA violation. Is any modding necessary to put Linux on the PS2?

    If so, this could be a great DMCA test case, since NCSA is a respectable organization, and would present a much more sympathetic case in court. Even if they don't go after NCSA, others could use it as an example.

    XBox modders, for instance, claiming substantial non-infringing uses could point to the NCSA PS2 cluster as an example.

    --
    If I can be modded down for being a troll, can I be modded up for being an orc, or a balrog?
    1. Re:Is this legal? by JohnCub · · Score: 5, Informative
      Sony sells the linux kit for ps2. So I'm guessing they are saying it is ok to put linux on your ps2.

      http://www.us.playstation.com/hardware/more/SCPH -9 7047.asp
      Linux (for PlayStation®2)
      The Linux kit (for PlayStation 2) allows you to use the versatility of the GNU Linux operating system with the power of your PlayStation®2 computer entertainment system as a fully functional desktop computer!

      • The Linux Kit (for PlayStation 2) includes:
      • Linux Kit (for PlayStation 2) release 1.0 software
      • Monitor Cable Adaptor (for PlayStation 2) (with Audio Connectors)
      • Internal Hard Disk Drive (40 GB) (for PlayStation 2)
      • Network Adaptor (Ethernet) (for PlayStation 2) [10/100 Base-T]
      • USB Keyboard (for PlayStation 2) & USB Mouse (for PlayStation 2)


      ~$200
      --
      -= Why can't I add 'Anonymous Coward' to my list of Foes? =-
    2. Re:Is this legal? by Dunark · · Score: 2, Interesting

      ok.. I am so sick of seeing this.. the xbox modding may or may not be a 'DMCA violation' but that is not the point.. xbox modding is ILLEGAL in any country with even the most basic of electronic intellectual property laws as you are using an ILLEGALLY modified BIOS image.. so please, stop acting as if it is evil of the microsoft oppressors to be claiming this as so.. so believe what you want, but unless you are using cromwell, xbox modding on the most basic level is equivalent to piracy

      Just out of curiosity, where is the restriction on xbox usage spelled out? Is it a plain and obvious label on the outside of the package that a buyer can see before they pay for it? Or is it hidden somewhere inside the package?

  7. Unfortunately... by dfn5 · · Score: 5, Funny

    the nodes started competing with each other and yelling "w00t w00t". In the end no work got done.

    --
    -- Thou hast strayed far from the path of the Avatar.
  8. Re:1 more cluster.....and I'm gonna by aeinome · · Score: 2, Funny

    Cluster fuck. Happy now?

    --
    When you don't have a leg to stand on, don't even get up.
  9. Cheap, easy (erm..) and powerful by valisk · · Score: 2, Interesting
    Seems like a nice use for the playstation2 and rather nice of Sony to provide a Linux kit for the machine, it is a bit expensive though but I imagine it is quite a bit cheaper than a cluster of comprable SGI Mips boxes. In fact it wouldn't surprise me to find out that this cluster cost less than a single SGI Workstation.
    Looks like cash strapped science labs all around the world may soon be rolling in CPU cycles on a failover cluster built of Kids game consoles and Linux, and the heavy duty workstation manufacturers will see their stock slip even further.

    --

    Economic Left/Right: -0.62
    Social Libertarian/Authoritarian: -3.69
  10. Reminds me of this cartoon by muon1183 · · Score: 4, Funny

    This reminds me of an episode of one of the cartoons I read. Written by a Nuclear Engineering PhD at Berkeley, the strip is quite funny. Here is the one this reminds me of.

    --

    There's no sig like SIGSEG
  11. What's next? by questamor · · Score: 4, Funny

    What will they think of next?

    Probably clusters of just about any cheap all-identical hardware. It seems to suit the concept of clustering well. Sony have already done all the marketing and hardware price cutting to get the machines out there and used, while subsidising that cost with the games they sell. They'll only get cheaper. On top of that, they're identical systems that'll stay pretty much the same for the next 2-3 years. Good for spares in the future when three of your boxes have worn out, and the pet rat belonging to professor sieslak upstairs has pissed in two.

    Sounds good to me!

  12. Next step by Anonymous Coward · · Score: 2, Funny

    Perhaps they got this idea from Slashdot. Then it's easy to predict what they will do with their cluster. They will render a picture of Natali Portman, naked and petrified.

  13. No performance info... by StandardCell · · Score: 4, Insightful
    ...but a group from UIUC says:
    We have also investigated the impact of vector size on performance. The EE processor is tailor-made for 4-element vectors, so one could expect performance degradation for longer vectors. In fact, the opposite is found - a consequence of the pipelining built into the VPU. Performance improvement stops once the vectors reach length 16, consistent with the rather shallow pipelines used in the VPU. In Figure 5, we compare the performance of the PIII-600 and Playstation 2 for 32-element single-precision vector dot products. The absolute performance for smaller datasets now tops 150MFLOPS for both the EE and PIII processors. Curiously, one sees a performance hit on the EE once the dataset exceeds 5 million vectors. This is almost certainly a consequence of the small amount of memory available on the PS2.
    So, I have two question:

    1. What are the performance stats of the cluster in the /. story?

    2. Why would you bother when you could use current commodity hardware for much less? I mean, a P3-600 is interesting, but you could probably drop some Duron 1.4s with a basic mobo and 256MB RAM for less out the door than a PS2. (Note: I'm only asking, please clarify if you have a better idea of what's going on).
    1. Re:No performance info... by SanLouBlues · · Score: 3, Funny

      The real reason for using consoles is that this cluster has a higher resale value, so when the project is done, they can make some of their money back.

    2. Re:No performance info... by bobbozzo · · Score: 3, Informative
      1. What are the performance stats of the cluster in the /. story?

      320 MFlops on matrix ops. Not great, but they say it's capable of 900 if they can feed the VPU fast enough. They think they can use additional existing hardware in the CPU to increase memory performance.

      2. Why would you bother when you could use current commodity hardware for much less? I mean, a P3-600 is interesting, but you could probably drop some Duron 1.4s with a basic mobo and 256MB RAM for less out the door than a PS2.

      Maybe. Wal-Mart sells Durons (with Lindows) for $199 complete, sans monitor.

      But, apparently PS2's are under $100 according to another poster.

      ISTM that they may be spending a lot of time figuring out how to optimize code for the PS2 though.

      --
      Nothing to see here; Move along.
  14. Playstation 2 Linux by Anonymous Coward · · Score: 3, Interesting

    Apparantly this runs on Sony's own version of Linux

    See more about it here: http://playstation2-linux.com/

    Maybe an XBox port in the future? :)

  15. Re:Yay... by Mysticalfruit · · Score: 5, Insightful

    I Highly doubt they paid a dime for any of it... I'm sure they told Sony what they wanted todo and Sony said "Hmm, 65 PS2's and you'll make a cluster out of them and we'll get good press? Sure, where would you like the pallet delivered..."

    --
    Yes Francis, the world has gone crazy.
  16. Re:Iraq by sould · · Score: 4, Insightful
    According to Zdnet:


    A source close to Government Intelligence services in the UK said: "This is complete cobblers. For a start, the suggestion that there's a shortage of standard PC hardware in Iraq is silly. PCs are commodities like cars and washing machines, and they can get as many PIII and P4 PCs as they like, sanctions or no sanctions".

    I feel I should make a WMD joke here...but I won't.

  17. Linear price declines, exponetial performance gain by SpikeSpiff · · Score: 4, Interesting
    The issue with using game hardware, especially "older" platforms, is that the price can not come down as fast as overall computing performance can increase.

    This means that the cheapness of stable platforms can not compete with innovative platforms.

    The real question is whether the administration and maintentance benefits of a homogenous and stable platform outweigh the higher cost of processing power.

    I suspect that we will see a step function between rapidly and smoothly improving Dell boxes and occassional huge leaps on game platforms.

    --
    "All that is required for evil to triumph is for good men to do nothing." - Edmund Burke
  18. We've investigated GameCube clusters too. by Samir+Gupta · · Score: 4, Interesting
    At Nintendo, we've been excited about clustering applications of game consoles as well, and we've pursued a active program of research within our company.

    Internally, we've experimented with large clusters of GameCubes to handle applications such as online games where various game entities in the universe can be logically decomposed into discrete units and processes running on each node of the cluster. This provides a more natural and robust organization to the traditinal setup of a few massive servers, since if one server crashes, it may bring down large parts of the game universe. In our setup, if a node fails, it might affect one NPC at worst, which another node will take over in due time.

    While our investigation has targetted the needs of games in mind, I'm excited about using them for sheer computation, since the cost/MIPS of a game console is far less than traditional mainframe, supercomputing, or even PC platforms, and we are in preliminary talks with some large Japanese universities to experiment with using the GameCube as a compute unit.

    While I must admit I'm sort of biased :-), we believe that our GameCube makes a superior clustering platform compared to the PS2, computationally (higher CPU speed), physically (its smaller size and form factor, less heat dissapation) and financially (lower unit cost).

    Our future game consoles will likely support clustering "out of the box", with expansion as easy as hooking them together, allowing games, such as FPSes, or AI-heavy games like the Sim* series, to seamlessly evolve with the greater "virtual" CPU and memory resources that a cluster provides.

    --
    -- Samir Gupta, Ph. D. Head, New Technology Research Group, Nintendo Co. Ltd., Kyoto, Japan.
    1. Re:We've investigated GameCube clusters too. by waldo2020 · · Score: 2, Interesting

      hey Mr. PHD, sure the clock rate is higher on your PPC, but where are your vector units?? Streams benchmark shows PS2 sucks vs a PC, but it's the vector units that shine. good luck duplicting a toshiba custom vlsi Emotion Engine with the hardware you've got on a Cube. No way to add a hard drive, no way to read an ISO disk or DVD... no built in LAN - how did you say your Cube was better suited to clusters?

  19. Re:Iraq by Anonymous Coward · · Score: 5, Funny

    I feel I should make a WMD joke here...but I won't.

    Windows of Mass Destruction

    there

  20. Also worth considering: the Xbox by mkro · · Score: 5, Interesting

    A Xbox is cheaper than the PS2 (An Xbox is about $150, according to OSDN Pricewatch), comes with twice the amount of memory, ethernet, and instead of buying a $200 Linux kit, you pick up a flashable, legal* mod chip for $25-$50. How the Emotion Engine compares to the Xbox P733 I have no idea, but I can't imagine the EE is that much faster.
    Both The Xbox-Linux Project and Gentoox can provide you with a distro. For free.

    Even if you're not planning a cluster, this is a good deal for a low-performance work station, or just a "media box", using Xbox Media Player, which plays most (all?) popular media formats, both music and video.

    It's been repeated countles times that Microsoft are losing money on the console itself, and depend on the games to cover their expenses. Therefore, paying up for a Xbox and giving your money to MS isn't immoral as long as you don't buy any games.

    See, it's a win-win situation :)

    * I lost track of the current situation in the U.S., but in the free world (Read: Europe) at least the chips not using MS code is legal.

    --
    I shall go and tell the indestructible man that someone plans to murder him.
    1. Re:Also worth considering: the Xbox by Space+cowboy · · Score: 2, Informative

      The vector units on the PS2 are far and away more powerful than the graphics card on the XBox. They're fully general-purpose vector processors, not a graphics chip co-pro. I *do* know a little about this topic - I've written a VU simulator...

      Go to the Sony PS2 demo section on the PS2 linux site, and look at the VU demos there - or at least read about them. There are examples of marionette models being manipulated in response to the user input (x,y,z,buttons for impulses, etc.) on the controller. The physics is correct. The entire program runs on VU1...

      These aren't graphics pipelines with programmable filters (Cg, for example), they're general-purpose CPU's with float and integer registers, maths operations (obviously), local single-cycle RAM (for programs and data), dma channels, interrupts, the works.

      I'll start to take note of the Xbox graphics when you can download programs to it, tell it to execute them (until an event happens), register inbound/outbound dma data-transfers so it doesn't run out of data, and then let the main CPU get on with doing its own stuff. What's that, you say ? It can't ? Oh well. Shame.

      The PS2 was an experiment in a new computing architecture - one that almost cost it dearly, since it's a pain in the *rse to program if you don't adapt to its' strengths rather than force it to use your own. It's a dataflow architecture - you download programs to the CPUs, then stream the data (vertices, colours, textures, etc.) through the programs from RAM using DMA and onto the graphics rasteriser.

      The thinking is that most transformation programs can be expressed relatively succinctly, and that there's always more data than program anyway, so your algorithm for the bubbling ripple effect is (say) 6k, with (say) 2M of vertex,texture,lookup, etc. You feed in the same (initial conditions) data every frame, and a time clock, letting the VU program calculate the vertex manipulations... Because the data is always going to be much larger than the code, the overhead in switching VU programs during a frame is negligible, so do it whenever you need to...

      When you think of the problem that the PS2 engineers were trying to solve, the architecture is very neat & very elegant ... The PS2 has (for its' time) enormous bandwidth between on-chip modules, local cache RAM on all the processors, a general-purpose MIPS chip to keep things ticking over (run this one, wait,... run this one, wait...), and the VU's to do the heavy lifting from frame to frame.

      In fairness, the more recent PC cards are almost getting there - Cg2 will be better (it'll have loops!) I think the maximum program length is currently 128 instructions as well . Whoosh. But at least it's getting better.

      To try and compare the two is laughable at best. Yes, they both produce similar games, but they do it very differently under the hood, and this thread was about using the VU's in a cluster to form a supercomputer, after all... (I think that's misguided, myself, even using BSP you'd be hard pressed to cope with the latencies involved, but that's another story!)

      Simon

      --
      Physicists get Hadrons!
  21. It's the trend of the future by Ryu2 · · Score: 3, Interesting
    Since 3-D graphics essentially is comprised manupulating vectors very quickly, the Graphics processors found not only in the PS2, but the latest PC graphics cards are now essentially very fast stream-based vector processors, and can be readily harnessed for general-purpose scientific computation other than graphics: particle, cloth, fluid simulations. The GPU replaces the CPU for computation, and texture or other video memory, with its much higher bandwidth and lower latency than system ram, is used as a backing store for data.

    A lot of the GDC and SIGGRAPH 2003 papers focus not on graphics directly, but on scientific computations using the CPU. It's very cool, and if nVidia and ATI the like ever want to expand into a new market, they should build cards with multiple GPUs each, and sell them to the scientific community, or to non-realtime CG places like Pixar to accelerate their offline rendering.

    This page has a good summary of the current research going on to make GPUs do stuff other than graphics. http://wwwx.cs.unc.edu/~harrism/gpgpu/index.shtml

    --
    There's 10 types of people in this world, those who understand binary and those who don't.
    1. Re:It's the trend of the future by afidel · · Score: 4, Informative

      The big problem with using PC graphics cards is that the memory bandwidth on the AGP bus leading back to the system is abysmal. I know several groups looked into this when the Geforce 3 came out and suddenly we had a high speed low cost programmable vector processor, the result was that unless your application could return relativly small datasets you weren't going to get much performance out of them. I think a PS2 would be similarly hampered by the small amount of ram available, not many interesting datasets would fit in it.

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
  22. Still a waste by nobodyman · · Score: 4, Insightful

    The hardware costs are negligible whether NCSA paid for the units or not. I doubt Sony paid the salaries of the people working on this -- and this is where the real money is spent. I'm all for people working on projects like this even if it's for no better reason than to see if it can be done. But when my tax dollars are involved, and we are in an economic downturn, and the nation and many states are facing huge budget deficits, my hacker ethic gives way to my pissed-off-taxpayer ethic.

    Really, there is no tangible scientific benefit to doing this, so I don't know why they bothered. The only leg they have to stand on is if they argued they were trying to see if a terrorist-friendly nation could build a supercomputer out of toys, but we know this is true already so I still don't like it. If they wan't to play around, they can do it on somebody elses dime... not mine.

    1. Re:Still a waste by tarzan353 · · Score: 3, Insightful

      ...and you're completely off base. There is a distinct scientific benefit of doing this. The VPU is fast as hell for how cheap the hardware is.

      They aren't just "playing around"... this project initially was being directly used by the chemistry department in scientific computing. Only after word got around a little bit did more people start looking into how best to exploit the PS2's power for research.

    2. Re:Still a waste by rawgod0122 · · Score: 2, Insightful

      Bull Shit. Doing science (be it playing with chemicals or computers) just for the sake of doing science is what has given us MANY of our most useful tools. Penicillin and Lasers were discovered because some scientist was messing around with something and said "Wait, why is that happening?". We also get things that are just part of the journey to destination. This would include things like Velcro.

      Besides that what is so wrong about people trying to do things cheaper? More reliable? Because they are interested in them?

      If they can make this go as fast as (or close) the theory says, this would be a pretty good platform. Keep in mind that we will be seeing clustering of different types of systems for a long time to come. The more research we do the better we will be at it. In the end it will allow us to be more efficent.

  23. This seems like a really good idea by coupland · · Score: 2, Insightful

    After all, everyone knows that console hardware is sold for a fairly significant loss, all the profit is in the licensing of titles. One on its own isn't much to sneeze at, but a cluser of 64? You get a fairly powerful cluster and Sony subsidizes your super-computer. Smart idea...

  24. Timex Sinclair Clusters by leejor · · Score: 4, Interesting

    Reminds me of a nut case I met at a garage sale some 10 years ago. He was scavenging ZX80 Timex Sinclair in a effort to prove that clustered computing built around very cheap systems was the wave of the future.

    I also complained about how he had been an EE for IBM who was not appreciated for his genius. He was very worried that once he released his ZX80 FrankenCluster, IBM would steal it from him due to his old employment contract.

    Lee Joramo

  25. This is bullshit. by Anonymous Coward · · Score: 2, Interesting

    I've seen it over and over. General purpose hardware being used for specialised tasks. Yes it works ok and it's cheap, but so what? Video card GPUs can do this too, but you've only got on AGP slot. Refine it and go faster.

    What do you need? How about rack full of Custom PCBs each with a GF-FX or similar, with some RAM and a PCI-X backplane. The host can run a regular fast cpu and provide the interface. I'm sure Nvidia would jump at the chance to power a supercomputer with their chips.

  26. Xbox Port by Anonymous Coward · · Score: 2, Informative

    Not a chance. Playstation 2 linux is designed for the MIPS architecture; the Xbox has a good old-fashioned x86 under the hood.

    Also, Sony's linux distribution for the PS2 is based on a 2.2.1 kernel (old old old!), XFree 3.3.6 (again, quite old), gcc 2.95 (somewhat out of date, though plenty of systems still use it). The FAQ here says that the software is only slightly more recent than the software included with Redhat 6.2.

    In short, there's nothing worth porting when you can get all of the Debian goodness for so much less work. I personally don't know why I'd want to shell out that kind of money for some second-rate hardware and a profoundly old linux distro with the price of commodity hardware being as low as it is these days.

    Or were you just kidding?

  27. You don't exist by shepd · · Score: 4, Informative

    At least not on the internet.

    Nein for google.

    One EXTREMELY LAME hit from deja. Surprisingly, the sig is identical.

    Until you show some credentials (as in a link to nintendo's site, with a page with AT LEAST your name on it), you don't exist.

    In fact, it appears your department doesn't exist.

    Heck, where's your thesis, at least?

    I find it neat, though, that you went from being Head of New Technology Research at SEGA straight to being Head of New Technology Research at Nintendo. More amazing, though, is that both companies have exactly the same departments!

    More interesting:

    <sgupta@research.sega.jp>:
    Sorry, I couldn't find any host named research.sega.jp. (#5.1.2)

    Look, provide me a page at nintendo.co.jp with your name on it, and everything will be sorted out.

    Otherwise, this is:

    Bill Gates,
    Microsoft Founder
    Redmond

    Signing off.

    --
    If you could be told what you can see or read, then it follows that you could be told what to say or think - BoC
  28. Re:Since this came up by brandorf · · Score: 2, Informative

    IIRC (I own the kit, btw)

    Sony put everything they themselves created on the first disc. Their bootloader, PS2 technical documentation (covered by a NDA), and thier software development libraries.

    Basically the Linux packages are on the second disc.

    --


    Bork Bork Bork!!
  29. Oh boy! by Anonymous Coward · · Score: 2, Funny

    65 nodes and it's still got jaggies!!

  30. Re:Move on! by tarzan353 · · Score: 2, Informative

    How else do you propose that people run arbitrary scientific programs on the PS2? Right now Linux is the only solution, nobody saying it's the end-all be-all of computing.

  31. playstation2-linux site with Mozilla by silvaran · · Score: 3, Informative

    Some people might need to use SSL while connecting to the playstation2-linux site, or you'll get a blank page:

    https://playstation2-linux.com

  32. Um. by Niet3sche · · Score: 2, Interesting

    Iraq did this in the summer of 2000 - they were using the PS2 (on pre-order, IIRC) and its graphics engine for -surprise!- missile guidance and telemetry.

    Old news. New company. Same story, really.