Slashdot Mirror


Xgrid Clustering Software and Demo

no_demons writes "Along with a selection of other goodies, Apple also unveiled their Xgrid clustering technology from their advanced computation group today. Xgrid can turn a number of networked Macs into a supercomputer, detects nodes automagically via Rendezvous, and can run in or out of a screensaver mode. You can download a technology demo (including a BLAST test app) here."

25 of 290 comments (clear)

  1. small scale? by SHEENmaster · · Score: 4, Interesting

    Does this work on the small scale as well, like OpenMOSIX? We have a few G4's at school that could benifit from clustering.

    --
    You can't judge a book by the way it wears its hair.
    1. Re:small scale? by dave+at+hostwerks · · Score: 4, Informative

      It's running on my home network of 2 desktop G4s and one PowerBook G4. Looks and works great.

      --
      d a v e

      --
      d a v e
      "Hmmm...upgrades."
  2. Will it work on legacy machines? by ActionPlant · · Score: 5, Funny

    It'll be interesting to see if I can make this work with the stacks of old LC520s in my garage. I've been wanting to cluster them for a while. If Xgrid will work on those, Mac just saved me a ton of work. Not that I wasn't going to have fun with it....

    Damon,

    --
    http://actionPlant.com
    1. Re:Will it work on legacy machines? by xactoguy · · Score: 4, Informative

      Nope, it won't work on those. XGrid is based off of Apple's Rendezvous, which is OS X ( well, at least until someone ports it, seeing as it is open source. So, unless you plan to port it yourself, and to port XGrid as well ( if it is ever open sourced ), then you're out of luck. If this was a serious post that is. If it was a troll, then I bit, but you don't care ;)

      --


      And so we go, on with our lives
      We know the truth, but prefer lies
      Lies are simple, simple is bliss
    2. Re:Will it work on legacy machines? by Squid · · Score: 4, Funny

      Of course Apple probably won't make this available for anything other than OS X. But even if they did... how many LC520-vintage Macs does it take, clustered, to equal the raw computing power found in, say, an iPod? (A modern Apple MOUSE probably has a more powerful CPU than some of the older Macs.)

      If there is a law of diminishing returns trying to cluster old hardware to keep it useful, I think an LC520 is well past it.

      Besides, if you want to do it, see if Linux will run on those 520s and... yes, you guessed it... build a Beowulf cluster out of 'em.

    3. Re:Will it work on legacy machines? by Squid · · Score: 5, Informative

      OSX requires:
      - PCI
      - Open Firmware
      - a PPC 603 or 604 or later
      - oodles of RAM (64 minimum).

      Running it on a legacy Mac - that is, anything older than a Power Mac 9500 - would involve somehow getting around these. You'd have to:
      - write an Open Firmware bios for the machine and trick it into booting via it
      - write drivers for the machine's onboard video so that it LOOKS to the OS like a PCI card behind a bridge chip (repeat for sound, network, etc)
      - get a 603 or later (OS X 10.2 needs a G3 or later), some of the upgrades for 68K machines could only go to a 601
      - provide for 64 or 128MB RAM on a machine whose motherboard is limited to 36. Oh, and endure the sluggishness of 72-pin RAM.

      OS X is not OS 9 and it is not Red Hat.

    4. Re:Will it work on legacy machines? by TCM · · Score: 5, Funny

      What has Slashdot come to? Suggesting throwing cash at a problem that can be solved over "many weekends of hard labor"?

      Next you suggest to pay for an operating system instead of writing your own?

      Tss..

      --
      Of course it runs NetBSD. BTC: 1NT7QvbetmANwaMzhpVL6
    5. Re:Will it work on legacy machines? by Ffakr · · Score: 4, Informative

      "XGrid is based off of Apple's Rendezvous, which is OS X "

      No, Xgrid is based off of the Zilla project that ran on NeXT.
      Zilla was acquired by Apple when NeXT was purchased.
      Zilla was rechristened Xilla during development in honor of OS X.
      It's now called XGrid.. and yes it is cool.

      Now, XGrid includes support for Rendzvous.
      Rendzvous is Apple's release of ZeroConf, an OPEN SOURCE ad hoc IP based protocol.

      Someone else asked about running on other BSD's.
      XGrid runs in user space. It isn't a kext (kernel extension). It probably could run on other BSDs without too much work, but it is a carbon app so you'd have to totally port the interface to some other GUI API.. and you'd have to port it from Obj C to something more common I'd guess.
      Apple hasn't provided source (yet) though so I don't see anyone porting it soon. Maybe reverse engineering it...

      other stuff... it apparently makes use of XML too but I haven't gone through all the docs yet.

      --

      I'm not feeling witty so bite me

  3. Great, this sucks.. by QuantumRiff · · Score: 4, Funny

    Now every single story posted on slashdot for the next 6 months is going to have a comment of "Imagine an XGrid of these!" The old incarnation was slowly dying too...

    --

    What are we going to do tonight Brain?
    1. Re:Great, this sucks.. by tbmaddux · · Score: 4, Funny
      "Imagine an XGrid of these!" The old incarnation was slowly dying too...
      With XGrid now out, Apple will die much more fastly.
      --
      Can't you see that everyone is buying station wagons?
  4. Re:Sounds good, but... by rampant+mac · · Score: 5, Funny
    "But for me, the model I want is a broker model. I want to sell my processor time to a broker who will resell it on a day to day basis to whoever is the highest bidder. E-bay of grid computing, ya know. I don't want to pick projects, download clients, etc. I just want to pariticipate (i.e. make money) from whoever is willing to pay the most at any given moment.

    And when I feel like it, I'll volunteer x% to non-commericial stuff like SETI@home."

    Ladies and Gentlemen, please welcome the 21st century pimp.

    "What do we get for 10 teraflops?"

    "Anyting you want!"

    "Anything?"

    "Anyting!"

    --
    I like big butts and I cannot lie.
  5. Been there, done that, Apple bought me lunch. by antarctican · · Score: 4, Interesting

    Oh good, you mean I can actually talk about XGrid now after signing an NDA over 6 months ago? :)

    We had the second installation of XGrid, the only other group using it at the time was NASA. I haven't had much time to play with it personally but we had our coop do some genetic sequence analysis using it and he was quite impressed. Plus the speedometer-like gauge measuring performance just looks soooo cool. ;)

    1. Re:Been there, done that, Apple bought me lunch. by buckhead_buddy · · Score: 4, Interesting

      Back when Spindler ruled as Steward of Apple (well before the return of Jobs), I signed an NDA for an evaluation period with a piece of Apple hardware that was supposedly about 10-12 months from release.

      The specs of the machine have been outclassed by modern standards, and the neat software features not made irrelevant by Mac OS X have surfaced in Mac OS X Server. But there were two very cool things about the case though that I thought were of the "Geez, that seems so obviously handy!" variety.

      The gotcha was that it has never been released. I keep expecting new Mac hardware to one day come out with these two features but until that time I guess I'm still under NDA. Arrggghhhh!!!!!

      Be glad your NDA expired with the release of the product. Otherwise you'd be burning with the image of that cool speedometer in your mind and unable to tell anyone about it. :-)

    2. Re:Been there, done that, Apple bought me lunch. by laird · · Score: 4, Interesting

      Wow, usually NDA's are released either when the info becomes public knowledge OR after three years (or whatever). Lawyers never let me sign any contract that doesn't have an expiration date, because it means that they'll have to worry about it forever...

  6. Re:Why limit this.. by sydney094 · · Score: 5, Informative

    It isn't inherently limited to Macs... however, the only computers that they have written the client for is Mac 10.2.8 or better.

    (From the FAQ)

    Q: Can I use Xgrid with other UNIX-based computers?

    A: The short answer is no.

    The long answer is that Xgrid uses an XML property list protocol built on top of BEEP for all of its inter-computer communication and coordination, and because these protocols are open, it is possible a client, agent, or controller could be written to run on other UNIX-based computers and interoperate with Xgrid. However, no such programs have been written.

    --
    "If we knew what we were doing, it wouldn't be called research." - Einstein
  7. Re:what ever happened to the exageration of the "i by cosmo7 · · Score: 4, Funny

    From my own inexhaustive observations, Apple gives consumer stuff "i" and geeky stuff "X", hence iPod, iApps, iMac, iLife etc against XServe, XCode, XGrid, etc.

    To be frank I've always wondered about Apple's name syntaxes. When the Mac IIx and the SE/30 came out - improvements of the Mac II and the SE with then top-of-the-line 68030 processors - it seems they really should have gone with Mac II/30 or SEx. Mac II/30 sounds like a third grade joke about chinese dentists but the Macintosh SEx would have probably made them billions.

  8. Re:Sounds good, but... by Wesley+Felter · · Score: 4, Informative

    I want to sell my processor time to a broker who will resell it on a day to day basis to whoever is the highest bidder.

    Several companies tried this back in 2001 and discovered that the processor time on your computer is worth less than the overhead cost of using it. Sorry.

  9. Re:Sounds good, but... by andcarne · · Score: 4, Informative
    Its free software.
    "Anyone can download the technology preview today, which includes a kit that lets programmers add functionality to Xgrid for more advanced job control."
    The download can be found at: http://developer.apple.com/hardware/ve/acgresearch .html
  10. Hardly a Supercomputer: Cluster computing 101 by deadline · · Score: 5, Informative
    There are only certain problems that work well on LAN clusters. Those that have a lot of independent jobs (like BLAST) and those that require a small amount of communication like rendering.

    Read ClusterWorld and you can figure this out yourself.

    --
    HPC for Primates. Read Cluster Monkey
  11. 90nm G5s by sergeantmudd · · Score: 5, Informative

    What's more important is what it's clustering, 90 nanometer G5s. Apple and IBM are the first company to bring 90 nm processors to the market. Xserve White Paper

  12. Re:Why limit this.. by laird · · Score: 5, Interesting

    "However when you can pick up Dell or Sun machines cheaper and more powerful than Xserve cluster nodes, it's more tempting to me to put a little effort into getting each one up & running as a node and enjoy the benefit of more power and a little effort, than simplicity and less power."

    This might make sense except that Dell and Sun servers are slower and more expensive than Apple's. Unless you're talking about buying used servers on eBay or something, I suppose. But if you want scientific supercomputing floating point number crunching, the G5 is amazingly good...

  13. Nah, not really. by PCM2 · · Score: 4, Informative

    Clustering databases has different issues/concerns than clustering computational problems. I wrote an article about database clustering a while back, available here, if you're interested.

    --
    Breakfast served all day!
  14. Re:ifdef Win32 at Apple? by derubergeek · · Score: 4, Informative
    From the header:

    AltiVec-based factoring program. Created as extension of original factor.c project at Next Software, Inc.

    Not originally PPC specific...

    --
    Trust me. This is an inactive account. Regardless of what the /. bean counters might report.
  15. Re:Competitive with Linux clustering? by larkost · · Score: 4, Informative

    Actually, a G5 starts out at $1799. You are thinking of the Cluster Server XServe, at $2999. If you actually were to do even a little bit of research you will start to notice that in order to match the performance of these machines you will have to spend a lot more than the $1000 you quoted.

    Remember you have to have:
    Gigabit Ethernet (the XServe has 2 ports built in).. I think this will probably account for $300-$500 of that thousand right there
    SATA
    Very high performance memory systems (with ECC on the XServe)
    FireWire800 (drives and networking)
    PCI-X (can you say Infiniband?)

    And if we are focusing on the XServe:
    Hardware fault notification (very well implemented)
    1U rack space (slide out drawer, including cable management)
    MacOS X Server (so nice to admin)

    I don't think you know what you are talking about. After all, Virginia Tech just hit #3 on the supercomputing list with a cluster of G5's, and everyone is talking about how cheap they did it. The guy behind the project did a lot of research and discovered that this was the best price, Dell didn't even come close (they gave them 3 tries to do so).

  16. Re:Why limit this.. by andcarne · · Score: 4, Informative

    XGrid does NOT need to run on Xserves. People seem to be drawing that conclusion from somewhere. You can use it on any machines capable of running OS X (10.2 though, I believe). The reason it gets quite interesting is because the average person can set up something somewhat powerful with the desktops laying around their house. I for one, have 5 Mac machines in my house that have lots of idle time. I could install XGrid and use that idle time efficiently to perform distributed tasks. (of course, I would have to figure out what to do first)