Slashdot Mirror


University Chooses Apple RAID for Linux Cluster

An anonymous reader writes "A Linux World article describes how Swinburne University chose Apple's Xserve RAID to add storage to it's Dell linux cluster, as it was the cheapest solution. Apple was sceptical about its RAID system working with Linux, but the system was up and running in 15 minutes."

19 of 68 comments (clear)

  1. Compression - WOW! wait, I mean HOW? by seigniory · · Score: 3, Interesting

    "According to Bailes, the centre records 13TB of data per day, which gets processed in real time down to 30GB and then compressed further to 3KB."

    OK, can someone to explain to me that either yes, there is a lot of redundant data that can have crazy-good compression rates, or that no, this quote is wrong...

    1. Re:Compression - WOW! wait, I mean HOW? by MindStalker · · Score: 4, Informative

      I'm sure they meant 3GB as I know most non-normalized data generally can be compressed 10:1.

    2. Re:Compression - WOW! wait, I mean HOW? by daeley · · Score: 2, Funny

      Hey, you can store a lot of compressed pictures of polar bears in blizzards in 3KB!

      --
      I watched C-beams glitter in the dark near the Tannhauser gate.
    3. Re:Compression - WOW! wait, I mean HOW? by GoRK · · Score: 3, Insightful

      I'm sure that they are not processing web traffic statistics, but that is an application that mirrors the data needs in a similar situation. I imagine many other applications have similar data needs. No doubt, the 3K is not re-expandable to 13TB, and probably neither is the 30GB.

      For instance, I might be generating 10GB of logs per day. To save disk space, the streams might be written out with gzip compression (it's write-only, after all), or I might rewrite the formats to conserve space - write the IP addresses in 4 bytes rather than writing out the full ASCII dotted quad, etc. Since it's text and the format is highly redundant, it compresses very well.. I might end up with a 50-500MB log file depending on how things are done. At the end of the day, I could process the statistics and generate report/archive data of several KB that retains all the important data I want to keep from the logs.

      ~GoRK

    4. Re:Compression - WOW! wait, I mean HOW? by khb · · Score: 2, Interesting

      A long time ago, in a job far, far away, I had to deal with some radio astronomy data.

      The raw data was pretty much noise (quasar output).There were two data streams, from opposite sides of the earth, listening to the same noise source)

      The data (after extraction) was very, very small. I can't recall if it would have been on the order of Tb to Kb but it might well have been. We didn't have that much storage, so we had to compute (using custom hardware) in near real time.

      With appropriate temporary storage, much simpler (and probably more accurate) computational solutions are practical.

      It's possible they mean reduced not compressed (to use appropriate buzz words). Data reduction can be quite steep (e.g. count the number of LGM found in the current sample. Typically all your data reduces to 0 ;>).

  2. mmmm....Xserve by GreatTeacherMusashi · · Score: 3, Funny

    Those things are soooo yummy, if I had a million dollars, some of it would go to an xserve array, just for fun, it'd be like the equivalent of some movie star buying like, some diamond coffee table or something "oh haha, and yeah that's my Xserve over there, oh no I don't really use it much, it's just to brighten the room up"

    --
    You win battles by knowing the enemy's timing, and using a timing which the enemy does not expect. Miyamoto Musashi
  3. Xserve is cheap by joshsnow · · Score: 4, Informative

    This topic reminded me of an article in the print version of UK mag PC Pro by Jon Honeyball. He tells of one of his (consultancy) "clients" looking for a SAN/RAID solution from Dell and EMC, which would cost 120,000.

    Aparently, Apples offering was 2TB storage for 9000 - vs 80,000 for 2TB from Dell/EMC.

    In the article he says;The obvious question is whether you can put fibre channel cards into your Windows servers and connect them up too. Apple tells me this is possible The idea being to use the storage for SQL*Server databases and the like.

    I'm not surprised this is such a good solution for use with Linux.

  4. Xserve RAID in non-Apple environments by daveschroeder · · Score: 4, Informative

    There's a new community site called alienRAID.org that focuses on supporting Xserve RAID in non-Apple and mixed environments. It's likely to be helpful to people interested in deploying Xserve RAID in conjunction with other platforms.

  5. Cheapest redundant solution by goombah99 · · Score: 4, Insightful
    Before a bunch of silly gooses shout they can get the same storagein their generic Linux boxes please lets note that were comparing reliable redundant systems.

    the X raid has dual redundant power supplies, redundant fans, dual redundant raid controllers, dual redundant and DEDICATED processors, dual redundant ethernet connection, dual redundant fiber channel outputs. it has separate busses and controllers for each ATI hard disk, and the busses to the disks are high speed. all of the disks are hot swapable self contained pluggin units. and it all sits in 3U. (plus another U for whatever server is receiving the fiber channel). All the software on board is tuned to the task and other than the web admin, the box has no extraneous services.

    also the raid is Hardware raid 5,1,0 not software. other than a netapp at 25x the price, there's nothing that comes close.

    --
    Some drink at the fountain of knowledge. Others just gargle.
    1. Re:Cheapest redundant solution by Anonymous Coward · · Score: 2, Informative

      Actually, while there are multiple controllers and cache modules in the Xserve RAID, they are not redundant. Each controller and cache module is responsible for its own side of the enclosure. The power supplies, cooling modules, etc., are fully redundant. The RAID Admin utility (the java piece), however, can talk to both controllers through only one IP address, so in effect, the ethernet devices are sort of redundant. This is all in the PDF documentation on the website, FYI.

      (Still a good deal for the money compared to some others, in my biased opinion.)

      (Posted anonymously because I work for Apple.)

    2. Re:Cheapest redundant solution by pmz · · Score: 2, Informative

      also the raid is Hardware raid 5,1,0 not software. other than a netapp at 25x the price, there's nothing that comes close.

      The only "disadvantage" of Apple's product is each individual disk is relatively slow (specs say 7200 RPM vs. 10000 to 15000 RPM for other options). Other than that, Apple really has a killer product (at least on paper...I don't have one :(

    3. Re:Cheapest redundant solution by Creepy+Crawler · · Score: 3, Insightful

      I'd rather have a bulk of HD's at 7200RPM than at higher speeds. More RPM equates to more heat and easier failure.

      --
  6. Kewl. Everything to make a slashdot article. by kabocox · · Score: 5, Funny

    It runs linux check.
    It has Apple. Check.
    It has a low price for server hardware. check.

    This article is hearby Slashdot approved.

  7. Um, well "Duh!". by DAQ42 · · Score: 4, Interesting

    I've been booting my Linux boxes from my XServe RAID for months now. It's just a fibre array. And the XRAID Admin program is a straight Java applications so you can run it on any platform that supports Sun Java 1.4.1.

    Go figure.

    It's not rocket science. These devices have been engineered using standards of the industry.

    Doh!

    --
    Don't Ask Questions. I don't know the answers and even if I did I wouldn't tell you.
  8. Apple's Trojan Horse for I.T. Depts.? by Johnny+Mozzarella · · Score: 5, Insightful

    iTunes has been called a Trojan Horse that will slip into consumer PCs and perhaps persude them to buy an iPod or a Mac.

    Will the XServe RAID become the equivalent Trojan Horse that will slip into corporate data centers and lead to future purchases of XServes?

    I hope Apple doesn't ignore this opportunity but instead promotes the fact that the XServe RAID plays well with other systems.

  9. Re:Fiberchannel by Anonymous Coward · · Score: 3, Informative

    You ever plugged a Fibre Channel RAID into a random Linux box? Your chances of getting it to work correctly without a lot of pain-in-the-assedness are about one in five.

  10. I doubt Apple was surprised this worked by Ffakr · · Score: 4, Informative

    Apple went out of its way to describe how splendedly xServe RAID ran on Solaris, Linux, and even 2K/XP boxes at WWDC this year.
    This is the same story they've been telling since xServe RAID was shipping (and probably before that since it was pre-announced very early).

    I'm pretty sure that any doubts were from the customers or the Lunuxworld writer and not Apple. They've been trying to sell this for linux boxes. If it was 'Apple' that had doubts, then those engineers need to return to the mothership for some more training.

    --

    I'm not feeling witty so bite me

  11. Re:Fiberchannel by weave · · Score: 2, Informative

    Interesting, we have 5 servers using qlogic 2200s. The default redhat kernel since 7.x works fine, autodetects the driver right out of the box. As long as the san zones are set up correctly, it'll find the disks with absolutely no problem.

  12. Apple Australia SE told us... by icekey21 · · Score: 2, Interesting

    During the conference held couple weeks back at Melbourne Uni, the guy from Apple Australia explained to us as to why Swinburne TAFE decided to use the XRAIDS. As it's the only one that supports IDE (He went on to say that the whole reason why RAID is there for is to reduce the costs, yet others use the more expensive SCSI drives) it was the cheapest way to transfer the data from Parkes to Hawthorn. They basically get a van, pack the HDs onto it once the data is collected, and drive back to Melbourne, which is still cheaper and faster then transferring all the data through existing network channels. The ultmiate connectionless network =)