Slashdot Mirror


3 Terabytes, 80 Watts

legoburner writes "The Enquirer is reporting that Capricorn have released a mini-itx based 1U-sized storage computer featuring four 750-GB hard drives and a 1-Ghz controller system with a typical power usage of an astounding 80 W per machine. A full 40U rack only uses 3.2 kW, which is less than 30 kW for an entire Petabyte!"

219 comments

  1. Ouch by lucky13pjn · · Score: 2, Funny

    And they would need all that storage to record their utility bills.

    1. Re:Ouch by $RANDOMLUSER · · Score: 3, Informative

      3200 Watts for 120 Terra bytes - that's like two hand-held hair dryers!

      --
      No folly is more costly than the folly of intolerant idealism. - Winston Churchill
    2. Re:Ouch by tritonman · · Score: 0, Offtopic

      ouch?

      Can I use this technology to power my car?

    3. Re:Ouch by Anonymous Coward · · Score: 1, Informative

      Well, seriously, that is a really _low_ figure. We're running to 8-12kW per rack these days on our linux clusters, whether storage node or worker node racks. And we're extra careful to keep our per-rack wattage low.

    4. Re:Ouch by ackthpt · · Score: 4, Funny

      3200 Watts for 120 Terra bytes - that's like two hand-held hair dryers!

      Kids these days... we used to have these things called Mainframes. They had special 240v wiring, with BIG power cables. You could hear the circuitbreaker box HUM when you walked past. This is all a pittance.

      --

      A feeling of having made the same mistake before: Deja Foobar
    5. Re:Ouch by $RANDOMLUSER · · Score: 1

      That's what I was saying - I used to work in a disk laundromat too.

      --
      No folly is more costly than the folly of intolerant idealism. - Winston Churchill
    6. Re:Ouch by OverlordQ · · Score: 2, Interesting

      3200 Watts for 120 Terra bytes - that's like two hand-held hair dryers!

      Yea, but most people dont run two hair-dryers 24/7

      --
      Your hair look like poop, Bob! - Wanker.
    7. Re:Ouch by Anonymous Coward · · Score: 0

      By comparison, the Library of Congress holds only 20 terabytes, and its utility bill is, well, that of a large building.

    8. Re:Ouch by thePowerOfGrayskull · · Score: 5, Funny

      Yea, but most people dont run two hair-dryers 24/7

      You haven't met my wife.

    9. Re:Ouch by Anonymous Coward · · Score: 0, Flamebait

      And that is just her crotch hair..

    10. Re:Ouch by Anonymous Coward · · Score: 5, Funny

      Yea, but most people dont run two hair-dryers 24/7

      You haven't met my wife.


      Those aren't hair dryers.

    11. Re:Ouch by hankwang · · Score: 4, Interesting
      3200 Watts for 120 Terra bytes - that's like two hand-held hair dryers!

      Or 28,000 kWh per year, i.e. $2800 at $0.10 per kWh (not sure what the going rate is nowadays).

    12. Re:Ouch by cosmicj · · Score: 0, Redundant

      That has to be one expensive hairdryer!

    13. Re:Ouch by modecx · · Score: 3, Funny



              3200 Watts for 120 Terra bytes - that's like two hand-held hair dryers!

      Or 28,000 kWh per year, i.e. $2800 at $0.10 per kWh (not sure what the going rate is nowadays).


      In other words, if you have the money to afford 120 terabytes of storage, let alone the need to have and use that storage, you can probably afford to pay for the electricity to run it.

      And as a bonus, you could lease the exhaust from your 120 terabyte storage system to a nearby hair salon so you can kill two birds with one stone.

      --
      Constitutional rights may be respected, repealed, or modified; but they must never be ignored.
    14. Re:Ouch by StressGuy · · Score: 1

      ...OUCH!...

      --
      A goal is a dream with a deadline
    15. Re:Ouch by ATMD · · Score: 1

      ...or possibly to supplement the heating system during cold months?

      Seriously, has anyone thought of doing this?

      --
      Nobody else has this sig.
    16. Re:Ouch by Anonymous Coward · · Score: 0

      Doing what? Having two sets of computers in each hemisphere so that you only run the ones that are in winter? Run the same computers all year long by shipping them to the southern hemisphere in spring and shipping them back in fall?

      In the first case you have loss due to idle hardware that you purchased which loses value due to Moore's Law.

      In the second case, you have shipping costs, and man power needed to pack, unpack, and install everything.

      It's not clear to me that those options are cheaper than footing the A/C bill in summer, but feel free to prove me wrong.

    17. Re:Ouch by Nutria · · Score: 1
      ...or possibly to supplement the heating system during cold months?

      Back in the Cretaceous Period, data centers up in the northern latitudes would vent the cold winter air into the dinosaur pens. Saved a lot of electricity that way.

      Now that x86 server densities are getting so high, that same technique should be brought back.

      --
      "I don't know, therefore Aliens" Wafflebox1
    18. Re:Ouch by ATMD · · Score: 1

      I mean route the exhaust into the building's air ducts when it's cold, thus saving on heating bills.

      Obviously you'd route the exhaust directly out of the building when it's hot.

      --
      Nobody else has this sig.
    19. Re:Ouch by afidel · · Score: 1

      I have a SAN box that fills about 1/2 of a rack and sucks down 4kVA and has a 13TB raw capacity. 3.2kVA and 120TB is awsome. Of course that's without the kind of management facilities that the Xiotech has, has none of the redundancy facilities , and doesn't have near the performance.

      --
      There are 4 boxes to use in the defense of liberty: soap, ballot, jury, ammo. Use in that order. Starting now.
    20. Re:Ouch by mungewell · · Score: 1

      It's not the cost of the 'used' electricity that is the problem... it is the waste heat and getting rid of it from your sealed computer room.

      Most establishments will also have a huge investment in cooling equipment.
      Simon.

    21. Re:Ouch by Anonymous Coward · · Score: 0

      Um, 'most everyone in a reasonably cold climate. I run my PC all winter and use it as a heater/footwarmer. In summer I use my laptop, unless I want to play a 3D game.

      Still, I can't wait till my toaster has a "heating element" that's actually a block of CPUs + RAM running folding@home to heat the bread :)

    22. Re:Ouch by Clover_Kicker · · Score: 1

      I've seen it done with a mainframe.

      A few years later they upgraded, the new dinosaur was 1/4 the size and didn't produce enough heat to really matter.

      I haven't worked for that shop in quite a while, but I expect the plumbing is still intact, so they're probably making good use of the heat from all those racks of x86 peecees.

    23. Re:Ouch by Propaganda13 · · Score: 1

      Our data center in Wisconsin does not have heaters at all. Computers are the only source of heat. Generally, we're run A/C most of the time. The big negative is if they wanted to sell the building for office space, they can't due to no heating system.

    24. Re:Ouch by thePowerOfGrayskull · · Score: 1

      Oh. Shit.

    25. Re:Ouch by pyrote · · Score: 1

      I live in an apartment and with my 32" WS LCD, 21" CRT, 2 17" CRT, 2 computers, and a laptop I completely skipped turning on my heaters this winter. half the time I had the windows open while it snowed outside.

      Yes the year-round bills are high, but not having the utility bills spike in the winter sure helped.

      --
      THE WORLD IS GOING TO END!!!! eventually.
  2. your file server structure? by legoburner · · Score: 5, Interesting

    At last, a chance for a rejected ask slashdot of mine... What is the structure of your file storage area / file server? How do you filter and back things up for your home file server?

    1. Re:your file server structure? by jjeffries · · Score: 2, Informative

      backuppc rocks!

    2. Re:your file server structure? by Anonymous Coward · · Score: 1, Informative

      mine is as follows:
      1st Raid 5 array: 3 * 300GB HDDs, stores anime, cartoons, documentaries, misc tv and movies
      2nd Raid 5 array: 3 * 300GB HDDs, stores music, code, photos, backups from desktop systems, CD images, music videos, roms and software

      All data which has been produced by me personally is backed up to a (raid 5) computer at my parent's house every night with rsync over ssh. Files are shared with windows via samba using 2 shares - read only (for normal usage) and writeable (for copying things onto the server). I found that windows would end up with too many new folders created, or folders moved via drag and drop so put in read only access for most occasions to prevent this and it works well.

    3. Re:your file server structure? by Ant+P. · · Score: 1

      I just put all my media files in /home/ and back it up with scp. Call me lazy, but it works.

    4. Re:your file server structure? by JayAEU · · Score: 2, Informative

      Indeed it does, but not on a system like that. BackupPC relies heavily on MD5-checksums and does on the fly (de-)compression of archived files, so a little more horsepower is necessary for smooth operation.

      But other than that, there's nothing like BackupPC for a pain- and effortless networkbased backup system.

    5. Re:your file server structure? by Anonymous Coward · · Score: 0

      Here are the specs of my fileserver at home:

      AMD Opteron 165
      2GB RAM
      (4) Seagate 300GB SATA II Drives
      Areca 4 port PCI Express RAID Controller

      I have the drives setup in RAID 5 and use Windows Server 2003 R2 for my OS. Right now I do have an HP StorageWorks 320GB tape backup drive, but am still in the process of getting that setup. I also have another low-end computer that runs two virtual machines (domain controller and exchange server) and the hard drives are two 120GB running in RAID 1. I guess my setup only allows for a single point of failure, but hopefully once I implement the tape backups I will have a fallback solution incase I have two hard drive failures on either machine. I'm sure that my whole setup is kind of overkill, but it is probably nothing compared to what some slashdotters have for their home network.

    6. Re:your file server structure? by ObsessiveMathsFreak · · Score: 3, Interesting

      I have an old 386 running fedora and samba on a 120GB drive with no RAID whatsoever. The machine won't fit another drive and an upgrade will involve so much hassle I've been putting it off over and over. Any reasonable upgrade would have to involve a terabyte machine because I don't want to go through the hassle of upgrading too soon after.

      CD based backups would be laughable considering that the disk is almost filled with downloaded TV shows and movies. Ditto for DVD's, not to mention the impracticality. USB HDDs; Backups are meant to be _more_ secure. Internet backup; not enough bandwidth. I never thought I'd say this, but I miss tapes.

      It's going to give out. I know it, you know it, we all know it. Bloody shows aren't even that good... *grumble*....

      --
      May the Maths Be with you!
    7. Re:your file server structure? by tf23 · · Score: 1

      rsync to big external f/w ide hd's on a seperate box. depending on the data, daily backup, sometimes weekly, sometimes monthly. add int cvs repo's and tarballs of those and it's pretty easy to cron up. the lesser used f/w drives you can turn off between backup runs. you can pickup some fairly large ide drives and el cheapo enclosures to slap them in.

      if you really want to be careful, you'd have a few to rotate and then you could drop one at the safe-deposit-box.

    8. Re:your file server structure? by JayAEU · · Score: 1

      For automated backups, you really should give BackupPC a try. There are no tapes, CD or DVD media involved, everything is tucked away efficiently on the harddisks. If you want (I never did so far), you can export a .tar.gz from the pool and burn that somewhere for off-site keeping.

      As for setting up a fileserver, have a good long look at www.freenas.org or www.openfiler.com! They make it really easy to set things up without any hassle whatsoever.

    9. Re:your file server structure? by Anonymous Coward · · Score: 0
      How do you filter and back things up for your home file server?


      For backups I create a tar.gz file of my home directory, encrypt it, and then upload it to Usenet. I can then download it if I need to do a restore.

      ;)

      ./DM

    10. Re:your file server structure? by Just+Some+Guy · · Score: 2, Informative
      All data which has been produced by me personally is backed up to a (raid 5) computer at my parent's house every night with rsync over ssh.

      You misspelled "synchronized". RAID != backup. What happens when you accidentally garble "Doctoral Thesis.odt" and automatically overwrite your only other copy with the new version?

      --
      Dewey, what part of this looks like authorities should be involved?
    11. Re:your file server structure? by TheRaven64 · · Score: 1
      Three tiers:

      1. Working copy on my laptop, gets checked into
      2. a subversion repository on a machine with a RAID-1 set.
      3. At the end of every week, a machine in a different country makes a dump of the repository and rsyncs it across. It then keeps five weeks of these in separate files, in case the main server is compromised (or corrupted) and I don't notice.
      I'm just coming up to the end of a PhD, and I don't want to lose my thesis and have to start again.
      --
      I am TheRaven on Soylent News
    12. Re:your file server structure? by WuphonsReach · · Score: 1

      300GB RAID1 - data, databases, subversion
      600GB RAID10 - backups (rsync snapshots or Second Copy via Samba)

      Offsite backups are a set of 300GB external USB/Firewire drives, rotated periodically. Those drives pretty much only hold a snapshot at a current point in time. They also concentrate on non-replaceable data rather then system configuration.

      System config is a combination of storing any edited config files in Subversion along with weekly snapshots via Dirvish / RSnapshot / RSync. The SubVersion allows me finer control over config changes while the snapshots catch more drastic errors where I have to restore the entire O/S. The O/S snapshots can also be offloaded to read-only media or tape for long-term storage.

      --
      Wolde you bothe eate your cake, and have your cake?
    13. Re:your file server structure? by avronius · · Score: 1

      He's indicated that the backup occurs every night, not realtime. So, he's got a couple of hours to scp the file back. Having said that, I'd hope that he'd use some form of revision control - like sccs or cvs - just in case.

    14. Re:your file server structure? by Fred_A · · Score: 1

      I'm using a RAID1 NAS box from Thecus with two 300 GB disks. They are seen through SMB only which isn't optimal (no rsync for example) but I can live with that. Finding an affordable box with RAID (without having to build a PC which I was too lazy to do) was oddly enough quite difficult. Apparently most people just backup to a single disk and expect it not to fail. I would have thought that personal computing had been around long enough that they'd know better by now.

      The home LAN backup is starting to be a major headache for everybody nowadays. People who just have a few office documents and a bit of email can get away with burning a DVD or a CD every now and then. If you have media files, it's no longer an option. I take a lot of photos, I have a large collection of audio CDs and I can't retake the first and won't rerip the second.

      I also considered getting a video camera but what kept me out of it so far is storage and backup problems.

      --

      May contain traces of nut.
      Made from the freshest electrons.
    15. Re:your file server structure? by Anarke_Incarnate · · Score: 1

      so CIFSMOUNT is not available to you in *nix?

    16. Re:your file server structure? by Anonymous Coward · · Score: 0

      This is correct, the limited version control is handled by bi-monthly DVD backups of important data. There is a 24 hour period between backups and in 3 years of using this system, I have never had a problem with it (the 24 hours has been sufficient, with DVDs for other revisions). The really important data that would need to be in revision control is backed up through old fashioned tar.gz as and when a major revision occurs, which then goes into the usual backup system.

    17. Re:your file server structure? by h4ck7h3p14n37 · · Score: 1

      It sounds like it might be time to buy an automated tape library. We have several 80 bay StorageTek (IIRC) tape libraries in the server room and they work pretty well for massive backups.

    18. Re:your file server structure? by Pieroxy · · Score: 1

      everything is tucked away efficiently on the harddisks
      That's not a backup if it's still on your HDD.

      you can export a .tar.gz from the pool and burn that somewhere for off-site keeping
      How do you burn 120GB?

      Looks like you didn't answer the question. In fact, you didn't even scratch it!

    19. Re:your file server structure? by Matt+Perry · · Score: 1
      You misspelled "synchronized". RAID != backup. What happens when you accidentally garble "Doctoral Thesis.odt" and automatically overwrite your only other copy with the new version?

      He may be keeping local backups and rsyncing those. That's what I do and I would have used the same terminology. I have nightly cron jobs that dump my MySQL and Postgres databases as well as tars up important files from the file system (like everything in /home). The compressed tarballs sit in a backups directory which gets rsynced to two other machines in different physical locations every morning. I have another cron job that removes old files from the backup directory to keep it at a certain size. With a 15GB backup directory I have about the last three weeks backups available.

      But rsyncing the raw home dir to another place... yeah, that could be disastrous as a backup strategy.
      --
      Slashdot: Failed Car Analogies. Amateur Lawyering. Anecdote Battles.
    20. Re:your file server structure? by RevRigel · · Score: 2, Insightful

      Rsync makes incremental backups. It's possible to roll back to any previous date.

    21. Re:your file server structure? by Fred_A · · Score: 1

      rsync is much more versatile and simpler to use than having to mount a remote disk to all the machines that have to be backed up. Whether through cifsmount or smbmount or whatever.

      So yes there is a way around the limitation. However a more elegant solution would be better. And since the box runs an embedded Linux it shouldn't be too difficult to add.

      --

      May contain traces of nut.
      Made from the freshest electrons.
    22. Re:your file server structure? by plasticpixel · · Score: 1

      Hmmm.... Mine gets:

      750G * 12 drives = 9TB ( ZFS Raid-Z )

      System power consumption 240W

      26W per TB.

      That's the same number as the 3TB @ 80W machine.

      I don't see what the big deal is.

    23. Re:your file server structure? by jaseuk · · Score: 1

      You should try using dirvish (http://www.dirvish.org/) on top of all that. It's a primitive snapshotting tool, that runs on top of rsync. It'll make your backups a bit more like tape, you'll be able to step back a few days if you need to. It only stores the differences between your various snapshots (kind of like rolling incremental backups), so it's very space efficient.

      Jason.

    24. Re:your file server structure? by evilviper · · Score: 1
      USB HDDs; Backups are meant to be _more_ secure. Internet backup; not enough bandwidth. I never thought I'd say this, but I miss tapes.

      Rub your feet on a carpet for a few minutes, then tell me how reliable tapes are, versus removable hard drives.

      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    25. Re:your file server structure? by evilviper · · Score: 1
      Rsync makes incremental backups.

      There's a huge difference between "CAN" and "DOES".

      The GP made no indication either way. Unless you're claiming to be the AC in question...
      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    26. Re:your file server structure? by thre5her · · Score: 1

      You mispelled "documentaries". It's spelled "porn".

    27. Re:your file server structure? by jriskin · · Score: 1

      8x400gig SATA drives $100x8 (costco special)
      1 medium old PC Athlon XP1700 laying around $0
      1 Rocketraid card (turns out to be mildly pointless with PCI) $200
      1 Cheap PC Case/power $35
      3 5.25-3.5" adapters $15
      1 big fan $12.50
      $1062.50 + tax ($1150.15)

      Total formatted space RAID5 2.6TB (damn binary vs decimal marketing)

      Performance 28-30Megs/sec (PCI Bus limited...PCI-X (64-bit or 66-133mhz slots) would probably speed things up. But I couldn't find any cheap Athlon XP PCI-X motherboards...

      Backup - When I download 4gigs worth of crap I burn it to DVD-R. Other than that and the occasional system backup. I pretty much cross my fingers I don't lose more than 1 drive at once.

      But i've managed not to lose anything big [insert safety superstition here] except 2 CD-Rs (physically lost), and a 60gig with some anime on it (before I did RAID), since around the late 80's. I've found the most important thing is to just keep migrating drives and media. When blue-ray gets cheap i'll consolidate all my DVD-R's and spool up the old ones.

    28. Re:your file server structure? by JayAEU · · Score: 1

      OK, time to clear a few things up.

      Firstly, the harddisks storing the backups aren't the same ones containing the original data being backed up, of course. Their not even supposed to be in the same physical location, let alone the same server! As I said, the data is being backup by means of a network (LAN, VPN et al), which is perfectly feasible thanks to the clever rsync algorithm being used by BackupPC.

      Secondly, the .tar.gz export mechanism I mentioned is perfectly capable of creating partial files of 650MB or 4GB size for example. Thanks to the par2 information being generated at the same time, you get lots of checksum data to verify that your exports actually contain something worth taking off-site. If you don't want to actually slice the exports you can always generate them to a locally mounted removable harddisk as one big chunk as well.

      Feel free to reply if anything remains unclear in your view.

    29. Re:your file server structure? by JayAEU · · Score: 1

      On a sidenote, I even use rsync to back up my Windows PCs. The nice people at http://www.itefix.no/phpws/index.php?module=pagema ster&PAGE_user_op=view_page&PAGE_id=6&MMN_position =150:150 put together "cwRsyncServer" for Windows for free using rsync and Cygwin, which works like a charm.

      It installs itself as a service and allows for really smooth backups using BackupPC.

    30. Re:your file server structure? by rbrewer123 · · Score: 1

      I have an old PC running linux with a 160 GB drive in it which is my backup server. I use rsync with hard-links to backup my laptop, photos, and music there. My mythtv video is not backed up, because it is so big and I got it for free anyway, I'm not going to cry if the drive fails and I lose it. By using rsync with hard links I can keep several historical snapshots of my data without using up very much space. I get the space savings of incremental backups with the ease-of-use of full snapshots.

      I am in the process of creating an off-site backup scheme. For me that entails burning my unchanging data, such as music and photos, to DVD. The more changeable data I will save to an old 40 GB hard drive and an old 60 GB hard drive in USB enclosures. I plan to put the DVDs in a safe deposit box and swap which drive is in the safe deposit box every 3 or 4 weeks. The 40 GB drive was given to me by a friend. For the 60 GB drive, I bought a new 250 GB SATA drive for the mythtv box and reclaimed its 60 GB drive for the offsite rotation scheme. The price per GB of a new 60 GB drive is too high to consider. Why spend $50 on a 60 GB drive for backups when I can spend $80 for a 250 GB drive and upgrade my mythtv at the same time?

      With this scheme I will end up with 3 or even 4 physical copies of my most precious data... 1 in use at my house, 1 on the backup server at my house, and 1 on either DVD or a hard drive in the safe deposit box. This should be good enough to survive all but the largest natural disaster or act of war.

      I don't think RAID should be the main solution for backups, because there are so many hardware, software, human error, and natural disaster scenarios that it can't handle. Redundant physical copies with as much geographic diversity as practical seems better to me.

  3. Can I get that petabyte in Cornflower Blue? by SpasticMutant · · Score: 5, Funny

    As long as it's not silver, black or grey, I'm fine with adding another petabyte to my current configuration. If only my file system could handle it...

    1. Re:Can I get that petabyte in Cornflower Blue? by keithmo · · Score: 5, Funny

      But mauve has the most RAM.

    2. Re:Can I get that petabyte in Cornflower Blue? by Pike · · Score: 5, Insightful

      Sounds like you need ZFS.

    3. Re:Can I get that petabyte in Cornflower Blue? by grammar+fascist · · Score: 1

      Yeah, but mauve doesn't journal. You'd want to go for magenta, though you'd take a hit on write-only memory latency.

      --
      I got my Linux laptop at System76.
    4. Re:Can I get that petabyte in Cornflower Blue? by wild_berry · · Score: 1

      The first rule of ZFS is you don't talk about ZFS...

    5. Re:Can I get that petabyte in Cornflower Blue? by evilviper · · Score: 1
      Sounds like you need ZFS.

      Bah! XFS maxes out at 8,000+ Petabytes. Not as much as ZFS, but... umm... let me know when you need more than that, and I'll buy you a cookie.
      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
  4. Sounds heavy by BadAnalogyGuy · · Score: 5, Funny

    Knowing my luck, I'd probably tip the rack over and lose all the bank data to a massive head crash.

    If information is power, then this thing is a perpetual motion machine.

  5. I think I'll buy the house... by BlahMatt · · Score: 5, Funny
    "you could have every reality TV program at your fingertips for a little less than the cost of an average house."
    Thank you I think I'll buy the house...

    A) Because why would you want every reality TV program at your fingertips?
    B) Because we already do (See http://bittorrent.com/)
    C) Because... just because.
    --
    To understand recursion, one must first understand recursion...
    1. Re:I think I'll buy the house... by Anonymous Coward · · Score: 5, Funny

      Also, you can live in a house. Have you tried living in a Mini-ITX case though?

    2. Re:I think I'll buy the house... by mordors9 · · Score: 1, Funny

      Your inclusion of B makes you subject to serious fines and possible imprisonment. Please remit $2000 to my address to avoid impending litigation.

    3. Re:I think I'll buy the house... by Mister+Whirly · · Score: 1, Offtopic

      Actually, I think blackmail is a much more serious crime...

      --
      "But this one goes to 11!"
    4. Re:I think I'll buy the house... by Xichekolas · · Score: 1

      Not according to the RIAA... seems like blackmail would fit right in with the rest of their extortion methods...

      --

      Self-referential Sigs are cool on /. these days...

      54

    5. Re:I think I'll buy the house... by KevinIsOwn · · Score: 2, Funny

      I don't think I really understand their cost comparison...

      How many Libraries of Congress is that?

    6. Re:I think I'll buy the house... by evilviper · · Score: 1
      Have you tried living in a Mini-ITX case though?

      Yes. I live in a rent-controlled Mini-ITX case in New York for 6 months... My friends were jealous when they visited.

      What's more, the heat always works, unlike their crappy non-Mini-ITX apartments.

      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
  6. It's still not big enough! by kcbrown · · Score: 5, Funny

    Not when I keep getting a new internet every few minutes. A whole internet every few minutes! Can you imagine how many libraries of congress that is? I don't know about you, but I'd have a lot of trouble stuffing an entire library of congress into one of those tubes! And since the library of congress is obviously a lot bigger than this storage computer, there's no way you could stuff it into it!

    Until they come out with one of these that's bigger than the library of congress, I'm not buying!

    - Senator Ted Stevens, computer guru extraordinaire

    --
    Use 'slashdot stuff' in the subject line in any email you send me if you want to get past the spam filter.
    1. Re:It's still not big enough! by grammar+fascist · · Score: 0, Troll

      You're allowed to make jokes about senators' computer knowledge (or lack thereof) when you can tell us what "cloture" is - without Googling for it.

      And no, it has nothing to do with coagulation or female body parts.

      --
      I got my Linux laptop at System76.
    2. Re:It's still not big enough! by Mister+Whirly · · Score: 2, Funny

      "You're allowed to make jokes about senators' computer knowledge (or lack thereof) when you can tell us what "cloture" is - without Googling for it."

      Culture for blood clots?

      --
      "But this one goes to 11!"
    3. Re:It's still not big enough! by just_forget_it · · Score: 2, Insightful

      Ted Stevens jokes will not get old for a long, long while. It is a glorious time to be alive.

    4. Re:It's still not big enough! by squidfood · · Score: 2, Insightful
      You're allowed to make jokes about senators' computer knowledge (or lack thereof) when you can tell us what "cloture" is - without Googling for it.

      Difference is, I don't have any decision power over his parliamentary procedure but he has decsion power over my technology.

    5. Re:It's still not big enough! by ottothecow · · Score: 3, Informative
      It's where the senate is able to call for a time limit until a matter must be voted on. Its how they get rid of filibusters if they have the votes.

      Thats right bitch, I went to high school. (its easiest to remember it because its kind of like "closure" and they are really calling for deliberation to come to a close and are just bad spellers)

      --
      Bottles.
    6. Re:It's still not big enough! by Anonymous Coward · · Score: 0

      I gotta tell you, I moderated you back up cause I thought your post was very insightful. We know what we know, and our Senators know what they know. Too bad they have the ability to dictate more about our lives than we can about theirs!

    7. Re:It's still not big enough! by ConceptJunkie · · Score: 1

      I can.

      Can Senator Stevens?

      --
      You are in a maze of twisty little passages, all alike.
    8. Re:It's still not big enough! by 955301 · · Score: 1

      What's the logic in this rule? The Senators had to look it up at some point too? I mean, they weren't born knowing what cloture is were they? In order to be clear to insult the guy we just couldn't be briefed on what cloture is, then stand in front of a televised program and explain it horrifically wrong to the entire world.

      --
      You are checking your backups, aren't you?
    9. Re:It's still not big enough! by TheRaven64 · · Score: 4, Insightful
      You're allowed to make jokes about senators' computer knowledge (or lack thereof) when you can tell us what "cloture" is - without Googling for it.

      I didn't know what cloture was. I had no need to. Then you posted about it, and I needed to. I googled for it and now I do. I still don't really need to know (I'm not a US Senator, or even a US resident), but because it seemed like it might be at least moderately important that I knew about it, I read about it and learned. This is what moderately intelligent people do; they spot important gaps in their knowledge and then do something about them.

      What Ted Stevens did, was spout nonsense on a subject that it was very, very important that he understood well. He is in charge of a committee whose responsibilities include determining whether the US section of the Internet should be regulated. He was leading the debate on this very subject, and yet displayed a complete lack of understanding of the subject in question. From The Daily Show's coverage of the speech, it seems clear that the average American television viewer has a greater understanding of the way the Internet works than this person, who, nonetheless, felt it necessary to stand up and publicly air an opinion on the matter.

      --
      I am TheRaven on Soylent News
    10. Re:It's still not big enough! by InfiniteWisdom · · Score: 1

      Anyone who's been paying even casual attention to all the bills and confirmations votes that have been filibustered/threatened to be filibustered know what cloture is.

    11. Re:It's still not big enough! by Xocet_00 · · Score: 1

      "I googled for it and now I do."

      Yeah but you didn't tell us what you found out in your post. If you had, I would've made some dynamite jokes out senators' computer knowledge.

  7. So...I read the article... by StressGuy · · Score: 4, Insightful

    My head spinning with the amazing possibilities such an immense data storage per kW solution could be applied to...why, it was even re-kindling my interest in the mini-ITX board. Then....I read the article

    "The next step up is the TB120 PetaBox, basically a rack of 40 GB3000s and an ethernet switch or two."

    WOW! so far so good...then, things turn ugly

      "If you need more space than that, I would say it is time to lay off the naughty pictures for a bit and seek serious help.

    In any case, Capricorn is saying you can get into one to the TB120s for about $1.50 a GB, and a little math says a full rack would cost under $200K. If you think that is a lot, imagine the Tivo you could make out of one, you could have every reality TV program at your fingertips for a little less than the cost of an average house."

    Yup, for a mere $200K, you too can have every reality TV program and/or naughty picture at your fingertips...and here I was thinking about mundane things like virtual libraries, genome sequencing, protien folding, etc.

    I'm going to be sad now...

    --
    A goal is a dream with a deadline
    1. Re:So...I read the article... by digitalhermit · · Score: 1

      It's coming to the point where every home should come equipped with a file server. We have MP3 collections, DVRs, home video to be edited, backups, etc.. Most technically savvy folks realize at some point that it's much cheaper and manageable to build out a file server than to try to replicate across multiple machines. Worst is when a box needs to be updated...

      A typical computer power user may have the following:
      1) 100G-200G worth of DV video from home movies
      2) 10G-20G of MP3s
      3) 5G-10G of digital camera pictures
      4) 200+G of Tivo, MythTV, downloaded movies
      5) 10G of software (ISOs, update files, BIOS upgrade, etc)
      6) 5G miscellaneous

      That's half a terabyte there already. You can put together a fileserver with JBOD for a few hundred dollars. But if you're putting all your data there, you probably want RAID and a backup solution. Right now I have a terabyte of storage, with the majority used by DV files from my camera. Though it would be nice to do cooler things, it's just barely adequate for my mundane stuff.

    2. Re:So...I read the article... by cdrudge · · Score: 1
      Yup, for a mere $200K, you too can have every reality TV program and/or naughty picture at your fingertips...and here I was thinking about mundane things like virtual libraries, genome sequencing, protien folding, etc.

      I'm going to be sad now...
      The problem with saying they can be used for genome sequencing, protein folding, etc is that the typical Enquirer reader isn't going to have a clue how much space those activites take. I consider myself an above average geek and I don't know what an educated guess would be. However many people can relate what a show or movie size is, and they have a general idea that there are a ton of reality episodes out there. They can somewhat equate the storage requirements although it's quite vague still.

      I'll admit that reality TV shows and porn isn't a great intellectual measurement of storage space. A more generic measurement, such as 1000 DVD movies or 200k MP3s may be a little better though.
    3. Re:So...I read the article... by Mister+Whirly · · Score: 1, Offtopic

      "up, for a mere $200K, you too can have every reality TV program and/or naughty picture at your fingertips"

      It would only be worth the $200K if that included the rights to all reality shows - so I could pull the plug on all of them...

      --
      "But this one goes to 11!"
    4. Re:So...I read the article... by Kjella · · Score: 1

      "up, for a mere $200K, you too can have every reality TV program and/or naughty picture at your fingertips"

      It would only be worth the $200K if that included the rights to all reality shows - so I could pull the plug on all of them...


      A lot of people like watching them but if you don't, that's fine. But why do you want to deny everyone from watching, just because you don't personally approve? I'm a firm believer that what consenting adult people do in the privacy of their own home is their own business, including but not limited to watching mindless reality shows on TV. In the same way, I don't manage to get worked up about people buying the latest MPAA blockbuster or RIAA album, and would never dream of "pulling the plug" on them. The alternatives are clearly there for those that seek them, and if they don't it's their problem. If you want to take it from them against their will then you're just another one of those anti-this and that people that want a nanny state, "knowing better" than other people.

      --
      Live today, because you never know what tomorrow brings
    5. Re:So...I read the article... by Mister+Whirly · · Score: 1

      Or I could have just been joking - but let's over analyze it anyways, shall we? Oh, but not right now, because Project Runway is on and after that The Real Wives of Orange County...

      --
      "But this one goes to 11!"
  8. RAID by Doc+Ruby · · Score: 2

    What's the best SW RAID to run against a cluster of these 3TB 1U appliances? That transparently offers swappable cluster units to apps designed to write to local filesystems?

    --

    --
    make install -not war

    1. Re:RAID by Firehed · · Score: 1

      Well, even JBOD would be stupid, let alone the RAID0 that some enthusiasts would try (which would probably saturate a quality gigabit link anyways). I think a hardware RAID5 approach for each cluster would be a very good idea, though each of those acting as a node of sorts in a massive RAID50 array would be good. I wouldn't want to lose an entire node due to a single drive, so I figure it would be best to find the bad node, replace its bad drive and rebuild that array, then pop that node back into place and rebuild as necessary.

      As for software... well, I'm lost. But I don't think I'd really want to get into the business of dozens of clusters all in some massive RAID array anyways. Aside from the insane confusion, I just wouldn't want the hassle if/when a drive goes out. Especially since repopulating a 750GB drive would take a really damn long time, at least if my formatting some 320GB units is anything to go by (I did two at once, a good six hours plus for a full format). You might be looking at upwards of a day if the array was pretty full (though that's really just speculation, I've never rebuilt arrays but I figure it's a safe assumption to say it takes longer than a full format).

      --
      How are sites slashdotted when nobody reads TFAs?
    2. Re:RAID by Doc+Ruby · · Score: 1

      HW RAID is incompatible with the HW we're discussing, at least in power/size/cost specs.

      Repopulating the drives takes as long in SW as in HW, limited by the HD write speed. Saturating a GB network is also not a function of the RAID, whether HW or SW.

      You're talking about the bandwith constraints of moving local filesystems to network storage, which is another matter. Once the network and storage HW can accommodate the app bandwidth (and latency) requirements, SW RAID on a cluster of these cheap, cool, tiny applicances makes all kinds of sense.

      --

      --
      make install -not war

    3. Re:RAID by Anonymous Coward · · Score: 0

      Well, even JBOD would be stupid, let alone the RAID0 that some enthusiasts would try (which would probably saturate a quality gigabit link anyways). I think a hardware RAID5 approach for each cluster would be a very good idea, though each of those acting as a node of sorts in a massive RAID50 array would be good. I wouldn't want to lose an entire node due to a single drive, so I figure it would be best to find the bad node, replace its bad drive and rebuild that array, then pop that node back into place and rebuild as necessary.

      Let's not get silly here, no enthusiast is going to buy one of these. The sorts of people who would buy something like this are people with truly gigantic data storage requirements, i.e., large databases, digital animation, digital video production, etc. And most of those people are going to have the good sense to go with a nice RAID 1+0 setup (striping across mirrored pairs). The performance will be far and above anything that you're going to get with RAID 5.

    4. Re:RAID by Wesley+Felter · · Score: 1

      If you want to make this hardware into a single filesystem and you want scalable performance, Lustre is pretty much the only choice.

      (Someone suggested ZFS, but that would require a single file server that would potentially become a performance bottleneck.)

    5. Re:RAID by WuphonsReach · · Score: 4, Informative

      Rebuild rate for a RAID1, 2-drive, 750GB SATA set is around 75MB/s. (Raw read/write rates for 750GB drives are around 75MB/s as well.) So figure 3 hours to rebuild a RAID1 array.

      Not sure what rebuild rates would be on a RAID5, probably about half of that? So 6 hours to rebuild the array?

      (That's using 750GB SATA drives with Software RAID on a PCIe motherboard.)

      --
      Wolde you bothe eate your cake, and have your cake?
  9. Bah by bunions · · Score: 3, Funny

    I'm not interested in no mini-itx box unless it's wedged into an adorable, panda-like case. http://www.norhtec.com/products/panda/index.html

    --
    there is no need to sign your posts. this isn't usenet. your username is right there above your post. stop it.
  10. Where do you live? by ackthpt · · Score: 2, Interesting

    And they would need all that storage to record their utility bills.

    Where do you live that 80 watts is a big drain on financial resources?

    My CPU consumes 39 watts and I consider that loverly, compared to the old CPU which sucked 70+ watts.

    --

    A feeling of having made the same mistake before: Deja Foobar
    1. Re:Where do you live? by Anonymous Coward · · Score: 0

      Add in your disk drives, ram and motherboards. Oh, and make it 3 diskdrives. More than 80

    2. Re:Where do you live? by Alaria+Phrozen · · Score: 4, Funny

      You think that's bad? My CPU fan consumes 70+ watts.

      What's worse the rig I built to cool my harddrives is essentially a system of Peltier devices http://en.wikipedia.org/wiki/Peltier-Seebeck_effec t in series!

      The very premise of the grandparent is ridiculous. Now if it were one-point-twenty-one-jigga-watts, I'd be worried, but 80 watts? I've got more on in light bulbs right now!

    3. Re:Where do you live? by ackthpt · · Score: 1

      Add in your disk drives, ram and motherboards. Oh, and make it 3 diskdrives. More than 80

      Ah, but I got an LCD monitor, see? And that cut my power bill down a bit from the old Cathod Ray Tube and Thyroid Irradiator.

      I've got more on my desktop than an entire room full of mainframes from the day I started in programming, by orders of magnitude. And it all runs on less than a Mr. Coffee

      I'm one of those weasels who keeps everything to a minimum and stare, slack-jawed, when my monthly bill comes in over $20.

      --

      A feeling of having made the same mistake before: Deja Foobar
    4. Re:Where do you live? by DarthStrydre · · Score: 4, Informative

      I'll hope you mean in parallel on your drives. Peltier in series are not befitting that application unless you live in an unusually hot house, or have drives requiring cryo conditions.

      Placing peltier patties in series decreases the amount of heat they can move, but obviously increases the temperature differential, but only if the stack is properly designed. It is very easy to put two peltier in series and have worse performance than a single device. In your case, with a non-static system (i.e. the hard drives are actively PRODUCING heat that you wish to remove) heat handling seems more imprtant than massive temperature differential. In thermodynamics, there is no free lunch... your secondary peltier is not only moving the heat away from the drive, but has to struggle with the heat it produces (however much electrical power it consumes is heat) as well as the first stage cooler.

      To optimize a multistage thermoelectric cooler, a rule of thumb is that each stage should recieve 1/2 to 1/3 as much current as the previous one. This roughly translates to an equivalent voltage ratio, though as the temperature and temperature delta change, the silicon has different resistances, and the Seebeck also changes the apparent resistance.

      In a PC, if you really want to do multistage peltier patties, and assuming they are 12v devices, you would notice an increase in performance (i.e. less heat coming off the hot side, and a colder cold side) if you were to connect the hard drive peltier to the +5V rail, and the heat sink peltier to the +12 rail. This is a very crude system, but definitely better than running both on +12.

      I still maintain that the coolers in parallel are preferable for nearly any computer usage. You have a metric library of congress of BTUs (slashdot measurement) to move quickly. Stacked units do this poorly.

      I have some data at home to determine near-optimal steady-state stacked configurations. Google is a help too, though sorting through the deep research and crackpot FAQs is rather tedious in this realm.

    5. Re:Where do you live? by The_ForeignEye · · Score: 0, Offtopic

      Hi!!! How are you?

      It's so nice to meet a fellow PowerPC-based Mac user on the net...

  11. addot? by Anonymous Coward · · Score: 0

    I'm very interested in this for a small app, however we need fail-safe redundancy rather than storage capacity. How much for 4-8 of the 1TB models?

  12. Pricing by jonesy16 · · Score: 3, Informative

    Since it's not mentioned on their webpage or in the article, I searched for a listing of the price points and found the following.

    "The PetaBox nodes and racks are available now. Base pricing for the nodes (512K RAM, 10/100 interface, and no LCD) ranges from $1,595 (GB1000) to $3,395 (GB3000)." http://products.datamation.com/dms/sc/1156440622.h tml

    The GB1000 is the 1TB node and the GB3000 is the 3TB node. I think they might mean 512MB of RAM base, but who knows. Sounds like it's a Fedora linux based product which makes me wonder what services it provides, they don't list. I would assume basic NFS/SMB/AFS services but there's no mention of backup / replication services, mirroring between twin nodes, etc that competitive products offer.

    1. Re:Pricing by rthille · · Score: 1

      Interesting. I just ordered the parts for my new server:
      $704.89 including tax & shipping.
      1.5 GHz C7 w/1000-base-t Mini-ITX 2 IDE & 2 SATA ports (would have liked 4, but whatever, I can get a PCI card)
      4-drive 1U 15" deep case [could be dual-racked I suppose]
      1GB RAM
      DVD writer [dual layer]

      The drives going in it are coming from my old server and others I've got lying around, which is why I wanted PATA & SATA.

      Even buying a SATA PCI adapter & 4 750GB drives I think I'd come out far cheaper.
      And I think these guys use master and slave on the mini-itx's IDE ports, at least the picture doesn't show the PCI slot filled.

      --
      Awesome furniture, accessories and cabinetry in Santa Rosa, CA: http://humanity-home.com/
    2. Re:Pricing by jonesy16 · · Score: 2, Informative

      SATA doesn't have slave and master so that won't be a bandwidth issue. The drives are also quite an expense and you are reusing yours. The 750 GB drives go for $330 a piece. There's also the quality of the power supplies and cases (which can inflate the cost). Lastly, you're paying for the integration and the configuration of the OS. Even if they're using a free implementation of open source software such as Fedora, it's not a trivial matter (for some) to set up the remote administration and any other non-advertised services that may come preconfigured (they aren't very descriptive on their website). Overall this is a fairly good price if you compare it to products from Aberdeen, Adaptec, Iomega, etc.

    3. Re:Pricing by rthille · · Score: 1

      They aren't using SATA, they are using PATA. You can see the cables in this picture:
      http://capricorn-tech.com/images/mobo176.jpg
      They're barely-visable at the top.
      Certainly they are a good deal to a company buying a rack full, but for someone like me who's doing it as a hobby, the $3k isn't worth it given I'm only going to have one (ok, maybe 2 :-) and will be setting up the system to my liking anyway...
      Still, I wonder if the Sun box that has the 48 drives (vertically) in 3U or 4U that was on slashdot not long ago might be denser...

      Robert

      --
      Awesome furniture, accessories and cabinetry in Santa Rosa, CA: http://humanity-home.com/
    4. Re:Pricing by WuphonsReach · · Score: 1

      Rough parts list for a sizeable server that we're slowly building:

      $4200 (12) 750GB drives
      $0159 Thermaltake Armor VA8000BNS Black Chassis: 1.0mm SECC
      $0190 Thermaltake toughpower W0117RU ATX12V/ EPS12V 750W
      $0035 DVD-RW (BLACK)
      $0050 misc parts (fans, cables)
      $0182 MB-BA22658 AMD Athlon64 X2 4200+ AM2 (WINDSOR)
      $0200 XXXXXXXXXX Asus M2N32-SLI Deluxe motherboard (ATX)
      $0210 XXXXXXXXXX 1GBx2 ECC memory modules PC2 4200 DDR2 533
      $0009 XXXXXXXXXX Assemble & Test
      $0334 (2) INTEL PRO/1000 PT DUAL PORT EXPI9402PT gigabit PCIe x4
      $0500 8-port SATA-II PCIe x4 RAID adapter (undecided)
      $0367 4:3 SATA hotplug backplanes (iStarUSA BPU-340SATA)
      =====
      $2236 + $4200 for drives

      Note that the above is a full-tower using a standard ATX motherboard. Price for the PSU would be around $600 for a redundant 750W unit (which I *think* will fit inside the case). We're bonding some NICs together to give better bandwidth and fail-over capability. Also, we can fit (3) additional hard drives inside the case but they won't be as easy to swap.

      The dual-core CPU is going to become a bottleneck at some point. We'll probably upgrade to a quad-core AM2 CPU if they ever become available down the road. I've seen loads of 25-40% total CPU time while building the RAID10 array.

      Total space is 4200GB in RAID1/RAID10 setup (possibly 4900GB if we use 2 of the internal bays). Figure roughy $1.50/GB for a fully populated unit. But we're only starting with a (7) drive unit (700GB RAID1 + 1400GB RAID10 + hot-spare) and will add the other (8) drives down the road.

      --
      Wolde you bothe eate your cake, and have your cake?
    5. Re:Pricing by Anonymous Coward · · Score: 0

      Just curious - why not go RAID5 with that many drives? You could get a decent controller for the price of the drives you'd save, & have more space for cooling & use less power to boot.

    6. Re:Pricing by WuphonsReach · · Score: 2, Informative

      1) Performance - Average I/O time for a 4-drive RAID10 array is 1/2 that of a 2-drive RAID1 array on average. Throughput also steps somewhat linearly as you add more drives to a RAID10 array. RAID5 is fine for read-oriented storage, but not so good at writes. RAID10 allows us to improve throughput of both reads and writes.

      2) Rebuild time - Rebuild time for a RAID5 array isn't all that great. And if a 2nd drive fails, you have a 100% chance of data loss (vs only a 50% chance with RAID10). There's the possibility that RAID6 would be a better fit.

      For a 4-6 drive RAID, I've never been happy with RAID5 performance. Maybe it makes more sense at the 8-12 drive mark. Although at that level of spindles, you'd better be running RAID6 with hot-spares.

      If this was a backup storage server, we might go the RAID6 route... in which case capacity trumps performance. (Anyone know what performance gain is on a 8 or 12 drive RAID6 array?)

      --
      Wolde you bothe eate your cake, and have your cake?
  13. Why power per storage capacity? by Bromskloss · · Score: 3, Insightful
    less than 30 kW for an entire Petabyte
    What?! Power per storage capacity? The interesting figures are how much energy it takes to really do something, such as read or write, not just remember what was previously stored. I'm sure they can do the latter without power at all!
    --
    Swedish plasma phys. PhD student; MSc EE; knows maths, programming, electronics; finance interest; seeks opportunities
    1. Re:Why power per storage capacity? by Anonymous Coward · · Score: 0

      Hard disks don't spin by magic...
      -bendodge

    2. Re:Why power per storage capacity? by Ant+P. · · Score: 1

      Hey, does that mean I can sell this 1W/PiB floppy drive for a million dollars then?

    3. Re:Why power per storage capacity? by Frightening · · Score: 1

      It needs to keep breathing. Imagine having a terabyte worth of pornography stacked on your back..you need juice to carry that sort of stuff, mate. It doesn't matter if you're a magnetic disk. Just being there is an energy-sucking sort of event. It's like telling Elvis to come over to a party - it doesn't matter whether he's singing or not, just having him (esp. back from the grave) means you have to pay the sombitch. /previews comment

      Sleep is a wonderful phenomenon. I need sleep, but even sleep requires energy! /previews again

      I think the answer is tat 80W is the average rate, or the maximum rate, or something.

  14. WOW! But is it ready for the enterprise? by WidescreenFreak · · Score: 4, Insightful

    And, no, I'm not talking about the starship Enterprise, so can it with the "Star Trek" comments.

    Obviously, this is the kind of product that companies and perhaps even data centers will possibly take a very long and desiring look at. No doubt that's exactly what Capricorn is hoping for. 3.2Kw/hr is nothing compared to the power that's eaten up by a rack that's loaded with arrays and SCSI drives.

    My concern is with reliability. For the most part, the general attitiude is that SCSI, while much more expensive than IDE or SATA, is also more reliable with a larger MTBF. Whether that's really true or not is up for debate, but that's the general opinion that out there. Of course, there's also the general attitude that more spindles means more throughput and more reliability if in a proper RAID configuration. From what I've seen with other solutions, we can probably assume with a wide margin of safety that 120TB for this Capricorn system is RAID 0. If a 1U system only contains four drives and they're all independent RAID configurations, then say goodbye to 30 TB just to add a modicum of redundancy with RAID 5, whereas if there were more spindles, the amount of lost space would be greatly decreased even though there would be the increased chance of a failed drive.

    Looking at this system, my gut feel is that a more-spindle configuration might be a wiser move, unless the money saved in electricity goes to a better-than-average backup system. Maybe it's my bias towards SCSI/fibre channel, but I don't know that I can yet trust a low-spindle, IDE configuration to do the same thing in an enterprise environment.

    Just out of curiosity, has anyone out there in Slashdotland had good luck with enterprise IDE solutions? Who knows. Perhaps some success stories might change my pro-SCSI/fibre view.

    --
    The Overrated mod is for reversing inappropriate, positive mods, not for voicing disagreement with a post.
  15. This is not a storage array. by Phishcast · · Score: 4, Insightful

    Technically this is a convenient way to stuff a lot of managed storage into a small space with low power consumption. Cool, but it's really nothing more than a bunch of servers in a single rack with big hard drives. If I've got a petabyte of storage to utilize I want to manage it as one large pool (or several large pools), not 40 servers, on each of which I need to run an OS and services which make a relatively small portion of that storage available. Where's my FC or iSCSI target ports?

    1. Re:This is not a storage array. by hackstraw · · Score: 1

      Cool, but it's really nothing more than a bunch of servers in a single rack with big hard drives.

      Actually, it is or can be one big disk or "just" a JBOD. Yes, each box is just a regular server running Linux, but the setup can go like this: internal RAID5 or so within each box, then concatenate the drives with RAID 0 over each of the raid5.

      Its up to you. For at least one of the previous slashdot stories about this take a look here: http://linux.slashdot.org/article.pl?sid=05/06/22/ 0418253&from=rss Bunches of good replies about the box there.

      Personally, I want one or 10 of them :)

    2. Re:This is not a storage array. by redhog · · Score: 1

      Network block devices / iSCSI / IDE-over-ethernet or whatever your favourite network storage for today is, and a front-end server to raid it all. You have endless possibilities. With that solution, you have a good hotswappability too - just hotswap a whole 1U machine!

      --
      --The knowledge that you are an idiot, is what distinguishes you from one.
  16. Too expensive for large install by slykens · · Score: 2

    At $1.50 per GB in a large install its about two and a half times what one could build on their own. 5U 24 drive racks go for about $2k each, add in $2k for mobo/controllers, and 24 750 GB drives at $330 ea and we're at $11,920 per 18 TB. You can fit eight of these in a rack so that's 144 TB per rack at a cost of $95,360. Add in for the rack itself, a good switch, and some miscellaneous expenses and call it an even $100k. That's a cost of $0.66/GB.

    It's not raid but it is a ton of storage space. Even if you back out one drive for parity and one for spare in each enclosure the cost per GB only goes up to about $0.72.

    1. Re:Too expensive for large install by Anonymous Coward · · Score: 0

      Unless you just want to look at the servers, you need to account for power consumption. $2/GB may not be so bad then and you get a 1Ghz CPU per node into the bargin as well.

    2. Re:Too expensive for large install by CatOne · · Score: 1

      What's management going to be like on that homebrew system? Sure, BYO can be cheapest but allocationg/partitioning/whatever is going to take up substantially more of "someone's time," which even if they pay that person $40K/year the cost to a company is at least $80K/year all things considered.

    3. Re:Too expensive for large install by slykens · · Score: 1

      You assume that managing forty individual servers will be less costly than managing eight larger servers.

      Really, person-hours wise the cheapest way to do it is likely one big farking system with fibre channel or the like.

    4. Re:Too expensive for large install by Anonymous Coward · · Score: 0

      Obviously you're just looking at the cost per GB, but I think the article more focuses on the power consumption.

    5. Re:Too expensive for large install by pdh11 · · Score: 1

      5U 24 drive racks go for about $2k each [...] 144 TB per rack

      If density is all, you're doing better than TFA at 4.8drives/U, but you can get 8U 40-drive racks for 5 drives/U or 150TB/rack. Pricey though, and you need at least 3 raid cards per box to run that many drives, which rules out mini-ITX.

      I expect you can do even better with those pull-out drawers of drives that Sun used to go in for, but probably not in SATA.

      Peter

  17. Re:WOW! But is it ready for the enterprise? by jo42 · · Score: 2, Informative

    Low-end EMC SAN boxes use SATA: http://www.emc.com/products/platforms.jsp

  18. You could do that... by Wannabe+Code+Monkey · · Score: 0
    imagine the Tivo you could make out of one, you could have every reality TV program at your fingertips for a little less than the cost of an average house.

    Or you could archive the entire internet with several of them...

    --
    We always knew Comcast was corrupt, here's the proof: http://tech.slashdot.org/comments.pl?sid=1909890&cid=34545432
  19. You can get that in any colour you like by ackthpt · · Score: 2, Funny

    Can I get that petabyte in Cornflower Blue?...As long as it's not silver, black or grey, I'm fine with adding another petabyte to my current configuration. If only my file system could handle it...

    You can get that in any colour you like, as long as it's Beige

    muah ha ha ha haaaa!

    --

    A feeling of having made the same mistake before: Deja Foobar
  20. Low end? by WidescreenFreak · · Score: 1

    But as you said, they're low-end. I can't imagine anyone actually going to their head of IT and putting "low end" and "mission critical data" in the same sentence.

    --
    The Overrated mod is for reversing inappropriate, positive mods, not for voicing disagreement with a post.
    1. Re:Low end? by georgewilliamherbert · · Score: 1

      Nobody's positioning PATA/SATA FC drive units as "Low end" anymore. I don't have the detailed statistics, but these were just coming out in 2003, and now dominate the marketplace in terms of volume of drives sold into large enterprises.

      The PATA ones make me a little nervous, but SATA (especially the ones with command tag queueing and such) is generally just fine.

      Capricorn is the system build spinoff from the Internet Archive; a friend of mine who works there was doing some of the QA work on these units. He's pretty picky about flaky hardware, and these measured up fine.

  21. can be nice... or a nightmare by Kz · · Score: 1

    I've done such a thing: several 1U cases with 4drives each and a mini-itx mb. works great, but back then there wasn't a good block-sharing software (like iSCSI, gnbd or AoE), so i had to throw together an app interface to move files and assure redundancy and integrity with no RAID.

    now i'm moving away from this to a more SAN-like system (AoE for now, maybe iSCSI next year). i could reuse the hardware, but unfortunately the mini-itx mb had only PATA and 100BaseT. if there's a little mb with 4 SATA and GbEth, i'd do it in a flash.

    --
    -Kz-
    1. Re:can be nice... or a nightmare by rthille · · Score: 1

      There's a 4-SATA mini-itx board, but it's from commell (I think), not VIA, and it's a P4 board.

      --
      Awesome furniture, accessories and cabinetry in Santa Rosa, CA: http://humanity-home.com/
  22. In perspective... by CoolCash · · Score: 1

    We have a Promise Vtrack M500I which holds 14 drives, the max wattage of this is 440W or 31.4W per drive. The PetaBox is about 20W per drive. Also, since this is a 1U vs 4U your are getting 16 drives in the space of the Vtrack's 14.

  23. Re:WOW! But is it ready for the enterprise? by OverlordQ · · Score: 4, Informative

    I dont think it's RAID anything at all.

    The PetaBox TB120 says 120TB of space on 40 nodes. That's 3TB a node, and given 4 drives per node, that's 750GB drives.

    So basically the RAID selection is left up as an exercise to the reader, they're just marketing raw diskspace with a very low power consumption.

    --
    Your hair look like poop, Bob! - Wanker.
  24. Watts Life? by Doc+Ruby · · Score: 1

    Maximum rez (8Kx6Kx60FPSx2eyes) video for 75 years is 54 petabytes, compressed to maybe 3-5PB. That's about 120KW at 80W:TB.

    The average American home consumes about 5KW, for about 2 people, unless it's storing their life experience data in 67 racks, 240KW, 48x their electric bill. They might only need half the power if they add storage as they add experience at 54TB:y. Maybe if we start now, we could get the power demands closer to human biological power consumption of about 0.12W by the time a new person is ready to go to school.

    --

    --
    make install -not war

    1. Re:Watts Life? by Overzeetop · · Score: 1

      Yeah, but have you seen all the freakin' error reports on those humans? The compression is super lossy, and degrades - sometimes catastrophically - over time. Not to mention that there's just no good way to back up a human and get even a small portion of the data to replicate.

      If I didn't know better, I'd say these "human" storage devices were designed and built by the content industry for the specific purpose of being endless consumers of media.

      --
      Is it just my observation, or are there way too many stupid people in the world?
    2. Re:Watts Life? by Doc+Ruby · · Score: 1

      That's why I want to replace them with "always on" dataservers. I'm inverting The Matrix.

      --

      --
      make install -not war

    3. Re:Watts Life? by inviolet · · Score: 1

      Humans utilize EEPROM memory, you know. Which reminds me: wouldn't it be cool to have true random-access long-term memory? Then I could actually 'remember' scoring on that beautiful brunette who sat behind me in American History in 7th grade. Wow, what a long and beautifully miserable year that was!

      --
      FATMOUSE + YOU = FATMOUSE
    4. Re:Watts Life? by Doc+Ruby · · Score: 1

      What you're looking for is a neuroIDE for these petabyte racks.

      --

      --
      make install -not war

    5. Re:Watts Life? by myz24 · · Score: 1

      I'm familiar with double d racks but just how big are petabyte racks?

    6. Re:Watts Life? by Doc+Ruby · · Score: 1

      "Pet-a-byte" is not a size, it's a measure of interactivity. But anything over a mouthful is wasted.

      --

      --
      make install -not war

  25. Id10t by SirKron · · Score: 1

    What idiot would actually put 120TB into an array that a single disk failure would require shutting down the entire 120TB storage array to replace the (non-hot-swap) disk? I would rather, for uptime sake, spend the extra heating/cooling dollars implementing a solution that utilizes hot-swap SATA SAS drives. Also, is it really red? Looks like a rack of firewalls to me...

    1. Re:Id10t by wiml · · Score: 1

      Your firewalls are red? My firewalls are black. From soot.

    2. Re:Id10t by matthew.thompson · · Score: 1

      Well given that the web site states * EZ-Latch disk mounting system I'm guessing that Capricorn Tech have thought this one through.

      --
      Matt Thompson - Actuality - Insert product here.
    3. Re:Id10t by SirKron · · Score: 1

      EZ-Latch != hot-swap

      Have you ever tried removing an IDE drive from an operating system and reattaching a different drive? Sure, it works fine with USB, but not ATA IDE. I did not read anywhere that mentioned being able to hot-swap the drives.

    4. Re:Id10t by Wesley+Felter · · Score: 1

      The nodes are hot-swap in a sense.

    5. Re:Id10t by matthew.thompson · · Score: 1

      As each node is an indicidually powered unit you'd not have to power down the entire array.

      As for hot swap PATA - I have a hot swap PATA system - works perfectly. I've had drive failures and been able to throw new drives in, access the admin console and start the re-build without powering down.

      --
      Matt Thompson - Actuality - Insert product here.
    6. Re:Id10t by dbIII · · Score: 1
      What idiot would actually put 120TB into an array that a single disk failure would require shutting down the entire 120TB storage array to replace the (non-hot-swap) disk?
      The sort of idiot that has two, is using it as temporary storage space, or the sort of idiot that can let the users know the thing will be down for at hour at the end of the working day.

      You have to look at these things the same way you look at rust. It's easy to prevent things corroding - you just coat them all in gold, but most of the time you don't bother and use a cheaper solution.

  26. Not enough capacity by SuperBanana · · Score: 1
    Obviously, this is the kind of product that companies and perhaps even data centers will possibly take a very long and desiring look at.

    Uh...I'm not so sure. It can't be expanded (and only 4 slots is pretty cheesy), 750GB drives are commanding an insane price premium (300GB drives are under $100, and 750GB drives are about twice as expensive per GB at $400), and fewer drives = slower...why one would "look long and desiring" at this is beyond me when you can get 2+3U solutions with equal density, but far superior overall capacity (y'know...6-12 slots?) letting you use cheaper disks.

    There's also the missing software component...

    1. Re:Not enough capacity by WuphonsReach · · Score: 1

      I wouldn't consider the 750GB drives to have an insane price premium. At least, not compared to historical prices. They're down under the $0.50/GB mark (but not as cheap as the ~$0.28/GB price point of lower-capacity drives). If they were still up around $500, I'd have more of a complaint.

      Are they worth the price premium for reduced heat / power requirements? Maybe... especially if it lets you pack double the density into an existing enclosure without spilling over to another enclosure. (Enclosures probably add $200/disk as a base cost, so putting the largest possible drives in makes some sense.)

      --
      Wolde you bothe eate your cake, and have your cake?
  27. if the goal is low power by dfghjk · · Score: 2, Insightful

    if the goal is low power i'd prefer to use more than 4 drives in the system. half the power budget is the motherboard, so an 8 drive chassis would result in a 25% reduction in power for larger installations. Clearly the focus here isn't on performance after all.

    If all I wanted was 4 drives why would I care? Why would I want a 1U rack? Why wouldn't I just stick them in my PC?

    1. Re:if the goal is low power by evilviper · · Score: 1
      half the power budget is the motherboard, so an 8 drive chassis would result in a 25% reduction in power for larger installations.

      They could also have used lower-power CPUs in each. But low power is never an exclusive proposition, otherwise you'd just turn everything off... They clearly wanted more performance per-drive than 8 drives on a single 1GHz VIA C3 processor (which is comparable to Intel/AMD chips of half the MHz) could muster.

      If all I wanted was 4 drives why would I care? Why would I want a 1U rack? Why wouldn't I just stick them in my PC?

      Possibly because of the (2) 500GB hard drives, and (2) DVD/CD ROM/RW drives you ALSO want, that are currently in your PC.

      Windows, at least, is a massive bitch when you try to use more than one controller.
      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    2. Re:if the goal is low power by Vlad_the_Inhaler · · Score: 1

      I thought Via were discontinuing the C3.
      The AMD Geode would then be an alternative, although I think it has (even) less muscle than the C3.

      Going back to the C3, I have just looked at Via's website and they have the Eden ULV which draws 3.5W @ 1GHz and 7.5W @ 1.5GHz. Both can be passively cooled. That must be why the C3 is history, I would guess my C3 Ezra 866 processor's requirements as being around 8-10W.

      --
      Mielipiteet omiani - Opinions personal, facts suspect.
  28. I hope you're in the US... by Anonymous Coward · · Score: 0

    ...because in the UK you'd be lucky to find a garden shed for that kind of dough.

  29. Interesting times... by WeekendKruzr · · Score: 1

    Like the old curse says, it's definitely weird when your e-penis is determined by how little electricity your rig soaks up...

  30. Re:WOW! But is it ready for the enterprise? by Tmack · · Score: 2, Interesting
    For the most part, the general attitiude is that SCSI, while much more expensive than IDE or SATA, is also more reliable with a larger MTBF

    While this used to be true, modern drives are the same between IDE/SATA/SCSI except for the control board the drive is strapped to. The reason SCSI is still preferred over IDE/SATA in most cases is from this old belief, most devices for enterprise level storage are still built mainly around it, SCSI still offers more devices per controller (14 per cable, rather than 2 of IDE/SATA), and SCSI is alot more hot-swap friendly. The company I work with has several storage solutions for different needs, the central and main storage is a large Fiberchannel system (3Par InServ), but our backup systems are SATA based (Nexsan SATABeast). All of them use some variant of RAID5, the 3par going so far as allowing raided volume provisioning across the array. As for enterprise level IDE/SATA, the SATABeast, and SATABoy are definately worth at least a peek.

    ...general attitude that more spindles means more throughput and more reliability if in a proper RAID configuration

    More throughput, maybe, if setup in a RAID that allows that. Reliability, maybe as in the array as a whole, but more spindles=more parts to fail, and with more spindles, more drives WILL fail. The up side is that when a drive fails, it doesnt take as large a chunk of the redundancy with it. With the 3Par, (iirc) a whole shelf of drives (40drives) can fail or be taken offline without losing operation of the array if setup correctly, where in a 4drive RAID5 setup (3 active, 1 hot spare), one drive failure requires rebuilding the failed drive on the hot spare. Losing another requires immediate replacement of hardware. For home or small office, that might be acceptable. But for large enterprise solutions, its not. You simply cannot afford to be running around hoping drives wont fail (they will), with a rack full of these 4drive units. If 2 drives go bad in the same unit at the same time, you just lost data.

    tm

    --
    Support TBI Research: http://www.raisinhope.org
  31. Really? by Anonymous Coward · · Score: 0

    How much it last to compile a Gentoo distribution? Can I use this unpaired power to look for aliens with the SETI project? Will the Duke Nukem Forever run decently there? Wow, I want a dozen of them!!

  32. Put it in units I can understand by Anonymous Coward · · Score: 0

    But how many Libraries of Congress does it get per watt?

  33. 80W server farm by Anonymous Coward · · Score: 0
    If you allow 120W to light a case and push water cooling with 5% loss per day,
    and you have enough resources to grow corn and maintain 1 chicken per unit.

    A self-sustaining green server farm that doesn't smell much worse than most.

  34. Drives Matching Motherboard? by Doc+Ruby · · Score: 2, Interesting

    They're using ITX motherboards to keep price/power down. If they used notebook HDs instead of the 3.5" 750GB ones, they'd get about 10% the storage density per host, 50% the price performance per GB, but much better power efficiency per GB. Is there a way to stuff 40 80GB notebook drives into an ITX host, for even better power efficiency at only double the price?

    --

    --
    make install -not war

    1. Re:Drives Matching Motherboard? by evilviper · · Score: 1
      If they used notebook HDs instead of the 3.5" 750GB ones, they'd get about 10% the storage density per host, 50% the price performance per GB, but much better power efficiency per GB

      That isn't even remotely your only problems.

      2.5" drives aren't as fast as their larger desktop counterparts. They also aren't as reliable, when put under heavy usage.

      Those aren't the kinds of things most companies want to trade to get their power costs down.
      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    2. Re:Drives Matching Motherboard? by Doc+Ruby · · Score: 1

      But if you stripe data across 10 80GB drives, they're faster than a single stream read/written on a single 750GB drive. And the reliability means quicker failures, but the tinier drive means replacing a smaller, cheaper chunk every time one fails ($80 instead of $330). That savings alone could count against the double cost per GB, maybe even result in a lower cost per month.

      --

      --
      make install -not war

  35. Re:Enquirer? by Lazerf4rt · · Score: 1

    I think that was the parent's sly way of pointing out that 'Enquirer' is a typo. Should be 'Inquirer'. Anyway, both magazines are rags. Although I guess for the Inquirer, you have to print the articles yourself to use them as rags.

  36. Re:Thankfully by JerLasVegas · · Score: 1

    lol, make sure you wear gloves

  37. Yeah, but 80 watts 24/7 is still sizeable by Odeen · · Score: 1

    I'm looking to build a terabyte+ NAS for home storage. Since I'm either at work or asleep for a good part of the day, I don't want to spin disks and use up power when I'm not around to enjoy it.

    Will this solution go to sleep ( 5 watts) after 15-20 minutes of inactivity, shut down the fans, and go completely silent? And then wake up as soon as I try to retrieve data from it?

    My current single-drive Tritton T-NAS box, being slowish and flaky, has a sleep mode. Buffalo Terastation has a sleep mode. Tritton ReadyNAS doesn't.

    1. Re:Yeah, but 80 watts 24/7 is still sizeable by macmouse · · Score: 1

      Actually, infrant's readynas now does support drive sleep mode.
      A new (stable release) firmware was released a week or so ago

      http://www.infrant.com/forum/viewtopic.php?t=5529

    2. Re:Yeah, but 80 watts 24/7 is still sizeable by Anonymous Coward · · Score: 0

      What would be truly impressive is a system that can spin up/down individual disks on an as-needed basis, so that you can still use one disk, while the others remain in the 'standby' mode.

    3. Re:Yeah, but 80 watts 24/7 is still sizeable by Wesley+Felter · · Score: 1

      That's called MAID: Massive Array of Idle Disks.

    4. Re:Yeah, but 80 watts 24/7 is still sizeable by Anonymous Coward · · Score: 0
      Yes, 80W x 24/7, as another post pointed out, is ~$2800 / year for electricity.

      But, for comparision's sake, a Snap Server 14000 3TB Network Attached Storage server burns 210W steady-state (300W Max). So, 80W isn't so bad.

      And then, if you replace a few incandescents with CFLs, well, you could get even pretty fast!

  38. Ouch? Obviously... by WebCowboy · · Score: 1

    You've never seen a utility bill before. Don't worry, you'll see one very soon after you move out of mum's basement.

    The article says a rack of 40 of these little babies consumes in the neighbourhood of 3.2 kW. That's rougly equivalent to two nice microwave ovens. Yes yes, I know you don't run microwave ovens 24/7. But if you didn't close your refrigerator door all the way and it ran all day it would cost about the same as this unit. It would hardly put you in the poor house, especially if you had the means to purchase or finance the $200k cost to begin with.

    It might not represent the pinnacle of performance but if you need merely adequate performace and huge capacity and high density with very low operating costs this represents a compelling development for enterprise-class storage. It would be a helluva cool Beowulf cluster too ;-)

    The only gripe I have it that this article is a bit of a slashvertisement. There is little in the article or links besides a high-level description of a specific product and a path to a single vendor's brochure-ware site. Not much there to trigger thought-provoking discussion. I don't mind a certain level of such shameless plugging, but perhaps it could be categorised under "shameless plugs" or "slashvertisements" or "product reviews" or whatever to distinguish these articles from more discussion-oriented news. It would be great for filtering or searching. Sometimes I am actually looking for such articles when shopping/speccing stuff, however sometimes I want to avoid having such stories clutter my /. experience.

  39. Astounding? by julesh · · Score: 1

    a typical power usage of an astounding 80 W per machine.

    This is astounding why? My PC-based fileserver typically idles at 60W and has two hard disks. With one disk powersaved, this drops to 45W, so if I took it up to 4 disks, I'd estimate it would only use 90W. OK, so its CPU doesn't quite run at 1GHz, but I bet it has more RAM to cache stuff with than these devices do.

    And it runs Linux. ;)

  40. But not enough to...... by starshining · · Score: 1

    Record an average lifespan ( 2 G sec) with reasonable quality ( 1 Mb/ sec). So we'll have to wait for a 2000 TB system. Or just get a little older so we don't have so many seconds left..........

  41. Homebrew File Server Solution? by Milican · · Score: 1

    I've been looking for a Micro / Mini ITX solution for a while with a low Watt processor. I would like to find a *small* case that and fit disks in it to store 1-TB with RAID 1 (mirroring). There are lots of commercial solutions out there with cool cases, but I want to build my own with Linux. Then I want to build a few more and sync them using rsync. You can't do that with any of the commercial solutions I have seen. The case has always been the issue. I can find the software and the motherboard.

    JOhn

    1. Re:Homebrew File Server Solution? by TheRaven64 · · Score: 1

      Same here. I am thinking of just buying a standard smallish tower case with a load of drive bays, and installing hard drive caddies in them. It seems like the easiest solution, but I also want a silent (fanless?) power supply.

      --
      I am TheRaven on Soylent News
    2. Re:Homebrew File Server Solution? by WuphonsReach · · Score: 1

      Might be able to do it with an Antec Overture II case. Heat might be an issue though. Plus it takes a standard microATX motherboard.

      Could put a 3:2 hot-swap SATA enclosure or a 3:2 bay cooler (80mm fan) in the front 2 5.25" bays. With one or two more drives in the rear internal 3.5" drive bay.

      Still might be too large.

      (We're considering using the Overture II cases as Xen head units. We don't have a real server rack, but the Overture II units are slim enough that we can pack them in tightly on a 30"x24" chrome shelf unit. Plus, since we're using Xen, we can move services between units on the fly.)

      --
      Wolde you bothe eate your cake, and have your cake?
    3. Re:Homebrew File Server Solution? by tknd · · Score: 1

      I tried the MiniITX thing with a Via board and Via cpu. Worked, except it was annoyingly hard to upgrade past it's limits. The CPU was fanless and it only had a 120gb hard disk to start with. I gave up on the thing trying to be small, though it had its benefits if all you wanted it to do was one task and only one task. The efficiency marketing isn't that great, you can easily get a laptop that will compete with MiniITX boards or perform even better in terms of fewer watts because most laptops are filled with low power solutions from the cpu to each component.

      What I have now is a AMD athlon64 system that's more than a year old now. It was the best price I thought at the time for what I was getting and it had cpu throttling. In the best condition it consumes under 50watts. When the hard disks spin up and the cpu clock goes up the power can go up to 60 to 80watts depending on the load, but most of the time you're idle. I used a regular atx board with a fiarly stripped down via chipset (no fancy pci-e, sound, and other stuff) since it was the least power consuming board I could find. The benefit is, it's fast, and because it is a regular computer it is much easier to upgrade. For example when I first made the box it only had one ethernet connection (1gigabit capable) being used for the dsl connection and a 802.11g Atheros card for wireless access. That worked ok except when you wanted to transfer large amounts of data between computers. So later on I added a gigabit card and now I could connect to it from a wire or from wireless. I would have never been able to do that with the MiniITX since I was limited to 1 pci slot.

      Right now I have two hard disks in it: 1 laptop hard disk for the OS/program data that runs the system (laptop hard drives consume much less power compared to regular 3.5" hard disks) and a 250gb disk for storage. Another 250gb will be added whenever I find the time and will mirror the current 250gb. The 250gb disk is almost always shutdown unless I'm accessing something which is only a couple hours per a day. It takes 3seconds or so for the drive to spin up but that's ok since I know waiting those 3 seconds was worth how much power I would save if I had the disk on all the time.

      However, I'm not just using the box as a file server, it has many other purposes like being used as a router and an access point. I can also ssh to it from the internet and I have installed some software to test some things at home. I chose the athlon64 because at some point I wanted to have the cpu capability to run encoding jobs that take forever with new things like x264. Sometimes I even use it as a regular computer to do simple things like browse the internet; but since it's linux based there's some software that doesn't run too well without a lot of headache. Likewise, it sometimes sucks working in windows when you can have a command line *nix utility do exactly what you want. So I frequently find myself using both computers to get work done. GNU screen allows me to save the terminal session between computers so I can leave something running in a terminal and access it from pretty much any computer on the internet.

      So if you're looking to build one of these with the intention of doing more with it later, I don't recommend ITX.

  42. Performance? by dlapine · · Score: 2
    Here's the specs for the 3.0GB model. http://www.capricorn-tech.com/gb3000.html

    Here's the Motherboard Info:
    Motherboard/Processor:
    * 1GHz VIA C3 CPU
    * VIA CLE266 Northbridge
    * VIA VT8237 Southbridge
    * DDR266 RAM - Up to 1GB
    * 2 USB 2.0 ports
    * 1 Serial port
    * 1 Parallel port
    * 1 VGA port
    * PS2 mouse & keyboard ports

    Anybody have performance numbers for these units? A 1GHZ CPU can be hard-pressed to run an OS, serve disk and support a gige connection at full throughput. I'd be weary of looking at these for a data center without knowing how fast they can serve out the disk over a single gige connection. In fact, I see a distinct lack of information about this unit functions as a "storage node". Are you buying a 1U, 3.0TB node on which you need to install an OS and fileserver? Doesn't look like it would have the horsepower to run an iSCSI driver in additional to software raid drivers and still produce any real transfer speeds.

    While a rack of these sounds nice in cost/wattage terms, it appears that you would have just purchased a cluster of storage nodes. A cluster of storage nodes with no way to present the available 120TB's as any kind of coherent storage space. You might be able to run Lustre, PVFS or GFS on them, if that's even possible, but that's a level of complexity the price and performance don't warrant.

    If you figure in the cost of a Storage Engineer and lack of performance, this looks less appealing at the full rack level. Doesn't mean some PHB's won't buy into the the whole "Cheap Cluster Disk!" theme though. I pity the sysadmins who get a 120TB of raw disk and 40 more nodes to admin.

    --
    The Internet has no garbage collection
    1. Re:Performance? by Anonymous Coward · · Score: 0

      I wouldn't worry about maxing out gigabit ethernet with only 4 ATA disks in there, unless they're RAIDed for speed or you happen to be pulling a different file off each disk simultaneously.
      Hell, gigabit ethernet is only an optional feature on the boxes anyway, probably because they're better suited to low-access storage/backup or light fileserving than constantly spanking them for transfer - plenty of usage scenarios that fit that nicely.

      And yeah, 1GHz Via has maybe 2/3 of the performance of a 1Ghz Athlon. Not a speed machine, but good for the wattage.

    2. Re:Performance? by dlapine · · Score: 1
      I wouldn't worry about maxing out gigabit ethernet with only 4 ATA disks in there, unless they're RAIDed for speed or you happen to be pulling a different file off each disk simultaneously. Hell, gigabit ethernet is only an optional feature on the boxes anyway, probably because they're better suited to low-access storage/backup or light fileserving than constantly spanking them for transfer - plenty of usage scenarios that fit that nicely.
      The 750GB sata disks are rated for 70MB/s sustained transfer rate. Each. Even line speed for a single gige is only 128 MB/s. I'd like to think that you be using the storage in such a fashion that you could access all of the disks at the time, whether via raid or some concurrent access patterns. The connectivity (lack thereof) is a big limiting factor when considering this box.

      Yeah, I caught that the gige was optional. Sheesh.

      --
      The Internet has no garbage collection
  43. Re:WOW! But is it ready for the enterprise? by Anonymous Coward · · Score: 0

    Just out of curiosity, has anyone out there in Slashdotland had good luck with enterprise IDE solutions?

    There has to be someone. Considering that PATA, SATA, SCSI, SAS, and FC (and basically anything since the 80's) all happen to be "Integrated Drive Electronics" drives ;-)

    (Obviously you meant (P)ATA or SATA, but I feel funny today.)

  44. Difference between SCSI and PATA by LinuxDon · · Score: 2, Insightful

    Depends on what you call "mission critical", if the company relies so much on the data (Telecom and banks) that they will actually go bankrupt if the system is down for a day. Then I would go for the expensive and proven solution. A golden rule is: When you want the best, you got to pay the bill.

    But for a smaller company, cost savings are significant if you dare to take a chance.
    The biggest difference between SCSI and PATA configuration is throughput performance. A PATA RAID 5 is very likely to save your data in the event of a disk failure, just like a SCSI RAID will.
    And since the disks are very cheap and you can afford a hot spare, why not just replace a drive once in a while?
    Also remember that there have been rare and unusual cases with SCSI drives dying almost simultaneously and therefore trashing the RAID configuration, so a SCSI configuration is not a guarantee to success.

    But obviously, with a 15K RPM rotation for SCSI, throughput is higher. However, SCSI disk space is more than 6 times more expensive.
    So a PATA raid might be a good solution if you require a bit less performance and higher capacity.

    I believe that the most important thing in any storage solution is the controller, since this is the technology that will actually need handle the any kind of failure correctly.

  45. ZFS by Anonymous Coward · · Score: 0
  46. High cost, poor density? by Anonymous Coward · · Score: 0

    Not a big deal, I say.

    Why only 4 drives per CPU? That seems like a lot of baggage to get only 4 drives worth of gross storage.

    I currently pack 10+ drives per CPU into standard cases. Obviously standard cases aren't rack mountable but I am just not impressed by the price-performance of this front page worthy storage system.

    $1.50 a GB? I'm paying about 30 cents per GIG for the raw drives.

    Let's do some math...

    $500 PC
    $1080 12 x 320GB drives
    ------
    $1580 for 3840 GB raw = 41 cents per GB

    Even if I raise the price of the PC to $1000, that's still only 52 cents per GB.

  47. Re:WOW! But is it ready for the enterprise? by Genady · · Score: 2, Interesting

    Just out of curiosity, has anyone out there in Slashdotland had good luck with enterprise IDE solutions? Who knows. Perhaps some success stories might change my pro-SCSI/fibre view.

    Yeah, kinda. We've got a tray of PATA in our EMC Clariion. Don't ask it to perform with multi-threaded I/O, and it's certainly slower than the FC stuff, but it works okay for test and backups. Can't say we've seen a higher failure rate on the disks than we have with the FC trays. I hear that the SATA stuff is much better about handling multi-threaded I/O.

    --


    What if it is just turtles all the way down?
  48. *rolls eyes* by deque_alpha · · Score: 1

    Whoopdi-freaking-do. Other than the capacity, this describes the file server I've been running at home for the last 2 years. The title of this article might as well be "Capricorn makes obvious product using COTS components". Unless they're doing something novel in terms of management or presentation of large logical volumes that span nodes (which it doesn't look like they are) this is hardly newsworthy...

  49. Get it right! by DNX+Blandy · · Score: 1

    This is linking 4 750 GB HDs in a RAID 0... errrr, bad idea. RAID 5 more like. At which point you loose 1 HD for the parity bit which changes the size to: 2.046 PB RAID 0 is baaaadddddd as you will loose everything if 1 HD fails.

  50. Well by Sammy+Loo · · Score: 1

    Petabype, terabyte, minibyte. I like cheese. Bagel Bite.

  51. Re:WOW! But is it ready for the enterprise? by TubeSteak · · Score: 1
    modern drives are the same between IDE/SATA/SCSI except for the control board the drive is strapped to.
    I thought the difference between SCSI/Fibre and everything else was in the quality control of the platters.

    Random IDE drives are pulled from each batch for in-depth testing, while every SCSI drive recieves in-depth testing.

    That's why SCSI drives can claim a higher MTBF, since all the drives are measured up to a certain standard. This is also why SCSI drives are more expensive, since each drive has to go through QA/QC.

    YMMV
    --
    [Fuck Beta]
    o0t!
  52. Re:WOW! But is it ready for the enterprise? by flaming-opus · · Score: 2, Informative

    No it's not even close to enterprise ready! A basic dual-powersupply server with a hardware raid card and a raid5 of sata drives isn't really enterprise ready. Enterprise means no single point of failure. Redundant raid controllers, power supplies, storage networks, mirrored caches, remote administration and performance monitoring, remote snapshots or archiving. Enterprise is expensive, but for good reason.

    As for your question, enterprise IDE can only be realistically used for back-up or archiving purposes where the drives are used intermittenly. Several drive makers have sata disks with fibre channel interfaces on them, termed FATA drives. IF you put a bunch of FATA drives under high load 24-hours a day, after about a week you'll start to see 1% of the drives fail EVERY DAY. I'm not joking. I had to deal with a cluster of FATA raids used for high-def video workloads, which was loosing 4-5 drives every day, out of 550 installed. We eventually junked the entire setup and installed 1300 real FC drives instead. Even those die at more than 1 per week. IDE drives work fine in your desktop because you are only loading them up 10 minutes at a time, a couple dozen times a day.

    It doesn't look like Capricorn is possitioning this as an enterprise solution anyway. It looks like a workgroup NAS sort of thing, or a proxy cache of some sort. I'd file it in the "not mission-critical" folder.

  53. Re:WOW! But is it ready for the enterprise? by TheRaven64 · · Score: 2, Interesting
    Capricorn is the system build spinoff from the Internet Archive, and this is the commercialisation of the system they built to store... well, pretty much everything.

    They don't use RAID at all. They use RAIC (which is an acronym I just made up for a Redundant Array of Inexpensive Computers). Each individual node is a file server. Each file is distributed over a number of file servers. When a machine fails, they just swap in a new machine. It then grabs a load of files that aren't mirrored as much as they should be, and begins serving them.

    --
    I am TheRaven on Soylent News
  54. Re:WOW! But is it ready for the enterprise? by WuphonsReach · · Score: 1

    Just out of curiosity, has anyone out there in Slashdotland had good luck with enterprise IDE solutions? Who knows. Perhaps some success stories might change my pro-SCSI/fibre view.

    As always, if you treat the disks properly, they're going to be almost as reliable as SCSI/FC. Just don't expect the same performance (you'll need roughly 2x the number of spindles... maybe more). But you get a lot of capacity for 1/3 to 1/4 the cost of SCSI.

    Make sure the drives have (a) quality power feeds and (b) proper cooling and they'll do just fine.

    (And I prefer to go after the 3-year / 5-year warranty drives which puts the manufacturer on the hook.)

    --
    Wolde you bothe eate your cake, and have your cake?
  55. Obligatory question... by jozeph78 · · Score: 1

    ... but is it Vista ready?

    --
    Ever done a `man` on `top` ?
  56. Re:Enquirer? by Groo+Wanderer · · Score: 1

    Damn it, you beat me to it. :)

                  -Charlie (the article's author)

  57. A European asks: by wild_berry · · Score: 1

    What's special about 240v wiring?

    1. Re:A European asks: by tempmpi · · Score: 1

      That isn't like the 230-240V one-phase wiring you usually got in European homes. With european 230V wirings you got one wire with 230V to neutral. But with that wiring you got two 120V wirings with 180 degree phase shift between them, so the voltage between them is 240V, and both still got 120V to neutral. It is similiar to the 400V three phase power system used in Europe. You don't use such a 240V connection or a three-phase connection for small devices, but only for devices using a huge amount of power.

      --
      Jan
    2. Re:A European asks: by wild_berry · · Score: 1

      I assumed that this was a USA equivalent of the UK three-phase system; my question remains that 240 volts is not special to my equipment. My original post was intended to highlight and challenge a US-centric attitude; thank you for your additional information.

  58. order by j.leidner · · Score: 1
    The next step up is the TB120 PetaBox, basically a rack of 40 GB3000s and an ethernet switch or two.

    Dear Sir or Madam,

    I herewith order

    QTY.......ITEM
    1.(one)...TB120 Storage System
    Please deliver it with 42 of the GB3000 19" racks instead of just 40 of then,
    since they say you can never have enough space, and I already have an external
    switch.

    Thank you very much in advance for your quick delivery.

    Sincerely
    J. Doe (Mr)

    Ha, finally everybody can keep their own copy of the Internet at home, instead of wasting money on expensive broadband....

  59. And isn't she... [Re:order] by Anonymous Coward · · Score: 0

    And isn't she BEAUTIFUL, too??

  60. Re:Enquirer? by Chapter80 · · Score: 1

    No no no.
    The Enquirer is a Cincinnati newspaper. You're thinking of the NATIONAL Enquirer.

  61. HP MSA20 by Anonymous Coward · · Score: 0

    The HP MSA20 can give you 6TB (12x500GB SATA) in 2RU that interfaces to the outside world as UltraSCSI 320 for $10,357.

  62. I use these every day at the Internet Archive by brak · · Score: 2, Interesting


    They are very low power, reasonably easy to work on and not hot-swap. They are not going to win any speed contests, but they store data cheaply and make it accessible at reasonable rates.

    The VIA based systems are PATA, so they will not be RAID5 friendly because RAID5 on master/slave is simply stupid.

    They are reasonable fast at delivering the data. Having only a 100Mb connection means that it takes a really really long time to fill it. At the Internet Archive we use the nodes in JBOD and do the redundancy at the application layer.

    If I were doing it at home I would probably try out ATA over Ethernet and make all of these hosts/drives targets. Mirroring is always another option.

  63. A comparison by Guspaz · · Score: 2, Informative

    Capricorn's unit (750GB drives): 3TB per 1U
    Sun Fire X4500 (500GB drives): 24TB per 4U

    Capricorn TB per 42u rack: 126TB
    Sun Fire X4500 TB per 42u rack: 240TB

    Capricorn watts per rack (80w/unit): 3360w
    Sun Fire X4500 watts per rack (1500w/unit): 15000w

    Capricorn watts per PB: 26667W
    Sun Fire X4500 watts per PB: 62500W

    Capricorn cost per rack: ~ $200,000
    Sun Fire X4500 cost per rack: $470,995

    Capricorn cost per PB: ~ $ 1,560,000
    Sun Fire X4500 cost per PB: ~ $1,960,000

    So yes, Capricorn's solution provides lower power usage, but also lower density (And less processing power and redundancy I'd imagine). So it's a tradeoff. Lower the power bills, but raise the rent bill and the risk.

    It should be noted that for Sun's server, I'm using the 1500W rating of each of the redundant power supplies, the typical usage would actually be much less (just like how a PC with a 500w PSU might only use 300W under load). This also ignores processor power, as each Sun unit is a quad opteron. It also ignores RAID, as the Capricorn could do no more than 3 drive RAID5, while each Sun box could have a 48 drive RAIDZ or RAIDZ2, wasting a lot less for parity. And things might change if Sun put 750GB drives in their unit instead of 500GB drives. It's all about tradeoffs.

  64. OK, so it's a pretty rack of JBODs, but... by TychoCaine · · Score: 1

    ... how the hell do you manage 40+ storage servers, providing disk to $X application servers in the datacenter? I've got application servers running Linux, AIX & Windows in clusters, failover setups, and behind load balancers, so dealing with so many storage nodes will hurt. I could stick everything behind NAS heads, but then I've got a significant performance bottleneck. I could/should RAID 5 each box, but then I've no redundancy if a PSU/CPU/controller/NIC blows, so I think what I'd have to do is run each node RAID 0, with each node functioning as a "disk" of a AoE RAID 5 set managed by the application server. That's no big deal with a low number of application servers, or where each RAID is only accessed by a single server, but it's unworkable if I have to coordinate disk additions and deletions and rebuilds across multiple application servers, isn't it? I guess what I'm asking is " lots of disks are fine, but what management tools are available to make it all work in the real world? "

  65. Barracuda 7200.10 by StikyPad · · Score: 1

    I assume they're using the Seagate Barracuda 7200.10 drive, which is the first gen of desktop drives with perpendicular recording (AFAIK), and are badass according to TH's tests, with average read rates on par with the 70GB Raptor, second only to the the 150GB Raptor. Also Tiger Direct has a $60 rebate on them through Thursday, which brings the total cost to about $50 less than anything I saw on Froogle and would make the price per GB ~$0.46US -- well below the ~$1.60US/GB of the 150GB Raptor.

  66. Re:WOW! But is it ready for the enterprise? by Anonymous Coward · · Score: 0

    Which mfr/model for the FATAs?

  67. Re:WOW! But is it ready for the enterprise? by evilviper · · Score: 1
    While this used to be true, modern drives are the same between IDE/SATA/SCSI except for the control board the drive is strapped to.

    Then please explain why I can't get a 750GB SCSI hard drive.

    More throughput, maybe, if setup in a RAID that allows that.

    Troughput, and seriously reduced seek times (a huge deal on larger databases, CVS servers, etc.).

    And absolutely everything on the planet is conditional upon "if setup in a [XYZ] that allows that."

    --
    Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
  68. Petabytes for ~500W by benow · · Score: 1

    Optical or tape, with indexes/caches sitting on hard drives. Spinning drives don't make too much sense for large scale data archiving. A smart storage management system can keep your r-o archives as if they were rw, via versioning, caching, etc. If you have a petabyte of OLTM, perhaps it would be different... but that's unlikely.

  69. Re:WOW! But is it ready for the enterprise? by oo · · Score: 1
    ...more devices per controller (14 per cable, rather than 2 of IDE/SATA),


    SATA is only 1 device per controller, not 2.

  70. Lies! by Inoshiro · · Score: 2, Informative

    "I have an old 386 running fedora and samba on a 120GB drive with no RAID whatsoever. The machine won't fit another drive and an upgrade will involve so much hassle I've been putting it off over and over. Any reasonable upgrade would have to involve a terabyte machine because I don't want to go through the hassle of upgrading too soon after."

    Yea, well, 1986 called, they want their CPU back.

    Your system isn't a 386, though; old PATA IDE controllers on those things couldn't address more than 4 or 8gb (the first lip; then there were controller issues at 20, 32 or 36, and 160gb as well). Given that a real 386 won't have the PCI slot for a modern IDE controller, I call bullshit. Just spend the 400$ to get a basic system with a decent IO subsystem, spend 400$ to get the 4gb of RAM to buffer it, and then spend the 800$ to put 1Tb of disk space in (RAID5). That's a fileserver.

    --
    --
    Internet Explorer (n): Another bug -- that is, a feature that can't be turned off -- in Windows.
    1. Re:Lies! by muyuubyou · · Score: 1

      It's actually possible with a BIOS upgrade.

      GParent really sounds retarded for wanting to a Terabyte upgrade, when it can be done incrementally. He disses the reliability of Harddrives when all his data is plugged to a 386 system with a SINGLE DRIVE WITH NO RAID WHATSOEVER? And yeah, having your data in a couple of drives is better than having it only in one drive.

      I'm not sure what's he smoking.

  71. Now if they did one.. by clickclickdrone · · Score: 1

    Preloaded with pr0n, they'd be on to a winner.

    --
    I want a list of atrocities done in your name - Recoil
  72. Re:WOW! But is it ready for the enterprise? by Anonymous Coward · · Score: 0

    What I find interesting about the article is this: Watt/byte is an enterprise concern. This isn't an enterprise system. If you're running 5-10 drives, the pennies you're saving on this kind of solution add up to dollars per year. While small/medium businesses do care about the dollar line, they don't go down to every last dollar. This device, with no built-in raid, is on the very small end of business products. This is a product for a branch office or a workgroup, and their product differentiation of low watt/byre energy consumption effectively means little to a thoughtful product purchaser.

    Let me answer the asked question: Good experiences with IDE in an enterprise environment.

    We run a couple HP EVA SANs (I'm not the storage admin, I don't know exact product numbers). At any rate, the cabinet hosts a mix of scsi & sata hard drives. Their connectors are fibre channel (basically each drive is plugged into an adaptor board to interface between fc & scsi/sata). The EVA is sliced into several raid (5) pools by drive speed, with scsi offering higher speeds than the sata drives. Stuff that stays hot, that keeps the drives spinning, go on the scsi slices. e.g. databases, email storage, application caches. File spaces and longer term stuff are allocated from the sata pools.

    It's a system we've had for six months, so we haven't seen longer durability (mtbf) with scsi versus sata. Too, cheaper sata prices could easily compensate from a GB/hour comparison.

    Yes, we're happy with what we have. I'd recommend it.

  73. I am sorry by Groo+Wanderer · · Score: 1

    It is a well known fact that the Inq story submission engine strips HTML sarcasm and humor tags. We at the Inq are sorry if this has caused you any inconvenience.

                -Charlie