Slashdot Mirror


1.8TB Of Disk Space In A (Semi-)Normal PC

zdzichu writes "A friend of mine is building a personal server. He bought 17 of the cheapest IDE drives available and used Linux' LVM to get them together. The result? Almost two terabytes of disk space in regular x86 PC. The most juicy part - photos are here. For an operating system, he first tried the enterprise-ready PLD Linux Distribution, later he reinstalled Slackware Linux." Update: 03/01 20:24 GMT by T : I'm sure that should be "drives" and not "drivers" :)

17 of 449 comments (clear)

  1. Won't last long by dattaway · · Score: 1, Interesting

    It will only take a month for a cablemodem connection to fill them up.

  2. Must not be a very good friend... by Roadmaster · · Score: 1, Interesting

    for you to post his server's address here. It's already slashdotted... just goes to prove that gobs of disk space won't help your web server's resilience to massive ammounts of requests.

  3. Controllers? by stevenbdjr · · Score: 2, Interesting

    Damn, /.'ed already...

    Anyone that actually saw the site know how he hooked up all those drives? I'm guessing motherboard IDE, motherboard RAID, and three PCI IDE cards. Wow, talk about IRQ hell.

  4. Large Disk Arrays by JWSmythe · · Score: 5, Interesting

    We've done this before, but usually just go with arrays.. It's easy enough in a regular PC.. My prefered way to do it is, get something like the Promise UltraTrak SX8000, and put 8 200Gb IDE drives in it.. If you do RAID0, that'll give you 1.6Tb.. If you do RAID5, it'll give you 1.4Tb.. Linux sees it as a single SCSI drive. It's a lot cheaper than getting a whole bunch of SCSI drives.

    With 8 250Gb Maxtor drives, he could have 1.75Tb per array. :) Then he could use the same method to append them to each other.. Whoohoo.. Imagine 14 of those arrays chained together, and let Linux append them to each other.. 24TB.. :)

    I'm curious. What did he use to allow him to put so many IDE drives in the same machine? Off the top of my head, I believe he can use PCI cards that have 2 IDE controllers on each, allowing 4 drives.. Did he have 4 of those, plus the onboard IDE controllers? The pictures are going really slow to load..

    I have a server now, that has 8 120Gb IDE drives, with a Promise internal RAID card, which works ok.. It freaks out under load though, so I don't recommend that. We don't use it for a web server any more. It's just a backup machine now, with 840Gb storage. :)

    --
    Serious? Seriousness is well above my pay grade.
    1. Re:Large Disk Arrays by nbvb · · Score: 2, Interesting

      The RAID5 is a much better solution, since it can handle a single drive failure with no problems. The odds of two drives failing at the same time are really low. So as long as you are prompt about replacing failed drives, you can't go wrong.


      Except that performance blows.

      And it gets worse when (not if, but WHEN) a single disk fails. Parity recalculation is EXPENSIVE.

      RAID0+1, or RAID 10. Mirror that stuff, don't look back.

      And egads, seriously, 2 drives per IDE controller? Performance has to be in the toilet already.

      Just buy a damned XServe RAID and be done with it.
  5. Are linux drivers ready? by lavalyn · · Score: 5, Interesting

    If accumulating 1.8TB on a "consumer-level" PC is feasible, are the Linux LVM code and filesystem drivers ready to take on the 4TB barrier?

    In kilobyte blocks, 2^32 blocks only allows for 4TB of data to be referenced. ext2 still has options to set for 1024 byte blocksize, and supports up to 4096 - which would be a 16TB barrier.

    --
    Doing the Right Thing should not be preempted by making a buck.
  6. Precarious setup? by lawpoop · · Score: 3, Interesting
    If anyone saw the pictures, his setup looks awfully precarious.

    He has 1 normal PC case, 2 homemade stands for the drives, and one more homemade stand for additional power supplies.

    The stands with the drives look like they could topple with a moments notice! Why did he put them at the top...?

    I think it would be better to mount as many power supplies and drives in 2 additional cases, with the shells removed. Might be a problem with IDE cable length; maybe you could do 2 next to each side the the master computer.

    The setup.

    --
    Computers are useless. They can only give you answers.
    -- Pablo Picasso
  7. Re:My opinion... by dotgain · · Score: 2, Interesting
    Exactly. When you think about it, if he doesn't have any redundancy, he's seventeen times more likely to suffer a disk failure than anyone else with one drive.

    I can't begin to think how you'd come back up after losing a drive in a concatenated R^HAID. Whoops, no R if it's not redundant eh?

    I'm actually quite glad I'm not sitting on 1.8TB of data, and I don't intend to in the near future.

    If he does mirror the drives, I wonder if his mobo will be the bottleneck..?

  8. its all in the noise... by sheemwaza · · Score: 2, Interesting

    Filesystem Size Used Avail Use% Mounted on
    /dev/lvm/site 1.8T 33M 1.7T 1% /test


    I love it when 17967MB can be considered rounding error. That's more space than I have on my whole computer!

  9. First time I heard of a terabyte of storage by John+Jorsett · · Score: 3, Interesting

    Back in the early '70s, I recall reading a proposal for this multimillion-dollar centralized storage server on the Arpanet. Called The Terabyte Memory Project (as I recall), it was going to be this facilty hooked to the Arpanet for use by anyone needing large amounts of storage (not free- they'd have to pay for using it). It was going to use tape as the storage medium, since the hard drives of the time were the size of washing machines, stored just a few tens of megabytes at most, and were enormously expensive. I remember wondering what people were going to use all that storage for. I look forward to seeing what the hell we're going to be throwing on to our multi-petabyte drives a relatively few years from now. The day's fast coming when we'll be able to record every moment of our entire lives in HDTV-quality on a single drive. I wonder how many people will?

  10. Re:Why 17? by J.+Random+Software · · Score: 2, Interesting

    Might be using four RAID arrays plus a boot drive. Or have eighteen IDE controller channels (four per card and two on the motherboard?) with one used for a CD drive. Or built a 16-drive filesystem due to some obscure size limit and then added a hot spare. Hard to tell while the images are unavailable.

  11. Re:link already dead by Anonymous Coward · · Score: 2, Interesting

    I was wanting to know what that is in picture number 5 of your project.

  12. Re:I fondly recall.. by Cramer · · Score: 3, Interesting

    If that's 3TB of SCSI storage, then it might be note worthy. But it's certainly not a 6 o'clock news event.

    Why is this news anyway? I, personally, have built (and sold) several 1TB+ "PCs" over the last few years. 1.8TB can be done with a half dozen drives these days. (for the cost of *2* large SCSI drives, even.) Heh, I could fit that in a 25$ mini-tower case.

  13. Re:how by dmidtbo · · Score: 2, Interesting

    I built one of these, and it works great!
    It's a relay built into a power outlet that lets you control any 120v devices with the power button on your computer.

    http://home.bendcable.com/werstlein/

    He could plug all the "extra" power supplies into it, and when the main computer power supply gets turned off it would siwtch off all the others. It would also turn them all on when he turns on his main computer.

  14. Big deal by Dynedain · · Score: 2, Interesting

    I was just at the local computer swapmeet today...and saw 250GB drives for $280 (US).

    I have a raid motherboard....so...
    2 primary IDE chains x 2 250GB drives
    2 raid chains x 2 250GB drives

    WOW.... 2TB.....whoopdeedoo...that was hard

    --
    I'm out of my mind right now, but feel free to leave a message.....
  15. Re:Porn and exploitation by willis · · Score: 2, Interesting
    I agree -- this is a disturbing trend.

    I'd imagine, though, that the bulk of women who are tapped for this are already in the market as prostitues (it makes sense -- there are usually established ways for outsiders to find prostitutes, and I would guess the only differences between the two are that the action is being recorded when it's for porn).

    This isn't to say that it makes it OK, etc, but if, say, all of them are willing prostitutes (of reasonable age/education, not economically coerced or otherwised forced), that does narrow the scope of the exploitation by a bit.

    --

    there is no thing
    what else could you want?
  16. drive letters? by harlows_monkeys · · Score: 3, Interesting

    Yeah...I know I should just go look at the source, but I'm lazy. Since Linux names IDE drives hda, hdb, etc., anyone know offhand what it does if you have more than 26? What comes after hdz?