Slashdot Mirror


Building a Budget Storage Server

An anonymous reader noted an article running over at Firingsquad talking about building a budget storage server. Talks about cooling, power, RAID, expandability, etc. Good overview type article, with practical application.

27 of 433 comments (clear)

  1. Did I miss something ? by tmark · · Score: 4, Insightful

    In an article about building your own storage server, why are they spending so much time talking about irrelevant things like *video card's 3-d performance* (128 MB in a storage server ??), mouse and keyboard choice, and yet fail to even so much as mention (as far as I could tell) OS choice or software ?

    1. Re:Did I miss something ? by jmt9581 · · Score: 2, Insightful
      They did mention OS choice briefly:

      This is also the reason Linux was not a good choice for our system -- it doesn't make sense to put XFS/ext3/ReiserFS drives into a USB2.0/Firewire external box.

      After skimming the article, I have some questions:
      • Why does it not make sense to put a journaling filesystem in an external box?
      • Why not just use ext2 if they don't want a journaling filesystem?
      • Do they mention their choice of OS anywhere else in the article?
      To me, this read more like an advertisement for some of the latest and greatest in computer technology than a real article on building a 1TB fileserver from commodity parts. For example:

      "For this application we'll use an NVIDIA GeForce FX 5200 128MB card to stay within budget. No one should mistake this card for a 3D powerhouse though; it is among the slowest 3D cards on the market -- fast enough for us, but slow compared to the other NVIDIA and ATI offerings. Most "servers" do with an integrated graphics chip like an ATI Rage XL or less.
      Cost: $70 with free t-shirt or hat"


      Why the heck would you need a fileserver to support "at least 1024x768 resolution" and have "good drivers?" Are you actually going to be using it as a workstation?
      --

      My blog

    2. Re:Did I miss something ? by kiwimate · · Score: 5, Insightful
      In an article about building your own storage server, why are they spending so much time talking about irrelevant things like *video card's 3-d performance* (128 MB in a storage server ??), mouse and keyboard choice, and yet fail to even so much as mention (as far as I could tell) OS choice or software ?

      Look at the banner on the pages -- "Home of the Hardcore Gamer". It's because they're gamers and know everything about tuning a system for games, but don't know the first thing about building a server. What they've ended up with is a mish-mash that won't serve any particular purpose well, except possibly as a rather decent PC for a secretary (except no secretary would want something that big at her desk).

      As one reads through the article, what leaps out is that they're most comfortable when debating relative merits of 3D video cards and building uber-fancy custom machines designed for gaming excellence. Good for them, but this is far removed from building a server.

      It's got a terabyte of utterly unsafe storage. No RAID, no nothing.

      It's got a video card which is overkill for a server but which they disdain as a low-end 3D graphics card.

      They've got one hard drive for the system and everything else as data, so they're not building a "high performance" system or else they'd have a separate drive for paging.

      They haven't discussed the types of files they'll be storing at all -- will they be tiny text files, medium sized spreadsheets and documents, or massively large presentations and CAD files? This affects how you configure your system.

      Their approach to planning for hardware failure is "we bought the better quality stuff so we don't have to worry so much about MTBF". No need for RAID or redundant power supplies. (Although oddly enough they've chucked in two NICs.)

      Did I mention no RAID? Yet they've bought a 3D graphics card (overkill), a nice mouse (in case they want to do graphics editing or perform fast wrist actions on their storage server), a wireless keyboard, and a fun little LED display to tell them how fast the CPU fan is spinning.

      Look at how they're future-proofing the system, by the way. They anticipate going through 2 TB of data every year. So every six months they're going to pull out the existing 1 TB of storage, plop into an external array, and put in a new set of disks. I wonder how long this system is supposed to last...

      All in all a very odd system indeed. In fact, a pseudo-server built by gamers with no understanding of how to build a server.

    3. Re:Did I miss something ? by Stephen+Samuel · · Score: 2, Insightful
      agreed. terrible "review". out of touch with its "budget" title. no mention of OS/software at all.

      Yeah. They did mention something about not using Linux because they didn't want ext3fs or reiserfs on their disks (or something like that). ah, shoot.. .here's the quote.

      This is also the reason Linux was not a good choice for our system -- it doesn't make sense to put XFS/ext3/ReiserFS drives into a USB2.0/Firewire external box.
      So it sounds vaguely to me like they've got 4x250MB drives with no RAID, an ill thought out backup system and probably running Wintendos because it's a more stable game^H^H^H^Hserver operating system... Then they wrote this article to justify it.
      --
      Free Software: Like love, it grows best when given away.
  2. Completely Stupid by Anonymous Coward · · Score: 5, Insightful

    No raid? Going to rely on the drive's MTBF? WTF. A raid controler is like 80$ MAX and one additional drive is like 250 or so. Spend the damn money. While you're at it. Invest in a tape drive. You're data is more valuable than the drives.

    1. Re:Completely Stupid by McSpew · · Score: 2, Insightful

      In the article, they point out that RAID will only help if a drive fails on its own, and not if there's a MB failure or some other badness. And one of the points was they were going for a cheap offering. Adding more stuff means adding more $$$$.

      Okay, first off, what planet are you living on where solid state electronics are less reliable than hard drives with moving parts? Also, RAID is cheap, relative to the total cost of the system. These clowns spent almost $3200 building a storage system, but were too cheap to spend an extra $350 to support RAID 5? Yeah, that's freaking smart.

      They're relying on the MTBF of the drives, but they forgot that your chances of failure go up with every additional drive you add to your storage setup. With four drives, you've quadrupled the chances that one of those drives is going to fail early. I don't remember enough about MTBF calculations and don't know enough about statistics to know what that does to your real-world MTBF numbers, but I'd bet that your real-world MTBF can be no better than one-quarter what it is for a single drive.

      The people who wrote that article are serious morons. They completely misspent their money, if their goal was to build a storage server. For a storage server, what's most important is reliability and IO throughput. If you're on a budget, there's no sense in spending $500 on a CPU and motherboard and another $350 on 1GB of RAM. An Athlon and MB combo with 256MB or so of RAM could be had for probably the cost of their CPU alone. They could have then spent the rest of their budget wisely, by buying a high-performance RAID controller.

      The problem is their idiotic dual-purpose requirement. Storage servers aren't workstations and vice versa. High CPU performance isn't a requirement for speedy file-serving: High performance hard drives and a high-performance caching RAID controller do that. Putting a gigabit Ethernet card in the server and hooking it to a switch with a decent bandwidth will do more to speed up your file fetches than putting a 3 GHz P4 on the MB.

  3. Re:WTF? by pivo · · Score: 2, Insightful

    Yeah, if you want to build a mickey-mouse file server.

    Which is what they've done. Notice they're also using it as a workstation to play games.

  4. Morons! by phlyingpenguin · · Score: 3, Insightful

    Since when do you need a 3ghz processor and a gig of ram let alone a GeForceFX (yes he noted it's slow, not slow enough mind you) for a fileserver?

    And why is he putting a keyboard/mouse in the picture? Oh he's putting windows on it... he forgot to buy a license for that! I'm not sure I understand the comment on it not being smart to put XFS/JFS/ReiserFS/Ext3 on a firewire drive... can somebody explain why that's not smart?

    $3,100 dollars is REALLY steep for a machine that shouldn't cost anything more than the drives it serves data from.

  5. he's right... by snooo53 · · Score: 4, Insightful
    While for a large business, $3000 must be dirt cheap.... for the rest of us it is WAY too expensive. I could either build a kick ass entertainment center for $3000 or their "budget" server.... I'll give you one guess to figure out which one I'd choose.

    I've learned to be very skeptical of any of these articles on "budget" this or that, because they rarely are. To me, a budget server means less than $500. How about an article on how to build and configure a home network server for that price?

    --
    The sending of this message pretty much inconveniences everyone involved.
  6. Re:Whoa... by Anonymous Coward · · Score: 1, Insightful
    I don't think we're talking about "I want a cheap computer to store my mp3's!"

    And you think you're gonna put IDE drives that aren't even in RAID in place as enterprise level storage? PFFFT!

  7. Yep. I have one too by The+Tyro · · Score: 2, Insightful

    but I admittedly went a little over the top...

    - Raid rack-mount server chassis (space for 8 drives)
    - 3ware RAID controller (great linux support)
    - multiple 120gb drives in RAID-5
    - dual-athlon MB, bunch of RAM
    - CrystalFontz LCD running LCD4Linux
    - Samba, Postfix, etc.

    It has enough extra horsepower that I can run a counterstrike server along with providing network services, primarily huge storage, for all my other machines. It's full of high-bitrate oggs (reripped everything; it took weeks, even using Grip's auto-rip feature). Oh, let's not forget the high-quality DivX.

    Apart from giving me room to grow, it's made me a huge fan of dualies. I've never worked on a machine that's as snappy and responsive.

    --
    Even if a man chops off your hand with a sword, you still have two nice, sharp bones to stick in his eyes.
  8. Re:Wow by kwerle · · Score: 2, Insightful

    Mac OSX.......... $129 (you DID pay for it, right?)

    Actually, assuming they only have < 5 OSX systems in their house, they probably bought the "family pack" for $199. So the /system cost for the machine could have been as little as $40.
    For a supported system (good, easy software updates) and an OS that's a pleasure to use, I'd say the money was well spent.

  9. Re:Whoa... by AchmedHabib · · Score: 2, Insightful

    I've got a $25000 mail server
    Yes, but would you want to replace that server and all the others with a budget server?

    I mean, the people that bitch about the hardware is to expensive, are the ones that would not understand that you have to bring the entire server down to replace a harddrive. and who's "spare/family time" is going to be allocated for the job? :)
    However for a near-line backup system it could work, or any other system where you can afford it to have downtime during business hours.

    Besides from that, they seem to fall between 2 chairs here, whats with the geforce card for a storage server.

  10. Re:Mini-itx by wilper · · Score: 2, Insightful

    Well, in the specs he said he wanted it to be a workstation AND a storage server. However, he didn't want to run Linux on it because of lack of drivers (Which I presume rules out the BSDs as well.), so he'll probably end up running some form of Windows on it.

    So he basically built a windows workstation with lots of disks, guess the other users on the network will learn to hate the poor man who uses it when he reboots after every change in the configuration in the server, depriving them of access to the files.

    I would have gone with a dedicated server, hid it in some closet somewhere and left it alone, and bought another workstation for the money saved on the server. (Give or take a few $100.)

  11. Re:a tip by bconway · · Score: 2, Insightful

    This is extremely poor advice to give, and I hope no one takes your word on this and jumps in the deep end. There are a host of unforeseen problems that can arise from using unmatched drives. This is not what the array manufacturers designed for, and they even warn against it in their documentation.

    --
    Interested in open source engine management for your Subaru?
  12. A Budget!!??? A point? by westyvw · · Score: 2, Insightful

    I have many different storage servers, at different locations. They have no clue on how to build on the cheap. They mention no Linux (or BSD) and thats just plain stupid. They put a video card in a server? WTF? You dont neeed one at all, all admin access should be with an xwindow on a main computer.

    Slashdot, News for Nobody. This was the lamest article I have read in awhile.

  13. Re:What OS? by jeffhot · · Score: 2, Insightful

    Yes, this seems like a huge oversight to me too. Especially when comparing it to offerings from Dell and Apple, who surely include a Server OS with their hardware. It's not like you can just throw Microsoft Windows Server 2003 into the mix without affecting the budget. I know that XServe from Apple they are referring to comes with an Unlimited Client version of OS X Server. MS Windows Server 2003 is $999 for only 5 Clients, and $3999 for 25. Now compare this build it yourself to the Xserve! There reasoning for saying no to Linux was the formatting of the hard drives into any common Linux format would reduce compatibility when the drives were eventually moved into External FireWire enclosures.

  14. Having looked at it thoroughly.. by mindstrm · · Score: 4, Insightful

    I can't figure out why these guys thinkg a DVDR is a backup solution
    a) Likely to fail
    b) Look how much time, and how many discs it will take to back up 1TB.

    The realistic backup solution for stuff like this is: stuff like this.

    Back up to a set of hard drives. Seriously. The cost/MB is still the cheapest out there, and it's more flexible, and heck, way faster than tape.

  15. Dangerous by SomeOtherGuy · · Score: 3, Insightful

    Talk about working without a net. I mean, why call it a file server -- sure it will serve files...But it will not do anything about redundency or recovery. Thus it is just a Desktop with lots of standalone drive space. The whole file server moniker should be reserved for machines that not only collect and serve your data -- but also protect and back-up your data. No raid, no mirrors, no tape backups -- no nothin. And some good the 3d graphics card or MTBF will do you when one of the drives goes south taking your data with it.....(Well at least you may be able to replace it under warrenty with a new EMPTY hard drive and play a mean game of Unreal Tournament or something....:)

    --
    (+1 Funny) only if I laugh out loud.
  16. Re:a tip by Macgruder · · Score: 3, Insightful

    Man, is it the day for everyone to switch off their brains?

    He said different batches and different vendors. Not different models.

    Use the same model all around, but buy them from different vendors (such as CDW, NewEgg, etc.) That way the chances of having a batch failure is minimized.

    --
    I'm not crazy,I'm actively irresponsible.
  17. Re:a tip by k12linux · · Score: 4, Insightful
    While we're handing out tips, here is one I learned the hard way. Create your RAID paritions at the lower side of the "specified" drive capacity. In other words if your new 180Gb drives actually have 180.5Gb available, DON'T use the extra .5Gb!

    I had to replace a failed 180.4Gb drive on a 1Tb server and the replacement was exactly 180Gb. I had to back up 400+Gb of data, re-create the RAID array with 180Gb partitions and then restore. If you think backing up 60Gb is slow... ha!

    Unfortunately, the 3ware utilities don't seem to allow you to specify the partition size.. they just use the whole drive. Mixing one 180Gb drive in with the 180.4Gb drives made it use 180Gb for all of them. Unfortunately that isn't very practical when you are creating a raid array on a batch of brand new drives. (You'd have to find one slightly smaller drive.)

  18. Re:Mini-itx by Zak3056 · · Score: 4, Insightful

    He should have gotten a motherboard with integrated graphics, so even if he needed to attach a monitor, integrated graphics would be more than enough to handle anything.

    Because if he wasn't blowing $70 on a video card, and $160 on his keyboard and mouse, he wouldn't be able to complain about how RAID would blow the budget.

    His calculations for the power supply have SEVENTY WATTS budgeted for the video card, which, of course, forces him to spend $190 on the 450 watt power supply.

    His motherboard has dual gigabit LAN, because "an extra NIC is essential for a server." Note, he doesn't say WHY he needs that extra gigabit NIC (fault tolerance? Performance? It looks cool?) only that he considers it "essential."

    He has a hundred dollar add-on that "displays the latest stock-quotes and surf reports."

    I feel dumber for having read this article.

    --
    What part of "shall not be infringed" is so hard to understand?
  19. Re:Last time I checked by antifun · · Score: 5, Insightful

    Been using Linux SW raid in the 2.4 kernel series for a year+ now and it has worked like a champ, with both IDE and SCSI devices. All disk servers were SMP (overkill but management wanted it that way). Dunno what you screwed up.

    If your criteria for an adequate disk server include either (a) high performance or (b) long-term maintainability, then you should choose SW raid.

    Most HW raid systems, especially cheapo PCI cards, but even expensive Fibre Channel-SCSI3 rackmount monsters, offer either extremely primitive performance metrics or none at all. With SW raid, you normally get the full performance-monitoring and tuning capabilities of the host OS. Big win. You will also get better performance from a SW raid, given the same drive layout, and as long as you do not use the box for anything else at the same time. It should be obvious but some people don't believe this.

    The other big win is more important when you spend more money than $3000 (a pittance in this market): there's no hardware manufacturer to get bought, go out of business, or change product lines. No multi-thousand-dollar support contract or custom software to configure the RAID or any of that other crap. Trust me, when your dedicated RAID box's motherboard flakes on you and you discover the manufacturer has gone out of business, you'll be cursing yourself for choosing HW raid every time you search Ebay for a replacement part.

    Not to mention that commodity, general-purpose HW is always cheaper to replace, and its performance/price ratio grows much faster than special purpose HW. The HW raid system with the 200MHz i760 and 64MB RAM might have looked great in 2000 but now you're stuck with the proprietary on-disk format of an out-of-business vendor with no way out except to build a new system of the same capacity and copy everything over. (In the case of large data warehouses, "full backups" don't usually happen.)

    HW raid was compelling in the past. Now, with commodity hardware so cheap, and open, stable SW raid systems floating around, you'd be a fool not to prefer them in many situations. If you want a fire-and-forget dedicated box, go for it. But be ready for the "forget" part in a year or two.

  20. Re:Tape still competitive by red+floyd · · Score: 2, Insightful

    The equalizer is the cost of the drive. CD drives are dirt cheap; if you back up to hard drive, the drive is the media; but if you amortize the cost of the tape drive over, say 100 terabytes (not so unreasonable given the durability of tape drives), you bring up your cost to maybe 55 cents on the gig for tape. Granted, if you back up only 10 terabytes, it's no cheaper than hard drives.

    No, the cost of the tape drive is not necessarily the equalizer. The equalizer is the cost of the operator sitting there and swapping CDs/DVDs, as opposed to getting a tape solution that can hold your typical incremental backup on a single tape, that can be dropped in at COB, and removed in the morning.

    --
    The only reason we have the rights we have is that people just like us died to gain those rights. -- Cheerio Boy
  21. Re:Last time I checked by stmfreak · · Score: 3, Insightful

    Never again. Hardware raid all the time :-)

    Riiiiight, because that hardware RAID doesn't have any of that untrustworthy software in it. No bugs there. Move along.

    --
    These opinions guaranteed or your money back.
  22. Re:Last time I checked by Lumpy · · Score: 3, Insightful

    and the other funny part is that they talk that reliability is important and yet dismiss SCSI right away.

    please find me IDE drives with a 5 year warrenty. Or server class IDE drives.

    I can't. I tried. and I decided that for our "cheap" server we use U160 drives off a 29160 scsi card and use software raid 5 on a linux box running samba.

    I came in less than they did, yes I have less storage but I know that my drives will still be spinning and running happily in 2007 you can't say that for today's IDE drives. I also added a DLT7 drive (anyone that spec's a server WITHOUT a backup solution is a hack.) to back things up daily.

    IDE is great for consumer class stuff. I would NEVER EVER trust critical business data to any server running IDE drives and without a good backup system like a DLT drive.

    --
    Do not look at laser with remaining good eye.
  23. 1/3 disks, 2/3 bloated computer by billstewart · · Score: 5, Insightful
    They spent about $1000 of that cost on disks, and were too cheap to spend an extra $250 for RAID, but they spent $100+60 on a really cool keyboard and mouse and $100 for a really cute front-panel display.

    They spent $300 for a Pentium-3 and $200 for a high-end motherboard and $350 for the fastest most expensive memory they could find, when a "budget server" could do just fine with a ~$100-150 2GHz CPU+motherboard and $200 for 1GB of average-speed memory. (Their motherboard does sound good, though.) After all, the bottleneck here is the disk drives and network, not the CPU, though even on a budget server it's probably worth having the 1GB of RAM for caching and for staging CD or DVD burns.

    The $190 power supply seems expensive, but that may be realistic for a system that can expand to 8 drives. If you've got a UPS, you may not need as high-end a power supply, and a "budget" system might get away without it, but since they were too cheap to buy a 5th drive for RAID they're probably much more in need of highly reliable power. And their 3GHzP4 CPU and overpowered-for-a-server video card use too much power and put out too much heat - you can easily save 50-75 watts by making better choices, and probably 100. You could save even more by using a motherboard with built-in 2D video, but most of those don't have the high-performance networking support yet.

    Also, they didn't have a price for an operating system :-). That means that they're planning to use Linux, which is another reason not to waste power or cooling or money on a gamerz video card...

    --

    Bill Stewart
    New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks