Building a Budget Storage Server
An anonymous reader noted an article running over at Firingsquad talking about
building a budget storage server. Talks about cooling, power, RAID, expandability, etc. Good overview type article, with practical application.
Since they couldn't afford RAID, what about software RAID? Way faster than normal IDE operations.
This is a test. This is a test of the emergency sig system. This has been only a test.
... it's possible to buy a large PC case and fill it with a large number of drives that add up to a volume of storage that was once considered to be large several years ago. What's new here?
The article could have covered a little more than just the hardware needed to run such a setup, perhaps covering some sort of remote management interface for the storage? It would also have been nice to hear if they solved the problem of backing up this data on a budget too. (Ingoring the possiblilty of burning the data to DVD).
Wouldn't a mini-itx system make more sense here? You're building a simple storage server, doesn't need to be massively huge. A 533mhz processor (the low end with mini-itx boards, I think) is plenty fast enough to run a simple storage server.
Video card? Why on earth would you need a $70 video card for a storage server! He should have gotten a motherboard with integrated graphics, so even if he needed to attach a monitor, integrated graphics would be more than enough to handle anything. What is he building, a storage server or a full fledged PC?
If you want reliability you cannot just rely on ONE server anymore. Just get the cheapest boxes that meen the requirement and get *2* of them. Use DRDB and heartbeat to make the failover seamless. With these two cheap boxes you get 24x7 reliability at a 7-11 price. Raid, cooling, ... will all help in the one box senario delay system failure, but that box *WILL* fail. Two boxes can help not only with outages, but upgrades as well since the primary can be taken offline for upgrades without any upseting of the system.
The latest issue has reduntancy and scalability articles that go from 2 boxen to as many as you want.
http://www.linuxmagazine.com/
Built a storage server two years ago, it's run like a tank since I put it online.
Dual 800MHz PIII in a Supermicro Motherboard.
Cheap-O video card
Gigabit card
40 GB system drive.
6x80MB Maxtor drives (5400 rpm)
Escalade RAID-5 card.
I chose 5400 rpm drives for several reasons:
A) A little bit cheaper
B) Used half the power of the 7200
C) Runs a lot cooler
D) Higher MTBF
Every drive that has ever failed on me has been because of heat. I put several fans in the case to make sure the drives don't overheat. So far so good (knocks wood)
Total $3,140
/. (including me) could build a server for less than half that, and I would bet that for storage activities, it would be equivalent or faster than this moron's PC.
Okay, I just looked at the article again. $3,000? Damn. I wouldn't mind having that budget...
Seriously folks, if you think you need $3,000 to build a server, then you're out of your minds. I don't want to be modded as Flamebait, but anyone here at
Video Card? Keyboard? Mouse? No. Shouldn't even be there. Yeah, sure, during initial setup, connect a secondhand monitor, mouse, etc (who doesn't have a spare monitor lying around? I have one 10 yrs old lying around somewhere and it still should work). But after initial setup, after you install and configure Linux/Apache, Windows/IIS, FreeBSD/whatever combos, forget it. After that, you should be able to telnet or remote admin the server.
I'm going to issue a challenge. Alexis Dang (the author of this piece), if you're listening, here's a challenge. Give me $1500 and I'll build you a server that can beat your server in storage related activities. Not video games, not music, not Paintshop testing.... just pure storage. Hell, give anyone on this board $1500, and they can beat your "server" upside down.
I agree, that seemed much more like, "Watch us build an expensive PC with a lot of hard disks" than "Watch us build something useful for reliable network storage."
I am currently trying to put together a RAID 5 file server and they do not cover any topic of use to me in that article. For example, practical backup solution? They chose a DVD burner, why that over similar tape solutions? I would guess price, but it would be nice if they at least mentioned some of their considerations. Especially since it would take 112 DVD-R's to back up a terrabyte?
Also, aside from their DVD backups, they seem to have no data recovery plan in case a hard drive fails. I guess they aren't storing anything important on these drives?
I agree, that seemed much more like, "Watch us build an expensive PC with a lot of hard disks" than "Watch us build something useful for reliable network storage."
My solution to building a cheap storage system was the following:
1. Buy old Netfinity 5000 on eBay.
2. Order 5 x 9GB SCSI drives from my trusty IBM parts guy (csaunders at itexchange.com)for $70 each.
3. Order basic RAID card for said box.
4. Install RedHat 7.1 from a CD in a book under my couch.
5. Install SAMBA
6. Run cron job to back up user data and relevant config files to an external USB hard drive attached to a windows box on the lan.
7. Take external hard drive to safe deposit box weekly. Get second USB drive out of safe deposit box and attach it to windows box at office to await next update. FWIW, I've been thinking about putting the USB drive that is in the office in a safe when the back up is not taking place. This is not for fear of fire or catastrophe -- I just don't want it to walk out the door.
8. The Netfinity server has the RAID 5 array configured for a hot spare drive so that there is failover operation if a drive quits.
9. Installed PowerChute software with a UPS to shutdown the box gracefully if power quits.
External USB -- $100 each (2) = $200 (got enclosures and cheap-o spare IDE hard drives from scavenged boxen)
SCSI Drives -- $70 each (5) = $350
Netfinity box = $300
UPS = $200 (I think)
Redhat 7.1 on CD in book under sofa = priceless
Total: $1,050.
Project results:
RAID-5 with regular offsite storage. Logical disk size is only 27 GB, but you can fatten this by using bigger SCSI drives. I didn't need mondo storage, so I saw no need to go with 36 GB drives, though you certainly could if you had more money.
I am currently trying to put together a RAID 5 file server and they do not cover any topic of use to me in that article. For example, practical backup solution?
External USB drives worked for me. Depends on how heavy-duty you need and how your office works. Perhaps simply connecting up two servers in different offices and doing mutual backups nightly for changed files might suffice. DVDs and CDs are an option, and tape is still useful.
Also, aside from their DVD backups, they seem to have no data recovery plan in case a hard drive fails. I guess they aren't storing anything important on these drives?
My data recovery plan (if everything pukes) is to buy a new chassis and drives and reinstall RH 7.1., connect it to the lan, and download old config files and user data. I think it would take a couple of days (mostly waiting on delivery of the drives and box). That time could be slashed if I were truly paranoid if I simply kept spare parts off-site. I'm just not that worried, however.
FWIW, our office is a small lawyer's office with about 10 people on our LAN. The data we need to store is not huge.
GF.
Lots of petrified grits