Building a Budget Storage Server
An anonymous reader noted an article running over at Firingsquad talking about
building a budget storage server. Talks about cooling, power, RAID, expandability, etc. Good overview type article, with practical application.
A tip which I don't see mentioned very often: when using multiple drives in a raid-array, use drives from different batches. Or even better: from different vendors. Why? You don't want your complete raid-array failing because to much drives fail because of a common problem in their hardware/firmware.
Ok, chances on that might be slim, but in my opinion you're better safe then sorry.
www.vanheusden.com - home of Multitail, HTTPing, CoffeeSaint, EntropyBroker, rsstail, bsod, listener, nagcon, nagi
You were worried about this article being slashdotted??
I mean, I can't even afford to build a storage server, but some need a storage server just to store their budget!
Their definition of "budget" is $3,140? Someone give me their budget right now!
"The choice of IDE over SCSI is now easier then ever due to the vast difference in their price/performance ratios"
Yeah, if you want to build a mickey-mouse file server.
CDs may self-destruct at sustained speeds of greater than 56x
The author (or the person who wrote the sidebar comment) needs to learn the meaning of self-destruct...
Since they couldn't afford RAID, what about software RAID? Way faster than normal IDE operations.
This is a test. This is a test of the emergency sig system. This has been only a test.
In an article about building your own storage server, why are they spending so much time talking about irrelevant things like *video card's 3-d performance* (128 MB in a storage server ??), mouse and keyboard choice, and yet fail to even so much as mention (as far as I could tell) OS choice or software ?
Finally a place I can store all my p0rn/warez/dvds. But seriously why did they put in a 3D Graphics cards on a server. Surely any cheap AGP card even without 3D will do. Some basic ATI's are just $20
Rus
Cheap UK and US VPS
I took a Beige G3/266MHz that I got for $50... put a 120 GB WD drive, ACARD IDE Controller, and Mac OS X.
An extra fan, to keep it nice and cool, and a 10/100 NIC.
Runs rather well. Smooth, reliable, and fast. For a very low cost. Mac OS X 10.2 comes with AppleShare, for Macs, and Samba for windows file sharing. Apache for a webserver, and PHP, Perl...mySQL.
You got whatever you really need.
I added webmin, for remote control. Makes it a bit easier.
Article is lame when it comes to the important stuff. Its great he gave us the hardware to do it, but thats not the important part now is it? Software.... something that can do backup's to harddrive and then take backups and archive on tape. we went with tapeware because of price, but we cannot archive a current backup to tape, so that means we have 4 week online and no archive really (bad). Are there any open source solutions? I saw a couple but they look hard to setup and manage. Tapeware gives a powerful interface and makes it easy to backup from multiple machines... plus linux boxes don't need special server license (unless they have a tape drive) where any Windows 2000 Server box needs a server license.
I built a similar system for the web rack (disks are bulky, compared to 1U motherboards). Gave me 1.5 TB of SATA hardware RAID-5 in 2U. All the other machines boot off it - much better use of space :-)
Simon
Physicists get Hadrons!
No raid? Going to rely on the drive's MTBF? WTF. A raid controler is like 80$ MAX and one additional drive is like 250 or so. Spend the damn money. While you're at it. Invest in a tape drive. You're data is more valuable than the drives.
... it's possible to buy a large PC case and fill it with a large number of drives that add up to a volume of storage that was once considered to be large several years ago. What's new here?
The article could have covered a little more than just the hardware needed to run such a setup, perhaps covering some sort of remote management interface for the storage? It would also have been nice to hear if they solved the problem of backing up this data on a budget too. (Ingoring the possiblilty of burning the data to DVD).
Wouldn't a mini-itx system make more sense here? You're building a simple storage server, doesn't need to be massively huge. A 533mhz processor (the low end with mini-itx boards, I think) is plenty fast enough to run a simple storage server.
Video card? Why on earth would you need a $70 video card for a storage server! He should have gotten a motherboard with integrated graphics, so even if he needed to attach a monitor, integrated graphics would be more than enough to handle anything. What is he building, a storage server or a full fledged PC?
I don't think they used RAID. Drives aren't as reliable as they've been spec'd out to be.
I guess if they have everything important backed up on DVD and/or their data wasn't worth much, it'd just be a hassle... But when the system fails you end up with a big panic: running out to buy a new drive, then trying to get everything back up and running again.
I've built similar configurations and lost a drive (twice now!) and it's a big mess. At least with a separate system drive they eliminated one problem... if they lose the main drive they can reinstall and if they lose a data drive, they can at least reboot.
I would recommend raid -- at least raid 5 which would give them 3/4 terabyte and less headaches.
I really don't understand this, RAID costs $0 when done in software. Just because you get high MTBF doesn't mean a freak accident won't trash your data, RAID is really worth losing even 1/4 to 1/2 of you space in exchange. It may not be perfect, but it is a great first line of defense against failure.
XML is like violence. If it doesn't solve the problem, use more.
If you want reliability you cannot just rely on ONE server anymore. Just get the cheapest boxes that meen the requirement and get *2* of them. Use DRDB and heartbeat to make the failover seamless. With these two cheap boxes you get 24x7 reliability at a 7-11 price. Raid, cooling, ... will all help in the one box senario delay system failure, but that box *WILL* fail. Two boxes can help not only with outages, but upgrades as well since the primary can be taken offline for upgrades without any upseting of the system.
The latest issue has reduntancy and scalability articles that go from 2 boxen to as many as you want.
http://www.linuxmagazine.com/
I salvaged a derilict dual P3x450, dug up enough 256meg sticks to give it a gig a ram and a salvaged video card.
For drives, I watch and wait until I need more space, then I add a drive, ussually whatever Fry's has on cheap. I use LVM to add it to my partitions. Of course, I can only add a total of 4 drives this way before I'm forced to by a off board controler (I'm at that point now).
The other downside is that there is no redundancy, but oh well. Redundancy is expensive.
Performance stinks as I violate the rules about one device per controler. Of course, I don't care because I'm accessing it over a 10mbit network (via the phone lines in my appartment). It is sufficient to stream video to 2 or more machines so no worries.
Total cost ~$500 worth of hard drives. Everything else was "free".
Andrew
Spell check? Why bother. That is what grammer/spelling Nazi freaks who waiste band width posting "spell right" are for.
ECS Fully-Integrated motherboard
Athlon 1800XP, 256MB Ram
4x 40GB IDE Hard Disks
Promise SX4000 Raid-5 Controller
All in a micro_ATX chassis
Can't get much cheaper than $700 for a 120GB storage server with at least some measure of redundancy.
[Fuck Beta]
o0t!
"We added a PCI Promise ATA-133 controller so we can run our four Maxlines as all master drives. This will improve simultaneous access performance and allows for an easy upgrade to eight storage drives."
Since when do you need a 3ghz processor and a gig of ram let alone a GeForceFX (yes he noted it's slow, not slow enough mind you) for a fileserver?
And why is he putting a keyboard/mouse in the picture? Oh he's putting windows on it... he forgot to buy a license for that! I'm not sure I understand the comment on it not being smart to put XFS/JFS/ReiserFS/Ext3 on a firewire drive... can somebody explain why that's not smart?
$3,100 dollars is REALLY steep for a machine that shouldn't cost anything more than the drives it serves data from.
We needed a moderate amount of storage (print shop dealing mostly with 1/2 Color Offset and moderate color copy work).
We purchased 4 160GB drives and an Adaptec 1200 IDE Raid card. Yields 298GB as RAID 0/1. About $480.
How would you rate us? Good, bad, okay? Shoulda, coulda?
This guy makes no mention of what OS will be installed which is a critical factor when creating a file server.
Just yesterday I brought up a server here at work to server as a 1.0 TB-range backup server using 8x200gb WD 8mb cache drives strung off a 3ware escalade controller (raid5, two hot spares). The build process was suprisingly painless (used an athlon-based solution but that's relatively unimportant. you'll want 64bit/64mhz pci slots for things like the 3ware storage card, scsci card to drive a tape drive, etc. the cheapest board I found that could do this was ironically a dual CPU MPX chipset board from gigabyte, sub-$200), with a total cost for a total beast of a machine coming in at about 3400 USD with shipping and such. I'd recommend heartily the 3ware controller cards if you want to try something like this, they're worth every penny of their ~200-300 cost simply for the increased performance and reliability they bring to the table as well as the reduced hassle (the array just shows up as a single huuuuuge scsi drive to linux... always nice when /dev/sda is
reported to contain something like two billion 512 byte sectors ;)). I went with a black aluminum Lian-Li case because it has enough 3.5" drive bays to hold all those drives, comes with lots of fans by default (as well as cooling a bit better than your average plastic / steel case due to the thermal properties of the material), and a monster 550w "vantec stealth" powersupply for reliability and the ability to sustain all the devices in the system. Debian stable installed with zero hassle and now I'm just left with the pain of fighting with backup software. ;) True, I'd trust something from Sun or similar more than this homebrew thing, but this is also a mere fraction of the cost of something from the commercial Unix vendors, so for the same total cost I could have multiple redundant servers... or more ale-and-whores money in the departmental budget. ;)
News for Geeks in Austin, TX
I've learned to be very skeptical of any of these articles on "budget" this or that, because they rarely are. To me, a budget server means less than $500. How about an article on how to build and configure a home network server for that price?
The sending of this message pretty much inconveniences everyone involved.
test
I thought the article was about a storage server? this is a high-end gaming rig!
they slam in a Gig of ram, use gigabit ethernet (for a home server?), and last but not least, a high end video card??
I guess that a storage server really doesn't need that kind of stuff... maybe one of those mini-itx cards with half a gig of ram, a good power supply, and a decent pci raid card from 3ware or somehting?
they're probably running windows on that machine too...
talk about being cost-effective...
I wish this article had discussed tradeoffs; for a fileserver, how much processor, memory, etc. do you need to do the job well and how much is waste (like the 3d card).
Of course, I'm using NFS so their answers might not have been too helpful.
Somebody didn't RTFA...
At the same time, we wanted this server to act as a workstation with as much capability as the other systems attached to the storage server.
Next, what are you uses? I mean most small business work groups I have seen might store larger Powerpoint, excel and other files. It takes them a while to fill up dual 160GB hd's in a raid 1.
Still, for our company we purchased 1.6TB Xraid's from apple with Fiber cards. Why? well we are doing a lot of work with FCP and need the quick access times that come with fiber vs. ethernet.
"The problem with socialism is eventually you run out of other people's money" - Thatcher.
with only 720GB storage
Built a storage server two years ago, it's run like a tank since I put it online.
Dual 800MHz PIII in a Supermicro Motherboard.
Cheap-O video card
Gigabit card
40 GB system drive.
6x80MB Maxtor drives (5400 rpm)
Escalade RAID-5 card.
I chose 5400 rpm drives for several reasons:
A) A little bit cheaper
B) Used half the power of the 7200
C) Runs a lot cooler
D) Higher MTBF
Every drive that has ever failed on me has been because of heat. I put several fans in the case to make sure the drives don't overheat. So far so good (knocks wood)
I was surprised to see video cards, mice and keyboards covered at all. Then the author spends literally two sentences on the IDE controller.
This seems more like a general-purpose machine that happens to have a lot of storage. Why's that a big deal? Maybe I should have written up my Dual AMD, SCSI RAID development/gaming box -- nah. Why spend time on something that's really not that interesting.
You are not a beautiful or unique snowflake -- but you could be if you got off your ass.
My company just recently invested in a mass storage solution, since it's obvious that mass, redundant storage on SCSI (>300GB) isnt a cost effective option for a small office environment. We took the easy way out and purchased the following:
:-)
Dell PowerEdge 1600SC Server:
Xeon 2.0Ghz
512MB RAM
18GB U320 15k RPM (OS Drive)
32x CD-RW/DVD Drive
We chose this server because it has both PCI33, PCI66, AND PCI-X slots on the bus, supports up to SIX internal hard drives and has two 5.25" drive bays.
For the mass file store we chose Maxtor 300GB 5,400RPM 2MB Cache Drives. You have to remember this is not going to be an active file server but more just a file repository and source control/backup server for a small office (10 Clients).
Our Mass Storage Solution Is:
3Ware 7506-8 RAID Controller
4x Maxtor 300GB Drives
We're going to put the Maxtor Drives on a RAID5 and since the 3Ware is a Switching HARDWARE 64-Bit/66Mhz PCI RAID card for IDE Drives, performance should be stellar.
I think all in all the entire solution ended up costing us around $4,000 for parts and systems, BUT, we also got OS (Win2k 5 CAL) and a 3 Year Dell Warranty on Parts.
I think $4,000 for a 900GB Hardware RAID5 on a Xeon server aint too shabby
Total $3,140
/. (including me) could build a server for less than half that, and I would bet that for storage activities, it would be equivalent or faster than this moron's PC.
Okay, I just looked at the article again. $3,000? Damn. I wouldn't mind having that budget...
Seriously folks, if you think you need $3,000 to build a server, then you're out of your minds. I don't want to be modded as Flamebait, but anyone here at
Video Card? Keyboard? Mouse? No. Shouldn't even be there. Yeah, sure, during initial setup, connect a secondhand monitor, mouse, etc (who doesn't have a spare monitor lying around? I have one 10 yrs old lying around somewhere and it still should work). But after initial setup, after you install and configure Linux/Apache, Windows/IIS, FreeBSD/whatever combos, forget it. After that, you should be able to telnet or remote admin the server.
I'm going to issue a challenge. Alexis Dang (the author of this piece), if you're listening, here's a challenge. Give me $1500 and I'll build you a server that can beat your server in storage related activities. Not video games, not music, not Paintshop testing.... just pure storage. Hell, give anyone on this board $1500, and they can beat your "server" upside down.
How the hell is this a budget server? Why does a server need an nvida grafix card? Stupid. Why does resolution even need to go over 1024x768? Jez. Make sure to run the 3d pipes screen savor non stop too, to suck performance from the thing. And why oh why does it need a 2.* ghz proc. That's just buying without thinking. It' s storage server. It doesn't need a kickass CPU. It just needs nice drives. Get a 1.7Ghz celeron for 60 bucks or a 2 ghz p4 if you hate celeron for 100 bucks. This server ain't budget at all. Its a gaming pc built by gamers, not real sys admins.
but I admittedly went a little over the top...
- Raid rack-mount server chassis (space for 8 drives)
- 3ware RAID controller (great linux support)
- multiple 120gb drives in RAID-5
- dual-athlon MB, bunch of RAM
- CrystalFontz LCD running LCD4Linux
- Samba, Postfix, etc.
It has enough extra horsepower that I can run a counterstrike server along with providing network services, primarily huge storage, for all my other machines. It's full of high-bitrate oggs (reripped everything; it took weeks, even using Grip's auto-rip feature). Oh, let's not forget the high-quality DivX.
Apart from giving me room to grow, it's made me a huge fan of dualies. I've never worked on a machine that's as snappy and responsive.
Even if a man chops off your hand with a sword, you still have two nice, sharp bones to stick in his eyes.
So you spent
IDE controller... $20? (being generous here)
Mac OSX.......... $129 (you DID pay for it, right?)
Congratulations. That $159 difference could buy you another whole fileserver. Not one like you built, rather an Intel/AMD running Linux.
I wouldn't call anything without redundancy "storage". Personally i would've skimped on the processor and DVD+/-R/RW. Skipped the graphics card and splooged for a RAID 5 card & an extra HD. Otherwise you just have a bigass file server.
[Fuck Beta]
o0t!
Okay, so external drives aren't as cheap as internal drives, but they are a lot easier to cool (40 cm fan for instance), easier to swap if needs be, easier to expand the capacity (just plug in yet another drive into your FireWire-bus).
...
Not sure how easy it is to raid those though
We do not live in the 21st century. We live in the 20 second century.
I built an ftp server which holds almost the same amount for about $500 cheaper:
Rackmount hot swap ide chasis: $699
Athlon 2500 CPU: $99
Athlon a7n8x motherboard: $89
Used video card: FREE
8 120 gig IDE drives: $1000 (cheaper now)
500 watt power supply: $150
Memory: $200
3ware 8 port Escalade RAID card: $350
Total: ~$2600 with hot swap IDE, hardware raid, and rackmount
Spend a little bit more and up the capacity to 3 terabytes.
Linux!!!!
Feel free to mod me up now.
You need a FREE iPod Nano
I'm sorry, but i fail to see how this is a viable server solution, for anyone! I have over 5.5TB of storage on my fileserver (read pr0nserver), at home, at a total cost of under 2000. I've used cheap Siimage chipset based raid cards, and a variety of 250GB ide hdds, all purchased from eBay. The mobo is a generic via board, with 6pci slots, and no agp (why the hell would I need agp on a fileserver?!), with a slighlty overclocked 600MHz P3. I've got 100mb ethernet through the house, and, accordingly, a 100mb NIC in the machine. Other than that, that's it. It's got no graphics card, no peripherals, and the case is just a full tower server case, with a bumch of 5" fans hardwired into the PSU. I use 3 x 350W power supplies, each of which isn't used fully. The machine runs gentoo, and automagically emerges the latest whatever every 24 hours. I run samba-tng for the windows shares, and apache, for a media management system i'm working on. Anyway, enough of me showing off ;)
"How to build a budget file server without knowing what we're talking about"
3 grand is on a budget? What happened to raising from the grave an old AMD K5-166, throw some big IDE drives and you really got a budge file server.
This is a test. This is a test of the emergency sig system. This has been only a test.
From the article:
This is also the reason Linux was not a good choice for our system -- it doesn't make sense to put XFS/ext3/ReiserFS drives into a USB2.0/Firewire external box. Since we anticipate going through 2 TB of data every year, this setup allows for that flexibility without a significant cost penalty
I just flat out don't understand this statement. Can someone shed some light on this?
Ruby on Rails Screencast
just built a pretty 1.1T evms mashine. Runs smoooooth with 8x160GB Seagates. Filesystem Size Used Avail Use% Mounted on ... /dev/evms/.nodes/md/md0 1.1T 452G 592G 44% /mnt/raid
I would suggest to anyone plannig to build a file server to use EVMS. Great stuff (espacially for expanding the storage size)
My filesystem choice of course is reiserfs
OS X 10.1 users are still waiting for a patched SSH.
While Apple includes server software in OS X, Apple is not excited about you actually making use of this software (they would rather that you buy OS X Server), so it will constantly be a thorn in your side.
I've thought about OS X server applications, but...
It seems like a good deal at first, but look before you leap.
that looks like a fun home project but I would start here when looking for a small office server Penguin Computing Relion Servers
When you could have used yellowdog instead and saved some money and gained better performance (on a g3 yellowdog runs much a href=faster than OSX).
Is it just me, or did they leave out the operating system. That seems like a fairly important component to me. The briefly mention than linux is a bad choice (which I do not understand) but no other meniton is made. If they aren't choosing linux, then what are they using, and are they paying for it? I don't see it included in their budget!
I have heard that their RAID 5 controllers are a bit iffy at times - how's yours working out?
:)
What OS is on the box?
3ware RAID controller (great linux support)
We have several 3ware RAID controllers, of multiple generations. On several occasions, they have dropped a drive and reported a degraded raidpack. The linux tools don't successfully fix it, so you have to go into the BIOS and start a rebuild. Slowly, the rebuild happens (dragging down the machine considerably while that goes) and then everything is fine for another month or so.
So, the drive is OK, the card works 30 days out of the month, as do the cables.
Has anybody else seen/fixed this problem with 3Ware cards? Their support line just says, 'rebuild the RAID pack', but that's not why we have RAID in the first place.
My God, it's Full of Source!
OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
Interesting (to me at least) to hear what other people are doing for file servers. I have a 333 MHz AMD running RH 6.2, Samba, and netatalk, with two 40 GB Maxtors (mounted at /home/share and /home/mp3s) and new/changed files get copied (via cpio in a cron script @ 4am) to a sigle 120 GB Maxtor--poor-man's raid :-) Just have to clean out the 120 every so often since it won't delete files that are no longer on the main filesystem.
And to those who would post "who cares?", please don't bother. If you don't care, then don't read. Obviously, some people are interested. Would you like asshole non-geeks to come here and post "who cares?" to every single story? No? Then STFU.
This is kinda all common sense, doesn't seem to be anything here that I can't do, or any lateral thinking.
:)
Shame there isn't a way to cut the computer out at all and just have dedicated hardware, no software. But then of course this turns out to be more expensive.
I just feel we can do better
A blog I run for the wealth
Do NOT follow this articles advice - it's bad and here's why:
This is NOT the article you want to read for finding out about building a budget file server. They barely mention RAID at all, instead opting to spend money on things like a $70 video card and advising using said backup server as another gaming system. They talk about buying things like an 8 port Gigabit Ethernet switch that don't even have anything to do with a backup server. Word of advice, take that $200 for the switch and spend it on a 3ware RAID card. Your building a file server - not a network. For pete's sake they tell you to build a file server and not use RAID.
They stuff the case full of 5 hard drives, a floppy and DVD drive, but then don't even use an aluminum case. They actually tell you to pull out drives when they get full with "old" data and stick the old drives on top using USB 2.0 or Firewire. You are then supposed to buy a new set of drives to which they suggest doing this twice a year. No mention of rackmount cases at all, and there is no mention of a practical backup solution. Their backup solution consists of using a Pioneer DVR-106 4x DVD+/-R/RW. One sentence is spent telling you why they picked the drive, and two about the bloody color! This drive can burn 4.7 GB at a shot, to backup the proposed 2 Gigabytes would cost you $310 for a 500 pack of 4x DVD-R's on pricewatch (most economical purchase there). Nevermind the time spent making 436 backups.
If you believe the numbers, running a drive in RAID mirror will double the effective MTBF, we have done that by choosing the Maxline series vs a standard consumer IDE hard drive.
(Shakes head and bangs it violently against concrete wall)
MTBF and RAID is about entirely different things. The R in RAID stands for REDUNDANCY. You can have a MTBF approaching infinity and you would still have no redundancy.
Mirroring does NOT just double MTBF. It folds two probability functions. With RAID1 not only have both disks to die for data loss, but both disks have to die at the same time! (Or in fact, during the recovery window.) With a MTBF of 1.2 mio hours and a recovery window of maybe 5 hours, this really makes the difference.
Using non-RAID IDE disks, especially on a server, no matter how small the budget, is just playing russian roulette with your data. With at least 5 chambers loaded. It's wantonly negligent. It's unprofessional. Don't do it.
(As a side node, the MTBF is an utterly useless bit of information. It is determined by e.g. running 10,000 disks for 10 hours, with one disk failing. That is one dead disk in 100,000 hours of operation, so MTBF is 100,000. It's a bit like saying that if one woman can make a child in 9 months, 9 women can make a child in 1 month. Reality just doesn't work like that.)
--- The light at the end of the tunnel is probably a burning truck.
You could have your system disk mirrored RAID 1 in soft, which I did with 2 scsi disks.
And the the software raid failed, and the two disk didn't even talk to the card...
No more software Raid.
Get Hardware Raid, those people have to do it right, for you can return a raid controller, but not the failing bits of the soft you use...
I have many different storage servers, at different locations. They have no clue on how to build on the cheap. They mention no Linux (or BSD) and thats just plain stupid. They put a video card in a server? WTF? You dont neeed one at all, all admin access should be with an xwindow on a main computer.
Slashdot, News for Nobody. This was the lamest article I have read in awhile.
This is a fileserver, right? Do you actually "use" it? I would imagine not, if it's a G3/266. OS/X would be downright painful to use on that.
First of all, with a decent video card OS/X would be just fine on that... but as you said, it's a server so you really don't need to use it much.
And why bother with the GUI overhead for a server anyway?
What overhead when you're not using it? You could probably just kill off any windowing processes that were taking up background usage. But from my experience if the computer is just sitting there you have no overhead to speak of, beyond a bit of RAM - but then it's mostly a fileserver so who cares?
"There is more worth loving than we have strength to love." - Brian Jay Stanley
It was mentioned in the article that Linux would not be a good OS choice for this server, specifically that it makes no sense "to put XFS/ext3/RiserFS drives into" an external box with a Firewire or USB conncetion.
Sure the access times are slower going over USB/Firewire, but why in particular would a native Linux FS not make sense, and why would an alternative (ostenibly NTFS or FAT32) make more sense?
Also, there was no mention of the cost of the OS, so I guess Windows is really out of the question. Would they choose FreeBSD or something? Would UFS be any "better" for this purpose?
Wow, I can't begin to describe the number of silly design decisions they made.
Good choices on the Drives, Case and PSU, and the LCD is a nice touch. Teh backup solution is OK as well.
But the MB, CPU, RAM, Video Card, ATA Card and OS were all idiotic. And they don't need a 120GB System drive
MB: They'd be much better off with a Good server board with ECC Support and 64bit PCI slots. Get a 64bit GigE card if your board doesn't have one on-board.
CPU: Doesn't need more than a P3 1GHz.
RAM: Spend that cash on ECC, not fancy DIMMs with das blinkenlights. You don't need the speed, but the Error Correction may save your ass.
Vid card: 4MB Rage Pro. Anything else is overkill. Only idiots and cheapskates use their servers as workstations.
ATA Card: Put all that money you saved by buying a $60 P3 instead of a $300 P4 and a $10 video card instead of a $70 one into a nice Hardware ATA Raid card, complete with RAM.
OS: either Windows Server 2k3, Linux or FreeBSD.
System Drive: 40GB 7200RPM job.
Now, put the 4 shared drives into one Stripe set, and do proper backups, instead of this silly shit that is 4 individual shared drives. One nice big share is a better idea, and just buy a couple of frikkin external drives for offline storage. Use a decent filesystem (JFS, Reiser, NTFS) to gain reliability and performance.
Now, DVD-R is going to be OK for incremental backups (And the system drive, which should stay empty anyways) but if you care about your data and failure, buy a good SCSI tape drive and do real backups.
"You've got an invalid haircut" -Warren Zevon - Life'll Kill Ya
I can't figure out why these guys thinkg a DVDR is a backup solution
a) Likely to fail
b) Look how much time, and how many discs it will take to back up 1TB.
The realistic backup solution for stuff like this is: stuff like this.
Back up to a set of hard drives. Seriously. The cost/MB is still the cheapest out there, and it's more flexible, and heck, way faster than tape.
If you believe the numbers, running a drive in RAID mirror will double the effective MTBF, we have done that by choosing the Maxline series vs a standard consumer IDE hard drive.
So you are skipping any of the benefits of RAID just because you picked a drive with a higher MTBF?? Pretty naive, if you ask me.
Another possibility was RAID 5, which allows 5 drives to act as 4 drives.
I don't even know where to start here. RAID 5 doesn't require 5 drives, as the above statement implies. You can create a RAID 5 array with as little as 3 drives. And a RAID 5 array doesn't "act as" a number of drives. A RAID array will appear as a single drive to your OS. In the case of RAID 5, you'll have n-1 amount of storage, where n is the capacity of a single drive.
Something else to consider is that a RAID array would use more power than our current setup because the drives are run simultaneously.
The difference between an idle and active drive is one or two Watts. RAID or not, your system is going to draw about the same amount of power.
I'm sorry, but I couldn't make it any further in the article.
If you want to store your budget, put it on bank account, buy a piece of real estate, some art or something. Every geek will tell you what will happen with your $3000+ if you invest it in a system with top-notch gfx cardhuge harddrive, 1G RAM and such stuff. Wait 3 years and you will lose like 90% of the price! Servers are NOT a good thing to store your budget!
45 5F E1 04 22 CA 29 C4 93 3F 95 05 2B 79 2A B2
Budget is as simple as the .com bust! Considering that I have in my possession 70 25 gig drives with 7 "10 drive" raidcans and matching pci card. Granted, these drives are old, but that is over a terabyte.
It is interesting that each raidcan needs a pci card. I bought a motherboard with 7 pci slots, built on video and LAN. I never even had thought that they existed before. Oh, and for those who are going to ask... ide.
Also, the coolest thing about these raidcans... linux drivers:-)
I didn't know that. That's just absolutely amazing. It's just as if computers just keep getting faster and faster and getting more and more memory.
Just think, in the future we'll have processors that run at something like TEN Gigahertz! Think what you'll be able to do then.
If it's a server, isn't data integrity a higher priority than sheer performance? Why aren't they using ECC memory modules? Price is not an issue - I have a dual Athlon MP system which supports ECC and I'm running 1.5 GB of PC2100. The 512MB ECC modules were only like $112 each.
Plus they complained about not having front-panel firewire and USB! WTF? This is supposed to be a server isn't it? Not an iMac!
And my final rant - An NVIDIA FX video card? Are they smoking crack? A Matrox Millenium PCI card is all you need in a server. GeForce FX is the last thing I would ever imagine to find in a budget storage server.
I'd rather be a conservative nutjob than a liberal with no nuts and no job.
What are the Intel fanboys thinking? My Athlon 2600 cost $90.
I want to delete my account but Slashdot doesn't allow it.
I'm New Here
Talk about working without a net. I mean, why call it a file server -- sure it will serve files...But it will not do anything about redundency or recovery. Thus it is just a Desktop with lots of standalone drive space. The whole file server moniker should be reserved for machines that not only collect and serve your data -- but also protect and back-up your data. No raid, no mirrors, no tape backups -- no nothin. And some good the 3d graphics card or MTBF will do you when one of the drives goes south taking your data with it.....(Well at least you may be able to replace it under warrenty with a new EMPTY hard drive and play a mean game of Unreal Tournament or something....:)
(+1 Funny) only if I laugh out loud.
I'm using three different controllers, all 6000 series and up. One runs under windows (shoot me), and the others run under redhat. I make it a habit to use the latest firmware and drivers from 3ware's website (easy download), and I have not had a problem yet. I use very generic ribbon cables scavenged from a multitude of machines... nothing special there. The drives are all of identical sizes (for their respective arrays), but of various brands.
Dunno... anybody else have some insight?
Even if a man chops off your hand with a sword, you still have two nice, sharp bones to stick in his eyes.
Picked up a Dell Powervault 705N off ebay for $300 and added 4 x 120gb @ $135 drive (CAN).
So for under $1000 got a headless Raid 5 NAS.
Oh..I see..I can't play games on it.
Should have spent the extra $2000.
~ this space brought to you by ~
I have a storage server here at home that I built from a Sun Ultra1 that I bought on Ebay for $50. It's got ~800MB of RAM and two 100Mb NICs and two wide SCSI controllers. I bought 12 18GB 10krpm SCA drives and 80 pin to 68 pin adapters, three el-cheapo four device external boxes and put the works together. The drives cost something like $18 each with the adapters, the cases were ~$30 each. I had the cables and terminators sitting around, but three cables and two terminators should be under a hundred bucks. So, 216GB for about $450. A half a terabyte for about $850. A terabyte for $1650. The system runs Aurora Linux, yes, it uses software RAID, but I've used Linux software RAID for years with no trouble. And I've run this old Sun stuff for a long time, too...with no failures. No, it's not world class power, but it is world class engineering.
Just to be fair, twelve 10krpm drives are noisy. And I suppose that that the four boxes take up more space and may use more electricity. And it probably could have been done cheaper with PC compnents and fewer large IDE drives. But based on my personal experience, I think that the way I did it was a good compromise between price, performance and reliability. Your mileage may vary.
I could have bought a single 250GB IDE drive for less money, but then I'd have a single point of failure...no thanks. And I'm with everyone else here who wonders why in the world it took $3000 to build a "server" if "budget" was the goal. Of course, I think that we all know that they weren't really building a server
I wish I could buy a cheap firewire-based raid enclosure for multiple drives... I'd be willing to pay $400 for one that'd hold 4 drives in a snap...
You want budget? I bought a pair of Maxtor 40 GB HDs, a stick of 256 MB of RAM and stuck them in an old P150 with Windows 98.
That thing is used by a workgroup of about 6 for storing just about everything they need with their business. (They're using at most 10 gigs.) Every night, a batch file starts XCOPY to backup all files that have changed during the day from the main disk to the backup. Every little while, I burn CDs of everything with the snappy little script I wrote.
Total cost at the time (two years ago?), probably 500 bucks.
That's what I call a "budget storage server".
I am sure you could get a great deal on this one
Here are pages 1-3. Please reply if you have the rest.
Today we are going to be building a budget, high performance storage server. So what exactly is a storage server? We'll first go over the technical requirements and operational goals for our system, then move onto the design and assembly of the system.
First we need to discuss why we need a storage server. It is useful for a workgroup environment, where there are multiple users that need to share data across a network. In addition, it facilitates backup of data since the storage is centralized. Where cost is an issue, it is much cheaper to build a robust server with high levels of reliability than to submit that level of reliability and performance to all the network nodes.
At the most basic level, a storage server needs to be able to hold a lot of hard drives. To accomplish this, we could go out and buy a network attached storage device, but remember this is a budget system. Our goal is to maximize the functionality, reliability, and performance of the server, while keeping costs under control. It sounds like you could just add a bunch of hard drives to any networked PC and call it a "network attached storage device," but if you want it to be reliable, you have to think about cooling, power, and anticipated usage. So, if you're only interested in building a hardcore gaming PC, you'll still want to read this article to see our thoughts on cooling and power.
We wanted a server that would serve only data files and not program files. This would limit our network bandwidth and maximize performance. At the same time, we wanted this server to act as a workstation with as much capability as the other systems attached to the storage server. Our minimum storage requirement would be one terabyte. Not too long ago, terabyte storage was reserved for government labs like Sandia National labs, Lawrence Livermore labs, or science fiction.
Another consideration specific to storage is expandability; how we will cope with increases in storage requirements over time. Some network attached systems are great in the first year, but as needs expand, you basically have to double your initial investment to double your storage, by duplicating your initial purchase. The technology that you bought the first time does nothing for your future expansion, this is something that we tried hard to prepare for.
Let's start with discussing what we need to have and then build around that. First the hard drives.
A storage server should have a hard drive for the operating system and an array of drives for the shared storage. We feel that the most important feature for a storage hard drive is reliability. We went with IDE drives because of their superior price to performance ratio, as compared to SCSI. In our case, we don't even need the bandwidth of the SCSI drives - quantity rather than blistering speed was important. With respect to SATA or parallel ATA, both are more then adequate for our needs.
With these needs in mind, we chose the Maxtor Maxline II Plus 250GB 7200rpm 8MB buffer hard drives. These drives are rated at 1,200,000 hours MTBF as compared to 600,000 hours for standard consumer drives. This does not mean that you can run your hard drive for 137 years, but does imply that it is more reliable than a standard desktop drive. Maxtor has advertised this drive as one designed for 24/7 applications, this is in stark contrast to the old line of IBM drives that did not recommend continuous usage. Currently 250GB is the maximum capacity for 7200rpm drives. The only other IDE/SATA drive with a similar MTBF rating is the Western Digital Raptor series, but the max capacity is still only 36GB, with a 74GB version coming soon.
We will use four of these drives for a nice and even one terabyte of storage, with a server design that will allow for an easy addition of another 4 drives for a peak of 2 terabytes. But, when we are ready for a storage upgrade there will likely be even higher capacity hard drives on the market, further extending
Im dreaming ofa big bndwdth, That can resist the
I agree with most of what you say, I believe you know what you are talking about but in the case of
:)
RAID 5, you'll have n-1 amount of storage, where n is the capacity of a single drive.
That doesn't make sense,
capacity of drive *( # of drives - 1) makes a little more sense. Assuming all drives are the same.
I read yours and actually it just doesn't make sense though I know what you are trying to say.
Alexis builds a budget storage server and explains why you can't take a random desktop and add a bunch of disks.
Funny, the article never really explains why you need all the super-super parts that he uses to build the server, except for the reasons like the UPS looks cool on your desk. Whoever wrote this really just took a budget and blew it on a bunch of cool parts to build a kick ass server, but would have been out of a job if he did the same at my IT department for wasting IT budget and time.
-$0.02
Anyone can build a PC and fill it with 300GB IDE drives. Big deal.
A few problems:
#1, if you've got BIG files (read: audio/video) or a quite a few users, it won't be fast enough.
#2, It's not a real SAN device. Where's the SCSI and Fibre channel? Can you plug it in to multiple servers?
#3, How do you plan on backing this up? a stack of DVD-R's? A bunch of 80GB tapes?
... how long will it take before it's rendered useless due to slashdotting?
Come on, put a page on that server it and post the link on slashdot!
> PII-200MHz, just because you can probably find one around.
> RAID controller, and a RAID array. How can they even USE the word reliability when they have no redundancy???
> Dual power supplies.
> ECC RAM.
> Dual network cards. They almost got this right, and then put them on different networks. WTF??!!!
> No extra video card. (get a motherboard with something cheap built in)
> Reliable OS. If you're going to use an MS OS , you'd better make sure that all of your equipment is on the HCL.
> Good backups. I can't get far enough to see if they have a backup scheme or not, but I doubt it.
> A clue. Half a clue. 1.3% of a clue!!! ANYTHING more than this author had!
Oh man, what an utterly bad article.
"People who do stupid things with hazardous materials often die." -- Jim Davidson on alt.folklore.urban
For Half as much storage as the article is listing, Dell has a NAS that is bulletproof. These Dell NAS systems are much better because they are RAID 5 and will not break down. And the price is $1200 less. Of course you do not get the same amount of space, but it is rare to see a company use a terabyte every 3 months or 6 months as the article states. I think this is a great option for most companies.
SYSTEM SPECIFICATION
PowerVault 725N (System Identifier EEBHWT0W)
Dell PowerVault 725N: 2.0GHz Pentium 4 Processor, 1U
System Price $2,508.00
Dell recommends Microsoft(R) Windows(R) XP Professional
Memory: 1 GB DDR SDRAM
Hard Disk Drive: 120 GB EIDE Hard Drive (7200 RPM)
120 GB EIDE Hard Drive (7200 RPM)
120 GB EIDE Hard Drive (7200 RPM)
120 GB EIDE Hard Drive (7200 RPM)
Misc: Bracket
Documentation
C1, Cable
Shipping Material
Documentation
- Kill Yourself, spare us all! -
Here's a good budget config:
The Xserve RAID can sustain roughly 130+MB/sec write throughput on the RAID-5 set
Since we're on a budget, choose the cluster config of the Xserve's with only 10 client - can upgrade to unlimited version for $500.
No storage kept on each head - instead, boot off the RAID. If a head dies for any reason, change the LUN masking on the RAID controller and bring up the second head as the first head. No physical changing of cables necessary. Add a PDU with web management for complete remote operation. Downtime is roughly 5 minutes after admin launches the admin Java application (and the web browser for the PDU). This is budget after all.
This system can server up roughly 2 terabytes on two separate volumes (or do software RAID 0 to combine them) over a variety of network protocols - AFP, NFS, SMB, WebDAV, ftp, and whatever else you can slam into the open source core. It can also be a member or server of a variety of directory services including LDAP, NT PDC, NetInfo, NIS.
Includes network based remote management as well as serial port access for integration into existing console access servers. Solution is easier to manage than most UNIX (including Linux) setups.
Price competitive against similar Wintel setups, especially as the number of clients go up. Server is good for 50-150 clients depending on client performance demands.
Add software and hardware support contracts, rack system, UPS(s), gigabit switch(s), etc.
Price is a bargain $16,770 (ClubMac mostly). Compare against $25k+ systems with similar resiliency, manageability, and performance
I basically agree with you, except that backup to hard disks doesn't get you offsite backup, unless you use removables and buy a lot of them. Expensive, although it would be fast.
Back up to a set of hard drives. Seriously. The cost/MB is still the cheapest out there, and it's more flexible, and heck, way faster than tape.
Last time I checked, CDs were about 30 US cents on the gig (ok, say 50c for good CDs). DVD-Rs were about on dollar to the gig. Hard drives were about 80c on the gig for cheap ones. Tape was also about 50 cents on the gig.
The equalizer is the cost of the drive. CD drives are dirt cheap; if you back up to hard drive, the drive is the media; but if you amortize the cost of the tape drive over, say 100 terabytes (not so unreasonable given the durability of tape drives), you bring up your cost to maybe 55 cents on the gig for tape. Granted, if you back up only 10 terabytes, it's no cheaper than hard drives.
So, if you're a large company that makes lots of backups, tape is still cheaper. If you're an individual without too much porn/mp3s, CDs are the way to go; if you're in between, go ahead for hard drives.
I hereby place the above post in the public domain.
I think your post sums it up quite nicely. Poor guy who wrote this article is getting bashed on slashdot...but seriously. fileserver != workstation, and never should be. ESPECIALLY NOT IF IT RUNS WINDOWS!!!!
A few years ago, I needed to put together a fairly heavy duty samba/NFS server setup. The important issues were reliability, and cheap (in that order.) I went with a couple of P-4 (after watching the TomsHardware video of the athlon going poof), three 40 GB WD drives (per system) and a total of 3 NIC's per system (we have redudant LANS). I created a 3Gb / on each disk, a swap partition on each disk and a RAID 5 (software) 75 GB MD. I also used heartbeat so that the two systems would be "Highly Available" see linux-ha.org for more HA stuff.
Then for the backup up stuff, I just rsync the primary box to the secondary twice a day. Worked great . . . until I lost TWO disks on one of the boxes. I was able to run on the secondary until I replaced my disks AND backing up 55 GB of files only took 2.5 hours. NOTE: I had 455 days of uptime on the primary when it crashed because of the bad disk. It DOES make sense to occasionally verify your box CAN reboot.
I've been looking for a chassis to host 6+ scsi drives and connect via an external . I'd prefer a rackmount enclosure. Just about everything I've seen is either another server to maintain (got lots of those) or at least a populated chassis. I have the disks, and if I didn't could get them cheaper than the "solution" vendors.
What I want is to plug hot-swap drives into an applicance that connects to the 68 pin ultra2 external channel. Dual (individually adequate) power supplies would be nice, along with adequate cooling.
Anybody found what I'm looking for?
Good thing, because it is! :-)
Can someone explain (or link) how does external HDs connected thru
USB2 or Firewire performs against conventional xATA and SCSI?
Are they reliable? Do they work well with linux?
I have seen articles about hacking firewire to connect HDs on MacOS X, but no word about its performance.
Try one of these
http://www.tigerdirect.com/applications/category/c ategory_slc.asp?CatId=330
Add another grand for drives and it still could be done rackmount with hardware RAID for around 2 grand
Off-hand, I'd question the power-supply. But I'd hope that you're running a large enough power-supply to handle the amount of drives and that you have it hooked to a line-filtering UPS. Does this only happen when the system is under heavy load?
Are the drives individual cooled? A slightly over-heated drive might respond too slowly for the controller.
Is it the same drive all the time? The same cable? Are you keeping a written log of what died and when so you can spot the pattern?
Wolde you bothe eate your cake, and have your cake?
It's /.ed. Nice work, people.
Wh47 d1d j00 541, 31337 15n't t3h r0xor5 ne m0r3???
Well, this is where I stopped reading:
Another possibility was RAID 5, which allows 5 drives to act as 4 drives. An additional parity track is written on each drive, so if one fails, then the other drives can recover the lost data. This is available through software or hardware. This is a great solution if you do not plan to upgrade your maximum server capacity. When the time comes to replace a drive with a higher capacity drive, you will be forced to replace the entire array.
Right. The thing reads more like an excuse to play with some SATA drives they got for review or something. At any rate, the article presents some seriously flawed and amateurish design decisions under the guise of "budget" architechture.
When I was a kid, we only had one Darth.
applicable for whom?
If, accidentally, you're system administrator of some sort and you actually believe this article, then you're fscked. Really.
From the article:
"If you believe the numbers, running a drive in RAID mirror will double the effective MTBF, we have done that by choosing the Maxline series vs a standard consumer IDE hard drive."
MTBF: Mean time between failures. Mean time. Mean. As in, "it should run this time". "Probably it won't fail until it has run for that many hours". "Maybe it will last that long".
Not as in "this hardware drive is the ultimate perfection".
It doesn't get better when the author declares, how useless RAID 5 is, but it shows one thing: This guy really hasn't got a clue what he's talking about.
Even better: The backup/restore solution.
So, back to the practical application: Who the hell is this arcticle for? The private user doesn't have the money nor the need for Gigabit Ethernet ("budget server".. muahaha), and in Business this system obviously fails.
I'd love to see this guy set up his "Budget Server" in some company. Then an hard-disk headcrash. Just imagine this guy having to explain why the contents of his $3000 dollar-machine are impossible to restore. MTBF. My ass.
To me, this comment epitomizes everyone's complaints about this article. The the-marginal-cost-of-cpu-performance-starts-to-sho ot-up-here logic has nothing to do with their application and can be used to justify almost anything.
http://www.newegg.com
part #N82E16817145316 External firewire enclosure $ 50 each
part #N82E16822152011 Samsung 160GB hard drive $105 each
http://www.pccables.com
part #70924 FIREWIRE HUB 6-Port $ 35 each
With the six-port hub, we set up a topology such that we have one
hard disk per port, minus one port which goes to the host
computer. Then we have five disks per hub in the array; if one of
them fails, we can pull it off-line without touching the cables for
the other drives, since they all go to the hub.
So it is $155 per 160GB element of the array, plus $35 for the
hub, amortized over the five disks (35/5=7) is $162 for 160GB.
At RAID 5, we have (N-1) effective storage capacity, or 4*160=640GB
for $810.
Since most every firewire host adapter has two ports, we can have two
of these hooked up to the computer, for a total of 1.3TB of RAID5
on-line for about a dollar a Gigabyte.
It's a bloooody mess, with twelve power-supply bricks, but it is
remarkably cheap for a hot-swappable personal server.
Note that we can scale this topology if we want to; we could
implement RAID 10, by adding elements to each of the hub ports in a
daisy-chain fasion; FireWire supports up to 63 devices... for a
personal server, I don't anticipate saturating the firewire
bandwidth. We would implement RAID 10 or other 2-D RAID topologies by
means of combining RAID with Logical Volume Manager (LVM) -- a RAID5
array per hub, with each element of the RAID5 array being an LVM
expandable volume. You would have to add to the LVM in "slices" of
five disks, or otherwise keep the RAID5 elements the same size...
Actually I'm not sure that this last point is meaningful; I would not
plan to do such a thing. But it is worth noting that I can
dynamically attach other devices to the firewire array by connecting
to the spare ports on the back of the disk enclosures.
i was just reading about one of two companies who retrieve information from failed drives, and how one should purchase drives from different batches, because when one fails they all fail. whenever a light fails on my car, i replace them all, because the others are going soon, oddly hondas were the most consistent (the others would be gone in days!). interestingly enough, one of the firms maintains a grief counselor! damn i can't find it...
They spent $300 for a Pentium-3 and $200 for a high-end motherboard and $350 for the fastest most expensive memory they could find, when a "budget server" could do just fine with a ~$100-150 2GHz CPU+motherboard and $200 for 1GB of average-speed memory. (Their motherboard does sound good, though.) After all, the bottleneck here is the disk drives and network, not the CPU, though even on a budget server it's probably worth having the 1GB of RAM for caching and for staging CD or DVD burns.
The $190 power supply seems expensive, but that may be realistic for a system that can expand to 8 drives. If you've got a UPS, you may not need as high-end a power supply, and a "budget" system might get away without it, but since they were too cheap to buy a 5th drive for RAID they're probably much more in need of highly reliable power. And their 3GHzP4 CPU and overpowered-for-a-server video card use too much power and put out too much heat - you can easily save 50-75 watts by making better choices, and probably 100. You could save even more by using a motherboard with built-in 2D video, but most of those don't have the high-performance networking support yet.
Also, they didn't have a price for an operating system :-). That means that they're planning to use Linux, which is another reason not to waste power or cooling or money on a gamerz video card...
Bill Stewart
New Fast-Compression-only CPR http://preview.tinyurl.com/dy575ks
If you have five 36 gig drives, and you RAID-5 them, you'll wind up with one big drive of (5-1) * 36 gigs of space; 144 gigabytes, in this case.
If you have three 36 gig drives, and you RAID-5 them, you'll wind up with one big drive of (3-1) * 36 gigs of space, or 72 gigabytes in this case.Vintage computer games and RPG books available. Email me if you're interested.
I have a couple file servers setup to share (and also replicate partially) my data for my Home LAN. They are all in a rack, and so I wanted a solution that wouldn't require many extra parts - mainly for thermal reasons.
I got a couple Asus A7N8X Deluxe motherboards and bout the only thing they are missing is built-in video. These motherboards are great for rack environments because they have two built-in NICs: 1 Based on the nForce chipset and the other is a 3COM, so they guarantee a decent amount of compatibility with whatever you are doing. I got a couple Athlon XP 2000+ to go with it, and 1GB of ram for each of them (no, not ECC unfortunately). The only thing I really had to worry about was putting a video card in each of them, so I only made sure I got AGP card, so AFAIK it won't clog up the system bus as much as PCI video. In addition to the normal IDE, these motherboards also have SATA raid controllers (I believe they only do RAID 0 or 1) which have decent capability for being built-in. They also have built-in surround sound, but honestly I haven't even touched these yet, and don't think I will for a long time.
These systems are setup on Windows 2000 and Windows 2003 respectively, and they are replicating data via DFS. I don't replicate everything I do, but mainly the important stuff (user folders, etc). I know these systems dont have ECC and other features which are common in servers, but as I mentioned before it is for my home LAN and I don't necessarily need all that. I set these up maybe a year ago, and it sure cost a hell of alot less than this RAID setup in the linked article. I definitely recommend the Asus motherboard to any AMD fan who is looking to build the server in a desktop/tower or rack system (probably 2U at the least). Good luck.
I just started building a File Server for all of the Raw Data for this site. Except my budget is a little less than theirs. I was planning on building a 1TB Raid 1 system 1.... 500GIG on onboard RAID Controller, 500GIG on PCI Raid controller. I am going to put a low end Athlon XP and a decent Mobo with prolly 256 DDR. Also I'm putting in 2 Gigabit Ethernet cards so our editors can have access to them quickly.
I still don't know if we need Tape Backup because if we lose a movie, we still have the actual DV tapes, so I guess thats a good enough Tape Backup.
--D3X
NeoX3.com: The One site you'll ever need for XXX
There are adapters that turn a cheap ATA drive into a SCSI drive, roughly in the neighborhood of $100 apiece. If these things work well, then one may be able to put a whole bunch of cheap+100 (which is still pretty cheap) ATA drives on a SCSI (160 or 320 or whatever) channel, instead of adding a bunch of ATA cards and using up all the PCI slots.
Yeah, yeah, ATA sucks, whatever. I have actually had good luck with cheap ATA drives (better than my SCSI experience in the 1990s, for sure) and besides, you RAID 'em based on the assuption that yes, they will die. And when one dies, you pay chump change to replace it. (And when they don't die, then you smirk and say, "That's because I'm ready for it. What would be the point of them dying?")
Another good thing about this approach is that SCSI makes it easy (compared to ATA) to use external enclosures. I'm party convinced that a lot of my good and bad drive experiences have been related to cooling issues. (My expensive Micropolis SCSI drives roasted inside my Amiga 3000 case, but my Coolermaster and Lian Li cases are doing a great job of keeping my cheap Maxtors comfortable.)
Anyone have any experience with building RAIDs of SCSI-adapted ATA drives? Can they transfer at Ultra160 (or 320?!) speeds?
As copyright owner of this comment, I authorize everyone to defeat any technological measure which limits access to it.
Big mistake in the article. They mention the SCSI hard drives require huge amounts of power to turn on. This is correct but what they failed to mention is that it is trivial to make them spin up one after the other. Seems that the authors of this article arn't too familiar with SCSI.
Looking at other network attached servers from either Dell or Apple brings a cost of $4360 for a 2.6ghz/400fsb P4 Dell Powervault for a one terabyte server and $5024 for a 1.33GHz G4 X-serve with 720GB.
What they forgot, is that included in (at least the Dell) price is the Operating System, AND Next day on-site support for a year, and parts support for 2 years after that initial year.
Maybe their "gaming" server would work for someone at home, but not a real buisness. Then again, a home user would probably just slap a couple large drives in their old K6-2 300 box and call it good.
Man, I was way off! All my tektbooks and HOW-TOs have been lying to me.
--
"Outlook not so good." That magic 8-ball knows everything! I'll ask about Exchange Server next.
Did anyone notice that they went to great lengths to make sure they could get full gigabit ethernet, and then only used Cat5e cabling? Cat5e cables will only give you a max of ~350-500 Mb/s, depending on the quality of the cables. If you want full gigabit ethernet over a copper medium, you have to use Cat6. What a waste...
We recently purchased 2 apple xserve arrays totalling 4.5 raw terabytes of data for a price that none of the storage venders could match. We have the arrays set up to do two different luns, each radi5/1 with a hot spair (Raid/5 and then mirrored). All using 180 gb ide disks. We currenty use Panther Server on XServe boxes to serve nfs, samba and afs, but the cool thing about these arrays is that they are standard fibre channel. You can hook them to any box and any OS that can handle fibre channel. The hardware arrays simply set themselves up as scsi luns. The admin software is java based and runs perfectly under linux. I think anyone looking into a storage solution for windows or linux should consider the apple arrays even if they have no intention of ever using Mac OS X or mac hardware.
I built this out of cannibalized parts last January 2003. I suppose by now you could probably double the media storage for the same cost -- there's a lot of rebates for PATA drives around.
Supermicro P6DBE (1997 vintage)
2xP3 600MHz
Adaptec 1940UW SCSI
Software RAID 1
x2 36GB Seagate SCSI drives
(web server)
1GB ECC PC100 RAM
x1 WD1600JB PATA drive
(apps)
Promise SX6000
Hardware RAID 5
x6 WD1600JB PATA drives
(media server)
ATI Rage Pro
(it's a server!)
Antec 1040SX Case
Antex True480 - 480 Watt PSU
Basically, all I bought new were the drives, the case, and the PSU. Total cost below $1300. Serves several thousand visitors a day, peaked at 30K hits for a while following a Slashdotting. CPU usage peaks around 20%. Using J River's Media Center, I've tested it serving 6 simultaneous 720x480 DIVX streams to clients over LAN and WAN with no problems.
These chumps spent 3 times what I did, and they don't even have disk redundancy. Who let the dogs out?
Da Blog
Da Blog
Does this only happen when the system is under heavy load?
No, sometimes in the middle of the night when they're idle.
Are the drives individual cooled? A slightly over-heated drive might respond too slowly for the controller.
Yeah, blowers right on the drive mounts (5.25" bay)
Is it the same drive all the time? The same cable? Are you keeping a written log of what died and when so you can spot the pattern?
It appears to be random in those regards, excepting the controller, of course.
My God, it's Full of Source!
OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
I just built a budget fileserver of my own - total proce $600 (including shipping). It probably could have been about $500 if I'd really shopped around a little more and looked for places with less expensive shipping (that came to $100 total). Specs:
Asus nForce 2 motherboard w/ Athlon XP 1800
4x IBM 60GB 2MB 5400RPM HDDs
3x HDD cooling units
256MB RAM
Decent case, FDD, extra case fan, etc.
RH9 w/ Software RAID partitioning
I don't need 7200RPM 8MB HDDs - You'd need a pretty damn high-usage server to actually require fast drives. The slower drives are more reliable, and of course cheaper. I wanted 4 drives so I could RAID them for reliability purposes, and I chose the 60GB drives because they offered the best price for the capacity I was aiming for. You could get 80 or 100 GB drives without significantly adding to the price.
The motherboard was obvious - it eliminated the lack for a graphics card, even if nForce is rather poorly supported under Linux. As for RAM, again - I'm not playing Quake on here - I rarely use more than a few percent, even with only 256MB.
All in all, the price is excellent, I get my RAID with ample (for my purposes) storage space, and speed is not an issue in any respects, so I don't need to worry about it. The case is extremely well-cooled and the system is robust in general.
Here's how my storage server 'grew up':
Stated off as a K6-2/450 w/256MB after I upgraded my main system. I added four 80GB Maxtor's to it running on an (original) 3Ware 6400, doing RAID-5.
I eventually upgraded my main system again. The fileserver became an Epox 8K7A+ w/Athlon 1.4Ghz and 512MB RAM. The drives stayed the same. It also inhereted my old GF2Pro, since I upgraded. Overkill, but I needed video, and had no other use for the card.
Then the Epox finally started popping caps (remember the stolen capacitor electrolyte formula?). Fortunately, Epox was kind enough to repair it (about $28 spent on shipping total), despite being out of warranty. I held back the CPU for it's return, but I needed the system up and running.
So, I picked up an NF2 board with onboard video, and grabbed an XP1700. I dug up some spare RAM I had around and made it an even 1GB. Again, same drives. The Epox, 1.4Ghz proc, and GF2Pro went into a new system for my sister.
Next step?
Next step, if I ever have money again (bah!), will be much more dramatic. I'll probably move to Opterons, and I may do so for the fileserver as well as my workstation, as my fileserver does FAR more than just that. I'm looking at the newer 3Ware SATA controllers, at least 8, maybe 12 ports. I'll get the best 'bang for the buck' SATA drives out at the time (currently, I think it's the 250GB Maxtor mentioned in the article). I'll do RAID-5 again, but maybe plan in a hot spare this time.
But Intel? Why are people still wasting money on this rubbish? Three hundred bucks for a CPU? I could have built an equivalent or superior AMD system, getting the MB, CPU, and maybe even memory all for what just the Intel CPU cost. What a waste of money.
Backing up to disk is fine for one on-site backup. If you need to restore something right away, and from not long ago then the data's right there on fast disk.
But how about restoring from a month ago? Six months ago? A year ago? Are you really going to have dozens of **sets** of disk drives sitting around?
And what about off-site storage? Are you going to be shipping dozens of heavy, bulky disk drives off site every day? And plugging and unplugging all those IDE or SCSI connections is going to become a pain very quickly.
It's just completely impractical except for **one** recent on-site backup. Tapes for everything else.
I work at a GIS shop, we have about 20T of storage in house. Recently we've been running the following configuration for desktop production (linux boxen of course). And yes, we do critical path production on these machines. You can safely bet your company on a configuration like this.
Case: Antec SLK3700
Motherboard: Gigabyte MPX board
Processors: 2400MP x 2
Memory: 4x512MB Crucial registered
Video: radeon 9000pro
Network: Intel pro 1000MT dual port gigabit
Storage Controller: 3ware 8506 4 port
OS drive: Maxtor 120GB 7200rpm
SATA drives: 4 x 250GB Maxtor maxLine PlusII Raid 5
Power supply: Antec TrueControl 550.
Price tag on this system is about $3k.
Buy a 120x120x38mm Antec fan for exhausting heat out the back. Take off the bracket an use 2 fan screws to hold it in.
The case needs to be modded a tad to fit the big board in.
Avoid using WD at all costs with 3ware. We tried with PATA drives and got absolutely horrific (less than half the maxtor) throughput.
We've had problems with the Antec power supplies overheating a LOT (not enough to crash a system). I just don't think they can handle the constant massive load we throw at these boxes. I'd suggest getting something beefier.
With the included 120mm fan up front the drives stay surprisingly cool even after hours of constant 100% raid operation.
Good rough and ready research - kinda what we've all been saying is possible for actual budget solution.
bsed on 1T
$1500-$2000 gives a decent budget/home storage box
$2000-$3000 puts you in the serious/quality league with raid, proper components, cooling etc.
Systems in the $3000-$4000 range are pro storage boxes w/ backup solution.
All IDE solutions peak out at 8 drives (aprox 3T by current limits). Scaling locally could use attached USB or ethernet disks.
On a larger level, for scalability you could go with lower cost servers but have many redundant ones with a net-raid/block level system in place (my fave), or start a hugh speed data network locally on one main site using fiber channel stuff.
Thats my rough and ready one paragraph summary of budget storage anyway. Your cost of $1500+ feels about right for the commodity deal.
So, only one drive will be accessed at once? Sounds like a single-user PC, not a storage server.
And then:
and: Sound like a storage server?
The article doesn't start by defining what it wants to accomplish. 1 TB of capacity, OK, but what levels of data transfer and downtime? There are mixed signals:
Since the author doesn't know what level of performance he's aiming for, he has no basis for choosing the amount of RAM, CPU, and disk formatting strategy.
IOW, RAID isn't perfect so I didn't use it. What's a "standard configuration"? Separate mount points for all disks? That can work, but ripples through to the applications.
Why? Since the three FS's mentioned are journalling, my first thought is that you're concerned about saturating the link bandwidth with journalling data. Is that it? Tough to analyze without some throughput numbers. If that's it, why not use ext2?
So what OS will you use? Let me guess - Windows XP. Because it has the most games.
Requirements (in this order)
#1 Cheap
#2 Bulk Storage
#3 Reliability
This is what I paid at the time...prices may be better now...
1. 7 120Gig Drives $100 each $700
2. Enermax 465Watt power supply $85
3. Cheap case lots of bays $30
4. 800Mhz Duron+MB $FREE
5. 3DFX Voodoo 3 card $FREE
6. Crappy old Keyboard + Mouse $FREE
7. Extra fan $5
8. Random CDR $FREE
9. 100Mbit Ethernet $FREE
10. 20Gig boot drive $FREE
11. Additional IDE Controllers $60
12. OS Slackware Linux $FREE
Total Price $880 + (some tax, some shipping) ~$950
I run software RAID, get about 15-20MB/sec read and about half that writing. Totally fit my needs, totally cheap...The only thing I am probably going to do differently next time is spring for the cheap 3Ware 8 Port RAID card (under $300 on pricewatch).
OMG. This article is wrong on a lot of things or makes really stupid claims and / or decisions. I could not believe my eyes.
First, the decision not to use any kind of raid. What are these guys smoking ? Didn't someone tell them this fact alone is simply inexcuseable ?
Then they really get going with the "assumed" power specs. Djeez. 15 watts per drive ?? It's not even close to 5 watts. Then, 70 watts for the videocard. Hey, what do you want to do with your fileserver, run UT at 200 fps ? Instead, slap in an old cheap 2D card and use less than 10 watts...
Then, by virtue of using an external firewire drive they conclude "we deem it smart to NOT use linux" WTF claim or logic is that ?
Further, ANYONE who takes the MTBF figures of harddrives at face value must have their heads examined. Who, in his right mind, will believe that a drive will sustain a period of a mere 10 years 24/7 use AND DEPEND ON THAT ? Much less, 20 years or the utterly laughable 137 years. Besides, by using 4 drive they effectively cut the expected MTBF by a factor 4. By using 8 drives the expected MTBF plunges from the theoretical 137 to 17 years.
Then it goes on. They choose not to use SATA !! Now that we finally have a better interface, one that does not suffer from all the problems of ATA (interference, short cable length, manageability)
they are not going to use it. What idiots !!
This article is SO full of holes one could drive a truck through them...! I smell BS.
It appears that they are choosing to use some flavor of Windows as their operating system. Did anyone see their choice? Obviously they can't toss Windows ME or XP on there. So say we throw Windows 2003 Server on there. Still not my choice, but as long as they remember to update it, it will probably work reasonably well (at least until their non-ECC RAM corrupts their data or their non-RAID drive fails).
Last time I checked, Windows 2003 Server was $1100 for only 10 licenses! Configuring a GNU/Linux server is certainly beyond these people so we better give them an XServe.
Uhm.. why is his "server" an intel box running windows? It's not a server motherboard. Why is a storage box concerned about having ANY video card, much less a 3D one? Why does it need a wireless mouse, etc. It's using non-hot-sawp IDE drives with no RAID and no workable backup solution? It's using a hokey hand-modified el-cheapo case?
... _THREE_ of them... or.. perhaps a whole lot of external firewire drives. (and you could use firewire as the network to the clients if you desired).
Real servers come from Sun and the like, but if we want to talk about adapting more general purpose systems into servers, I can detail two I have made:
a.) Took a Sun Qube 3 400MHz K62, already designed for server use, already with the LCD screen (and buttons, that DO something, so you don't need a keyboard or mouse to shut it down or change the IP!)... this was like $300? Added some memory and two massive drives, basterdized the OS to Redhat 9. Put in a firewire card to access external storage for backups. This was less than $1000 total for 600GB of storage. It's smaller, runs cooler, (looks cooler), uses less power, and I am sure well work about as well for networked storage. The only real advantage his has is the GB ethernet. With the money you saved on this Qube, you could have
b.) Blue G3 mac. The blue G4 mac is a 400MHz PPC g3 machine. It's well more than fast enough to be a storage server. I think I got this used for.. $200? I upgraded the memory to 1GB easily and cheaply. (Note: Why is this guy using "performance memory" for something where the hard drive and network will be the bottleneck?!?) The machine has 2 IDE busses, and I replaced the CD-rom drive and Zip drive that came with it with hard drives. There is a boot drive, a swap drive, and two RAIDed user data hard drives. I added a SCSI card, and several RAIDED SCSI drives. I added a GB ethernet card as well. Installed debian, set up Software raid, turned on NFS... walla. This machien cost around $1000 in total, mainly for the hard drives, and it is, I am sure, plenty fast enough for running NFS and samba. I also removed the video card from this machine. Again this machien has an additional level of reliability (RAID) that his doesn't, costed a lot less, and probably looks nicer. It comes with firewire and USB ports built in for external storage, and has an external SCSI port from my card.
Servers A and B from above also run RSYNC between them to keep data backed up, but with the money we saved, we could easily buy some external drives, or a tape backup machine and plenty of tapes.
I also wondered what the hell he was talking about.
I use exernal drives, and almost all of them are ext3 or JFS formatted. (I tend to use JFS on the much larger drives).
I would guess either:
a.) He means because he wants to move them around and mount them up on windows machines.
b.) he wanted to mention linux to sound leet, but avoid actually using it. Since he doesn't seem to know anything about SW raid (like the fact that you CAN SW raid a 100gb and a 200gb disk with no problems, just use a 100mb partition on the second disk, and use the "extra" capacity for something else....), I can only assume that this is the case.
These nice kids are obviously great at gaming gear. But, as others here have posted, they know dick about server configuration.
OK, 3000 dollars later they have what?
1 Terrabyte of destructible data, with glowing 400 dollar ram sticks, and a 3D video card so they can freeze their server when the GL sticks to the screen like a burnt muffin.
It's like a ricer trying to build a BMW. Lots a flailing with nothing as a result. Here's the gear they should have used:
AMD Athlon XP 3200
Kingston/Crucial ECC RAM
Any motherboard with-
2 spaced 64-bit PCI slots(Tyan/Iwill)
USB 2.0 with NEC chipset
Dual Gig NIC's
3ware 7506-8 Parallel IDE RAID card
Same Maxtor Maxline II 250 GB drives
RAID 0+1
Multiple case fans as well as decent bearing PCI cyclone vacuum fans(keep 1 slot away from active cards).
Linux with Reiserfs/XFS depending on file size.
Samba/SSH/SFTP
Fast, Secure, Suculent
That setup hits a little over 2K. No flashing lights, but you can drop that bastard off a building and you won't lose a years worth of data because your an ignorant tard. And as Martha says, "That's a good thing!(tm)"
Offsite multi-year storage? Agreed.
However, MOST small and medium sized businesses don't even do offiste backup. They back up to a server somewehre in the buildling, and that's that.
Tapes are not as reliable as you think; I've had more than my fair share of DLT tapes go bad. Further, they don't last that long on the shelf.
If we are talking about long-term archival storage for financial records, as required by law in many places, that's a totally different issue than making sure you have a backup of the last 2 weeks of incremental data in case someone erases something.
I have a 533Mhz Via Mini-ITX motherboard driving my file server. Here's what I built:
MB: Via 533Mhz Mini-ITX
Video: Built into MB, crap, but who cares?
NIC: 100 Base-TX built into motherboard
RAM: 1x 512MB DIMM
Storage:
- 1x 20GB Maxtor hard drive for the OS
- 2x Maxtor 120GB drives plugged into a Promise Ultra 66 PCI IDE controller, mirrored
Case: Some old piece of crap mid-tower ATX case
PSU: PC Power and Cooling 300W
It's not uber-leet, but it gets the job done. The system also has a minimum of fans: on for the PSU and one for the drives. Neither the CPU nor the video have fans.
My needs were for a reasonably large capacity (yeah, 120 MB is hardly "large" anymore), reasonable responciveness, low-as-possible power consumption and noise.
I wouldn't use this thing in a production environment or as a mission critical system, but for a home file server feeding files out to four/five client systems it works fine. (And yes, I am planning to put a backup system in there.)
This attrocity tha these idiots specced out is a sad and pathetic joke.
Boobies never hurt anyone. - Sherry Glaser.
Is there a chance that installing the latest Apple OSX 10.3 could corrupt the firewire data? I read it has issues with external firewire drives.
Da Blog
Trusting Maxtor drives to work long-term because of some marketed MTBF is insane. I don't know what it is but Maxtor drives always seem to flake out on me. I returned three of them this year after they toasted to unreadability (seems to be one of those things, people always get failures with one brand or another... I've never had a non-Maxtor fail in a PC (a few Seagates in Sun boxes but they were 10+ years old)). There is a reason Maxtor led the rush to one year warranties. I miss the days when 5 or even 3 year warranties were standard.
You got me into this! You were the ideologue! I'm only a poor assassin! - Twenty evocations, Bruce Sterling
ah
Summary:
480 GB (almost 1/2 TB) for $880
Here are my totals:
Assume 5 yr MBTF, which many quality drives are rated. 5 drives to start, with 4 more each year as they add space. In 4 years they will have 17 drives, with one failing on average once every 105 days.
Now consider that real-world says drive MTBF is often unrealistic. In 4 years with a 3 year MTBF, drive failures will occur once every 63 days.
This doesn't even consider througput issues, volume sizing, file retrieval, etc. Not well thought out at all.
And I'm sure there's tons of large business admins that frequent firingsquad.com...
They really missed the boat here, the article doesn't apply to any of their regular readers.
my karma will be here long after I'm gone
All IDE solutions peak out at 8 drives (aprox 3T by current limits).
What's stopping me to just add a second 3ware card and another 8 drives? 64bit and/or 66mhz pci of course.
Having a GigE card (~100MB/s) and a raid card (~100MB/s) on the same 33mhz 32bit pci bus (~133MB/s) doesn't make sense to me.
I may be reading the article wrong but I am getting the impression that the author intends to connect the server to both the internet ("behind a firewalled connection") and the LAN. Firstly, what business does a file server have on the Internet? Isn't that what VPNs are for? Secondly, even hot-swapping a network connection from internal to external and vice-versa can expose your Windows box to an exploit and then bring the exploit into the LAN (much less connecting the box to *both* networks simultaneously.) Naturally, the other problems w/ this system such as lack of redundant storage, lack of backup, dismissing the use of Linux as an OS offhand, huge cost, etc.
RAID isnt about increasing MTBF, its about not having to bring the system down and not losing data when (not if) a drive fails. When one of their four drives fails, they will have to stop the system and restore from an old backup. It takes a while to restore a 250Gb drive. And of course all the data since the last backup is gone.
Then there's the fact that they have four seperate drives, while with RAID you get one big one.
RAID controllers, especially the Escalade one, do a much better job of managing disk writes than your onboard IDE controller. For server usage you will see a much higher response for multiple users using RAID. No reference is made to the different behavior of drives in a server compared to workstation drives.
They remark that RAID wont protect your data because the PSU or motherboard can fail. Ok, I have never had a motherboard fail. That doesnt mean that they don't, it just means that their MTBF is way beyond discs. I have had a PSU fail, but not in a way that damaged the computer. You could consider dual PSU solution. Or a post-psu UPS (i.e. where the battery is between the PSU and the motherboard), as opposed to, or in addition to, a traditional pre-PSU UPS.
But then, the whole article is something of a joke. A $3000 budget server with the most expensive RAM, CPU, Keyboard and a bloody LCD panel??? I dont know what planet they are on but for $3000 I built a dual P4 XEON box with a Promise SX6000 pro raid controller. (I buy escalade now, I might add). And a $160 Keyboard for keyboard and mouse? What's it need a keyboard for? For $160 you can buy a 4 port KVM switch and use a keyboard you've already got. Or spend $5 on a basic one.
They use one gigabit port to connect to the internet. Why not connect both ports to a capable switch and get 2Gb/s?
BTW, I tried low-end Seagate, Maxtor and WD, and finally found that Samsung Spinpoint drives survived the longest in a RAID box.
You buy spares for your RAID array. Unless you're doing it for fun at home, if it's mission-critical then you've already thought this all through, gritted your teeth and written the cheque.
Fileserver DOES NOT equal a desktop with big disks.
And when your l33t motherboard goes pop in 2 years, what do you do? You can't buy that exact model anymore, so you get the nearest. Plug your drives into it's onboard RAID controller, which promptly craps out leaving you with a dead array. Fine for serving data when your data/uptime doesn't matter, but there aren't many calls for a server like this. At least, not more than once.
that is the most ridiculous article i have ever read.
they spent over $300 on parts that they could have purchased for under $100, and $100s on parts that aren't even necessary, all the while skimping on drives?
i thought they were building a storage server, not a gamer and pr0n surfer's wet dream
Having a bookmark to Google does not make you an expert on everything.
Helican scan/8mm is unacceptable.
If you're using a reliable linear tape tech (like SDLT or LTO) you're spending 75 to 90 cents per gig again.
Whaddya gonna do... I recommend a tiered scheme using backup to swappable hard drives or NAS for near term, and optical media (small data sets) and tapes (large data sets) for long term.
THIS THING CAN TURN ON A DIME, MACROSSZERO STYLE ALSO FUCK BETA, ~NYORON
they wanted to be able to backup the filesystems (byte-by-byte copy) to the external drive, but be able to access it from ANY machine (not just linux boxes).
Doesn't really make much sense to me.
THIS THING CAN TURN ON A DIME, MACROSSZERO STYLE ALSO FUCK BETA, ~NYORON
they'd be utilitzing their four IDE channels with SW RAID 0 striping and then the 5400 RPM doesn't really become a bottleneck anymore.
Dumbasses.
THIS THING CAN TURN ON A DIME, MACROSSZERO STYLE ALSO FUCK BETA, ~NYORON
Hard drives are not good for off-site backup, I already acknowledged that. At least, not the kind you want to tote to a vault.