Best Home Network NAS
jammerjam writes "My WD 120GB drive got its MBR scrambled so it no longer mounts in my W*ndoze box (I can recover the data so I know that's intact). But now that's made me realize I need to implement my data backup plan. Scouring the Internet I can't find a reliable resource for home NAS solutions. For every positive review I can find a negative that refutes it. My first choice from what I found starts at $1200...I've got $500. Anyone have a suggestion? I'm not looking for enterprise-level storage here — but I do want reliability."
Buy a couple of 500 GB SATA HDDs. You can build a box with a SATA RAID controller for probably ~$200 or so and throw OpenFiler on it. You still won't do this under $500, though. Probably under $750, though, for sure, if you're careful.
/mbr. That should fix it.
As for the botched MBR, boot an MS-DOS or even a FreeDOS boot disk and do a fdisk
My blog
I'd get one of those cheapo walmart linux boxes...stick it in a closet....then just use rsync or rdiffbackup....with a real box you'd have the luxury of being able to add additional storage easy...you can even setup a software raid for extra protection...
For $500 you could buy a whole PC with a pair of 7200RPM 500GB SATA2 drives. You could configure a mirrored RAID 0 array and back your stuff up over the network. For many dollars fewer you could upgrade your power supply and stick those drives in your current PC, assuming your motherboard supports software RAID.
Last year I ditched the file server at home for the DNS-323. With the current firmware, it's been rock solid for me. At the time, it was $300 for the unit and two 250GB drives. It's iTunes server works well enough for me as well.
As a bonus, it's debian based, so you can hack the OS as well to server up things light lighttpd, upgrade samba, or run subversion.
$179 for an Airport base station, $321 for three 500GB USB drives and a USB 2.0 hub. Should be enough for a serious porn collection, and you get wireless N for free.
Without knowing what you've looked at, it's hard to give you an intelligent reply, but a friend of mine just bought a Drobo and loves it.
-- Old Man Kensey
Try the freenas server. It works great. :)
I use a old beat up computer with 3 500 gig external usb harddrives in a raid 5 which gives me a terabyte of storage
www.freenas.org
Get an old box, age doesnt really matter.
Insttall FreeNAS, http://www.freenas.org/ .
Raid-1 (mirror) a pair of reliable disks (hitachi or seagates).
Set up CIFs shares.
à_à
... you'll always need backups. Even the most reliable systems will eventually fail. Routine backing up is essential.
You don't need enterprise storage solutions: great. That means that you probably don't need to do nightly backups.
The lesson in you losing your data is not that you needed NAS, but you needed to make better backups.
More Twoson than Cupertino
Try and work out exactly what you're protecting against before you worry about solutions.
Do you want data to survive a hard disk failure? RAID. (Though I make no guarantee that any of these things have implemented RAID terribly well, particularly if a disk fails 2 years later and the replacement you plug in has totally different geometry).
Do you want data to survive your own mistakes? Then use the NAS as a backup for your own PC(s).
Do you want data to survive poor implementation in the firmware? For best results, you'll probably need two totally different devices and some means of keeping them synchronised. (Though a number of Buffallo's Linkstation products can support a separate external USB disk for backup of the NAS itself).
Do you want data to survive a house fire? If you've got immense quantities of data, you'll need a unit you can take offsite. If not, perhaps a subscription-based internet backup provider is the way to go.
If you've got data on only one computer, don't bother with a NAS and get a USB (or Firewire, which would be better since FW doesn't hog the CPU) hard drive. SyncBack isn't a bad free backup program for Windows, but the free version can't copy open files.
Even if you've got two or three computers, a good external HD will be cheaper and probably more reliable than a NAS box, simply because there are fewer parts to break on a USB drive than a NAS, which is typically a power supply, network card, some RAM, an OS in ROM, drive controller, and one or more hard drives. The only thing you won't get from an external HD is RAID, but you can fake that with software if you get more than one per computer, and RAID only means that the data's still accessible if one drive dies (assuming you're not stupid enough to use RAID 0), so it's probably not important for you.
If your data is valuable, burn the most important stuff to DVD periodically and stick it in a bank's safe-deposit box.
Hail Eris, full of mischief...
E pluribus sanguinem
If you do it with OpenSolaris and ZFS, you make it very simple for yourself. The amount of administration needed using Linux and *iSCSI is huge. While OpenSolaris provides iSCSI/NFS on the fly. Including snapshots of snapshots. So you can have 'raw' volumes, and managed data. I'm using OpenSolaris now to boot my Xen Linux Nodes now from OpenSolaris NFS. Yes I know xVM exists, but it is not as mature as the Linux version. Use the best tool for a problem.
Support Eachother, Copy Dutch Property!
You must be new around here, right?
Go to office Depot or Staples or whatever the local office supply store is, buy out their entire stock of paper and number 2 pencils. Proceed to copy down bit for bit the content from your hard drive. If you write really small, you might be able to fit it in under $500 worth of supplies. For even greater redundancy, you can use clay and chisels, but thats just too time consuming for the average user.
We've secretely replaced the Enterprise's dilithium crystals with Folgers crystals. Lets see if they notice.
Either that or I was a beta-tester for Windows Home Server, during which it saved my bacon when I accidentally blew away my Quicken data files.
Reason, free market capitalism, and individualism
I run a slug with a 500GB WD essential drive attached to it. There is one more 250GB WD essential drive (my old one). The two combined together is more than enough to backup all the machines and laptops. It runs OpenslugOS/SlugOS 3.10. It's reliable and a cheap solution. You can implement software RAID if you want.
#include std_disclaimer.h
I just got a 1 terabyte WD MyBook World Edition 2 from Costco for 390 canadian. And it seems to work well. Of course I had to upgrade my router to gigabit to get decent network access. It also is software hackable(http://martin.hinner.info/mybook/) and user servicible. One of the problems I have is that it doesn't spin down the drives after inactivity. I didn't use the supplied software. I also had a Netgear SC101. It is nicknamed the toaster, not only for its looks, but the heat too. It did spin down, but you needed to install the Zetera drivers to access it. It wasn't really a nas, but a SAN. It is now collecting dust...
RAID0 = Striping
RAID1 = Mirroring
RAID5 = Striping with parity
RAID0+1 = Mirrored Striping
RAID10 = Striped mirroring
Chas - The one, the only.
THANK GOD!!!
I run Bacula (it's not just for the enterprise, folks) and back up all the important data to the disk array.
I think I peek in there once a month or so, mostly to check disk space and see to patching. The box has zero Internet connectivity, so no probs there.
Quo usque tandem abutere, Nimbus, patientia nostra?
I'm using a Linksys NSLU2 as a NAS. I've wiped it of the original Linksys firmware and installed the officially supported ARM version of Debian Linux on it. Debian is installed on a 2GB USB Memory Stick, and I have a 500GB External USB HD attached via a tiny USB hub. I also have an HP F380 Printer/Scanner attached.
I'm using the box as a Samba server for file sharing, SANE server for remote scanning, CUPS server for remote printing and a Twonky Media server for steaming audio and photos to my XBox 360. It all works really well.
Not a bad NAS (or really a complete Debian Linux box) for about $250 for the NSLU2 and the Harddisk.
--- I'm sure using a computer was fun back in the 80's. *sigh*
You've added $169 to his base cost, and haven't really given him a solution. The various open source products out there will more than likely compete just fine with your Windows software, and not cost the $169. On a budget of $500, if you're spending almost 1/2 that on software, you're not getting much for hardware.
I hate to pimp for the company I work for, but these are actually pretty good, and I don't see a lot of breakdowns with them. $200, 500GB. You don't get blazing speed, but you're not likely to find that in any prepackaged NAS system. It's certainly cheaper than you could build a box (with equivalent capacity) for. http://www.lacie.com/us/products/product.htm?pid=10844 If you need more capacity, there's also the 1TB ED Big Disk ($299), though that's a two-drive unit, and somewhat more prone to breakdowns. http://www.lacie.com/us/products/product.htm?pid=10882
I've been using a ReadyNAS NV from Infrant (company bought by Netgear) for a year and a half, and have had no troubles with it at all. It just works. When I wanted to increase capacity by adding another disk, I just hot-plugged in the drive, and it rebuilt the RAID array and increased the capacity automatically without any intervention other than a reboot after a couple of hours. And it sent me an email to let me know when to do that.
The DriveStation Quattro is in your price range and provides you with 750GB of storage using RAID 5 and it's in your price range.
I just got a 2TB buffalo terastation pro II for 1K and it's awesome. Here's a review of the 1TB model. They offer other options, but this seemed like the best one for me based on price, capacity, and reputation. True reliability means you probably want RAID 5 and that means 3 or more drives. If you don't want to fight with raid cards and configuring it from scratch, then this is a great option.
Creationists are a lot like zombies. Slow, but powerful and numerous. And they all want to eat our brains.
It sounds like this guy is a noob. So how long will it take for the OSS to be setup and configured correctly. When the Windows software is probably point and click. Some of the $500 is going to hardware but I am sure some is also going to keeping his sanity when setting up and maintaining this system.
I smoked pot once. But I DID NOT inhale. Will you hire me?
I've had good luck with the two Ximeta NAS devices I've bought in the last couple of years. They have a proprietary architecture that allows you to put a standard low cost, high capacity drive onto your home network for file sharing via either Cat5 or USB (through a PC). The network connection provides superior performance. I've used these drives in Windows & Linux environments succesfully. I believe you can pick up the external enclosure (that only needs a drive; already contains power supply and interface hardware) at Radio Shack for ~$60 and then put whatever compatible drive you want in it. Read more at: http://ximeta.com/
HP makes a Windows home server for $600. Half a Gig, with hot-swappable trays for SATA, etc. just plug into your network and voila.
http://www.amazon.com/EX470-MediaSmart-Server-Sempron-Processor/dp/B000UY1WSK/ref=pd_bbs_sr_3_s9_rk?ie=UTF8&s=electronics&s9r=8a585b431588ae070115f9650cd90da1&itemPosition=3&qid=1195658849&sr=8-3
Reason, free market capitalism, and individualism
So I built a debian box (after looking at FreeNAS and OpenFiler and concluding that they were inadequate for the hardware I had already bought ...).
I used: SilverStone GD01 case (it has room for 7 HDs and big, quiet fans), an Asus AM2 board with 6 SATAII connectors and 2 x gigabit ethernet, I installed a low power Athlon X2 BE-2350 and 2GB RAM as well as 6 Seagate SATA disks with 250GB each. I partitioned the disks to contain a small (2G) partition for RAID-1 and swap (2 x RAID-1 for the root/boot fs - Linux can't boot from software RAID 5 yet, 4 x swap partitions) and the rest of the disk is used for a 5+1 disk RAID-5 setup.
Performance is very good, I can saturate at least the gigabit ethernet LAN connection of my desktop PC both at reading and writing (it chokes at 44MB/s - local speeds are much higher, mail me if you want a benchmark run) and I can also run various server stuff on the box that a normal NAS wouldn't support. The box is extremely quiet, so I'm very pleased.
"I love my job, but I hate talking to people like you" (Freddie Mercury)
All you need is a cheap Linux box (Debian works well) with one or more large disks. The disks and disk controller don't need to be particularly fast either since backups happen during off hours. If you are worried about disk failure put in two drives, use software RAID, and forget about it.
I second that suggestion.
I just completed a very extensive review of both the hardware and software for Windows Home Server. It is a fantastic backup solution and you can build a machine for very little cost. Not only do you get a great backup solution, but you also get a lot more. Windows Home server has a built in web server that will host all your files online for free. From the website you can also Remote desktop into any of your Windows boxes that support remote desktop. You can also stream all your media content from the Home server to any machine on your network. There are some problems with the Media Streaming, hopefully those will be fixed. Last but not least you have the ability to use add-ins which can add tons of extra functionality.
The biggest limitation of Windows Home Server is that it will not backup anything but Windows machines, but that does not mean someone won't write an add-in that allows other operating systems to be backed up.
JusTech'n - Where Technology comes home
The title and summary do not explain what NAS is. Nor have the comments so far.
Of course, any geek worth his/her salt must know what NAS is. Since it must be a very common term for people to use it without explanation, I looked it up on Wikipedia. Now I no longer need to turn in my geek card, because I know that NAS is a 34-year-old American rap musician. It would surely be awesome to invite him home to perform over the network, thus solving problems of scrambled hard disks with the Best Home Network Nas.
Of course, NAS might stand for any number of other things including Network-Attached Storage, Network Access Server, Non-Access Stratum, Network Audio System, or of course that shining epitome of disk failure prevention, the New American Standard bible.
Anyway, I'm glad I'm done scratching my head over this, because I'm developing a bald spot.
404555974007725459910684486621289147856453481154 in hex is "You sank my Battleship?"
[GPG key in journal]
But then I also prefer SCSI disks.
... just in case it works too well and you don't think about it for the next 6 years.
That is because I can get them hot-swappable and with lots of nice lights.
I have a new SATA server that has fakeRAID, and the drive lights are not supported and they aren't hot-swappable.
For a home environment where YOU know what you have and how it is configured, I'd say go with whatever you're comfortable with. Just make sure you document what is what and where
just buy yourself an external hard drive and use flyback:
http://code.google.com/p/flyback/
http://kered.org
Last time I had a hard drive failure, I bought 5 identical 80G hard drives.
/dev/hda and a blank drive and make it /dev/hdb
and clone it. /dev/hdb and put it on the shelf. /dev/hdb then boot up from /dev/hda and copy everything that I did since my last clone to the new drive (mostly email and some programs).
I build one drive until I "get it right", then I place anoth drive in the system as slave. Then I boot Knoppix 3.8 or DamnSmallLinux or something similar from the CD drive (I found some Live Linuxes make this process take much longer).
Then I issue the command
dd if=/dev/hda of=/dev/hdb bs=512M count=160
I have 1G of ram in the machine so I am assured of getting full 512M reads, then 512M writes, so the OS does not have to do extra buffering.
It takes almost exactly 1 hour and 8 minutes to totally mirror a drive. This copies the MBR, all partitons, even the blank, space byte-for-byte from one drive to another. It ignores files, folders, etc (so those long filename errors NEVER happen) it just copies RAW data.
I then take the second drive out of the system and place it on the shelf.
In the event of a failure (I am down to 4 working drives now.)
I take the good drive off of the shelf, make it
I then take
I take the failed (or failing) drive and make it
After the new drive is happy and in place for a few days, and I am sure I got everything I needed off of the failing drive, I re-clone the good drive and put it on the shelf.
So, far it has been the most hassle free disaster recovery plan I have ever used.
You can get 5 identical 80G hard drives for less than $200 with a very short search.
- I live the greatest adventure anyone could possibly desire. - Tosk the Hunted
First, I'd not heard of Openfiler and will be reading up on it but for now I'm using unRAID from Lime-Technology.com and it's working well. Here's why I like it and why I think it's better than standard RAID:
:-O
1) It doesn't stripe and it easy expands to as many as 16 disks.
2) Because it doesn't stripe disks that aren't being used can goto sleep, much less power usage, noise, and heat trust me.
3) One disk is used for Parity and must be as big as or larger than all others but all other disks can be any size you want - they need *not* be identical. JBOD indeed!
4) If you lose a disk you still have access to the data, if you lose TWO disks you will lose data - two disks worth and NOT the whole array! Yes I know RAID can protect against multiple disk failure but only with hot spares or schemes that mean you get to use even LESS of your disks for data. I get to use ALL of my disk space save just one disk. I'm actually running sans a Parity disk right now since I had a hardware failure, I have access to ALL of my data and am hoping a second doesn't die on me while NewEgg ships.
5) It boots from FLASH memory on cheap hardware, you do not lose storage space to an OS.
6) The trial version supports two data disks and a parity disk, perfect for testing. The full version isn't super expensive. The product has decent support.
7) The disks use standard ResiserFS as their F/S. Want to pull one and take it someplace to mount to a Linux box? Sure, go for it. Need to do a data recovery for some odd reason? It's ResierFS so whatever works for that works for this.
Doing this for just $500 won't be easy without some spare hardware around. The Asus P5B V0 M/B runs about $106 at NewEgg and has 8 SATA ports (one is eSATA) and GigE. That and two 4port Promise cards (SATA or IDE) will get you up to 16 drives but obviously I'd start with just the M/B. Buy some cheap memory, no more than a gig. I spent $25 on the RAM I bought and $60 for a 2.4Gig Celeron D and that's WAY more than enough. Slap all that into a case you have laying around with a decent P/S and you're good to go on the cheap sans drives. Spend the rest on drives, I find Seagates work well and their 5yr warranty rocks! Oh you will need a FLASH stick too, 512meg is WAY more than enough so figure $25 here too.
Some things you might NOT like about unRAID:
1) You aren't going to turn this into a NAS\WEB server\Mail server. It's storage stupid, use it for that. To do all of those things you'd need a swap space and out of the box this doesn't have swap - nor is it needed. It can be added but....
2) Each drive is it's own share. I address them using UNC naming and there are ways to access files across multiple drives as a single share but it's not like RAID with one big fat volume. IMO the advantages outweigh this downside, more details can be found on the unRAID site.
3) It ain't super fast. Yes, it will max out a 100meg NIC pretty good but not the GigE. You're getting the throughput of a single drive with some overhead so there's no aggregation of disks to improve speed. It IS fast enough to stream HD and multiple SD streams are no biggie either. I *do* back my machines up to this without issue using Acronis. Do use a GigE NIC however, it bursts above the 100Meg mark and testing has shown advantages to having it, it just cannot max it out continuously.
4) unRAID doesn't YET support NFS, Tom is working on it. SMB is what I use.
5) The driver is open source but the controlling software is closed source and yup Tom makes some money on it. Source is available for the GPL'd driver software he's modded so you could go around this but frankly I think his pricing is reasonable, zealots might not think so.
Check it out, if nothing the ASUS board is a good base for damned near anything else you might want to build for a NAS and is supported under Linux, it has onboard video on it too. More details about the M/B, HD deals, or other hardware like SATA cages can be found on the unRAID support forums and in the Wiki.
Build it, Drive it, Improve it! Hybridz.org
"I can't imagine this taking more than half an hour to get working."
Jesus. The number of times I've said that and regretted it.
throw new NoSignatureException();
My 'dream NAS' would support 3.0 Gb/s SATA transfers, support RAID 0-6 + JBOD, use a Linux-mountable filesystem on the drives (ReadyNas uses EXT3), have iTunes and DLNA media streaming support, firewire 800/USB 2.0 connections for the currently-direct-connect-only OS X Time Machine, support and use 1 GB transfer speeds.
The Thecus 5200B is sinfully fast, but doesn't have the iTunes or DLNA servers (it is a SMB box, not a home server, after all).
Opinions?
Tiller's Rule: Never use a word in written form that you've only heard and never read. You will end up looking foolish.
I'll add another plug for the NSLU. Got one of those handling image data from remote security cameras. Works great. Note that you have to have USB hard drive however, as it does not have SATA support directly.
Also, I did mod the box so that it powers back on automatically after a power failure.
Like pi? Try 10,000 digits.
Whatever it is, is it worth $169?
Ok, let me break down the out of box comparison.
Ubuntu does not come with client software for windows machines to automatically back up the windows box nightly onto the Ubuntu server. WHS does.
Ubuntu requires you to install Samba. WHS uses windows shares / web server interface.
Ubuntu requires raid hardware or software. WHS uses a 'storage pool' methodology and allows disk redundancy without raid, and automatic growth of the 'storage pool' by plugging in a USB drive or ESATA device(s).
Ubuntu would not give you Remote Desktop access to your windows machines without configuring Wine, I think.
Ubuntu requires you to install CVS to get versioning of files, which requires you to actively commit files. WHS automatically saves changes between versions and allows you to step back, all through the nightly automatic backup.
You'd have to write your own web service to access the machines from outside the network. You'd also have to configure the router yourself. WHS automatically configures routers (if supported) and has an IIS app that lets you access all machines and WHS content from the internet.
This is just a handful. I thought this through, I run a small business (20 hours a week of development) and did my homework before making the decision to buy WHS.
Reason, free market capitalism, and individualism
I am going to be looking at NAS for my home network soon and am leaning toward a BSD or Linux based NAS solution using software RAID:
http://www.freenas.org/
Task Scheduler to copy files from client to a network share? Can't be all that complex to set up a basic data backup routine...
Ubuntu requires you to install Samba. WHS uses windows shares / web server interface.Samba has a pretty easy GUI setup, even in Ubuntu. It's also already installed, I believe.
Ubuntu requires raid hardware or software.Software RAID is already built-in. If you use Fedora instead of Ubuntu, you can use LVM's GUI tools to do all of the dynamic partition sizing goodness.
Ubuntu would not give you Remote Desktop access to your windows machines without configuring Wine, I think.Use the Package manager to install rdesktop, which allows remote desktop access to any Windows box. Done.
Ubuntu requires you to install CVS to get versioning of files, which requires you to actively commit files. WHS automatically saves changes between versions and allows you to step back, all through the nightly automatic backup.Ah, now there's one that you've gotten perfectly correct (IIRC), and why I use Bacula on my home network (which is admittedly not something for the casual user).
You'd have to write your own web service to access the machines from outside the network. You'd also have to configure the router yourself. WHS automatically configures routers (if supported) and has an IIS app that lets you access all machines and WHS content from the internet.I'm not so sure I'd want any un-hardened machine to be accessible from the Internet; esp. a Windows one that both streams media and holds all of my personal data in one easy-to-reach location. That's just begging for a first-class arse-pounding from the first script kiddie to see that you've done that.
This is just a handful. I thought this through, I run a small business (20 hours a week of development) and did my homework before making the decision to buy WHS.I'm sure you probably have... but I don't think you had all the facts at hand when you did. Now know that I'm not knocking your choice at all - if you use something as a beta and like it, and it works for you, cool... but I think that you haven't really looked all too deeply into the alternatives, you know?
Personally, I find that spending $169 for just the OS (when I can get at least an extra hard disk with change left over at that price) to be a bit much. There is also the headaches specific to Windows - the high probability of being targeted, the EULA that says I do it MSFT's way or no way at all, the 'phoning home', the DRM, the extra overhead (I stick with runlevel 3 on my home servers), and the fact that there really isn't much I can tweak on it (at least by comparison)... But then, I do the sysadmin thang for a living - so my needs, skillset, and priorities are a lot different from that of the average home user.
And so it goes... :)
Quo usque tandem abutere, Nimbus, patientia nostra?
One thing I've learned from speccing a few enterprise backup systems is that you really have to be specific with your needs. The reason everyone on this board isn't just recommending the same thing is because there are so many trade-offs associated with backup systems.
For example, how easy do you need it to be to set up?
Do you want something with a command line, web interface, or dedicated monitor?
How much space and ventilation do you have for the system?
Does it need wireless or wired connections?
How comfortable are you with the various technologies that you could use in a DIY situation?
How much space do you need?
How much reliability do you need?
How much availability do you need?
These are all factors that are essential to choosing the right solution.
My current setup is more of a NAS than a backup box. It's an old box, Athlon 3000+ with 1GB of RAM, running OpenSolaris. Solaris is a pain, but ZFS is worth it. It makes managing all those disks painless. In return I get redundancy in the form of mirrored disks, speed in terms of ZFS caching and mirrored disks, infinite constant-time snapshots (I do hourly), and a host of minor options. I export these disks via NFS to all the systems on our home network and it is generally faster than a single native disk. All in all it has cost me $120 for a new case and $40 for a new SATA card when I needed to add more disks, plus the cost of disks. Now I have 80GB of OS/web space and 750GB of storage, all mirrored. That means I'll basically never worry about losing stuff.
If you really want quality storage, look for ZFS. It's in OpenSolaris, FreeBSD, and OS X now. Also, if you ever get more systems it is nice to have a NAS to share files and allow for centralized management.
RAID is most definitely about reliability and recoverability as well as availability. It all depends on the level you choose. Your argument that multiple disks increases your likelihood of failure is trumped by one simple fact: how do you know that the single drive you buy for the job will be more reliable than the one next to it?
You can't, and that's why using at least something like RAID1 is a smart way to go. When one drive fails, your data doesn't all go with that one drive. I've seen drives from batches fail literally within a couple of days of each other. If you're smart and rebuild offline as soon as a failure occurs, your chances of losing all your data are very small. Reliability engineering is all about probabilities, and the mirroring and parity concepts of RAID facilitate this reliability. The only place where your argument holds sway is on RAID0, and that's a pretty specialized application to be sure.
If you want to swap drives without disassembling the machine, get case with enough 5.25" bays for the drives you need and buy some removable trays for $10 a piece. When one drive fails, you turn a key, pull the tray, swap the drive and back in it goes for a rebuild.
RAID doesn't open you up to data loss from accidental deletion, it just doesn't help prevent it. ZFS, however, does. You can check it out on FreeBSD (which has much better SATA controller support than OpenSolaris).
Although FreeBSD 7.0 (the version with ZFS) is still in Beta, it's been in a feature-freeze for a long time, and it's generally rock-solid. Just read the ZFS guides from OpenSolaris and the tuning guide for FreeBSD:
http://wiki.freebsd.org/ZFSTuningGuide
http://docs.sun.com/app/docs/doc/819-5461
http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide
Note that ZFS really wants to be run on a 64-bit OS, and it wants a lot of RAM. If you've got that, though, it's fantastic, and it allows for easy snapshots (which helps protect against accidental deletion.)
You jumped from realizing that you need a backup to NAS. NAS might use RAID for hardware protection, but you can still wipe it out with a mistake or a virus. My favorite approach is to buy a cheap USB-HDD enclosure and back up the internal drive on the PC (which needs to be powered on whenever you use the PC anyway) to the USB. Then, switch off the USB drive's power and it is safe.
Once in a while, yank the drive out of the enclosure and drop it in your safe deposit box and put a new drive in.
Advantages:
1) Easy approach to off-site storage
2) Protected from errors and viruses
3) Doesn't cost much
4) Doesn't waste power
5) Can restore on other systems
Disadvantages:
1) Not a very impressive geek toy
2) Not particularly fast
- Dynamic volume management.
- Incremental backup.
- Live snapshots to an arbitrary granularity (ZFS snapshots are O(1) in terms of time and O(n) in terms of space where n is the amount of data that has changed; rsync helps keep this nice and small).
It also lets you do a few things you didn't ask for:I am TheRaven on Soylent News
...was the way to go for me. Those little proprietary vendor NAS boxes, not generally being "open" open-sourced, make it difficult to deal with if there are problems. I'd say go for a little machine running either Linux or, in my case, Solaris. The hardware does not have to be super-fast if you are just serving files in a home network environment & I recommend RAID5 for the best usable gig/$. Even in a home system I want RAID - if my laptop or desktop hard disk fails I want a *solid* backup since I don't do tape B/U any longer.
For something super-reliable I went with an older Sun Blade 100 desktop machine - you can find them used on Ebay for $100 and they just keep running and running. They have a PATA internal interface, so toss in a couple of IDE drives (RAID as you like, use Sun ZFS and get enterprise-class features in a free NAS) and off you go.
I wanted something a bit bigger, so I installed an U160 SCSI controller & found a used external SCSI disk chassis for $20 (Ebay is your friend), stuffed it with 5x 500G SATA disks w/SCSI-SATA bridge boards (the only annoying part for me, since Solaris on SPARC does not support SATA) and it's been running rock-solid 24/7 since early this year. I serve NFS and CIFS (via Samba) as well as run my web server on it.
The next step would be clustering, when Sun offers a free option for that (not holding breath)
The easy way to remember this is:
How many drives can you afford to lose?
RAID0: you can lose 0
RAID1: you can lose 1
RAID5: if you don't remember this one, you're hopelessly lost anyway, so sure... you can lose 5.
RAID6: RAID5 with an extra pairity drive.
RAID0+1: you've added RAID1 to RAID0.
RAID10: you've added RAID0 to RAID1.
Never trust an atom. They make up everything.
I can't believe I have to mention this AGAIN, but every time there's a discussion of home-RAID systems, 90% of /. jumps to the wrong conclusion.
Let me state something VERY VERY CLEARLY here:
RAID is not backup.
NAS is not backup.
SAN is not backup.
Snapshotting is not backup.
Backup is backup.
A "backup" means A COMPLETE COPIES OF FILES STORED OFFLINE.
RAID is a way of providing data availability and reliability. It doesn't provide backups. SAN and NAS are various frameworks for presenting the data in a storage system (generally RAID, but not necessarily) to an environment. It doesn't provide backups either. Backups consist of making COMPLETE COPIES (and yes that includes incrementals--ultimately, with a base copy plus incrementals, you have a complete copy) of files, STORED OFFLINE. Snapshots provide copies of files (and the smart snapshot systems do provide complete copies), but they're still online copies of the data. They will let you recover files to a point-in-time, but if your storage array goes T.U. for some horrible reason, you're still screwed.
RAID is fantastic for keeping your online data from being destroyed or taken offline due to hardware failures. SAN/NAS is great for making data available to a networked environment. However, if you want backups of your files, then back up your files--don't use RAID (and SAN/NAS on top of it) as a backup scheme, because it ain't.
"People who do stupid things with hazardous materials often die." -- Jim Davidson on alt.folklore.urban
I should have been clearer in my post. While the disk performance in normal operation may be comparable hardware RAID does have several key advantages. The first being that with anything other than RAID 0 or 1 the cpu hit from the RAID driver during heavy use will be high even on a high end machine.
No, it won't. Even a 500Mhz P3 has a RAID5 checksumming speed of ~1GB/sec. A current low-end CPU (eg: 1.6Ghz Pentium E2140) has a RAID5 checksumming speed of around 4GB/sec.
Suffice to say your average SATA array that's unlikely to even get much over 150MB/sec isn't going to put much load on any remotely modern CPU (at least not from the checksumming).
This is fine if you aren't using that machine for anything else but if it is a desktop machine or a server that is required to do anything else other than serve files then it does cause a problem. This is even more apparent if the array becomes degraded as it will take significantly more cpu time to perform all the parity calculations to rebuild the array.
I'm not sure why you think parity calculations when the disk is rebuilding are any different from parity calculations when the disk is being written to normally, but they're not.
The real hit you take from software RAID is to the bus bandwidth, not the CPU. Most amateurs compare a hardware RAID controller to software RAID on a dinky little 32bit/33Mhz PCI bus (and remember that those onboard SATA ports are probably hanging off a regular 32bit/33Mhz PCI bus), that's why they frequently conclude software RAID is slower ("especially during rebuilds"). When you have a system with ample bus bandwidth the situation is quite different.
If you do need to rebuild the array then a decent RAID card will handle it without putting a heavy load on the server and significantly without affecting disk perfomance.
This is impossible. There will always be a performance hit during a rebuild, no matter whether your RAID logic is running on the system CPU or the embedded CPU on a RAID controller. Further, that performance hit comes from the greater number of IOPS necessary while the array is rebuilding and has nothing to do with "parity calculations" (which even a 10+ year old commodity CPU can do faster than any normal (not to mention most abnormal) arrays could ever hope to be).
In a server that is in constant use this is a key point. Rebuilding a RAID 5 array in software often reduces the disk performance to very low levels, effectively denying access to data until the rebuild is complete.
The difference you are seeing is almost certainly because most hardware RAID controllers throttle rebuilds by default to be relatively slow, so "normal" disk access suffers as little as possible. Software RAID can do this as well - although most HOWTOs tell you to bump the rebuild speed up as high as possible, which is probably why you see the results you do. The downside, of course, that the longer rebuild means a bigger window where your array's performance - and more importantly, reliability - are degraded.