Current Recommendations For a Home File Server?
j.sanchez1 writes "The recent coverage of Shuttle's new KPC has gotten me thinking (again) about a small, low-cost headless file server for home. In the past, I have looked at the iPaq and considered using older computers I have lying around, but for various reasons I have never jumped in to do it. Do you guys have any suggestions on what to use for a home file server (hardware and software)? The server would be feeding files to Windows PCs and connected to the network through a Linksys WRT54GL running DD-WRT firmware."
There are a host of good options these days; what has the best bang for the home-user's buck?
did you really need to ask?
Cretin - a powerful and flexible CD reencoder
I went to newegg and just built the system from scratch. I got 5 SATAII 250GB disks (the sweet-spot at the time for price per MB) in a tower with a run-of-the-mill motherboard, CPU and RAM. I didn't go headless entirely from the gate, but once I installed Linux, I never connected the monitor again. Simple software raid is enough for my purposes, and I didn't bother mirroring the root disk (which I can always just replace and re-install).
The Linksys NSLU2 is a little slow & not very intuitive but I just replaced my home file server (Athlong 1.4Ghz, 512MB, yaddahaddah) with one of these. There is a big fanbase for this little device and 3rd party firmware.
Boy, do I have a site you need to check out! http://www.stayathomeserver.com/book.aspx
There's a story right after this on on the KPC which is $200. You could swap out the HDD for a half terabyte $100 cheapy from Microcenter or rebated somewhere. I believe the motherboard has gigabit ethernet. Although I can't say for sure. I think this is as cheap as you can go without a used/DIY idea and on top of that, it will take up hardly any space.
If you're concerned about heat around the HDD, I would simply suggest a DIY project that moves the HDD to its own enclosure with heat sinks and fans. But one of those would look cute underneath your router or even in your living room.
My work here is dung.
Drag that old PII out of the closet and install Linux and Samba on it, maybe upgrading the HDD a bit first. I also use my primary home server a firewall, caching DNS server, transparent web proxy (Squid), voice-over-ip/ultra-advanced answering machine (Asterisk), and for experimenting with various web projects.
Entrepreneur : (noun), French for "unemployed"
I've considered a Buffalo Linkstation with a custom Linux distro. http://buffalo.nas-central.org/index.php/Main_Page
Escher was the first MC and Giger invented the HR department.
Say what you like about Microsoft, but they appear to have finally made a decent product here. You can buy an OEM copy through Newegg for $169. Then slap it on any machine you like. It's got built in support for automatically backing up all of your files. If you have multiple HDD's in your server you can specify at the folder level which folders should be copied onto multiple drives (for redundancy should one of your HD's fail). It's also got nifty support for managing it from outside your home and streaming music, videos and photos to other machines inside / outside of your home. Take a look at it - http://www.microsoft.com/windows/products/winfamily/windowshomeserver/default.mspx
You are using English. Please learn the difference between loose and lose; they're, there, and their; your and you're.
Unless you are really hell bent on speed or aren't mirroring, avoid hardware raids. While hardware may be faster, if the raid controller blows up, you probably have to find the same one to replace it since there is no standard on how the data is written.
If you rebuild your system, reloading the same software for the raid should be cake.
I'm now using a QNAP TS-109 (http://www.qnap.com/pro_detail_feature.asp?p_id=79/) and love it. It's silent (no fans), low-power-consumption (about 14 watts max draw), has lots of built-in functionality managed through a web interface (including DLNA for media streaming to a PS3 or similar), and runs Linux...
1. linux+raid5+lvm but the only problem is with more hdd's the more power, then you'll need to upgrade the psu, etc. 2. another option is something like promise tech's smartstor 4300 (4xSATA drive NAS enclosure that supports RAID). 3. there's drobo which is a RAID usb drive which can take 4xSATA drives, but it doesn't have a network connection. 4. dedicated windows machine with file shares also, another consideration is noise & placement. For noise, pc's are more flexible.
For super simple.
Freenas.org offers will do the trick.
Want to get fancy? Openfiler.com will do anything you could want.
For hardware. Well if you have a spare case with a good power supply sitting around you could go with this. http://www.clubit.com/product_detail.cfm?itemno=A4842001
It will be low power and is pretty cheap. Just buy some DDR-2 ram and what hard drives you want and your good to go.
This board does have two slots free so you do have some expansion options for more drives or even a raid if you want.
If you don't want to build a system then you could get the $199 Walmart Linux PC which uses this motherboard. If you are going to put a lot of drives on it I would still upgrade the power supply.
You could also pick this up at geeks.com http://www.geeks.com/details.asp?invtid=TS-X2002RS
Or if you want just use what any old PC you have.
It all depends on what you want to do. There are some nice small NAS systems that you can just plug in as well.
See my blog http://ilovecookes.blogspot.com/ for light hearted technical information.
When I upgraded to a new gaming system my old one turned into my file server. The only reason I used that particular system is because of the motherboard and case though. I have 10 hard drives installed with just over 3TB total (well, not nearly 3TB after using RAID5 and formatting disks.) The system is running Ubuntu Feisty and has been running great for quite a while. It's sitting in my laundry room hooked up to an UPS so I pretty much don't have to touch it for anything. I know this isn't exactly a small, cheap, home server. But you don't have to use a high end motherboard or fill up the case with hard drives to achieve the same results.
I'd read Microsoft's Brainwashing Children's Book: Mommy, Where Do Servers Come From? on Reddit yesterday, saw this headline and counted on more witless conspiracy theories about M$ here. Instead, it's a reasonably useful topic for discussion! I'd think my DNS was screwed up and I'd come to the wrong site if Timothy hadn't oddly followed it up with a semi-dupe on the smae subject.
What I'm listening to now on Pandora...
I've had fantastic luck with Windows Home Server since about October of last year. I've got 1.5TB in it (three 500GB Western Digital HDDs) and it serves files via CIFS/SMB over gigabit ethernet. My three Windows PCs, my Leopard iMac, and my Xbox360 can all watch movies, play music, and look at pictures hosted on the server (and access non-multimedia files as well, of course). Further, the client backup/restore offered by WHS is awesome (though Windows-only). Nightly backups of my three PCs, with data de-duplication, and it keeps a few months' worth of data. Backups can be accessed from any client through Windows Explorer or through the WHS console.
The crown jewel, though, is full PC restores. I swapped the hard drive out on one of my PCs for a bigger one, and instead of re-installing Windows onto the new drive and then laboriously copying my user files back, I just restored its image from WHS onto the new hard drive. The fact that the new drive was a different size didn't affect the restore at all--I popped in the restore CD, hit the "GO" button, and about an hour later my PC was exactly as it was before, but with a bigger hard drive.
I have no complaints about WHS. It handles as much hard drive space as you can throw on it, it will automatically duplicate shared data to multiple physical drives to mitigate the loss caused by drive failure, it functions as a web-facing RDC gateway for your clients if you'd like, and you can access your shares from the Internet if you'd like. It's great.
I leave my "file server" always on at home, so I wanted to pick up something with low power. I went with the VIA CPU/Mobo/VGA combo from newegg for about $60 a couple years ago. The Via 2000+ C3 is basically like a P3 800MHz, but it's power consumption is ultra low (we're talking half the wattage of its celeron equivalent). I picked up a small form factor shuttle like case from Fry's with a built in PSU (200W I believe), 512MB of PC2100, and have two 250GB HDD's in there. The system is now running Fedora Core 7 (would have preferred Gentoo, but it's kinda pointless to use the binary version of that in my opinion).
While it's fairly weak compared to modern systems, it has more then enough power for serving files, so I have it set up as my web & email server as well. I also have a UPnP server running to share music/video's to my Xbox 360 & SlimServer for listening to my music collection remotely.
For a while I ran MythTV on it with a Hauppage 150 card, and it ran fine (could even transcode on the fly to watch live TV in horrible quality on my Motorola Q). I also picked up a battery backup from APC which I configured with nut for when we have rolling blackouts.
One thing I'd recommend doing is sticking with NFS for file sharing if you have a choice. All major platforms now support it (well I can't speak for Vista, but XP works so I presume it would as well). If you need to share to Windows XP, you need to download the (now free) Services for Unix 3.5 from MS to get their NFS client. I'm not a Mac person, but I know you can mount NFS on those out of the box (at least from the CLI). I use amd (Auto Mount Daemon) for my other Linux systems to auto mount. The performance of NFS blows Samba out of the water, I can stream Xvid on 802.11B with NFS with virtually no issues (can't do that with Samba).
I should probably note I'm a Unix sys admin at work, so I'm fairly competent in Linux, but with that said I think even a novice could set this all up (exceptions being the email server and MythTV) without too many headaches. I let yum take care of all my system updates and am quite happy with my investment in this system (under $350 total).
Sadly, PS/2 was yet another victim of USB, which doesn't care what you plug into it, the electrical slut.
It's hard to supply advice without knowing what your requirements are and what the "various reasons" were that prevented you from employing the old PCs you mention. However...
In my basement, I have an Athlon 800 MHz, with 256 MB of RAM that houses a DVD drive, plus 3 IDE hard drives. A 15GB for the OS and such, and a 500GB and 200GB that are made available on my home network via NFS and Samba. The 200 gig is a "public" drive for people in the house to use. The 500 gig was a media drive until I built a myth box over Christmas, now it's a backup drive. I'm not doing RAID or anything. The machine runs Slackware 11, and is connected to the network on a 100 Mbit LAN.
Performance is fine. The most taxing I got was when I played my ripped movies from the file server in the basement to my Mac up in the family room. No stuttering or any other issues unless I saturated the link (ie. it couldn't serve two movies at once).
If you've got old PCs around - I see no reason not to use them. Otherwise, I'd probably just use an inexpensive NAS unless you want more out of the machine. I got Grandpa Otter a NAS for Christmas as he wanted centralized file storage on his LAN, but is not a hobbyist, and didn't want to muck with PC innards.
Knowing your requirements would produce better suggestions for hardware and software...but for file serving a home LAN - I'm thinking old hardware and any Linux distro will be most economical and get the job done.
Running Windows^H^H^H^H^H^H^H OSX and Linux in the home. (I don't have time for Solitaire any more.)
I have one of these in my kitchen (long story) that has been happily chugging away without any downtime for about a year now.
These processors/computers are certainly now the highest-performance machines in the world, but they handle most home tasks wonderfully and consume almost no power when idle. For 24/7 operation this becomes very important. Also, most varieties of C7 can operate with passive cooling, meaning your power supply fan will be the only noise it generates.
If you can afford it (I put mine together with a gig of memory, 500gb disk, and DVD for about $350 a year ago), this is a better approach than "throw slackware on an old Pentium 3" because you can get the same or better performance without the ongoing electricity cost and loud operation.
"It is not advisable, James, to venture unsolicited opinions."
under-performing fileservers can kill you fps on HD go with the best available.
http://www.isilon.com/products/index.php
Sorry about the writing. Robot fingers, you know? Cliff Steele in DOOM PATROL #23
There are a number of NAS's out there with good file server features. Netgear's new servers sound interesting. Synology also has lots. They come with web server, file streamer. Some even have bittorrent and USB hub for print servers.
It's not ultracheap (~$500-$600 + HDD cost) but have low power usage compare to any full PCs
Well, from my own experience, I would recommend one of the Synology NAS systems. I'm using a DS207+ myself, and while it's probably not the cheapest option, the device is well build, running linux, there is a ssh package available from the manufacturer and it comes with preinstalled mysql+php support. It also supports smb+afp, iTunes Sharing and offers a bunch of other services...
The only downside at the moment is that the UDMA service is not compatible with my PS3, so no direct streaming right now.
http://www.buy.com/prod/iomega-320gb-home-network-nas-external-hard-drive/q/loc/101/205120567.html
Only 320gb but that was plenty for my needs. Low cost, easy as pie to setup, low power consumption, no hassles/headaches(and no MS tax).
Patriot - A fan of expanding government power and spending while not wanting to pay higher taxes.
I got an Infrant ReadyNAS NV , before the company was bought up by NetGear. It's pretty awesome, though not perfect. Real hot-swappable RAID, dynamic reconfiguration, and lots of other good management tools. Looks pretty sweet, fairly quiet. Using it as a print server has always been problematic, tho.
Also, they seem to have gone up in price *quite* a bit. This site says the no-disk one is $1049. I think mine was around $600. I got one with no disks, and found a good deal on two 500GB disks (which were on their approved h/w list) and still ended up under $1200, and that was two or three years ago. But mine didn't have gigabit ethernet. I guess that explains some of the cost increase.
I set mine up with 500GB of storage, mirrored, and two open bays. I started offloading pix and video and backing up everything else, and a couple years later have not yet had to fill the other bays. But I like knowing I can expand to 1.5TB in RAID5 when I need the space.
Light cup, beer drink, thin so chain, neck turtle fat, man I won't say it again
Seriously; cheap, runs out of the box, bare bones and as big as you want it to be. Usually runs some form or Unix and samba. Since it is bare bones it has a small vulnerability foot print.
putting the 'B' in LGBTQ+
I'm not a computer genius by any stretch and this setup can be done by anyone who knows how to use Google to learn stuff. But like I said, given that I'm no genius, maybe I'm just missing the gist here. I've never tried to stream anything over the network and maybe that requires more advanced software, I don't know. My XBOX 360 takes care of my media access as I have it pointed to all the places I have stuff stored and it works like a charm over my THX stereo and HDTV.
I'm testing SME Server v7.2. It's based on CentOS and configures as easy as a router or NAS box. File access is much faster than my NAS and plays nice with both Windows and Linux (Ubuntu anyway). YMMV
A friend just pointed me to this set-up and I'm fairly happy for home:
/Storage that the whole network can access.
DLINK DNS-323
Two SATA bays. Can slide in the drives w/o tools.
Print server (USB)
Can run in RAID0, RAID1, or JBOD (I chose RAID1).
web interface for config.
I bought two 512Gb WD drives which were on sale for $119 each.
Some peculiar behavior if you really want a secure system: passwords couldn't include non-alpha chars!? And it didn't allow spaces in the WORKGROUP name for the samba mount, which isn't an MS requirement.
But for home use where you're already considered secure and not so worried about multiple users, I find it great having one giant
The reviews on Amazon are love/hate, I think for the above reasons. Probably not be the best set-up for an office or in The Wild.
Random review here: http://www.techworld.com/storage/reviews/index.cfm?reviewid=469
I just got a Thecus N2100 NAS for our office, and it rocks. It runs linux, so you can do whatever you want with it if you know how, but even if you don't (like me), it is still really easy to use. It holds 2 HDDs and i've mirrored them for safety, set up all the computers in the office to connect to it (on 2 different wired networks... it has 2 network ports, and can even be modded for wireless), and even set up FTP access for when i'm at home. It also functions as a USB print server that has some quirks but should be great for normal use, acts as an iTunes sharing device (shows up in the itunes shared computers sections), supports UPnP, and pretty much anything else you can throw at it. It was $275 or so without drives, and i love it! Oh, and it's also super silent. -Taylor here's the URL: http://www.newegg.com/Product/Product.aspx?Item=N82E16822102012
Worldwide Military budgets: $2100 billion. Worldwide Space Exploration budgets: $38 billion. Really, world? Really?
Anything you can scavenge, with as much RAM as possible (for the system cache), running Linux without GUI and needless stuff (saved RAM goes for the system cache), and the best storage drive you can afford having the size you require. Of course, your priorities as far as storage goes should be:
1. RAM (make all of it fit in RAM; most expensive; ridiculously fast; will probably require a 64 bit machine). Hint: Google uses pulls the critical stuff off RAM, not hard drives.
2. Flash storage (excellent for concurrency; fragmentation and parallel operations don't degrade performance; lots of other advantages such as durability, power, noise, size, weight, can be turned off anytime, etc.).
3. Hard disk drive. Disregard the bus, the hard disk is usually slower anyways. Especially skip SCSI unless you have a very good reason for it; prefer SATA.
And there you go.
I was about to say 13256278887989457651018865901401704640, but it appears this number is private property.
The WRTSL has a USB port, and you can rig it with a samba server.
Somebody already mentioned the NSLU-2 with one of the non-Linksys firmwares. I had one and, until the lightening killed it, it worked really well and uses very little power. I'm now replacing my router (a WRT54GS) and the NSLU-2 with an ASUS WL-500gP. I haven't heard anything good about the stock ASUS firmware, but OpenWRT (and probably others) work well. The ASUS has two USB 2.0 ports for attaching storage (or other hardware) and you could even use a powered hub to add even more drives. I don't have it all set up yet, but it should work well as router and file server while remaining quiet, cool, and using little power.
Use ZFS if you don't want bit-rot.
Bad thing is you need to have a 64bit machine and 1Gb min (>= 2Gb recommended) to run it and most file servers are the underpowered machines we keep around when we buy a new machine.
These are three little things that I learned the hard way from my own home server experiences.
1. Ventilation - You don't want your hard drives getting hot and crispy. Hard drives tend to break more often when you leave them cooking themselves for a couple of months.
2. CPU - Software RAID (especially writing to RAID 5) is very CPU intensive. Ideally you'd have a hardware RAID controller, but they're too expensive. Your better off getting a decent CPU that can handle all of the RAID goodness and everything else the server does. I'd recommend either a dual core or hyper threading.
3. Logs - Make sure whatever setup you have emails you, beeps at you, or does something to let you know if one of your drives fails. A 4 disk RAID 5 is worthless if more than one drive fails. If you're really serious about keeping your data, don't limp on with a missing drive on your array.
how about a WRT350N with a USB drive?? there is a usb port on the router, and admin pages on the router to make shares and assign permissions (AFAIK, it won't integrate with LDAP). even act as an FTP server. lower power consumption than even a VIA.
http://www.linksys.com/servlet/Satellite?c=L_Product_C2&childpagename=US%2FLayout&cid=1162354643512&pagename=Linksys%2FCommon%2FVisitorWrapper&lid=4351239789B01
I would get a nforce 570 SLI / Ultra board with dual gig-e ports with teaming and tcp/ip off load.
http://www.newegg.com/Product/Product.aspx?Item=N82E16813138059
this costs less then the one you picked
http://www.newegg.com/Product/Product.aspx?Item=N82E16813130048
Also alot of the upcoming am2+ nforce board will have tcp/ip off load as well.
you still need a load end video card even a low end pci one will work + you have open pci-e slots for pci-e raid cards if you need one.
Look into the QNAP TS-109/Pro or 209/Pro...I have a TS-209 Pro and it works great!
Buy it without disks, and then start cheap. You can always buy another large set and swap them all out, as long as you select their special raid mode (basically like raid5). Likely you picked up a low-memory one as well (256MB up to 1GB expandable).
The Infrant rocks, and their support forum is awesome.
I finally have it streaming to my PS3, which is pretty cool.
It also supports almost every file share mechanism you want. (NFS, SMB, FTP, WWW, AFP).
My personal favorite feature is just plugging in my USB flash stick, which the Infrant takes an automatic backup of. Great for snapping a quick backup of data with zero-effort.
I've been doing this for quite a while. Put Ubuntu 6.06 and a 300GB HDD into a PII, 400 MHz desktop that's about 8 years old. It works beautifully!
I use sshfs to mount the server's harddrives on my local computer with full access to samba directories. Then I configured samba to provide a "publicShare" directory, readable and writeable by any computer. Another directory called "fileServe" which is read-only from any computer. I even set up apache on a separate folder and port-forwarding so it doubles as webserver as well.
Anytime I find anything interesting at all--videos, documents, images, software--I post them to my fileServe directory for everyone else to use. And they typically backup all their stuff and share things with each other on the publicShare since it's publicly-writable.
I've been running this setup flawlessly for 1.5 years. It's a lot better than paying $15-$30 to have the hardware recycled.
I know it's a little limiting because it only has 2 internal 3.5" drive bays, but I think the Shuttle SD11G5 could be a good choice. It is a mostly-quiet Intel Pentium-M driven solution with on-board graphics and an external power supply (sort of how a laptop operates.) Power supply is rated at 220 watts, but running pretty barebones, the draw is far less than that.
I run one with Mandriva on it and do some file sharing on my home network and use it as a print server.
--You will rephrase your request for me to go to hell. Goto statements are not acceptable programming constructs
With a SATA II PCI card and however large of a hard drive you'd like. Combine that with Damn Small Linux, booted from a USB pen drive and running from RAM (dsl toram), you're not going to find a faster, easier to use setup without spending more money than you really need to.
If you want to buy a new system for use with Damn Small Linux as file server, I would suggest building a system with a Celeron 400 series processor (Core 2 based, single processor core) as it will be more than enough to serve files with the benifit of it being very low power. Spend more on a large hard drive than anything else. Onboard video is all you need (heck, my $14,000 Proliant server has onboard video - and three redundant power supplies). Focus on what is important. A battery backup might be a good idea if you are in an unstable power grid area.
.. or 'miser' as other people put it, I hate to throw away working computers. Instead, I use them as file servers in the cellar (where i can't hear the fans whirring).
:P
Even the humble PII has better performance and more simultaneous connections than a NAS enclosure ( or at least the cheap NAS enclosures I have bought ) and lasts a lot longer too.
My formula for home fileserving : cram an old PC with whatever IDE drives you have to hand and run FreeNAS on it, it will be plenty fast enough for 100megabit lan (which is fast enough for me). Whenever a drive fails, throw it away and put in whatever other (usually much bigger) hard drive is kicking around. When the motherboard fails, rescue the disks and build them into another fileserver.
RAID? why bother? Build another fileserver and keep your copies on that.
But what about the noise? Mine are in the cellar, only the spiders and woodworm can hear them.
Ah, but what about the power consumption? Pah! The heat slightly warms the house, reducing the energy used by the (admittedly more efficient) heating system, and is utterly dwarfed by the power consumption of other crap in the house. Also, a headless PII box uses much less power than you might think. Measure it.
Anyhoo, _my_ fileservers cost nothing but electicity, hold over a Terabyte and have uptimes of several months, so there
They whose government reduces their essential liberties for temporary security, receive neither liberty nor security.
I am looking at this same question. I investigated using a WRT54G or similar device for network attached storage, but eventually concluded that I could buy equipment on Newegg and build a low-power, high speed server for cheap, using an old case. The expensive part will be buying a new, efficient and quiet power supply.
I am looking at a 65w dual core processor on a mobo with a GB LAN interface built in. Lots of cheap memory. If you stay off the power curve, you can get processors, motherboards, system memory, and disk memory for cheap. Sometimes, you can use left-over stuff. I have a 1Gb memory stick that came out of a MAC. It's only worth about $25, but it's plenty for a good OS like Linux.
I could use an old HP Pavilion mobo, but it's power supply is noisy and I'd have to buy a GB NIC.
I'd recommend browsing the 'net for a cheap, low power mobo/processor that's using relatively current technology like SATA, GB LAN, and supports dual core processors. You can outfit it with a single core processor to save $40 and pick up a peppy multicore processor in the future. An AMD AM2 board with SATA and GB LAN can be found for $50, 45w processor for $40, 512 memory for $10, 160GB HDD for $50, and scrounge a case and power supply. That's $150 for a headless server that can be upgraded as component prices drop.
Best regards.
Older systems have pci bus limits that make useing raid + network slow and they are limited in how much ram they use.
Build a system get a nforce 570 sli board with dual gig-e port with teaming and tcp/ip offload and amd x2 cpu. DDR2 is cheap now days You also need a low end video card.
You will need a good PSU if you want to run a lot of disks.
I, as you seem to imply about yourself, have several computers at home. I also had family that would bring a PC/laptop over occasionally. I also have a linux PC running Apache/Gallery/MySQL (it was in addition to the "server" I had for my Windows PC's). The linux PC is an old Blue and White G3 with a defective IDE controller (Apple sent out a bunch with a CMD chipset that had a defect, but it wasn't noticed until it was too late). I can use this machine for my file serving, but I want something a little more modern. I was looking at this for a while, but the reports I've read state the MySQL access is too slow for Gallery (though people *are* using it). I am also keeping an eye on that mainboard (it was either on digg, or here, or both) sold at ClubIT that is supposedly the same board as in that $199 PC at Wal*Mart. Of course, I like my Intel "Bad Axe 2" board I just picked up, and I could put a cheap Celeron in one (I like it's 8 SATA ports and the built in firewire, should I choose to use it). I'm sure I can find a similar AMD board and get an even cheaper Sempron to put in.. I'll have to sit down and make up my mind.
I told you all that, to tell you this: The reason I have the server on a separate machine is so that I don't have to leave any of my desktops on all the time (I do leave my "main" machine, which is a laptop, on all the time, but it's not always at my desk which would make accessing anything on its, or an external HDD, rather difficult). Once I put together a new server, it will take over the duties of the G3, and be a "storage dump".
I'm not the type of person that will go around and unplug every electric item in the house to cut down on every watt of power -- I don't care *that* much, but if the machine isn't doing something, it's generally off. Now, before you ask, no, I'm not going to do Folding@Home (or the varied others) on all my machines -- I don't need all my machines running 100% CPU, driving up my electric bill (I have enough problems with my waterbed -- I just discovered it's thermostat died and it was always on, full blast, all the time.. GAH!). So long as my electric bill stays reasonable, I'll continue with things as they are (save for purchasing a newer, better, water bed heater/thermostat).
I should know better than to type this stuff at work -- my mind is scattered everywhere. Hopefully this will at least give you more insight into the topic.
I'm not a computer genius by any stretch and this setup can be done by anyone who knows how to use Google to learn stuff. But like I said, given that I'm no genius, maybe I'm just missing the gist here. I've never tried to stream anything over the network and maybe that requires more advanced software, I don't know. My XBOX 360 takes care of my media access as I have it pointed to all the places I have stuff stored and it works like a charm over my THX stereo and HDTV.
bork bork bork!
A little program called "QueTek File Scavenger" is capable of retrieving files from a broken raid array, given access to the disks and the raid settings (mode (0,1,5,10), stripe size (0,5,10 only), plus parity ordering if raid 5). There are other programs available (e.g raid reconstructor) that can figure out the raid settings given access to the disks, in case you don't know and can't figure it out through trial and error.
I used both recently to retrieve data from a broken raid-5 array (dead SiI3114 controller). I retrieved all hundreds of gigabytes of data, over the course of a couple of days.
I've used file scavenger in the past to completely recover all files from a single ntfs drive that had been quick-formatted, and a raid-5 set where one disk was completely dead (it happily reconstructed the disk from the raid-5 parity info).
The raid-5 capable version is fairly expensive, but not as expensive as having a professional data recovery company recover the data.
For years I used old hardware an cobbled together bits to run my home file server. In the end I felt my time was worth more than the constant restarts due to kernel panics (I suspected the motherboard was going) and the constant forced fsck due to a dodgy hard drive.
I few years ago I finally bit the bullet and spent AUD 2K on an Asus TS-300 pedestal server and have never looked back. In Australia they come with a 3y advance replacement warranty but I'm sure that Asus would offer that in other parts of the world. I tweaked my setup a little hardware-wise but the base model is less expensive now at about $1700.
I installed Debian Etch, with software RAID, Apache, Postfix/Dovecot/Ilohamail, Samba, SSH and Jabber. I fine tuned it for about 2 weeks, and then left it alone. I never hear a peep out of that box and it runs everything I need flawlessly.
Industrial strength software on rock solid hardware means no downtime for me (and no more late nights troubleshooting failed hardware). I have sworn that I will never go back to using cobbled bits again unless I'm just playing with it.
"And then I visited Wikipedia
IMHO the most important aspects of a file server is uptime and network connectivity. my most recent home server has ftp, nfs, http, ssh, rsync, smb and afp running... on top of openbsd.
i chose the mini-itx because of the small form factor and low power usage, on-board network/video/sound, without totally sacrificing cpu power. since i use it purely for file storage and retrieval, nothing else, so an 800mhz cpu is fast enough.
YMMV, but i've run a home fileserver in one form or another for the last 10 years, and i've had better reliability and uptime in the last 6 years with openbsd than any distro of linux(or qnx, solaris, or mac os). i attribute the stability mainly to the source code audits that are performed to discover security bugs. in the course of eliminating security bugs, the secondary effect is more stable builds.
three can keep a secret, if two are dead - benjamin franklin
I can strongly recommend using SME Server from http://www.contribs.org/ - It is fast, stable & secure and works well with almost any hardware, especially older machines. I have been using it in its various incantations for about 7 years and it is really great. It is a snap to set up and has full RAID support, automatically setting up various RAID configurations, depending on how many disks you install. Give it a try, you won't be disappointed. It will also double as a web and email server and has great community support. Best of all - its totally free - currently based on CentOs
An old PC full of hard drives looks cheap, but it will cost you in watts. An old PC server can easily pull 250-400 watts continuously. And don't forget this summer, when you will have to pay twice for the waste heat.
A better solution is a VIA PC1 board, plus a couple of new drives.
The "$60 PC 1" will only pull 20 watts at max. Combine this with 2 "$250 terabyte drives" mirrored, and a small low wattage "$35 case" and the "(Free) Linux" of your choice,
You will have a reliable Terabyte server for less than $700, that only pulls as much power as a small appliance bulb.
F X=0:1:9999 F D=2:1 Q:((X>2)&(X#D=0)!((D>X/2)&(X'=1))) I D>(X/2) W:$X>75 ! W X,?$X+5-$l(X) Q
If you don't mind the old hardware, you can usually find an old used Xbox for about $50 at a used game shop. Versions of 007, Mech Assault, or Splinter Cell are usually required to softmod the box, and you can pick those up on ebay for nearly nothing.
The Gospel according to lolcat
Actually, as long as you need heat in your house, how can efficiency possibly be an issue? Isn't all of the lost power simply converted into heat, which is something you need anyway? 100% of the energy is being used for something you want. Based on this thinking, in the winter-time I've stopped harping on the kids to turn off the lights when they leave the room.
If you run your own mail server, this is a critical service that you will want to be able to update infrequently and independently of any "hacking" that you might do on the other user domains.
A home server's most demanding function is serving up files over the network. Performance over 100T is more than adequate for the vast majority of cases. gigE is nice if you're moving video files around a lot but isn't necessary for streaming.
My NSLU2 is running Debian Etch, serving music to Roku Soundbridges and iTunes clients 24x7 with Firefly Media Server / mt-daapd. I administer it via ssh (passwordless with keyed access), and since it's on 24x7, I'm thinking about implementing local (in the house) DNS ('cause I'm tired of dicking around with hosts files on six machines).
When it spins down the Maxtor One Touch, it's using 2 watts. When it's running full out, disk and Slug are using 6 watts. I have the whole thing on a closet shelf next to my wireless router and gigabit switch.
I sometimes think that my much bigger dual-core AMD server could break in a way that could burn down the house if I leave it on unattended. No such worries with the Slug.
It's not a fast machine, but really handy, doesn't guilt me over leaving it on all the time, and if I needed an always-on file server, I'd take the Slug purely on power management grounds.
It'll be a little slow with file transfers, but scores very high marks on its compact size, silent operation and pretty-green power use.
I've had an ancient PC running home server stuff for years. For the operating system, it's SME Server, http://www.smeserver.org/. A Linux distro that does email (and webmail), SMB for file and print, firewall and DNS cache, web and ftp if you're into that.
I think the current machine is a Pentium 166 MMX with 128MB of RAM, the hard drive is too small to hold media, but that could be easily fixed. When routers became cheap, I stopped using it as a firewall and NAT.
That said, I'm planning to replace the box soon and start using a TV Tuner to record some TV shows for the network. The plan is to run the PVR software on Windows, and run the SME Server in a VMWare virtual machine. I might move email to a separate VMWare machine running Scalix - better Outlook support and better webmail.
I'm confident that it'll be fast enough on the cheapest dual-core machine I can find, undervolted if possible.
Airport Extreme router: $179
LaCie 1TB BigDisk Extreme: $369.95
Boom, file server for under $600.
The extreme shares files from the drive over SMB and AFP simultaneously and can allow WAN access. Passworded or open access.
Article X: The powers not delegated... by the Constitution...are reserved...to the people
Efficiency in heating matters when you are comparing apples and oranges.
For me, it is cheaper to heat a house using a gas powered heater than a load of PCs, although gas boilers won't run DOOM lan games while they are heating.
They whose government reduces their essential liberties for temporary security, receive neither liberty nor security.
My current one is a 150Mhz. I will be upgrading in a few months though. I'm thinking of a refurbished laptop for low power.
No, but yes but no.
I used to have a rack-mount AMD server running Fedora but it was way too noisy and I wasn't doing anything useful with it. When the Intel Mac Minis came out I scored a PowerPC model for £199 from my local PCWorld, and finally managed to repurpose it over Christmas by installing Debian 4 (about the only Linux that is distributed and supported for PowerPC at the moment). I added a 250Gb external Seagate drive for my music and video, built Firefly media server for music (supports daapd for iTunes), and VLC for video, added netatalk and avahi for OS X support (most of my machines are Macs) and I will be adding authentication, DHCP and DNS caching when I next have time. Next capital job is to set up a power over ethernet network and to get a Neuros OSD to serve video, as video isn't quite up to it. Moreover, it's completely silent and only uses about 85 watts against the average PC's 350 or so. A PowerPC MacMini can be had from eBay for £150 - £200.
On that same note I've decided to stop telling my kids not to eat so much candy. After all, as long as they need to eat something, how can it matter what they eat?
You are already running dd-wrt on your router... Get a NAS that will be low power storage. Then smb mount your nas from your dd-wrt router to run any linux stuff you need on it. Then you can ssh into your router from the internet and still have access to linux and all your storage. Granted, your "linux" box will be a 200Mhz (or so) machine, but for a low power solution it may be enough. And there are plenty of extras that you can install on dd-wrt...
All those people who bought base-configured Asus Eee PCs have so little money invested that I would expect quite a number to upgrade when the larger-screen version comes out. So what will happen to those old machines? I love my Eee but I can't help thinking that by the end of the year, I'll have a different one and this one will be sitting somewhere with an ethernet cable connecting it to my network and 3 USB-connected hard drives hanging off the sides. Sure, performance through the USB connections means that network file access will be slow, but for archiving away media files or other simple home user tasks, it's enough for me.
I'm betting that by next fall, Ebay will have a bunch of base-level Eees for cheap. When that happens, people are going to find all sorts of ingenious ways to repurpose them. A home file server is just one.
I bought their SX8300 with big dreams for a 2.5 Tbytes file server. Now I'm stuck with a 2.6.11 kernel because they have not updated their drivers for 3 years. I've sent emails asking them to please help me get the module compiled for a newer kernel- they just ignore me.
My girlfriend works on the computer at home so the machine is always on. We also do run BOINC projects on our machines. I guess there's a better way to setup a network file server than to just map a drive on a networked machine, but isn't that the essence of a file server anyway? It works fine for me anyway.
Thanks for all the responses! I learned a lot and also heard some things I never thought of.
Based on these comments, I decided to go with this.
Speedy thing goes in; speedy thing comes out.
The cheapest way I can think of was exactly what I did:
Cheap PC case with plenty of drive slots and FreeNAS (www.freenas.org) Been working great!
Sabre
Comment removed based on user account deletion
CPU - Software RAID (especially writing to RAID 5) is very CPU intensive.
What in the world? Do you know what CPU function is being used for RAID 5? XOR. It's not CPU intensive at all. It's four NAND gates for goodness' sakes. For most uses, unless you have dedicated storage appliances, like a Clariion or DMX array from EMC, software RAID should be used. If your RAID card fries, you can't be certain that you will be able to replace it with an identical model. You can always load the right version of Linux or BSD to recover a software RAID.
"Nature doesn't care how smart you are. You can still be wrong." - Richard Feynman
"boszgor"? Would you elaborate on that, "büdös oláh"?
Just to throw in one more home fileserver config for the sake of information.. My server is an old thunderbird core Athlon machine running at 1.33 GHz / 1 Gb RAM / Abit KT7-A RAID mainboard. I am not using the onboard RAID chip. Right now, I have Fedora core 4 on a 40 Gb drive and a 120 Gb drive for storage. I run a web server and print server (Shared printer on this box is usable to any other computer on my network). I've got a bunch of shared folders on the 120Gb drive shared via samba for my windows machines (Movies/Music/Documents/etc..). There is no keyboard, mouse or monitor on it.. just a network cable and power cord. I can open terminals on the windows machines using X-Win32 (or some other equivalent product). On top of all that, I also use Octave and Sage on this linux machine and there is no degradation in performance. This arrangement has served me well for the past three years. I am considering implementing RAID 5 on this machine just to support possible gigabit ethernet and fast file transfers when I get a home theatre PC in the near future (and to ad some redundancy). The OS will remain on a separate 40 Gb drive though. RAID 5 will be for storage only. This thing just sits in my closet and hums away.. God I love linux.
Steve Jobs is going to announce the Time Capsule at the MacWorld Expo, which might be exactly what you're looking for.