Slashdot Mirror


A Storage Solution for Lots of Digital Photos?

Duizendstra asks: "I've been asked to explore the digital storage possibilities for a professional photographer. One of the characteristics is the rapid growth of the amount, and size of pictures. At the moment, one photo session produces about 2 GB of raw data. He has an Apple - Power Mac G5, and he currently uses DVD as his storage medium. However, he has lost quite a few photos because of DVDs that can't be read anymore. I would like to know if any Slashdot readers have any experience in creating a solution for such a problem? Any help/idea(s) would be greatly appreciated!"

122 comments

  1. Extra Disk by PunkOfLinux · · Score: 1

    Get an extra hard drive and use it. Hard drives take a lot to kill... at least for me they do. ANyway, do something like that. SHould work. Eventually you'll run out of room, but you can always swap out/add another one

    1. Re:Extra Disk by HughsOnFirst · · Score: 2, Interesting

      I'm a photographer and I'm looking at over a terabyte of external firewire drives piled up on my desk and spindles of DVDs backing them up. Right now the options for reliable long term reasonably prices storage pretty much suck if you generate around six gig of files a day. Lots of hard drives is fine as far as price goes, but they aren't an answer for long term storage. If anyone has an idea for storage in the 30 year range, I'd like to hear about it. My experience with tape back in the DC250 days was pretty dismal, and I don't ever see any tape systems touted for long term storage, but I'd love a recommendation for a system that I could trust for more than 10 years. I assume that a product to address this market will show eventually but I'd like to have something now

      For what it's worth I'm looking forward to these when they come out.
      http://www.maxell-usa.com/Content/Pages/Page.asp?S ection=pressreleases&department=maxellusa_pr&Line= datapr&Open=datapr41
      or these
      http://techon.nikkeibp.co.jp/english/NEWS_EN/20050 608/105586/?ST=english

    2. Re:Extra Disk by ag0ny · · Score: 1

      ...but I'd love a recommendation for a system that I could trust for more than 10 years.

      Magneto-optical disks. Usually they should keep your data for around 50 years. They're very reliable, but have two cons:

      - They're expensive (around $17 for a 2.3GB disk)
      - You'll need 3 disks/day if you generated 6GB of data daily, so after a few weeks you'll need lots of space to store them.

    3. Re:Extra Disk by ccmay · · Score: 0
      Magneto-optical disks. Usually they should keep your data for around 50 years.

      The MO backups from the Sun workstations where I work have been found, through bitter experience, to have about a 5% failure rate.

      They suck shit.

      Hard disks and more hard disks are the way to go.

      -ccm

      --
      Too much Law; not enough Order.
    4. Re:Extra Disk by PunkOfLinux · · Score: 1

      SInce when does 5% failure rate (which is higher than most DVDs) 'suck shit'?

    5. Re:Extra Disk by bleaknik · · Score: 1

      If your wedding pictures were lost in that magic 5% wouldn't they suck shit?

      --
      Deja Vu
      n. 1. The sensation that you've read this very article before.
    6. Re:Extra Disk by Jeff+DeMaagd · · Score: 1

      I too think external hard drives are the way to go. Frankly, I haven't had a hard drive fail on me in the last decade, so I think it's unlikely that the computer's hard drive and the drive that stores the backup will go at the same time or in a succession that's too quick to get replacements before the remaining drive goes. If you are that afraid, get a second backup drive. If your data really is valuable, I bet that the extra hard drives are cheaper than replacing the data. At any rate, the external should be disconnected from power and data cables, placed some place else that is safe.

      I used to be gung-ho about CD and DVD backups, but frankly, the capacity just can't keep up. With an external hard drive, I can start back up the entire hard drive and walk away or do other things with the computer in the mean time.

    7. Re:Extra Disk by Johnny+Mnemonic · · Score: 1

      Lots of hard drives is fine as far as price goes, but they aren't an answer for long term storage. If anyone has an idea for storage in the 30 year range, I'd like to hear about it.

      No one does, because, frankly, digital photography hasn't been around that long--so there are no solutions that were around in the 70s, that are now still working, to demonstrate that they are reliable over that kind of time period.

      I think stacks of hard drives would suck, and could still fail on the shelf. I, like others above me, think you'd be best served by a RAID solution (not homebrew, but branded--I like Apple's and recommend if you currenlty use Apple gear, it'll hook right up to your G5 w/o need for a server). That'll protect your data for now, and be much more reliable than a stack of HDs--when one drive fails in a raid, you can replace it before all of the data on that drive is lost. Offload to tape for offsite storage or to "archive" your data and preserve the more recent photosets for instant recovery.

      Will a RAID that you purchase today last for 30 years, provided you swap components as they fail? Nobody knows, since they haven't done it before. Even if you purchase a box from Dell or Apple, long as they've been around, they may not even be in business in 30 years to provide you with spare parts.

      But with a hard drive based RAID, you can at least make a prettty painless transfer to the new solution that comes out every 5-7 years, or as finances and need permits.

      --

      --
      $tar -xvf .sig.tar
    8. Re:Extra Disk by HughsOnFirst · · Score: 1

      You (plural) don't understand. I and MANY others are looking for a reliable long term OFF LINE storage. Hard disks probably are fine if you are only talking about the platters and not the moter/bearings/heads/electronics not to mention the interface to the computer.

      Raid sounds good, but is there a standard for the controlers? Software to split the data across several drives in a similar fasion to raid 5 might work but I'd only be interested in it if it was open source in a language that was likely to be around for a while (Perl ?)

      I have some paper tape from 1972 that is probably readable if I could find a teletype 44 but I'm pretty sure that all of my magnetic media from the 1970s is lost.

      I've always subscribed to the practice of storing lots of copies of my work lots of places, but with photography it's pretty unwieldy.

    9. Re:Extra Disk by Blkdeath · · Score: 1
      Raid sounds good, but is there a standard for the controlers? Software to split the data across several drives in a similar fasion to raid 5 might work but I'd only be interested in it if it was open source in a language that was likely to be around for a while (Perl ?)

      Yes, there is a well established standard for the controllers. RAID is an enterprise-level technology that has been around for atleast a decade and is the storage medium preference for corporations that literally can't afford data loss and/or downtime.

      If long-term data storage is a priority for you (plural); something you similarly can't afford to go awry I would heartily reccomend you find an enterprise-level RAID storage solution. Max out its capacity with the largest disks available to-date and upgrade it in a few years as your needs progress.

      First thing that comes to mind is the Dell PowerVault line of storage solutions. Their PowerVault 775N Storage Server, for example, has a capacity of 40TB. You could also look at a PowerVault tape library which can store dozens of multi-GB tapes.

      If you wanted to expand on your mission critical storage solution you can look at a small/medium storage area network (SAN) which can be expanded nearly exponentially. Essentially what that will comprise of is a grouping of RAID devices on a high speed backbone. The largest SAN I've had the pleasure of working with was in the neighborhood of 1 Petabyte and only took up 3-4 six foot equipment racks. At a mere 6GB/day of additional data, it would take a very long time to fill an array of that size (the array was being used to store in excess of 50-100GB/day). The benefeits of a SAN is its pure flexibility. Need more storage? Add more disks. More still? More units. More racks. You could expand to fill a basketball court if you really needed to. If a drive fails the system will notify you by a variety of means including an on-screen notification, e-mail, pager/SMS transmission, audible/visual alarm, ... Replace the drive and the system syncs the data automatically.

      For a solution to meet your needs you can investigate Dell, HP, Intel, Sun, or any number of other smaller organizations depending on your propensity to take risks.

      If you're not interested in outlaying the cash for such a solution all on your own you can look at data storage warehouses and pay a monthly/annual fee. This can benefeit you in that you can increase your capacity as required and only pay for what you need at any given time. In short, make it somebody elses problem to maintain the freshness of your backups.

      As far as offline storage goes, you're taking a risk either way. You can use tapes, but yes, they fail. As do DVD-Rs, CDs, magneto-optical, etc. To gain maximum long-term effectiveness you need a well regulated room to store the media to maintain humidity, temperature and light penetration. By the time you're done equipping such a location and filling it with media you'll have spent the money that could have gone into a reliable online storage solution which puts the data at your fingertips at any given moment.

      As with anything else in life you get what you pay for. If you go to Future Shop / Best Buy / Circuit City and pick up Firewire hard drives, sure, you won't spend much but in return you get a cluttered desk and several possible points of failure with little to no recourse. If you want reliable storage, I'm afraid you're going to have to pay accordingly.

      --
      BD Phone Home!

      Shameless plug. Like you weren't expecting it.

    10. Re:Extra Disk by Nutria · · Score: 2, Informative

      I don't ever see any tape systems touted for long term storage, but I'd love a recommendation for a system that I could trust for more than 10 years.

      SuperDLT. It's what we use for SARBOX data retention compliance.

      Unfortunately, that's "enterprise" tech, which means Big Bucks.

      --
      "I don't know, therefore Aliens" Wafflebox1
    11. Re:Extra Disk by Glonoinha · · Score: 1

      I have some paper tape from 1972 that is probably readable

      And that, sadly enough, is your best solution.

      A few years ago I was brought in as a technical consultant for a city records office that wanted to modernize their records : a fireproof building full of flat metal storage racks full of deeds, records, and drawings (think civil engineering dating all the way back to the 1600's.) They needed to insure that whatever direction they went in modernizing the office would be viable not 5, 10, or even 50 years down the road ... but 300~500 years from now.

      I recommended that they stick to paper. They agreed.

      The only suitable alternative is to go with near line storage that you migrate to popular formats every few years. Tapes get sticky, but you migrated your data from tape to CD long before that (good thing, because you can't get that kind of tape drive any more.) CD-R disks have their aluminum substrate oxidize over a few years, but luckily you migrated your data to high quality DVD-R media long before that happened. Personally I recommend moving everything off of DVD-R onto an external USB high capacity hard drive, making two copies using two different units. A few years from now, move it off those onto something more current, whatever that may be.

      Ten years from now maybe you can read it, maybe you can't - but your prints (on acid-free stock) will still be around.

      --
      Glonoinha the MebiByte Slayer
    12. Re:Extra Disk by tonsofpcs · · Score: 2, Informative

      Film. No, seriously, there are labs that will project your digital files onto slide film. Usually you can find them if you look for presentation preperation companies. They usually advertise this service for converting computerized (read: PowerPoint) presentations to slides for showing in venues that do not have video or (SX-/X-/S-)VGA projectors. Good film has proven that it lasts for a long time. Go check your 30 and 40 year old slides.

    13. Re:Extra Disk by WhyCause · · Score: 2, Informative
      I and MANY others are looking for a reliable long term OFF LINE storage.

      Well, (and this is me just talking out of my ass here), you could maybe invest in a film recorder (we called it the slide-shooter). Think of it as a digital projector that projects onto film for later development. We used to use one in my lab to tranfer presentations from PowerPoint to slides (for scientific conference presentations), but I imagine that, as a last resort backup solution, it might work well for photos. The slides are definitely off-line, and I presume could be used to recover the photos in the event that all else fails.

      The backup scenario I imagine would be:

      • Back up photos to RAID array
      • Shoot photos onto slide film
      • Develop slides and store them WAY off-site
      • In the event of catastrophic data-loss, you use the slides to obtain all the hard-copies you need (direct development from slides or scan back into the computer)

      Now I imagine that this is not an ideal solution, but it does provide you with the 30-plus year proven backup (we've all seen 30-year-old slide shows). The downsides are that shooting the slides is a time-intensive process, and it adds in the overhead of purchasing and developing the film. I also imagine that you lose some quality going from digital to slide and back, but, you do have the photos in the event of hard-disk failure, and slides are fairly condition-tolerant and physicially small as a backup. Just make sure you don't drop the box.

    14. Re:Extra Disk by Anonymous Coward · · Score: 0

      Well, if the 5% is higher than for DVD, it would suck shit. Moron.

    15. Re:Extra Disk by stunt_penguin · · Score: 1

      You do have a very good point there. With your own machine, the cost per image mightn't be too bad, and film is a medium that is guaranteed to be something we can read in 30 years time. Will JPEG files still be around then? Possibly, but not likely.

      --
      When the posters fear their moderators, there is tyranny; when the moderators fears the posters, there is liberty.
    16. Re:Extra Disk by budgenator · · Score: 1

      30 year range sure a couple of Ideas
      1 best, home-made platinum prints, gives the best combination of storage volume and longevity
      2. staying digital, tape system as in punched mylar longest data retention, but storage volume has major suckage factor

      what I would do is massive RAID 50 array in the back for long term archial storage in the back room, something not as massive and faster up front for recent work that you might actually need to get to; only fire up the back-room arrary if you need something.

      I know that's not what you want to hear, but its too early to consider digital for anything than needs archival quality.

      --
      Apocalypse Cancelled, Sorry, No Ticket Refunds
  2. Reiser4 with compression by rnd() · · Score: 1

    I'd consider setting up a file share (nfs, samba, etc.) that is on a machine with plenty of storage space. ReiserFS 4 offers a compression module that would be perfect for this. It would make sense to set the FS to compress heavily, since transfer speed is less critical. Your friend could probably get about 6:1 compression I'd guess, which with 400 GB of storage in an LVM array would hold over 1200 photo sessions. This should be enough to last him a few years. In all liklihood in 3 years he'll be able to buy a 1 TB drive for under $300, which he could add to the storage array quite easily.

    Add in some software raid for automatic redundancy and you have a fast, cheap, high compression solution that is scalable into the foreseeable future.

    --

    Amazing magic tricks

    1. Re:Reiser4 with compression by swillden · · Score: 4, Insightful

      Your friend could probably get about 6:1 compression I'd guess

      I *highly* doubt that. It's unlikely he'd get any significant compression, and very possible that compressing the files would actually increase their size.

      We're talking about photos here, which are already compressed. Even RAW photos are compressed heavily (though losslessly). For example, a Canon EOS-1Ds Mk II takes RAW photos at a resolution of 4992 x 3328 with 36 bit per pixel. An uncompressed image would be 4992 x 3328 x 36 / 8 bytes, which is about 71MiB. The image files produced by the camera, however, are 14.6MiB, a compression ratio of nearly 5:1. The file system compression isn't going to get much more. On RAW files from my camera, bzip2 -9 only averages about 0.1% reduction in file size, and bzip2 -9 is very good -- and very slow -- compression.

      Disk drives are the best way to safely store large volumes of data, especially when you add some redundancy, but don't expect to get any help from compression of already-compressed data.

      --
      Note to ACs: I usually delete AC replies without reading them. If you want to talk to me, log in.
    2. Re:Reiser4 with compression by mgscheue · · Score: 1

      That's not quite correct. Remember that RAW files contain the sensor Bayer pattern data, not actual pixels. The conversion to pixels happens during the demosaicing process which, in the case of RAW files, happens later on in your computer, not in the camera. In the case of the 1Ds MkII, the camera has 4992 x 3328, each of which is 16 bits (actually 12, but I think the files are stored are written as two bytes/photosite), so that's about 33 MB.

      Nikon DLSRs give you the choice of storing RAW files as either compressed or uncompressed; I'm not familiar with Canons. I agree that compressing already compressed files won't gain you anything and will probably make things worse.

  3. Best bet... by tenverras · · Score: 3, Informative

    Would be to buy a few external hard drives. With the storage capacity of hard drives these days you can't go wrong. I bought an enclosure for one of my internal drives and now I don't know how I could live without it. Having a portable drive like this is an amazing convience, especially with a capacity of 160GB.

    1. Re:Best bet... by Mooga · · Score: 1

      External HDs are the way to go.
      Plus, I know that the apple shop sells a 1 TB External if needed.
      Idealy you keep the pictures you are working with localy and back up to the external. They are very easy to use, even for those who aren't up to par with technology.

      --
      ~ Mooga
    2. Re:Best bet... by jrockway · · Score: 2, Insightful

      No! These LaCie drives are a bad idea. They put multiple disks in one enclosure, but they're not RAIDed. That means if one disk fails, your entire life's work is gone!

      I would store these photos on a dedicated server that has good RAID. I don't think full tape backups are an option, but remember that RAID will handle a single drive failure -- not you accidentally typing rm -rf * . Maybe there's some service that will mirror your important data off site somewhere. That's probably expensive, but if this data is what puts food on your table, it may be worth it.

      --
      My other car is first.
    3. Re:Best bet... by dtfinch · · Score: 1

      I've noticed that most companies specializing in offsite backups charge 5-10x what it'd cost (apart from one-time labor) to set it up yourself, and do it right.

  4. get a big ol' disk by Anonymous Coward · · Score: 0

    Like one of these. I have a non-RAID LaCie and it's nice and fast, and you can physically move it around since it has it's own case and works over firewire.

    I don't have RAID because I back it up to another computer once a week (a Linux box with massive RAID.. I do the backup with rsync patched to send resource forks correctly). I'm not a pro photographer so I can stand to lose a week's worth in the worst case. Your friend needs a backup strategy (maybe just buy a second drive and sync them up once a week or night.. there are several strategies here). You want both a backup for reliability (RAID takes care of that), and a backup for those occasional "OH SHIT I JUST DELETED THE ENTIRE SHOOT" moments (doing a regular backup to another disk will take care of that).

    You can also get various utilities to manage the photos, while we're on the subject.

    I definitely don't use DVDs or anything like that, I consider them very ephemeral. I just make sure my important files are in multiple places, and I buy new hard drives every couple of years and copy everything over.

  5. perhaps the problem is with the DVDs? by ubiquitin · · Score: 2, Insightful

    One approach is to burn three copies and then you can recover the data by averaging the signal between them. This requires multiple drives but it is better than having to give up on archived data. Manufacturers suggest: "Store your recordable DVDs vertically, protected from sunlight, in a room that avoids wide variability in temperature and humidity."

    --
    http://tinyurl.com/4ny52
    1. Re:perhaps the problem is with the DVDs? by toddbu · · Score: 2, Insightful

      I hear stories about people not being able to read CDs/DVDs that they've burned, but I have to wonder what they're doing wrong. Whenever I burn, I verify the media to ensure that what I burned actually matches what was on the drive. I've had some problems with crappy drives (I'll never buy another NEC burner again) and some bad media (which I immediately destroy), but once I've verified them then I never have any problems reading them. I always burn 2 copies - one for the safe at home (for fire protection) and another for the safe deposit box at the bank. Should my home burn to the ground and the fire protection fail, I still have another copy. I've automated everything, so it takes me about 1 minute a day to back everything up, plus a trip once a month to the bank to get everything off-site.

      --
      If you don't want crime to pay, let the government run it.
    2. Re:perhaps the problem is with the DVDs? by Calmiche · · Score: 4, Interesting

      My problem is that I'm finally starting to see decaying CD's. I've got some backup CD's from 1998 or 1999. (I can't access the media anymore to check dates, but somewhere in there.) I put them in the other day to look for some old data and they wouldn't read. When I pulled them out of the drive, the silver media was peeling away from the disk. I've run across about 6 of my backup cd's so far this year that are doing the same thing.

      No, I think a good harddrive array is going to be your best bet. Get several harddrives and mirror the data. The cost of gigabytes is dropping on a daily basis. You should find that when you need more room, it will be easly upgradable and cheaper as the years go on.

    3. Re:perhaps the problem is with the DVDs? by 00110011 · · Score: 2, Interesting

      Even verifying CDs after burning isn't enough. I've had one batch of CDs that I burned stuff onto and verified that the sha1sums of the files I had burned on them matched. ONE week later the CDs became unreadable (I got a whole lot of I/O errors trying to even read the CDs). These CDs weren't even in the sun or hot car or anything. And these CDs weren't scratched and didn't have a spec of dust on them that I could see. They were in a cool desk drawer and untouched for that week and lost their data in a single week.

    4. Re:perhaps the problem is with the DVDs? by eraserewind · · Score: 1

      This won't necessarily work for you, but I've sometimes found that if some files can't be read from the CD-R media itself, that making an ISO of it on your hard drive, and mounting that using Daemon tools or something allows the individual files to be read correctly. I have recovered data from 2 old CD-Rs this way.

    5. Re:perhaps the problem is with the DVDs? by Mr.+Shiny+And+New · · Score: 2, Insightful

      I just wanted to mention that a fire-proof safe isn't necessarily going to protect your CDs from a fire. The operating principle of most fire-proof safes is that the safe is vacuum-tight and very thick. So there's no way for the stuff inside to catch fire, however it does get hot, so hot that, if you open the safe while it's hot, the contents will burst into flame. So if it gets that hot, you may find your CDs melted, or at least damaged, even if they don't exactly burn. Your paper documents should be fine though.

    6. Re:perhaps the problem is with the DVDs? by toddbu · · Score: 1

      Yeah, I realized when I bought it that it wasn't going to be perfect. The idea is to get maybe 75% of the way there, and if I really truly lose the media then I'll revert to the safe box at the bank. The same can happen at the bank too - a fire so hot that most stuff melts. Thankfully media can be replicated easily and kept in two places.

      --
      If you don't want crime to pay, let the government run it.
    7. Re:perhaps the problem is with the DVDs? by mmontour · · Score: 1

      Whenever I burn, I verify the media to ensure that what I burned actually matches what was on the drive.

      One problem with that is that CDs and DVDs use error-correcting codes. Unless you know how many errors have been corrected by the drive, you can't tell the difference between a perfect disc and one which is just below the threshold of having uncorrectable errors.

    8. Re:perhaps the problem is with the DVDs? by donutz · · Score: 1

      Your paper documents should be fine though.

      Well, that is unless the temperature inside the safe climbed so high as to make the CDs melt to the paper documents.

  6. Serious OS X user? by presearch · · Score: 3, Informative

    He should get an Xserve RAID, of course.
    It'll just work, it's well integrated with his G5, and it's cost effective.

    1. Re:Serious OS X user? by presearch · · Score: 1

      ...and Aperture for image management.

    2. Re:Serious OS X user? by karnal · · Score: 3, Insightful

      One last time.

      Say it with me.

      "RAID is not a backup solution."

      Again,

      "RAID is not a backup solution."

      That being said, RAID helps to overcome failure of the drive. Do yearly or bi-yearly DVD backups, or back up to another offline harddrive... etc..

      --
      Karnal
    3. Re:Serious OS X user? by Unholy_Kingfish · · Score: 3, Insightful
      RAID isn't a COMPLETE solution, but it is a start.

      There should be two levels of file storage, a live copy, and a long term copy. EACH of these needs a backup. Once you need more room on the "live" server, you move it to long term storage. you want to keep as much "live" as possible to go back to.

      Live Copy - I would get a RAID system with as much storage as you can afford or need. If price is no option, then you get a few XServes since they are on OSX. This is where you keep your files from today on backwards till the RAID is filled. You keep a backup of this RAID by tape, HD, optical whatever.

      Long Term Copy - There are problems with EVERY type of long term storage. The most reliable would probably be hard drives. You use two(or more) NEW and different brand drives, copy the data to be archived to each, verify each. Store each drive in a static bag and some sort of case. Put one at your house, one in the bank or somewhere else. A bank's safe deposit box might be expensive, but it is climate controlled and "safe". Using tapes and optical disc are problematic because the mediums break down with age. The hard drives will last much, much longer. Yah, hard drives fail. But if you use different brands, you increase the chance of a mfg being better than another.

      I have HD's that are 15 years old that still work fine after thousands of hours of use. These archive drive will only be used long enough to format, test to make sure they aren't DOA, and to write data to. They should outlast the drive interface technology that they use.

      As time goes on, drive get bigger so more data can be live, and archiving becomes easier. You can always go back and re-archive the data to a "better" medium that holds more.

      Back in the day, people would back up their 20MB HD's to floppy, then they bought a 100MB drive, used tape to back it up, then CD, now DVD. Times change, so your backup strategy must change too. What you do TODAY, will be easier in a few years.

      --
      Fear Is the Only God
    4. Re:Serious OS X user? by itwerx · · Score: 1

      He should get an Xserve RAID, of course.

      I'll second that! If he's already on an Apple environment the Xserve RAID is really the best choice. They're ridiculously easy to set up and they're surprisingly fast for still using ATA-133 technology.
            Of course I'd recommend a decent-sized tape drive (or possibly firewire hardrives) for off-site archiving as well...

    5. Re:Serious OS X user? by egarland · · Score: 2, Interesting

      "RAID is not a backup solution."

      No.. but it is many many times less likely to fail in comparison to storing a single copy on DVDs which is what it is being compared to here.

      In general though, the need to do backups is greatly reduced with RAID and in some cases, a single copy on a RAID array is "good enough" which is to say it eliminates the need to create a separate backup copy. To claim otherwise is to not fully understand data backup.

      --
      set softtabstop=4 shiftwidth=4 expandtab nocp worlddomination
    6. Re:Serious OS X user? by Anonymous Coward · · Score: 0

      (offtopic) I'm guessing by bi-yearly you meant semi-yearly. I hate when those words get mixed up.

    7. Re:Serious OS X user? by larry+bagina · · Score: 1

      Are you bi-sexual or semi-sexual?

      --
      Do you even lift?

      These aren't the 'roids you're looking for.

    8. Re:Serious OS X user? by HeghmoH · · Score: 1

      To claim that RAID is "good enough" in any circumstances where data loss is unacceptable is to not fully understand data backup.

      What happens if two of your drives fail simultaneously? This is not as unlikely as it sounds, since those drives were almost certainly manufactured, bought, and installed more or less at the same time, meaning they'll meet their MTBF at the same time. Yes, the M in MTBF means "Mean", but they're still all going to be reaching the end of their expected life at the same time. And when one drive fails, the demand on the others goes up a lot when you rebuild the RAID, increasing the chance of failure even more.

      What happens if you get filesystem corruption? Yes, it happens, no matter what hardware or what OS. My university had a massive RAIDed file server whose controller decided to start randomly corrupting things one day. Good thing they had everybody's files on tape, because that RAID was toast, and any RAID would be under those same circumstances.

      What happens if your house gets hit by a meteor? Yes, the meteor is fanciful, but building-destroying events are not. Meteor, flood, fire, whatever, RAID helps not a bit, because your redundant drives all get smashed/wet/burned at the same time. And even if you think that these are unlikely, what about a miniature flood caused by somebody spilling their Supersized Coke? Or any number of minor domestic accidents....

      If you can't lose the data, you must have offsite backups. If you can lose it, why bother with RAID?

      --
      Mod down posts with a "Free Mac Mini/iPod" sig, they're spam!
    9. Re:Serious OS X user? by budgenator · · Score: 1

      I've got punch cards that you can't even read the printing on that still hold the data perfectly uncorrupted; at least 25 years old. No mechanical device is ever going to beat good old punched cards or mylar/paper tape for longevity

      --
      Apocalypse Cancelled, Sorry, No Ticket Refunds
  7. Just answered by billster0808 · · Score: 3, Informative

    Try one of these

  8. ATA over Ethernet by madstork2000 · · Score: 1

    If I were tasked with this same job this is the solution I would use:

    http://coraid.com/

    Basically, you add your own disks, and have up to several terabytes of RAID storage. The best part is that teh RAID and all the complicated stuff is ghandled by the drive unit, to the OS it just looks like one huge drive.

    You can add a NAS (SAMBA/NFS) server (or roll your own), to make accessing the drive from Windows / Mac even easier.

    I don't have one of these myself, but have been drooling for a while...

    -Ms2k

    1. Re:ATA over Ethernet by atomic-penguin · · Score: 2, Interesting

      This is definitely a good recommendation. ATA over Ethernet has comparable performance to a similar SCSI configuration. Additionally the price tag is not quite as hefty. Coraid's prices range from $2,000 for 2 Terabytes - $4,000 for 7.5 Terabytes. That does not include the price of a NAS server. Like the parent said you should be able to homebrew this. You could possibly set it up on the Mac G5 you currently use. Making the assumption that you can easily set up an NFS server in Mac OSX.

      If storing all that data was important to my livelihood, it would be hard for me to not justify this investment.
       
      Other options, are optical storage, which is not working out for you currently. Of course, you could drop a couple thousand on a good tape-drive, and spend several hours backing up, and restoring. Then you have to deal with worn tapes, and eventually a worn out tape drive. Of course, you may outgrow your tape solution and have to invest a few more thousand in a larger capacity tape-drive.

      On the other hand, the biggest problem in a fault-tolerant RAID is taking a few seconds to unplug a dead drive, and replace it.

      --
      /^([Ss]ame [Bb]at (time, |channel.)){2}$/
    2. Re:ATA over Ethernet by Proc6 · · Score: 2, Insightful
      "Homebrew" and "critical data".

      Two phrases I don't like seeing anywhere near each other.

      Aim more for "redundant" and "widely tested" for starters.

      --

      I'm Rick James with mod points biatch!

    3. Re:ATA over Ethernet by Halfbaked+Plan · · Score: 1

      'Widely tested' is a checkoff point for something general purpose, that will be used in many different settings and applications. Reliability is a more important measure.

      'Redundant' implies there will be failure and that the only solution is to throw extra hardware (and money) after it.

      'Homebrew' is a term often used to describe a solution that is hand picked and configured. Not always a bad thing.

      --
      resigned
  9. Not much to go on by egarland · · Score: 2, Informative

    2GB/session isn't really enough information to design a storage solution but I'll dump out some generic big, reliable and cheep storage suggestions.

    For large scale reliable storage I dislike both optical and tape. They both quickly become more work to manage than it's worth and have serious reliability issues. Hard drive based is the way to go and since hard drives do fail and that is a bad thing, it's best to use RAID. It's especially a good idea since RAID is getting easier, since hard drives are getting cheaper per unit and since SerialATA is making it easy to hook them up right.

    Heres a basic design that I'm actually working on for a home server for myself:
    http://secure.newegg.com/NewVersion/WishList/WishS hareShow.asp?ID=1764600
    It's a 3U rack mountable 2TB storage server. Put a Linux distro on it with some small RAID1 boot partitions and a software RAID5 storage partition, throw samba and some email-home config to notify of drive failures and you've got a decent place to store up to 1000 of those 2GB sessions. Zip up the old ones if needed for more space. If rack-mounting isn't desirable there are cheaper desktop cases that would probably be appropriate.

    If this is overkill a 4 drive RAID5 array or even a 2 drive RAID1 array is much much easier to accomplish. Standard case, motherboard, power supply and drives with a Linux distro and you're done. Hardware RAID is also an option but since software RAID's high CPU usage wouldn't be an issue here I'd go that route.

    --
    set softtabstop=4 shiftwidth=4 expandtab nocp worlddomination
    1. Re:Not much to go on by Anonymous Coward · · Score: 0

      Interesting setup. Please note that the board you are looking at has not AGP slot, you'll need a PCI Express GPU.

    2. Re:Not much to go on by Anonymous Coward · · Score: 0

      Zip up the old ones if needed for more space.

      Uh, you do realize that these images are probably already compressed, right? Zipping ain't gonna do crap moron.

    3. Re:Not much to go on by egarland · · Score: 1
      --
      set softtabstop=4 shiftwidth=4 expandtab nocp worlddomination
  10. Pay for it -- it's a business expense by plsuh · · Score: 4, Insightful

    This is a system for a professional photographer, storing the digital photos that are the lifeblood of the business. (Note: most professional photographers charge a nominal fee for a session, but then make the real money by selling prints. No negatives or no files = no $.) This is most emphatically NOT the place to try to do things on the cheap. It's an absolutely necessary and tax deductible business expense.

    I work for Apple, and while I'd prefer that this place purchases an Apple-based solution, I am not wedded to a particular OS or brand of hardware. However, you get what you pay for -- either through hiring a skilled professional building an open-source based storage system or by paying for a commercial solution (such as Apple's XServe RAID unit). Be sure to include the necessary system maintenance in the budget for such a complex setup, including off-site backups, on-call support, and making sure that it stays up and running during successive system updates and upgrades.

    Given that the photographer is already using an Apple G5, I suspect an XServe RAID solution will suit the situation quite well. One unit can provide 7TB of storage, which at 2GB/session works out to about 3500 sessions at current resolutions (also allowing plenty of headroom for growth as resolutions increase). Apple offers professional services, on-call support, and training for server administrators. In addition, if you're looking for an Apple consultant with the necessary skills in your area, check the Apple Consultants Network.

    --Paul

    1. Re:Pay for it -- it's a business expense by egarland · · Score: 0, Troll

      "you get what you pay for" - the age old cry of someone asking you to pay too much for something.

      One unit can provide 7TB of storage.
      Hmm.. $13,000 plus the cost of whatever server you hook it up to. Hardly a good value. Maybe they'll make up for obviously overpriced hardware with important yet intangible benefits. :)

      --
      set softtabstop=4 shiftwidth=4 expandtab nocp worlddomination
    2. Re:Pay for it -- it's a business expense by Frumious+Wombat · · Score: 2, Informative

      Compared with the alternatives, such as IBM's entry-level system http://www-132.ibm.com/webapp/wcs/stores/servlet/C onfiguratorDisplay?storeId=1&catalogId=-840&langId =-1&site_type=public&oiId=null&currency=USD&base=1 722-6LU&x=11&y=12/, Dell http://www1.us.dell.com/content/products/compare.a spx/das_storage?c=us&cs=04&l=en&s=bsd/ or NetApp http://www.netapp.com/, add the cost of the redundant power and cooling, and ignoring the cost of trying to maintain a Linux system alongside their OS-X, Apple's price is not bad for the storage supplied.

      Sometimes, it really is time to call in professionals, and spend the money to do it right. I've built some storage solutions on my old job, to support our compute clusters. They worked from an OS point of view, but even buying what were supposed to be well-regarded components resulted in more downtime than we considered acceptable, mostly from heat. In the end, as soon as we had the money, it was entirely worth it to be able to call IBM, buy their servers for disk storage, and get the better engineering in terms of cooling, drive access, and remote management, as well as the three year warranty with onsite service.

      It is highly unlikely that you can screwdriver together a system with as good of airflow as major vendors who employ real engineers. As the poster said, it's a business, therefore when your data matters is not the time to hack something together with parts from NewEgg.

      --
      the more accurate the calculations became, the more the concepts tended to vanish into thin air. R. S. Mulliken
    3. Re:Pay for it -- it's a business expense by plsuh · · Score: 2, Informative

      Hmm.. $13,000 plus the cost of whatever server you hook it up to. Hardly a good value. Maybe they'll make up for obviously overpriced hardware with important yet intangible benefits. :)

      Uhhh...where are you getting this from? You don't need an additional server. An XServe RAID can hook directly to a G5 tower, and with fibre channel you can locate it far enough away (such as in a closet) that noise isn't a problem. Check your facts, dude.

      --Paul

    4. Re:Pay for it -- it's a business expense by Anonymous Coward · · Score: 0

      LOL, sounds about right coming from someone who works at Apple.

      Pffft, you don't "get what you pay for". My Apple equipment is some of the most expensive stuff I own and also has given me the most problems of any hardware I have owned. This seems to be the experience with everyone who owns Apple stuff. It just seems that most people are willing to overlook all the issues because they love Apple so much.

      In my experience Apple hardware has been the most unreliable (I say this as I type it on my dead-pixel'd iBook beside my iMac that only powers up correctly 25% of the time and takes 4 or 5 tries just to boot the damn thing).

    5. Re:Pay for it -- it's a business expense by egarland · · Score: 1

      An XServe RAID can hook directly to a G5 tower

      Assuming you are willing to make the pre-existing G5 your file server, then yes, the "plus the cost of whatever server you hook it up to" goes to nothing. That's why I separated that cost out. Unless there's something wrong with my $13,000 number my facts seem pretty well checked. Still... not a good deal.

      For a more or less direct comparison I'd suggest looking at the promise VTrak M500f.
      http://www.newegg.com/Product/Product.asp?Item=N82 E16811777006
      Add 14 500GB drives at $360 each and your total comes to under $10,000. I consider chaging $3000 too much to qualify for my vague "hardly a good value" proclamation above. In my opinion, the VTrak M500f in and of itself is wildy overpriced and creates an array with far too high a ratio of drive cost to overhead cost (0.75) and the Apple product's ratio is even worse than that (around 0.63) both not counting server cost and both using very expensive drives (which makes the ratio higher than it should be).

      A good deal for an array in my book is one with a ratio over 1, including server cost, using the cheepest cost/gig high quality drives available. Tough but doable. Here's a rough first stab at a design with only about $1,800 of overhead cost to bring 15 drives online:
      http://secure.newegg.com/NewVersion/WishList/WishS hareShow.asp?ID=1771473
      Its not comperable to either of the above products for ease of setup but far superior for cost and level of functionality. Using $360 500GB drives like the above configurations this comes out with a drive/overhead cost ratio of 3.0 which shows just how much too much they are charging for the above products.

      --
      set softtabstop=4 shiftwidth=4 expandtab nocp worlddomination
    6. Re:Pay for it -- it's a business expense by Johnny+Mnemonic · · Score: 1

      Assuming you are willing to make the pre-existing G5 your file server, then yes, the "plus the cost of whatever server you hook it up to" goes to nothing.

      If he is the only user, he doesn't need to operate it as a fileserver--in this case the Xserve RAID would serve as just a big external disk. Which could still be mounted anywhere he likes, not even in the same room, as he can connect to it via optical fibre with an adapter to the SFP of the Xraid.

      Its not comperable to either of the above products for ease of setup

      This guy is a photographer, which means two things: he'll have to pay someone to build this box for him, and if it breaks he needs to have it serviced the same day. The first case raises the price of your solution, and I don't know that the second requirement is available to him at all with your solution--although it is for any brand name RAID, inluding Apple's.

      Folks who aren't in the busines of computers don't like to make it their business. Mechanics could build their own cars, too, but there's a good reason that the kit car isn't very common--regardless of the fact that it's cheaper.

      --

      --
      $tar -xvf .sig.tar
    7. Re:Pay for it -- it's a business expense by Strolls · · Score: 1
      [I can knock this up for a third of the price using cheap commodity components] which shows just how much too much they are charging for the above products.
      "How much too much" is a very subjective figure. Considering research & development and the actual cost of your time setting up your home-brew solution the extra they're charging isn't even all profit. Account for the fact that Apple & Promise have to make a profit - it's not worth running a business if you don't - the "intangible" value of buying a off-the-shelf system, supported by a big name manufacturer suddenlly looks less costly on the pocket. And the value of something - whilst still subjective - should not be confused with its price.

      Personally, one of the things I find to stand out about the Promise is that not just the power-supplies but also the drives are hot-swappable. I don't think your solution offers this (?) and although it's probably not important to Joe Photographer that sort of quality is a big selling point in my book.

    8. Re:Pay for it -- it's a business expense by egarland · · Score: 1

      You missed the point entirely.

      My point was: Both of those products are overpriced. The Apple one is more overpriced than the Promise one but the Promise one is overpriced as well.

      I attempted to illustrate this by showing how a similar device with more powerful, more capable hardware could be built much cheeper. I admit, it's not a superset or a replacement for the other devices but I believe it demonstrates that the $4,300 embeded device that only provides block device RAID functionality is overpriced when a full capabilites server can be built for less.

      --
      set softtabstop=4 shiftwidth=4 expandtab nocp worlddomination
    9. Re:Pay for it -- it's a business expense by Anonymous Coward · · Score: 0

      I am curious, can the same level monitoring and administration be achieved on the cheap?

      At work I watched them have an XRaid setup in an evening including sending e-mails when something wrong and what not.
      And using the web interface they could monitor it from anywhere.

    10. Re:Pay for it -- it's a business expense by egarland · · Score: 1

      smartd will monitor disks and email reports of pending failures if configured to do so.

      I am unaware of any web interfaces to SMART alghough I'd be surprised if one doesn't exist.

      --
      set softtabstop=4 shiftwidth=4 expandtab nocp worlddomination
  11. External HDD by RManning · · Score: 1

    I shoot a lot of photos and I ended up buying a couple external harddrives. They're certainly more stable in the long run than DVDs and it's easier to organize and view the photos than if they were on hundreds of DVDs. Almost all external drives have USB 2.0 or Firewire connections, so moving them onto the drive isn't too painful.

    If I did photography professionally I'd look at an external RAID solution. It's too expensive for a prosumer like me, but a pro should be willing to pay for something like that.

  12. don't over complicate it by tolldog · · Score: 3, Interesting

    buy an external 300 GB firewire drive every couple months, label the drive by the time period. If you are really worried, have 2 every couple of months, they are pretty cheap. Drives don't fail sitting on a shelf, at least not like dvds do. The last thing you wan't is a raid system thats active every day, it only increases the likelyhood of failure. raid is great for data you must access now, but a waste if you are just using it to back up data you only need once every so often.

    If it is really important, use tape backup, make redundant copies, and send one off to a data storage place. As others noted, a backup solution should be part of the cost of the job, and is not really that expensive when divided over the different projects.

    --
    -I just work here... how am I supposed to know?
    1. Re:don't over complicate it by egarland · · Score: 1

      Hard drives do fail while off. A single copy will yield data loss, it's just a matter of time.

      --
      set softtabstop=4 shiftwidth=4 expandtab nocp worlddomination
    2. Re:don't over complicate it by BushCheney08 · · Score: 1

      Drives don't fail sitting on a shelf...

      You've obviously never pulled out a spare/backup drive only to see it not spinup. Hard drives can and do fail. It seems to me that a reasonably cheap solution is to extend the current dvd backups that they're doing to 2 or 3 copies of each disc. And burn them at a slow speed to ensure that the integrity is good. And possibly use parity files with them.

      --
      Be a real patriot: Question authority. Think for yourself. Formulate your own conclusions.
  13. P2P solution by Anonymous Coward · · Score: 0

    Load up your computer with a few P2P file sharing programs, and your hard drive will be backed up across the Internet. (Make sure you use ole FTP as well to make sure that files with Eminem in the name get backed up.)

  14. follow up question: best way to browse it...? by Yankovic · · Score: 1

    I've always been curious... any recommendations on how to browse that many pictures in a reasonable way?

    1. Re:follow up question: best way to browse it...? by Myself · · Score: 1

      Iview MediaPro has been recommended to me. It's smart about offline files, supports all sorts of tagging and searching, and isn't scared of terabyte-scale archives.

      That being said, Gallery 2 has most of the same capabilities. It's a web photo sharing package, but you don't need to give the whole internet access to it. Gallery 2 is quite a powerful database, and if you're smart about tagging things as you add them, the search functions are impressive.

    2. Re:follow up question: best way to browse it...? by ibennetch · · Score: 1

      Argh, I typed up a very lengthy response and slashdot ate it (something about a form key or something, I was too upset about loosing my post to care about the error message)...anyway, I use Picasa which is now owned by Google and free. I'm not a professional photographer; all I photograph are places we go and things we do and the obligitory friends & family photos as we're out and about...but I do have close to 10,000 of them.

      Picasa allows one to enter keywords (IPTC keywords, actually, so I could write a (shell|perl|PHP|python) script to manipulate the pictures based on those keywords, unlike some similar programs which use their own keyword method in a proprietary file somewhere. Anyway, once entering the keywords you can search for any of them. My wife is great about adding keywords; she goes through ever now and then to add keywords -- usually the person's name and maybe some general descriptive terms. I store the photos in directories based on date and event, so in the Pictures directory I've got 2005-05-14 - ibennetch's birthday and 2005-02-31 - Springfield Zoo. Picasa searches based on keywords, captions, folder names, and probably some other things I'm not aware of, so a search for "zoo" finds all the pictures in the Springfield Zoo folder and anything with the word "zoo" in the caption. The search interface displays the sub-directory structure so I can easily see the pictures that are from the 2005-02-14 springfield zoo trip and tell them from the Juno Zoo trip of 2000-09-31.

      Additionally, Picasa allows simple image editing. Brightness/contrast, color correction, soft focus, sepia/b&w, and some others...pretty much everything the casual user would need, saving me the price tag of Photoshop (or download of The Gimp). It's so easy that my wife can use it, but powerful enough that I use it.

  15. Use magneto-optical disks by ag0ny · · Score: 1

    I' more or less in the same situation. I'm not a professional photographer or anything like that, but I do like to take lots of photos when I go somewhere. And since I do not trust CDs or DVDs for long-term storage, I store them on magneto-optical disks. It's more expensive than DVDs, but *MUCH* more reliable. I use 1.3GB disks, and they cost 1000 yen each (around $8.5).

    Since your friend has around 2GB of data on each session, he could get a 2.3GB MO drive and use 2.3GB disks. These cost around 2000 yen ($17). In my opinion they're better, specially for someone who's using them for work, even though they're expensive compared to DVDs.

    I'm living in Japan and these disks are very popular here (and easy to find everywhere). I don't know about their availability on the USA.

    1. Re:Use magneto-optical disks by Jussi+K.+Kojootti · · Score: 1

      That's about 7-8$ per GB? Wouldn't it be wiser to buy an external firewire harddrive every once in a while, they're less than 1$ per GB -- you could even buy another one for redundancy and still pay less?

  16. RAID is wayyyy overcomplicating this by NeMon'ess · · Score: 1

    Not to mention it would consume a lot more power than is needed. Has the photographer been using Taiyo Yuden media? Or just whatever Maxell or Verbatim was on sale at Office Depot the week he was running low? Maybe he just needs better-quality media, and make sure the friend is burning no faster than at 4X.

  17. Desktop SATA RAID by kherr · · Score: 2, Informative

    WiebeTech makes a desktop RAID enclosure that looks interesting. It's actually two 5-bay RAIDs in a single unit. This is essentially a desktop equivalent to Apple's XServe RAID. WiebeTech has plenty of good high-capacity disk solutions.

    1. Re:Desktop SATA RAID by Johnny+Mnemonic · · Score: 1

      Spec/price: RT5x2 with ten 500GB 7200 RPM drives, 9399.95--$.53/GB. FW800 instead of SFP Fibre; frankly I don't how that compares in terms of speed reliabiity.

      vs Apples Xserve RAID: 14 500GB drives, $12999--also $.53/GB. I didn't delve into the specs to see if one has advantages over the other; for instance, there is on-site warranty support available for the Xserve RAID, but it admittedly costs more.

      I suppose if you didn't have a rack and didn't want one, you'd prefer the wiebetch to the Xraid.

      --

      --
      $tar -xvf .sig.tar
  18. What? by Kickasso · · Score: 3, Funny

    Nobody proposed the "a gmail account per session" yet?

    1. Re:What? by Deitheres · · Score: 1

      I've got about 150 invites I could throw towards that ;-)

      --
      Just like driving a car:
      (D) to go forward
      (R) to go backward

  19. 2 cents by itzdandy · · Score: 1

    to add a few cents here..

    i would definitely consider backing up to hard disk. avoid dvds like plague! i backup to two hard disks for redundancy but i do not do it in a raid set. raid is hardware AND software reliant in all forms and a hardware failure can leave you with a lot of lost data(raid controller failure, model not made anymore!) and software raid can fail via simple glitches and leave the data scrambled and data forensics cant pull usable data off the disk! so i suggest 2 firewire disks and take the time to backup to both disks.

  20. Well... by megaversal · · Score: 2, Informative

    Most everyone is recommending hard drives and I'm definitely part of that crowd. Most everyone says "RAID" as well. I'll tell you what I do at work, not for photographs necessarily, but for all our data. I have two servers for user data, one on each side of campus. One is the "active" server with RAID drives, the other is a backup. Each night (I have the luxury of a quiet network at night), I run a network backup to toss stuff over to the second server with RAIDed drives. This prevents the accidental "rm -rf" users that just 1 server with RAID wouldn't prevent against (of course other types of attacks WOULD kill two server solution, which is why important data goes to an external firewire drive from the backup storage server).

    Granted, not everyone has the cash to blow on all this, but my stepfather, who is also a professional photographer, has finally taken that all important step toward moving to digital. He's been backing up to CD and he usually gets away with a session on one or two CDs, not counting any editing he does in Photoshop (he still prefers to touch up photos by hand). Anyway, he has been watching his bookshelf fill up with CDs, much like all his file cabinets that store all his old hard copy negatives and select prints. Any long time photographer probably deals with the same stuff, which was a problem before digital ever came around.

    What I've been working with him on is what will most likely be a big storage server... even at 2GB a session, you could shoot every day of the year and only use 700GB, which will cost you about $300-400 in a non-RAID solution nowadays (based on me just purchasing 4x 300GB drives at $110 each and my friend buying a 400GB for $200). A small server with a few drives will be all the online backup one should need, plus to be extra safe, either that backup server, or just a few external drives.

    If you backup to the external drive once a week or so, this should save anyone from the accidental rm -rf (my stepfather once deleted all the pictures on his laptop by accidentally dragging the wrong folder to the Recycle Bin -- naturally all his photos were too big for the trash and were instantly deleted, luckily he had all his CDs to restore from). Plus, as long as you're backing up regularly, it should be obviously that the hard drive is working or not working. If you start hearing clicking, or feel something funny -- get it replaced.

    I guess my summary of all this is to have two backups. If one is your "online," primary storage, it should be obvious if it's failing or not failing, and assuming you're backing up to your second backup regularly, there shouldn't be any danger of you not realizing it's failing, because you are using it all the time. with DVDs and CDs and other media of that type, it's because you set it on a shelf and forget about it for years that is where the danger is caused.

    Sorry this was long.

    --
    Sig!
  21. Don't do it yourself! by pyrotic · · Score: 1

    Not sure which kind of photoghraphy your friend is doing, but don't sweat the details. That shouldn't be your job. Picture archiving is something magazines/agencies do professionally, and can throw serious amounts of money at a problem. Friend of mine is a picture editor, he's just organised a 10TB server, complete with backup, for the 17 photographers that work for his magazine. Agencies are even better in that respect, as they work for you and not the other way round, and are obliged to give you access to your archive whever you need it.

  22. Analogue Film by lga · · Score: 1

    I propose 35mm film.

    No, really. It has a really high information density.

    We could take the image and write it to film in digital form using optical drive technology...

    1. Re:Analogue Film by lga · · Score: 1

      In fact, to make it higher density we could use coloured dots to represent the bytes in the image.

  23. Don't use DVD-Rs, by cow-orker · · Score: 1

    use DVD-RAMs. They are much better engineered, without needless backwards compatibility and designed for long term storage. They're also a bit more expensive. If it's important enough, always have at least two copies of your data. (I guess, some king of ECC over many DVDs would be possible, but I doubt that anyone has ever implemented something like that.)

    Other than that, as others have already pointed out, you can always buy harddiscs. It's not what they're designed for, but still the easiest solution.

    1. Re:Don't use DVD-Rs, by Myself · · Score: 1

      You should look into SmartPAR, and the PAR file concept in general. You're generating FEC blocks for archives before dispatching them to [transmission | storage], so if one block is unreadable, you can recover it.

      Slyck seems to have a good explanation of how this works. They're geared towards filesharing, but the concepts are useful for backups too.

      You'll need a lot of temp space. If you're filling 4.7-gig DVDs and doing 1 parity disk for each 5 data disks, you're talking about archiving a ~20-gig batch of photos and needing ~25 gig of temporary storage to build the files before burning.

    2. Re:Don't use DVD-Rs, by cow-orker · · Score: 1

      Interesting, I didn't know of this particular implementation. Slyck's explanation only covers simple parity, which is only capable of recovering a single missing block. An explanation of more sophisticated codes can be found on http://www.eccpage.com/. SmartPAR is probably using a Reed-Solomon-Code.

      In principle, there's no need for temporary storage for the whole batch of data. Storage for all parity files would suffice and still allow single pass coding. Even better, given online storage for the redundant images would allow to incrementally add another image to the store and update the parity files. A system with such capabilities would be quite handy for large archives, and SmartPAR falls a bit short, as you noticed. Come to think of it, implementing something like that could actually be a fun project.

      BTW, back in the days when floppy discs were state of the art, it annoyed me no end that every single floppy that spent some months on the shelf would certainly be missing one track when reading it. 79 tracks would be okay, and one broken, usually making the whole archive on it useless. A simple RS code would have helped. Alas, I didn't know about them back then. Neither did anybody else, it seems...

  24. Keep it simple by mpechner · · Score: 1

    This guy is a photographer, not an administrator.

    Buy and label pairs of drives. HDs are cheap these days. One is the original store and the other is the backup.

    Name the first drive as driveA and driveAbkup, second set driveB and driveBbkup.

    Keep a notbook for eack to note the customers/jobs in each drive. This way he does not have to attach the drive to know which customers jobs are on it.

    When ever something on a drive is modified, use your favorite backup program to copy from driveA to driveAbkup.

    I currently use Integro Personalbackup.

    This give you 2 copies. If needed because of leaving town or what ever reason, one set of drives can be kept offsite if needed.

    This is something simple you can teach.

    Also keep in mind most photographers only keep the "negatives" for a specific period of time. 5-10 years.

    Using this method will guarentee tha the data on the drives are read and written which helps keep the data fresh. HD's can loose data of not read once in a while.

    Youo will need to teach your friend to run health checks on the drives twice a year to make sure it is not failing. This is important even for drives that site for 2 or more years. You do not want a HD to sit for 5 years without spinning up.

  25. Don't be innovative: Go with tape. by hey! · · Score: 2, Interesting

    If the imperative is protecting his data, then he should do what professionals do with any other kind of critical data: put it on tape. Sure, you probably could put together an optical solution, but the tape technology is compact, proven, convenient, stable and scalable. I'd avoid anything proprietary aimed at the consumer level (if anybody still IS aiming tape technology at consumers), and look at technologies such as DLT which are popular for critical applications among professionals. Support for technologies adopted this way is measured in decades.

    Given that this is his life work, he really should invest a few thousand dollars and put together a strategy that will protect him from media and system failure, localized disasters such as fires, and possibly even regional disasters. With a little thought, while it is not going to be cheap, it will be a bargain.

    Supposing he's willing to put four or five thousand dollars into this. He can get a SDLT tape drive with a 160GB native capacity (don't count on compression for photos), and 16Mb/s native transfer rate. That day's photo session takes two minutes to back up. am deacj tape stores possibly up to half a year of work. He'll have enough money to buy a good number of tapes, so with a a little thought he'll have a good system for archiving his old stuff, one that is not vulnerable to single tape failures and has an offsite (important!!!) component too. And he may have enough money left over to buy a fire resistant media safe that could buy his data at least a couple of hours of time. Depending on the economic value of his work, he could also send backups to an offiste media storage facility that provides a very high degree of security against regional disasters as well.

    I'll tell you a story I tell all my clients when the cost and inconvenience of a well designed backup program comes up.

    Years ago I had a client who drove up with what looked like a huge piece of burnt toast in the back of his nice Mercedes sedan. He was was a CPA, and this was three weeks before tax day; the burnt toast was a minicomputer that had all his client's tax work on it. He'd been doing backups daily to tape, but contrary to our advice he had stopped bothering to take them off site. Under the circumstances, if he'd had an offsite backup, we'd have lent him everything he needed, even the office space if necessary. He'd have been back on track with maybe two days down time on the outside. When tax season was over he could have moved to a new office, bought new equipment from the insurance settlement, and his biggest worry would be decorating. But all this depended on the offsite backup he didn't have.

    There's a small chance that some of his data mightbe retrieved nowadays, by firms specializing in this sort of thing. But they didn't exist in the early 80s, an in any case I wouldn't want to bet on it. The computer had obviously taken major heat; the interior wiring and connectors weren't just smoke damaged, they were brittle from cooking. We did the best we could, removing the drives, stripping and swapping the electronics on them, cleaning all the connectors on the drive with tetracholoride and so forth. After a few hours of work it was clearly futile, but we spent another day on it trying pointless and hopeless things, just to make him feel like we'd done everything possible. None of this would have been necessary, but for want of a simple step he was fully equipped to take, but seemed like a bit too much bother at the time.

    The lesson is that while people comprehend small disasters like misplacing a file, large disasters are sometimes so horrible to contemplate that they discount them altogether. If your client is lucky, he'll be irritated with being saddled with having to swap tapes every morning and perhaps rotate them offsite every few days. Maybe labelling the tapes will be a chore. If he's unlucky, you'll be a hero.

    --
    Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
  26. multiple DVD-R discs with PAR2 by Scarhead · · Score: 1

    As a general backup solution, I still have files from 1984 that are readable. These go back to my junior high school files from an Apple ][e. Obviously this method has been refined over time, but it works. It takes some work, but I'm paranoid about losing old data.

    1. Use high-quality brand DVD-R blanks. Currently about 35 cents/4.4 GiB.
    2. Verify all writes to make sure it was at least written correctly. Long term stability is unknown at best.
    3. Make multiple copies and store them in different locations. I store one here, one at my parent's house, and one at my sister's house.
    4. As part of the backup, generate PAR2 files. http://parchive.sourceforge.net/
    5. When the next cool storage technology comes out, switch everything to it. I used to backup to floppies, then switched everything over to 230 MiB MO, then 700 MiB CD-R, and now 4.4 GiB DVD-R.

    I also keep all digital pictures online. Large hard drives make this so much easier.

    1. Re:multiple DVD-R discs with PAR2 by dougmc · · Score: 1
      Scarhead nailed it. I do most of these things, even creating par2 files.

      The key steps are 2) verify that your writes are correct and 3) make multiple copies and store them in multiple places. These steps are important no matter what media you use, though verification is less important on hard disks (since they're far more reliable than optical media.)

      Personally, I don't really bother with high qualify DVD-R media -- I go for the cheap ones. Though to be fair, I do throw away a fair number of them just because they fail verification. But as long as you have the par2 files and multiple copies of the data, it's probably good enough.

      Note that backing up to hard disks is going to be a lot more convenient, and more reliable. But keeping at least two copies in two different physical locations is still a key ingredient.

      If your pictures are good enough, you could just do what Linus suggested --

      "Only wimps use tape backup: _real_ men just upload their important stuff on ftp, and let the rest of the world mirror it ;)" (1996)
      (though note that tape backups are notorious for not lasting more than a few years, and I suspect that optical media are actually worse. For now, the best long term data storage option that I'm aware of are going to be large hard drives, though 20 years from now it might be hard to find a computer that can connect to your miniscule 400 GB ATA (parallel or serial) drive. Keeping up to date and copying data to whatever the newest media is seems like a very good plan for very long term archival.)
    2. Re:multiple DVD-R discs with PAR2 by Blkdeath · · Score: 1
      # Use high-quality brand DVD-R blanks. Currently about 35 cents/4.4 GiB.

      Sorry, but I'm afraid the two are mutually exclusive. "High quality" media doesn't come at a bulk price of $0.35/unit. Generic consumer-grade media does. This is a person who's backing up thousands of hours of unreproducible work, not his MP3 collection.

      --
      BD Phone Home!

      Shameless plug. Like you weren't expecting it.

    3. Re:multiple DVD-R discs with PAR2 by tom+taylor · · Score: 1

      What settings do you use when creating PAR2 files? I'm using QuickPar under Win32.

    4. Re:multiple DVD-R discs with PAR2 by dougmc · · Score: 1
      What settings do you use when creating PAR2 files? I'm using QuickPar under Win32.
      I do it with the *nix command line utility, so what I do probably won't help you much.

      But basically I have a script (or group of scripts, actually) that calculates how much space the DVD has, and fills it with par2 files (if you're going to write a DVD, it might as well be almost 100% full.) Once it determines the space available for par2 files, it gets a list of files and feeds that to par2create, which creates the files in it's own directory. It also creates a file with sizes, names, CRC32 and md5sums for each file on the DVD so one can easily determine (without using par) if a file is corrupt. And finally, it makes the iso, burns it, then verifies that everything was written correctly.

      I usually aim for 5% pars on a DVD, about 250 MB, and creating 250 MB of par2 files takes about 45 minutes of cpu time on an Athlon 64 3000+ (it took about four hours on the p3/700 that preceeded it.) And of course if the data is important, it gets written to more than one DVD, with the multiple copies kept in different locations.

      It would be very tedious to do by hand.

      With CD-R media, assuming that the media is not physically abused in any manner, the usual form of degredation that I've seen is that bits here and there will get corrupted after many years, but most of the data is still valid and readable. But it's important to be able to tell the difference between valid and invalid data, hence the md5sum (yes, I know it's been cracked, but for this that doesn't really matter, though maybe I'll go to SHA-1 soon) file, and the par2 files help me recover it. I assume that DVD-R media will degrade similarly, but I haven't really had enough time to see for real.

      Assuming that I need to recover something a DVD that's degraded over the years, I copy everything to the local hard disk, then compare the md5sums agaisnt the files. If they match, great! -- I'm done. If not, then I run par2repair and hope it can recover it. If not, then if I have other copies of the DVD, I throw them into the par2repair mix and hopefully it can recover (since the exact bits that are corrupted are likely to vary.) And if all else fails, I can at least tell which files are valid and which files are not. So far, I've not had to do this very often.

  27. So much for that idea.. by Myself · · Score: 1

    Aww, and here I thought we'd managed to find the only Slashdot story in the last 5 years that had absolutely nothing to do with Google.

  28. SInce you are already using a Mac.... by Anonymous Coward · · Score: 0
    Of course the only answer that makes any sense is an XServe + XServe RAID. Additionally, I would use an SDLT solution for regular backups to tape. Note: I am not saying use the HP solution, that is just an example with some info about it.

    Since I am making the assumption that you are a professional photographer, you can easily write this stuff off as a business expense, depreciate it appropriately, etc. What I would not do is follow anyone's advice on a "homebrew/homebuilt" solution. I am sure that there are plenty of people out there that *could* build something reliable as the solution I suggest, but personally, having worked at several LARGE companies in the I.T. department in various capacities, we would NEVER EVER build our own solution. Vendor support, etc. becomes increasingly important when data is critical to the business and downtime results in monetary losses

  29. You are confused. by NoMoreNicksLeft · · Score: 2, Interesting

    No one does, because, frankly, digital photography hasn't been around that long--so there are no solutions that were around in the 70s, that are now still working, to demonstrate that they are reliable over that kind of time period.

    I'm unsure if you think this is a digital photography problem, or if you just believe digital photography is the only possible reason someone would need massive, long-term, reliable storage.

    Either way, it's an "ask slashdot" at least twice a year, for all sorts of reasons. It's a general computing problem.

    The only possible solution as I see it, is to quit sissying around with firewire drives... they're nice when you need a little extra storage, and don't want to dick around with opening the case. Get a real fibre channel card for $50. Get a fibre channel enclosure for $500. And another $5000 or so will get you decent, lowspeed FC drives, with a few spares. Over the course of 20 to 30 years, you'd have to constantly rebuild it... a 140gig drive from today won't be replaceable in 16 years unless you have a spare (even if you did, would it be reliable itself?). It could easily cost alot, but then, maybe you're already spending quite a bit?

    Also, if I hear SATA one more time, I think I'll puke. This guy is asking about 50-ton dump trucks, and people are talking about riced out Honda Civics.

  30. Re:Big ass SATA RAID by NoMoreNicksLeft · · Score: 4, Insightful

    You are talking out of your ass. I'm seeing your butt cheeks move in sync with the words.

    Big ass SATA RAID

    SATA? Do you also act like you're on the same level as F1 race mechanics, because you checked the oil in your Ford Pinto?

    using a mix of software and hardware RAIDs

    Yes, that's a strategy! In something very nuanced, complicated, and with potentially disasterous consequences, let's mix the two together for even more complexity. Maybe this is worth considering in some cases, but without an expert there to come to that conclusion, and certainly without any stated reasons for this, THIS IS A BAD IDEA. If this is what you eventually decide to use, do not hire parent poster to do the job. Oh, and since you'll want someone who knows what they're talking about to do it, it's going to cost more than his estimate.

    A cheap, sane alternative would be to compress your photos. JPEG really is good enough

    Just when I thought you couldn't be any dumber. "Yes, for long term storage of your incredibly hi-res pics meant for professional photography and graphics, where every single lost bit seems to count, why not print them out on acid-saturated paper with my crusty inkjet printer that's out of yellow?" I mean, my god. It's an ask slashdot, people are supposed to be stupid. It can't be helped, but damn. There are sea urchins with more advanced cognition.

  31. TerraStation by jelevy01 · · Score: 1

    Real Easy, Secure, and safe.. The Buffalo Terrastion, I just got on for this very purpose: http://www.buffalotech.com/products/product-detail .php?productid=97&categoryid=19

  32. Try this if you want to have enough space by dascandy · · Score: 1

    This system'll get you out of trouble for about a full year, given ten photo sessions a day. You'll get free on-site support and you can store a full session in cache!

    http://store.sun.com/CMTemplate/CEServlet?process= SunStore&cmdStartWebConfig_CP&familyCode=SE6920&ba seSelected=3

  33. Try Floppies (No Seriously).. by Halvy · · Score: 0

    Looky hear for something interesting

    http://www.clerks2.com/movies/whit560.mov

    It shows a Deva 2 sound recorder with a 'Floppy' Dvd!

    It is 24 bit (not shabby), Poly-Phonic with 4 tracks.

    Now why didn't you think of that! ;)

    --The InterNet is a terrible thing to waste. Arrest Bill Gates and shut down Microsoft immediately.

    --
    I will gladly loose all of life's battles.. in order to win the war..
  34. The solution... by joto · · Score: 2, Informative
    This is the solution. If you doubt me, look here for an article about it.

    It works. Reliably. In my previous job, we pretty much depended on it. A single faulty tape could cost us from $50k and up. And we didn't do backups of data on it... The tape drives were used continuosly 24/7.

    If you can afford it, is an entirely different question. I think it's about $30k...

  35. Calling back... by Omniscient+Ferret · · Score: 1

    I'm noting similar responses to a recent article - A question of stability of optical media was answered by some backup techniques. To repost: I really like parchive2, but I wonder if dvdisaster is faster & allows finer-grained recovery, though.

    Someone else already posted about having offline hard drives...

  36. Type of DVD? by OSXCPA · · Score: 1

    I had some problems with DVD storage storing scanned family photos I can't replace. I found out it was the el-cheapo DVDs I was getting by the spool from CompUSA. Now, I use Verbatim MediDisc DVD-Rs. Not as good as the Hard Drive solution, perhaps, but much cheaper. These are used to store medical records and imagery, and I've been told that they are manufactured to much higher quality standards than the average DVDs. Not too much more expensive, either, especially in spools of 100.

    On a side note, for those of you who have not been to a hospital cancer ward lately, in some hospitals, they give you a DVD of your loved ones' MRI imagery, complete with annotations showing where the inoperable brain tumor is, so you can check it out at home on your home PC (requires custom software to view, so no *NIX). Geek-creepy in a big way, IMHO.

  37. I take exception to the term MRI by cdn-programmer · · Score: 1

    Its NMR. Nuclear Magnetic Resonance. Some people figured "nuclear" is a bad word so they are trying to rename it. This is discrimination for no good reasons at all.

    1. Re:I take exception to the term MRI by dJOEK · · Score: 1

      More likely because most Americans kept calling it 'nucular'

      --
      Exercise caution when modding this message up: the author acts like a jerk when his karma is excellent.
  38. Re:The solution... Magstar 3590's ?? by cdn-programmer · · Score: 1

    Ah yes. These are nice tape drives. I'm in the market for one!

    If anyone has a 3590 kicking around please send me an email with details. I like the 256 track units. They are fast and realiable.

    As for $50K per tape - that is cheap.

    In the 128 track models the Fujitsu drives were more relaible than the IBM drives.

    BTW - if anyone needs some 10 tape autoloaders for the Fujitsu's I have several available plus main boards in both differential and single ended SCSI as well as some model H.

    Tape RULES!!!

    I'll never trust my precious data to a drive and media system as cheap as a DVD or CD. We are still reading tapes recorded in the 60's and 70's. I doubt a DVD or a CD will even last 10 years even if you have a special environment to keep it in. At least Magneto optical has an expected life span of 50 years.

    In all likelihood a hard disk drive has a longer life than CD's and DVD's.

  39. File server by dark404 · · Score: 1

    Get a very large server case with plenty of cooling, get a raid 5 card and make a raid array. Add more as needed. If you are going to store to a CD/DVD medium in addition to that, make parity files with something ala par2 as well, and get one of those food saver bags to chuck the jewel case in and store it in a vacuum in a dark area.

  40. Tape? by nurb432 · · Score: 1

    Tape will last longer then a DVD-R if taken care of.

    Actually, if the data is important id do both. 2 DVDs and keep the copies onsite, then a tape that is moved offsite to be stored *properly*.

    Sure, its a slow process to get your data back, but if you really, really, dont want to lose it..

    --
    ---- Booth was a patriot ----
  41. RAID 5 by Lehk228 · · Score: 1

    RAID server

    5 disk RAID-5 would be good, lots of storage capacity with only 20% overhead for redundancy. should be doable for under $1000 and store a great deal of images

    --
    Snowden and Manning are heroes.
    1. Re:RAID 5 by PermanentMarker · · Score: 1

      Wrong not 20%

      The overhead equals [n-1] disk
      As one disk is used with checksum information.
      Where the minimum of n disks is 3.

      So when you buy a raid 5 set :
      with 3 disk, you loose about 30%
      with 4 disks, you loose about 25%
      with 5 disks, you loose about 20%
      With 10 disks, you loose about 10%
      i wouldn't advice you to use 100 disks, altough it might be
      verry efficently

      hehehe :)



      This wouldn't be a nerd site, if one wouldn't give technical answers...

      --
      I know you're out there. I can feel you now. I know that you're afraid. You're afraid of us. You're afraid of change.
  42. 2 gig pere foto session ??? by PermanentMarker · · Score: 1

    Ehm one might also consider that one should take time to take a good picture. Instead of take time to make hundreds of photo's in the same time. 2 Gig (if it's done by one photographer, instead of a foto studio), is a lot.

    I know lot's of photographers only use RAW pictures, which require a lot of MB's (as i myself have an EOS350D, i know this). However when i got my light correction done, the quality of the jpg is as good as the raw image. Try use raw images if your sure that you need to process them afterwards because of difficult light conditions. Or when you you're verry afraid and it has to be good, and don't want to risk bad light, and have only that single shot moment. I cann't belief that when one produces 2 gig of photo's on a daily basis, that he cann't take some risk, is he so afraid for light ?, a proffesional photographer shouldnt be.

    Also one can switch between those formats and detail sizes, not all photo's require high defenition, as they wouldn't all be printed to an A3 format. Think about the resulotion of your end product and of your media resolution. Try to tackle the problems at their cause.

    --
    I know you're out there. I can feel you now. I know that you're afraid. You're afraid of us. You're afraid of change.
    1. Re:2 gig pere foto session ??? by skittixch · · Score: 1

      No matter how the artist works, it is the duty of modern technology to conform to his or her preferences.

    2. Re:2 gig pere foto session ??? by PermanentMarker · · Score: 1

      To me Art is craft.
      So it's not the technology that decides Art, it's rather just a tool. To create works that extend people's ideas of creation, for their recreation or intellectual experiences. Giving an Artist unlimited resources in this case "disk space" doesn't necessarily improve the creations of an Artist. It's the skill how he uses his materials, to reflect his ideas.

      ;0

      you might check my art site : htp//www.peterboos.tk/

      --
      I know you're out there. I can feel you now. I know that you're afraid. You're afraid of us. You're afraid of change.
    3. Re:2 gig pere foto session ??? by Photo+Client · · Score: 1

      I supervise photographers. 2GB/day is NOT a lot in my world. The company I work for routinely produces complex shoots that yield 20-30GB a day (1000+ RAW captures). My needs (and the needs of our clients) are served by having a lot of alternatives. In our world, the difference between a professional photographer and a wannabe is that the professionals shoot both high volume and high quality to produce many alternatives. Also, don't let anybody fool you into thinking that JPEG is a viable alternative to RAW for longterm archiving.

  43. ImageMagik will display Medical Images by Chris+Tyler · · Score: 1

    ImageMagick understands the image format used for most CT and MRI photographs, so most run-of-the-mill Linux distros can display images from medical imaging CDs. (The Windows applets usually provided on the disc do make navigation a bit easier, though).

  44. DVDs that can't be read any more? by dpbsmith · · Score: 1

    Please tell me more about that.

    I am sick unto death of cheerful articles that assert that [optical storage medium o' the month] has been proven in accelerated-life testing to last for umpteen aeons, and then discovering that my three-year-old disks can't be read... ...and saying "use a reliable brand," but no two people have the same opinions of what's reliable... ("Mitsui Gold or nothing..." "Just use the cheapest you can find..." "The Staples house brand is OK..." "No, no, it has to be a brand name like Sony or Verbatim, but which brand doesn't matter...) ...and every one was saying that because the DVD data layer is sandwiched between two thick pieces of polycarbonate instead of underneath a fragile lacquer coat, DVDs will be far MORE long-lived than CD-R's.

  45. For a photographer, RAID is the most important by SuperKendall · · Score: 1

    I agree that RAID is not a full backup solution, but for a photographer it's the most important component of one (well, alongside an offsite backup or ten).

    The reason is that the data a photographer is storing is non-reproducable in a way that very little data is. If I spend a month programming and then loose all that code in a crash - a terrible annoyance, but because the idea of what to do is in my head I can re-create it with some work.

    But a photo gone is lost forever. Additionally the work that can go into retouching photos can be very time intenstive in a way that you can't really compress a second time through in the same way you can reproducing lost documents or code.

    So RAID is very useful in that it is a constant backup solution to ensure failure of a single physical media will not kill you.

    That said, I've heard about multiple drives in RAID arrays dying at the same time so I'd do something like RAID 0 (mirror) for everyday use combined with a weekly backup to another HD which goes offsite. Perhaps you rotate the backup drive between five or so differnt units so you have some history as well in case you delete something by accident, then have monthy DVD backups that you can't remove stuff from by accident.

    --
    "There is more worth loving than we have strength to love." - Brian Jay Stanley
  46. I have similar needs, here's what I do by SuperKendall · · Score: 1

    Aftre trips I have between 2-10GB of photos to work with - that's before postprocessing which can add quite a bit of space as well. I also have a G5.

    What I have done is bought an external SATA enclosure for two drives, and a four-port SATA card. I have two 400GB drives set up using the software RAID in Disk Manager, configured to be Raid 0 (mirroring).

    The idea here is that I want enough space to hold all the photos I have ever taken and the work I have done on them. I only use two of the four ports for the SATA enclosure but I got a four port card to provide for another enclosure later on (which wil be sooner rather than later)

    The external box is for photos only - I have my home drive mounted on an internal drive, and I use Carbon Copy Cloner once a week to back that up to a second drive in the same computer. Thus all photo work has instant backup in the secondary drive, while less important things in my home directory can be backed up according to the frequency or work.

    Lastly of course is that these all need to be backed up as well. Currently I am using external Firwire drives for occasional dumps to save off the home drive and the photos - it's tricky though as I have to span a number of external drives. What I'm moving to do is regularily swap out one of the drives in the external SATA enclosure (it has trays you can just pull) and store that offsite with a new drive in place to be mirrored to. I've not tried that yet though. Later on when Blu-Ray burners become affordable that will be my last line of backup where I can make ten backups once a month and just mail them offsite.

    This is a pretty reasonable solution costwise, though it does add an extra box besides the G5 and it makes a little more noise.

    --
    "There is more worth loving than we have strength to love." - Brian Jay Stanley
  47. Big hard disks and rsync by tfiedler · · Score: 1

    I have two 300GB external USB2 hard drives that I sync my data to.

    I use rsync with the -E option (gets mac attributes should they exist) and is fast, copying only what has changed. I use two drives because I sync the two backups immediately after syncing my data with the first drive.

    Easily automated, no RAID to get in the way in the future, and cheap. New drives can be bought for next to nothing. My suggestion is to buy them in pairs and as one set fills, replace it with the second set. You can easily create new data directories and leave stuff online all the time with this method.

    Avoid RAID for long-term backup/archival purposes. Ignore those that tell you otherwise.

    --
    Democrats and Republicans are like AIDS and Cancer, I want neither!
  48. An age old delemma - how do we cheat death? by Bob_Who · · Score: 1

    Its funny how we sit here in this great dilemma. Now, realizing that you can't take it with you. Our own mortality looms and our life's work can dangle from a thread no more reliable than decaying plastics and magnetic drives. Oh sure, all that stuff survived in New Orleans, right?

    I spent the 90's recording everything I could on DAT and Cassette. Silly mortal, its all gonna die before I do...

    Results speak for themselves: Clearly the most lasting approach is to carve the data into a massive pyramid in the desert. So far, that outlasts Maxell by about 5,000 years, for what its worth.

    I mean, really, this is how nature keeps us from getting too uppity about being permanently imprinted everywhere. When we figure out how to make it last forever, then we'll just have accumulated way, way, too much to even care. The good stuff will be retained, somehow, in the culture, perhaps. Maybe the Navajo can memorize it in oral tradition.

    In the meantime, be a good consumer if you think it will assure that your tomb will be adorned with your art.

    As for me, I'm getting more DVD's just to keep them old DATs and Cassetes company. I might as well get busy before they bury me! Anyone got a viagra?