Slashdot Mirror


The Afterlife Is Expensive for Digital Movies

A new study shows that storing the digital master record of a film costs much more than storing archival prints. "To store a digital master record of a movie costs about $12,514 a year, versus the $1,059 it costs to keep a conventional film master. Much worse, to keep the enormous swarm of data produced when a picture is 'born digital' -- that is, produced using all-electronic processes, rather than relying wholly or partially on film -- pushes the cost of preservation to $208,569 a year, vastly higher than the $486 it costs to toss the equivalent camera negatives, audio recordings, on-set photographs and annotated scripts of an all-film production into the cold-storage vault."

289 comments

  1. Perhaps they need to learning about DUPLICATION? by Anonymous Coward · · Score: 5, Funny

    It seems Slashdot could teach them.

  2. You know... by Omeger · · Score: 2, Funny

    DUPLICATION is a lot easier with digital forms of media. I mean, holy crap /., this is probably one of the fastest dupes in the same field of interest I've ever seen.

    1. Re:You know... by Marcos+Eliziario · · Score: 1

      Look at the firehose...

      --
      Your ad could be here!
    2. Re:You know... by sm62704 · · Score: 5, Funny

      DUPLICATION is a lot easier with digital forms of media. I mean, holy crap /., this is probably one of the fastest dupes in the same field of interest I've ever seen.

      --
      mcgrew's razor: Never attribute to stupidity that which can be explained by greedy self-interest
    3. Re:You know... by Anonymous Coward · · Score: 1, Funny

      This article isn't a dupe, it's the Directors Cut with 13 previously unseen comments added.
      There's also a limited edtion Ultimate article, with a free article on how the original article was posted.

    4. Re:You know... by Ice+Wewe · · Score: 1, Funny

      DUPLICATION is a lot easier with digital forms of media. I mean, holy crap /., this is probably one of the fastest dupes in the same field of interest I've ever seen.

      I'm sorry sir, but this was deemed an unlawful duplication and we, the DIAA (Duplication Industry Association of America) hereby demand that you pay us $10,000/character or we will be forced to take this matter to the courts. Thanks for posting with a nickname that our private investigators can to track an IP address that might possibly be yours, unless you're writing that from a public terminal in which case we're going to need the keyboard to run a DNA scan on... at your expense, of course. Assuming we find your DNA on it. If not, we'll just frame a bunch of innocent people with some evidence that we pulled out of a dark place (no, VGCats readers, not Canada.)

      We appreciate your generous donation to our worthy cause, your hard earned dollars will help to fund more pointless lawsuits against people much like yourself.

    5. Re:You know... by shiftless · · Score: 1

      Wow, I never would have thought that a person could copy someone else's comment, re-post it as a reply to said comment, and get a higher karma rating than the original. Slashdot continues to amaze me.

    6. Re:You know... by sm62704 · · Score: 1

      What's even funnier is that I stole the joke from somebody else who did exactly the same thing a few weeks ago.

      Reusable comedy is comedy gold. Er, and speaking of which, a "funny" rating garners no extra karma. The theory about this is that many (most?) comments rated "funny" are meant to be serious but are so incredibly stupid as to be funny. You don't lose karma with them because then people would try NOT to be funny.

      What I think is absufuckinglutely hilarious is when I'm trying for "funny" and get modded "insightful".

      --
      mcgrew's razor: Never attribute to stupidity that which can be explained by greedy self-interest
    7. Re:You know... by The_mad_linguist · · Score: 1

      DUPLICATION is a lot easier with digital forms of media. I mean, holy crap /., this is probably one of the fastest dupes in the same field of interest I've ever seen.

  3. time by Lord+Ender · · Score: 3, Insightful

    This may be true, but the cost of preserving digital content is halving every year, and can digital content can persist indefinitely; while the cost of preserving film is generally going up, and film can not be preserved forever.

    --
    A slashdotter who didn't build his own computer is like a Jedi who didn't build his own lightsaber.
    1. Re:time by Venik · · Score: 1

      The cost of storage medium is halving every year, but not the cost of preserving digital content. You see, the two are not the same.

    2. Re:time by anagama · · Score: 1

      Aside from that, they could just post it to usenet and forget about it. 100 years from now, copies would still be floating around.

      --
      What changed under Obama? Nothing Good
  4. dupe by Lars+T. · · Score: 2, Funny
    --

    Lars T.

    To the guy who modded me down from perfect to terrible Karma - Apple haters still suck

    1. Re:dupe by cgenman · · Score: 1

      It's just their way of preserving the story.

    2. Re:dupe by Adam+Heath · · Score: 0, Redundant

      Dupe



      (this is a dupe comment)
    3. Re:dupe by Lars+T. · · Score: 0, Offtopic

      Gee, I guess I should have just posted "dupe" instead of first tagging the story, then digging up the first Slashdot story, hunh? That will teach me.

      --

      Lars T.

      To the guy who modded me down from perfect to terrible Karma - Apple haters still suck

  5. Expensive Duplicates by mosel-saar-ruwer · · Score: 5, Funny


    Yeah, it costs a ton of money in disk space, mirroring, bandwidth, and power bills to maintain all those duplicates of the original.

    1. Re:Expensive Duplicates by Anonymous Coward · · Score: 0

      Why don't they release them all on Pirate Bay and have the copies saved for them?

    2. Re:Expensive Duplicates by noidentity · · Score: 1

      Yes but what if something were to happen to the original article and comments? Everyone should post their thoughts here too!

    3. Re:Expensive Duplicates by Falladir · · Score: 4, Insightful

      Because nobody wants to expend more than a few dozen gigabytes (at the MOST) on a movie for personal viewing purposes. The task here is to preserve the "originals," the full-resolution, lossless cuts that were filmed on the set. I think I read that the footage that actually appears in Spiderman 3 constitutes 4 TB of information. Consider that a bunch of un-used footage also needs to be saved, and you'll agree that only a few insane enthusiasts would ever be willing to download and preserve that amount of information (at least with technology as it is now).

    4. Re:Expensive Duplicates by smittyoneeach · · Score: 3, Funny

      The obvious way to capitalize on the 4TB of data is to sell a new version every year with slightly lengthened scenes, out-takes, alternate endings, tie-ins, and boxed sets containing the previous and subsequent installments.
      By 2015, you'll have "Deluxe Duke Spiderman 3 Power Gold Director's Cut Nukem Forever".
      And you will like it.

      --
      Get thee glass eyes, and, like a scurvy politician, seem to see things thou dost not.--King Lear
    5. Re:Expensive Duplicates by ArsonSmith · · Score: 1

      see right below the store for the little section that reads

      > stuff,stuff,stuff,stuff (tagging beta)

      and ad which ever you want. Instant editor moderation.

      --
      Paying taxes to buy civilization is like paying a hooker to buy love.
    6. Re:Expensive Duplicates by TooMuchToDo · · Score: 4, Funny

      By 2015, you'll have "Deluxe Duke Spiderman 3 Power Gold Director's Cut Nukem Forever".

      I think you misspelled "Blade Runner, The Final Cut"

    7. Re:Expensive Duplicates by Anonymous Coward · · Score: 0

      4 TB is 10 LTO-3 tapes (assuming the data cannot be compressed). 10 LTO-3 tapes cost $750. Even considering duplicates, duplication costs, and storage costs, it's absolutely ridiculous to think it costs $200,000 per year to keep the originals. Someone is skimming a LOT off the top of that $200,000, and some dumb sucker actually believes he should be paying that much.

    8. Re:Expensive Duplicates by MMC+Monster · · Score: 1

      10 LTO tapes. I would probably add in 30% redundancy information and create par2 files, and call it a day.

      --
      Help! I'm a slashdot refugee.
    9. Re:Expensive Duplicates by stuboogie · · Score: 1

      How long till the next version? "Blade Runner: The Editor Strikes Back"

    10. Re:Expensive Duplicates by Wes+Janson · · Score: 1

      Burn in the fires of Orc, heathen. ;P

    11. Re:Expensive Duplicates by Anonymous Coward · · Score: 0

      I think you meant to say the one that is going to come out: "Blade Runner, The Second Final Cut"

    12. Re:Expensive Duplicates by TooMuchToDo · · Score: 1

      I went to go see Blade Runner: The Final Cut on a digital projection screen at a theater. Rarely can I say a movie is that beautiful. I loved it. I thought it was the best version released to date. I was more teasing at the fact that studios like to release cut after cut after cut to make a buck.

  6. Repeats eat into the budget, I s'pose by Anonymous Coward · · Score: 0

    This duplicate comment brought to you by the AC.

    1. Re:Repeats eat into the budget, I s'pose by Doonga2007 · · Score: 0, Redundant

      This duplicate comment brought to you by me.

    2. Re:Repeats eat into the budget, I s'pose by Doonga2007 · · Score: 0

      Congradulations Mr. Moderator, you lack a sense of humor. P.S. This and the above comment are meant to be a JOKE. Jeesh...

  7. I must be missing something here... by Pojut · · Score: 2, Insightful

    How does it cost more to store a bunch of files on a few duplicate hard drives than it does to maintain the facility AND personnel required to keep film negatives in excellent condition? I mean, isn't that one of the advantages to an all-digital film? Everything gets stored as a 0 and a 1, and can easily be duplicated however many times you want with no loss or degradation to the original source?

    Someone care to explain why it costs so much to buy a few hard drives?

    1. Re:I must be missing something here... by FredFredrickson · · Score: 1

      Someone might say that hard drives are not an acceptable form of storage for long term- but I honestly have a hard time believing there's anything really long term. A few hard drives replaced on a yearly basis could be under $1K. With the right machinery to do the copying, you might not even need much of a staff.

      The big number comes from the additional windows vista ultimate licenses after each hard drive dies.

      John Doe, head tech for one of the leading digital film storage facilities, was quoted saying, "It's very difficult, since compaq doesn't ship these damn computers with recovery disks, we have to buy a new copy of vista every time it crashes, and of course, I wouldn't be caught dead with Windows home basic- no, our media is very important. We needed the extra protection of windows ultimate."

      --
      Belief? Hope? Preference?The Existential Vortex
    2. Re:I must be missing something here... by Anonymous Coward · · Score: 0

      The article doesn't mention how many GB have to be preserved per movie, and what exactly they're buying with $208,569 a year, so we can't say whether they're storing too much or overpaying for the service, but common sense says one of these two must be true.

    3. Re:I must be missing something here... by Tsunayoshi · · Score: 1

      Just a complete WAG here by someone who has no knowledge of the exact process:

      It is not just buying another drive. Other costs include:
      - power for the drive(s)
      - power for the server(s) using the drive(s)
      - costs of the backup architecture for DR
      - costs of cooling the datacenter housing all of the above
      - maintenance agreement costs for all of the above
      - costs related to the admins who manage all of the above (salary, benefits, etc.)

      I am missing quite a few things in there as well, such as off-siting DR copies of the data and content management software to actually manage the digital storage.

      Of course, a lot of what I listed are pretty much fixed costs that can be spread/amortized over every digital copy being preserved, but 100% guaranteed non-corrupt storage of digital data is not cheap by any means. It takes a little more than just installing a linux box and slapping a few 1TB SATA drives in a raid.

      --
      "Get a bicycle. You will not regret it, if you live." - Mark Twain, "Taming the Bicycle"
    4. Re:I must be missing something here... by Falladir · · Score: 1, Flamebait

      The article talks about the reasons that storing a digital movie is expensive, but it doesn't break things down or give us any hard facts. The one truly important question that any reader should be asking (if he's a computer user) is "how many Gigabytes or Terabytes are we talking, here." I think the answer is in this case a few dozen terabytes, and while the cost of storing that much information is kind of meaningful now, it's decreasing continuously. That the article ignores this trend is a serious lapse, especially considering that they ask us to imagine a hundred-year storage period.

      This article, and your reaction to it, make me wish that people got better technical educations, so that they wouldn't be so unnecessarily ignorant.

    5. Re:I must be missing something here... by aerthling · · Score: 1

      Someone didn't get a Wii for Christmas. :p

    6. Re:I must be missing something here... by Pojut · · Score: 1

      I actually did read the whole article, and nowhere within that article (which the AC above me already stated) did it mention how much is being stored, what medium they are using to store it, where in the world they are storing it (cooler ambient temp means less cooling needed for the racks) etc. No details. Just that it costs an exorbitant amount more to store films digitally than it does to store them on film.

      By the way, people might take you more seriously if you didn't toss out insults like some five year old who just lost his doll.

    7. Re:I must be missing something here... by ILuvRamen · · Score: 2, Interesting

      what the hell are you talking about? Put the video on a high capacity plastic storage medium like HD DVDs or holographic disks (yes they exist) and stick em in the cold storage. How fucking hard is that? Plus, can't hard drives sit there and keep their data unpowered, out of a server, out of a datacenter, in the regrigerator for a long time too? Surely not as long as plastic but why would you even say that they'd be constantly live and powered in a server? There's absolutely no point to that

      --
      Google's Super Secret Search Algorithm: SELECT @search_results FROM internet WHERE @search_results = 'good'
    8. Re:I must be missing something here... by FredFredrickson · · Score: 1

      - power for the drive(s) Do the drives need to be powered? They could just sit there...

      - power for the server(s) using the drive(s) They could run a relatively small amount of actual devices to do the duplication, and stagger the duplication so a few drives at a time = full library in a year. Rinse. Repeat.

      - costs of the backup architecture for DR Minimal up-front cost.

      - costs of cooling the datacenter housing all of the above If we kept most drives dormant unless being used, I see a $55 air conditioner from walmart doing the job.

      - maintenance agreement costs for all of the above If we're close to the border, I know where we can get some cheap labor...

      - costs related to the admins who manage all of the above (salary, benefits, etc.) This could be the only real expense. But if you arrange it right, split the salary across number of movies, it could add up to only a few $$ per movie. Add staff as number of movies increase.

      I think the problem is lack of motivation and innovation. It's almost as if they're saying, oh noes! Please! Pitty us! We've got such a hard task here-- meanwhile making no attempts to make it easier on themselves. What a bunch of drama queens.
      --
      Belief? Hope? Preference?The Existential Vortex
    9. Re:I must be missing something here... by Anonymous Coward · · Score: 0

      Uh, hard drives aren't like RAM, you can keep them powered off and they won't lose their data.

    10. Re:I must be missing something here... by Tsunayoshi · · Score: 1

      I said it was a WAG, for all I know they do store the stuff on plastic. However, the summary mentioned that costs skyrocket when storing the data from a 100% all-digital, so to me that implies a system that meets the needs from filming to production to editing to distribution to storage.

      I'll agree that once a film has finished its useful life, it would probably be archived onto some sort of cold storage (plastic, or spun-down drives on 2nd/3rd tier storage), but during its active money-producing life, what I detailed is nowhere near unreasonable.

      --
      "Get a bicycle. You will not regret it, if you live." - Mark Twain, "Taming the Bicycle"
    11. Re:I must be missing something here... by cpaalman · · Score: 1

      nevermind that they are probably preserving more than the final movie. I'm a slashdotter so I refuse to RTFA or look up any proof to my following statement, but I suspect that capturing everything about a movie from start to finish, director & actor interviews, documents such as the original scripts plus any changes made along the way, as well as the multitude of other aspects involved in a 3 year movie production, can potentially occupy a TB of data storage.

      Then comes the issue of maintaining the ability to access the information, whether it be codecs for video formats, audio clips, document formats, etc.

      Your idea of cycling new hard drives is fine. On paper that sounds simple. Of course when that old SATA hard drive interface is retired and you can't purchase any more so now you need to implement a new storage medium and migrate TBs of data... and this will likely happen sooner than later...

      I don't know if a quarter million a year is justifiable, and it's not unlike Holywood and the Music industry to inflate their numbers... but I suspect it is not such a simple undertaking either.

    12. Re:I must be missing something here... by Tsunayoshi · · Score: 1

      I agree that you could mitigate a lot of the costs, but as a film company if my reason for existence is to make money from billions of dollars in films, I am going to have a system in place to damn well make sure I NEVER lose a single bit of data from all that money making IP. And that costs $$$.

      --
      "Get a bicycle. You will not regret it, if you live." - Mark Twain, "Taming the Bicycle"
    13. Re:I must be missing something here... by pla · · Score: 3, Interesting

      It is not just buying another drive
      $300/TB, currently.

      power for the drive(s)
      Approaching zero (minus a few hours per year for making a copy) if you store them offline.

      power for the server(s) using the drive(s)
      Ditto.

      costs of the backup architecture for DR
      A minimum-wage drive-jockey and a handful of PCs with EZ-Swap drive cages.

      costs of cooling the datacenter housing all of the above
      AKA "the dry and somewhat temperature controlled (40-110F) basement of any office building in the world"

      maintenance agreement costs for all of the above
      See "minimum-wage drive jockey" and add a broom.

      costs related to the admins who manage all of the above (salary, benefits, etc.)
      See "minimum-wage drive jockey".


      And that presumes they use HDDs and make a new copy once a year (keeping a few years as redundant backups and "working" masters)... Although I normally consider tape drives a waste of time and money, in this situation, they seem even more ideal than HDDs. The "handful of PCs" cost goes up, but the cost-per-copy drops drastically.

      Even if you replace "minumum-wage drive jockey" with "qualified IT professional or three", I can't see how you'd get anywhere near $12k per year.

    14. Re:I must be missing something here... by Smidge204 · · Score: 1

      I'm going to take a huge stab in the dark here regarding how much data they're storing...

      Hi-Def 1080p is 1,920x1,080 resolution, 29.97 FPS, 32-bits per pixel. That's about 14GB per minute uncompressed, say 15GB/min with audio to make the math easier.

      If a 100 min movie represents, say, a quarter of what was actually filmed and needs to be archived. 400min * 15GB/min = 6000GB or about 6TB of data *uncompressed*

      1TB hard drives are available now for about $350 or so and I'm sure you can get bulk discounts.

      Any arguments about outdated data formats is more or less bullshit, because you have the same issues with projectors and other analog media equipment. NASA's case is a tad special since they didn't use widely and ubiquitous consumer-grade hardware. Nowadays you can't walk down the street without seeing a place where you can buy a SATA hard drive or something containing one.

      Store the hard drives in the same cold storage vaults you keep your analog media. Problem solved IMHO. These dumbasses are probably burning everything to CD-Rs or something.
      =Smidge=

    15. Re:I must be missing something here... by Anonymous Coward · · Score: 0

      Read the title again: The Afterlife is Expensive for Digital Movies.

      WhyTF do your posts have score 2? What you post is utter BS.

    16. Re:I must be missing something here... by Tsunayoshi · · Score: 2, Insightful

      As I responded to someone else who mitigated costs in the same manner:

      If your business machine depends guaranteed access to millions of $$ of digital IP, are you going to rely on "minimum-wage drive jockeys" swapping out cheap disks to archive your data?

      --
      "Get a bicycle. You will not regret it, if you live." - Mark Twain, "Taming the Bicycle"
    17. Re:I must be missing something here... by dtolman · · Score: 1
      Congratulations - you just stored the master film copy. Multiply your guestimate by a factor of 2, and thats what hollywood says it costs.

      You blew the second part though. What you see isn't even 1% of the original footage. Maybe 50 years ago the stuff on film was 25% of what was filmed. Now you have to archive 1000's of hours of raw footage and special effects data for just a single movie. In multiple locations.

      And Hollywood has to do it for every film, because you never know when some young extra is going to break big in 10, 20, 30 years and some film studio head wants to advertise they have hot star of the moment's first movie ready to throw out again to the public...

    18. Re:I must be missing something here... by TooMuchToDo · · Score: 1

      They should outsource the job to Google. They've built an entire distributed architecture to deal with the processing and storage of Massive amounts of data. And Google has tons of techs who aren't paid squat to replace components/systems in their clusters. The cluster is built to handle the redundancy, so you can have "minimum-wage drive jockeys" doing the monkey work.

    19. Re:I must be missing something here... by Firethorn · · Score: 1

      Someone might say that hard drives are not an acceptable form of storage for long term-

      Agree. Hard Drives are designed for active access, not creating archives.

      A few hard drives replaced on a yearly basis could be under $1K. With the right machinery to do the copying, you might not even need much of a staff.

      Adds up quick if you consider that if each movie takes up 4TB(using another poster's number for spiderman) - that's a minimum of 4 drives, more likely 5 or more for RAID 5 or even a RAID 6(able to recover from multiple drive failures at the same time) type application.

      Personally, I'd go for glass masters - the current expected survival, given proper storage, is in the centuries.

      Figure 8 GB per glass master, at a cost of $1k each*. That'd end up being 500 masters - $500k ouch. Still, you'd end up with a store that would slaughter even film at longevity.

      And it'd be mostly a static cost - not annual.

      Maybe they're going with something like a DAT tape system. Much cheaper per tape, but might need an annual read test/refresh. Still, shouldn't be anything like the cost they're quoting.

      *I looked up a site and saw that the cost increase for 1000 disks vs 2500 disks was $1,500(the first 1000 DVD-8 would be $1.5k less out of a lot of 2500 than purchased seperately). Glass master is included, so I figured ~$1k for the mastering process.

      --
      I don't read AC A human right
    20. Re:I must be missing something here... by Smidge204 · · Score: 1

      More like they never know when they'll have to whip out a "director's cut" or "digitally remastered" version to prop up sluggish sales. Oh wait! You can't digitally remaster something that's already digital, can you? Hmm...

      As I said, it was a stab in the dark. It's also uncompressed, and halving that (at least) without loss would be a simple task. It still blows half the article's arguments clean away: When you're paying under 30 cents per gigabyte media costs becomes much less of a problem.

      If you have any actual information on how much data is stored, please share with the class. I think you are greatly exaggerating the amount of filming that's being done, considering most movies rarely spend more than a year in actual filming. Consider the costs involved and I'm sure studios go to great lengths to not junk 99% of their time and effort. I actually think only 25% is a bit generous for something involving live actors.
      =Smidge=

    21. Re:I must be missing something here... by Tsunayoshi · · Score: 1

      Karma bonus?

      OK, just take this little scenario: someone else posted about Spiderman 3 having 4TB of raw digital data, how would you store that data in such a way that the next time you need to access it you are guaranteed no degradation?

      --
      "Get a bicycle. You will not regret it, if you live." - Mark Twain, "Taming the Bicycle"
    22. Re:I must be missing something here... by rk · · Score: 1

      Your points are well-taken, but the increased cost argument is somewhat lessened by the idea that with these increased costs comes also increased utility (your hot new star's early movie supporting role being an excellent example). That they are storing things now that never got stored at all before makes a direct cost comparison a dicey proposition.

      If data volume increases greatly because of technological breakthroughs and how they are used, it stands to reason that archiving that data will become a more expensive proposition. They now want to archive things that 10 and 20 years ago would not have even been captured. It's not shocking to me it's more expensive. I wonder how much it would have cost to produce and archive the film if they used those thousands of hours of movie film like they use the digital formats now.

    23. Re:I must be missing something here... by Tsunayoshi · · Score: 1

      Then that goes back to my original point that is it more than just buying a disk and having a monkey copying data onto it.

      I'm sure Google's clusters are a little more sophisticated than that, and that they would still charge a pretty penny to provided long term archival storage of hundreds of TB of data that required 100% data guarantee.

      --
      "Get a bicycle. You will not regret it, if you live." - Mark Twain, "Taming the Bicycle"
    24. Re:I must be missing something here... by Cromac · · Score: 3, Interesting
      It's to bad there isn't any warning when a drive interface is going to be retired, also to bad it happens so often people can hardly keep up...oh wait...

      Even if it did cost a quarter million a year that's still a fraction of the salary the so called "talent" makes for the big movies, there is plenty of money in the movie industry to pay for a datacenter for long term storage of the film.

      Maybe the movie industry should hire some people from Google to help them design a large scale redundant storage facility, Google seems to have the entire web cached, adding movies - even at a few TB each - shouldn't be a problem for them.

    25. Re:I must be missing something here... by Cromac · · Score: 1

      These dumbasses are probably burning everything to CD-Rs or something.
      Hey, all those cheap CompUSA disks have to be used somewhere now that the stores are closed...
    26. Re:I must be missing something here... by dtolman · · Score: 2, Interesting
      Your numbers are way off. Actual filming tends to last around 6-10 weeks. But during that time they are filming 10-12 hours per day, with multiple film crews, each with multiple cameras.


      Television shows aren't much better. I have a friend who does TV editing - a major complaint he has is that there is dozens of hours of footage for hour long TV shows now - movies are worse. Major motion pictures can have over 200+ hours of footage for a 2 hour movie. Here a few cites I could find with a quick google on "feet of film" (the industry standard):
      Titanic - 1.3 million feet of film (about 240 hours of footage) - http://www.northern.edu/wild/th100/flmprod.htm/
      Dukes of Hazzard - 620,000 feet of film (120 hours of footage) - http://www.avid.com/profiles/080805_dukes_filmcomposer.asp?featureID=910&marketID=/
      Knocked up - over 1 million feet of film (180 hours of footage) - http://www.orange.co.uk/entertainment/film/19332.htm?linkfrom=%3C!--linkfromvariable--%3E&link=link_1&article=filminterviewknockedupsethrogenpart1/

    27. Re:I must be missing something here... by Anonymous Coward · · Score: 0

      Your mother must be very proud of you.

    28. Re:I must be missing something here... by foobsr · · Score: 1

      Maybe they're going with something like a DAT tape system.

      Probably.

      http://domino.watson.ibm.com/comm/pr.nsf/pages/news.20060516_magnetic.html
      "6.67 billion bits per square inch lays foundation for future tape storage improvements"

      http://www.fujifilmusa.com/JSP/fuji/epartners/TDSNanocubic.jsp
      "Imagine one data cartridge, small enough to fit into a shirt pocket, being able to store the equivalent of 200 two-hour movies, 50,000 trees made into paper, 100,000,000 web pages or all the X-ray films in a large hospital! NANOCUBIC technology makes this possible."*

      *I know they are not talking 'master-copy', but still

      CC. CC.

      --
      TaijiQuan (Huang, 5 loosenings)
    29. Re:I must be missing something here... by Divebus · · Score: 1

      Did Kodak fund this excercise? No way in hell does it cost that much to store all the elements digitally as opposed to film - if you're competent. And NASA not able to read the Viking Data is just incompetence of whoever is archiving it. That's just a scare tactic. Now, you do need to assess the quality of the storage and roll the assets to new media but that's just getting a lot cheaper, robust and more compact per TB every year.

      The biggest difference between old films and new is they often didn't keep all the old elements. The "cutting room floor" got swept every night. Of course, if you keep all that stuff it's going to cost more to store than if you didn't. You're lucky to find a print of a finished film, much less the cut negative. Cutting negative means destroying the original so there is no original - and not much for outs.

      You're not far from wrong on the storage assessment. Some movies are shooting more like 40:1 ratios but the original data may be compressed, saving some storage space if you choose. Much of that (depending on the film) also gets lots of digital effects; lots more elements within the same finished frames. Add to that all the audio work, screen tests, outs, behind the scenes stuff, deleted scenes... However, when you do several versions of a scene, you're only drawing from the same image pool with a different recipe for how it gets assembled so you aren't really adding data bulk except for an ASCII description file for a different version.



      --

      Most of the stuff on /. won't survive first contact with facts.
    30. Re:I must be missing something here... by Smidge204 · · Score: 1

      Your first two links are broken, but at least we have some hard numbers. Quite far from your "1000's of hours" number too, BTW :P

      So 200 hours at 15GB/min works out to about 180TB of uncompressed data. At $350 per TB, that is a one-time cost of $63,000. You can reliably cut that in half using lossless compression.

      I still don't see the problem, but this is mainly because the article was completely lax on any details. This is not the kind of data you need to have live all the time like a big company's customer data would need to be. It is archive data. There is little or no ongoing cost for maintaining archived drives - they just sit there. By the time you feel it necessary to verify the data and update the media, say in five years time, the cost of doing so would be significantly less than the initial setup. I fully expect the price of 1TB drives to be around $200 by the end of spring. A $500 computer and an intern paid $10/hr can plug in a hard drive and press a button to verify and copy data.

      You also don't need nearly as much physical space to store the data. 180 hard drives will fit in a crate vs. a million feet of celluloid film which would take up a whole room.
      =Smidge=

    31. Re:I must be missing something here... by rmerry72 · · Score: 1

      Figure 8 GB per glass master, at a cost of $1k each*. That'd end up being 500 masters - $500k ouch. Still, you'd end up with a store that would slaughter even film at longevity. And it'd be mostly a static cost - not annual.

      $500K doesn't sound too bad considering probably $100-200 million went into creating the film. For a reasonable expectation of a century of life and being able at any time to capitalise on a hidden extra, that seems very, very reasonable.

      If you had a $100 million jewel that would be kept in a sealed vault for $1/2 million for a hundred years would you opt for it? I would.

      Why is everybody worried about $100K here - these costs are the most minimal costs in making a $100M film?

      --
      We do not inherit the Earth from our parents. We borrow it from our children.
    32. Re:I must be missing something here... by emj · · Score: 1
      Of course there is more too it, they even say this at the end of the article:

      According to Mr. Shefter, a universal standard for storage technology would go far toward reducing aproblem

      What this mean is harder too understand, but what your parent describe is probably it.
    33. Re:I must be missing something here... by dtolman · · Score: 1
      Disk drives are not viable for long term storage - if they aren't used on a regular basis (for a few years), they can seize up. For long term storage they are going to use magnetic media - which max out at like .5 terrabytes a tape. And those are only rated for 20 years or so - which means that they need to be taken out and checked every so often...


      This isn't going to be a problem for existing movies forever... When they come out with terrabyte thumb drives whose going to care - except all the movies will be holographic and taking a terrabyte a second by then probably. Suckers.

    34. Re:I must be missing something here... by Firethorn · · Score: 1

      "Imagine one data cartridge, small enough to fit into a shirt pocket, being able to store the equivalent of 200 two-hour movies, 50,000 trees made into paper, 100,000,000 web pages or all the X-ray films in a large hospital! NANOCUBIC technology makes this possible."

      Well, given that a 2 hour movie can be stored on a single 8GB DVD, you'd still need 3 of these to store the 'source' archive used in movie making.

      As for the tape - I'll point out that the only real limitation as to quantity is how much tape you're willing to use, how big of a reel you're willing to live with.

      The concern with magnetic tape is still longevity - it undergoes gradual degradation just like more traditional film tape. One thing you don't want to do with archives is to put it on brand new cutting edge technology - you want stable, not necessarily new.

      --
      I don't read AC A human right
    35. Re:I must be missing something here... by dtolman · · Score: 1

      Oh - btw - the links I made might need the trailing slashes removed to work. And I know where I got the 1000 hours of footage figure from now - its from the Lord of the Rings - probably an exceptional case. Its on the IMDB trivia page for RoTK - 6 million feet of film for all 3. But still - romantic comedies with 100's of hour of footage? WHY?

    36. Re:I must be missing something here... by Firethorn · · Score: 1

      It's still a chunk of potential profit loss, especially if it can be done cheaper(which I'm fairly reasonable is possible).

      Whether the extras will enable the sale of enough extras to justify a half million is in doubt - how many special features can you market for the average film?

      --
      I don't read AC A human right
    37. Re:I must be missing something here... by Anonymous Coward · · Score: 0

      Actually, Google's copy of the web takes 4.2 TB (according to their talk on BigTable), less than the amount of raw data for one movie. Some of their tables are bigger (a couple hundred terabytes), but they don't compare to large quantities of movies.

    38. Re:I must be missing something here... by The+Evil+Couch · · Score: 1

      Even if you replace "minumum-wage drive jockey" with "qualified IT professional or three", I can't see how you'd get anywhere near $12k per year.
      Err, minimum wage is 12k USD per year. Replacing the "minumum-wage drive jockey" with qualified IT personnel will most assuredly not just near, but exceed $12k per year. Perhaps you meant $120k?
    39. Re:I must be missing something here... by Anonymous Coward · · Score: 0

      It's the JEWS, stupid. They're trying to make out that the shit that Hollywood produces every year is even WORTH archiving. It isn't. That's it. Period. But the JEWS want you to forget all about those wretched black and white movies which show America (and other countries) as ALL WHITE. Because you wretched whites might start noticing just how awful your countries have become, now that the JEWS have flooded them with third world savages, so that they (the Jews) can more easily control you all...

    40. Re:I must be missing something here... by Anonymous Coward · · Score: 0

      Let's suppose this "qualified IT professional" is paid $1e6 per year.

      Let's also suppose he needs to change one terabyte of backed-up data every year. (This could amount to 3 or 4 or some other trivial number of actual drives -- per year -- assuming current spinning-disk nonsense is perpetuated indefinitely.

      Let's say your movies are 5GB of data.

      Do the arithmetic: 250 movies per year are "maintained" by this woefully underemployed, hyper-expensive, million dollar/year "qualified IT professional".

      More arithmetic: $1e6/250 = $4000 per movie.

      Now in the usual reality most people inhabit, $4k $12k $210k. Maybe yours is different? And do remember that our million dollar a year guy is going to be maintaining a hell of of a lot more than 250 movies per year, which will push the $4k down to almost zero, even assuming a stupidly high-priced "qualified IT professional" is at the helm. To hit the $210k/year figure, you would probably have to pay this "qualified IT professional" billions, perhaps trillions, per year.

    41. Re:I must be missing something here... by TheSync · · Score: 1

      Almost all film archivists are looking at LTO tape for long-term storage of digitized assets. Hard drives are not really an economic option, compared with the economies of large robotic LTO tape libraries from ADIC or Sun. The expectation is every five years or so they will need to migrate data from LTO-(x) to LTO-(x+1), taking a doubling of data density per tape in each generation.

    42. Re:I must be missing something here... by mabhatter654 · · Score: 1

      but this is money the STUDIOS have to pay to keep their precious "IP"... there's nobody they can cheat out of paying, no back room deals.. they pay or lose the information.

      I do agree they are not contacting the right people. I'd bet GM or Ford keep this much info for SOX/ISO/EPA/engineering/QA/ect purposes on a monthly basis... studio exec are really stupid when it comes to technology.

  8. Re:Perhaps they need to learning about DUPLICATION by Danborg · · Score: 0, Troll
  9. Dupe Readings are off the charts... by tzjanii · · Score: 0

    I haven't seen them this high since the Tunguska Blast of 1909...

    --
    Slashdot is a pretty cool guy eh posts dupes and doesn't afraid of anything.
    1. Re:Dupe Readings are off the charts... by geminidomino · · Score: 1

      I'm not so sure. I was present at a mass sponge migration!

  10. ... what? by orclevegam · · Score: 0

    Aside from the fact that this story is a dupe as pointed out by pretty much everyone, where the hell are they coming up with these costs? Put the damn things on DVDs, or better yet, plain old HDs and stick them in a hermetically sealed safe. Problem solved, they're good for at least 10 years. If you want even longer storage replace the air in the safe with something like pure Nitrogen and it should be good for well past 25 years (depending on the chemical breakdown of the materials in the DVDs used, there's some evidence that the dye used in DVD-Rs and CD-Rs might breakdown in relatively short periods of time).

    --
    Curiosity was framed, Ignorance killed the cat.
    1. Re:... what? by cpaalman · · Score: 1

      so your solution is to put the info onto DVDs, which you then follow with the statement that there is evidence that the media might breakdown after time... Sounds like such a cheap solution may not be so viable. Maybe not a quarter-million dollar/yr problem, but me thinks that it's going to cost slightly more than some walmart DVD-Rs and Bob the intern to change the DVDs as they pop outa the burner.

    2. Re:... what? by gurps_npc · · Score: 1
      I work with DVDs and storage.

      DVD's on average begin to experience decay within TWO YEARS of creation.

      While the minimal decay is not noticed by you or me, it is noticeable by machines that copy things.

      To obtain the same high end storage with no detectable loss offered by raid storage, you pretty much would need to copy the DVD's every 18 months or so. Expenses for doing this mount up pretty quickly.

      --
      excitingthingstodo.blogspot.com
    3. Re:... what? by orclevegam · · Score: 1

      Are you talking DVD-Rs, or pressed DVDs, and what sorts of storage conditions? I would think a pressed DVD inside a nitrogen filled hermetically-sealed safe should be good for a very long time indeed.

      --
      Curiosity was framed, Ignorance killed the cat.
    4. Re:... what? by orclevegam · · Score: 1

      Actually I said DVD or HD. There are also 2 different kinds of DVD, pressed DVD, and DVD-R. DVD-R do have problems with breakdown, but as far as I know the only problem with pressed DVDs is oxidation. In a pure Nitrogen environment, oxidation shouldn't be possible, so I see no reason why a pressed DVD in nitrogen would suffer any sort of degradation.

      --
      Curiosity was framed, Ignorance killed the cat.
    5. Re:... what? by nitro316 · · Score: 0

      18 months is a lot longer than the Half -life of the highly unstable molecule known as Windows Vista. A typical WvU molecule degrades at an expontential rate after an install. Some theorizes that "Vista" is simply the radiated cousin of OSX/lINUX molecules that reached critical mass after being exposed to a can of super compressed monkeys. Well, super compressed monkeys soaked in gasoline, to be used for the first effective light speed version of whack a whole.

    6. Re:... what? by Chrisje · · Score: 4, Informative

      You are obviously not an electronic mass storage professional, because your answer could not possibly be further from the truth. The fact that it got modded 2, Interesting) is interesting in that it proves that people on /. haven't got a clue either.

      A hard drive is a mechanical part that will cease to function if the lubrication (I kid you not) goes dry. So sticking a whole bunch of hard drives in a safe for ten years most likely results in you scrapping 8 out of 10 disks for mechanical reasons. Then the magnetic information that is stored on those disks will degrade with time even under perfect conditions. This is why the shelf life of data on an inactive hard drive doesn't surpass 2 years.

      DVD's and CD's supposedly should last for 20-100 years depending on whose marketing bullshit you are reading, but in practice up to 15 years is the maximum before the thing starts degrading. Tape suffers, albeit less, from the same ailment hard disks suffer from, even the current batch of LTO-3 and 4 WORM media.

      The current generation of MO or UDO drives however use a laser to heat up particular clusters of particles after which it uses a magnet to create the 1 respectively the 0. This means that they are (nigh) impervious to magnetism or heat as long as those two are not combined. MO/UDO is therefore the only medium that will survive for long times on a shelf.

      The obvious solution therefore, since HDD's are getting cheaper and bigger, is to stick all that data on active hard-disks, and keeping it alive. Keeping it alive means also having to do backups. All of this requires system administrators. And rules, management, business processes and whatnot, and at the end of the day you will have managed to build an expensive data center. It works, but not as cheaply as putting boxes of film in a basement for 50 years, sorted by title/alphabet.

      Obviously, the physical survival of the media is not the only worry, we're also aware of the fact that the .mod file I could play out of my LPT-port-sound-contraption 18 years ago is now useless because mod players and those devices are far from ubiquitous (I found the .mod format converter, but can't find any schematics for that capacitor-LPT-sound-thingy I put together back in the day).

      But all that aside, this article is a dupe. And so are the comments claiming it's a dupe. I'm getting a strange sense of Deja-Vu, because it's not the first time I see ignorance on the subject of electronic data management either.

    7. Re:... what? by orclevegam · · Score: 1

      Ok, so HD is out (didn't know about the lubrication, thanks for the info). What breakdown process is involved with the CD/DVD? I know the -R format of both of those suffers from dye breakdown, but I thought the only danger pressed optical media faced was oxidation which should be possible to avoid by storing it in Nitrogen. Is there some other process that degrades pressed media I'm not aware of? Also for the HDD/data center solution, shouldn't you be able to reduce the overhead by just using mirroring hot-swapable HDD RAIDs and just having a tech swap out the drives as needed? I suppose the danger there is that with the rate HDD are updated the entire array could quickly go out of date, but maybe a networked cluster could offer some sort of solution. Instead of worrying about the particular hardware you just need software to make the system a node on the cluster and mirror data. As nodes die they could be replaced by newer hardware and you just update/port the client software as needed. Networking tech evolves at a much slower pace than HD or CPU so that should provide a little longevity.

      As for formats, that's rather easily gotten around by storing everything in a well defined format that's recorded as well. So long as the codec documents are kept in a reasonably current format there should be no danger of losing the old data as converters could be written to update it to the latest formats.

      --
      Curiosity was framed, Ignorance killed the cat.
    8. Re:... what? by MagikSlinger · · Score: 1

      ... better yet, plain old HDs and stick them in a hermetically sealed safe.
      From TFA:

      "If not operated occasionally, a hard drive will freeze up in as little as two years."

      --
      The bitter lessons of a veteran coder: http://bitterprogrammer.blogspot.com
    9. Re:... what? by UncleTogie · · Score: 1

      Obviously, the physical survival of the media is not the only worry, we're also aware of the fact that the .mod file I could play out of my LPT-port-sound-contraption 18 years ago is now useless because mod players and those devices are far from ubiquitous (I found the .mod format converter, but can't find any schematics for that capacitor-LPT-sound-thingy I put together back in the day).

      Wow. I'd almost forgotten 'bout that player. Good thing I found your schematic here.

      Just download the v1.12 and read the included file, Mp112.doc. Look for the section headed "How to make a D/A converter for five pounds" and you'll be in business!

      --
      Don't tell me to get a life. I'm a gamer; I have LOTS of lives!
    10. Re:... what? by Anonymous Coward · · Score: 0

      You obviously have no idea how much data the full contents of a digital film takes up.

      Including raw files, converted files, masked files, a film can take well over 10TB of data. And most production places DO backup on to dvds, but it's closets worth of dvds.

      This isn't just "stick your HD in a box and it will last forever". Especially not when people are asking to recover data you've "stored".

    11. Re:... what? by BranMan · · Score: 1


      Is everyone a moron around here? The only solution I have ever seen for long term digital storage is by far the cheapest, and easiest - though not the most compact. What about 2D barcodes? Just PRINT the damn info onto paper (the 2D barcode stuff has pretty good data density) and stick it in a cabinet or two. Jeez, it shouldn't take a damn rocket scientist. That will be good for 100+ years, is easy to read back into VOLATILE storage again, can be duplicated infinitely and relatively cheaply, and requires no maintenance. What is wrong with you people??

    12. Re:... what? by Tony+Hoyle · · Score: 1

      I've got DVDs in my collection that are 10 years old. And they haven't been kept in a storage environment either. I find it hard to believe the assertion that they break down after 2 years.

      This is digital data. There is either degradation that affects the data or there isn't.

      Just for kicks I just pulled out my old collection of Redhat 6 made on an old DVD-R when it was current arround 1999. It reads perfectly.

    13. Re:... what? by evilviper · · Score: 1

      DVD's and CD's supposedly should last for 20-100 years depending on whose marketing bullshit you are reading, but in practice up to 15 years is the maximum before the thing starts degrading.

      I presume you're talking about off-the-shelf CD-Rs, which certainly wouldn't be used here. Gold CDs are well worth the investment if you're planning long-term storage of data, and are certain to last at least reasonably near a century. Make a copy every ~50 years, and you have some extra insurance. Use some extra discs to store parity information (ala par2) and you have even more insurance against either a couple entire discs going bad, or several individual CDs being usable, but having a number of unreadable sectors.

      Tape suffers, albeit less, from the same ailment hard disks suffer from, even the current batch of LTO-3 and 4 WORM media.

      Indeed. It suffers from several other issues as well. Degradation of the tape, wear and tear from reading the tape, any electromagnetic field (eg. static) etc.

      The current generation of MO or UDO drives however use a laser to heat up particular clusters of particles after which it uses a magnet to create the 1 respectively the 0.

      The "current generation"? Are you suggesting there were previous generations of magneto-optical drives, that DIDN'T use OPTICS and MAGNETICS to store data?

      This means that they are (nigh) impervious to magnetism or heat as long as those two are not combined. MO/UDO is therefore the only medium that will survive for long times on a shelf.

      These two sentences are bullshit from beginning to end. Sound like you've got lots of stock in Sony, or some other major MO company. Or at least you've bought-in to their bullshit press releases.

      If you heat a MO disc up to it's "Currie Point/Temperature" the magnetic orientation (all stored data) will be erased. No magnetism is needed. In fact it is inherently true for any material that uses magnetism to store data. That is how MO discs are erased so they can be rewritten.

      Optical discs are no more susceptible to heat than MO discs are, and aren't at all susceptible to magnetism (or more accurately, the potential for decay of a less robust magnetic layer). And it's not as if either is highly susceptible to heat, either... Unless you plan on keeping your discs in an oven, or have someone intentionally put the discs in a drive and trying to overwrite them, neither should degrade due to heat, within a century's time.

      Finally, you neglect to mention that it's much more difficult to read MO discs than purely optical formats (CDs/DVDs/etc.). The equipment must be much more accurate to follow the tracks on the MO discs. Unlike purely optical discs, MO is highly sensitive to alignment issues. As such, the difficulties in recovering data from an aging or damaged MO drive are about the same experienced when recovering data from HDD platters (ie. alignment issues), as well as tapes, as you've mentioned. After a few decades, I'd be much more worried about being able to read ANYTHING from a MO disc, than I would a CD/DVD...

      For rewritable media, MO is probably the most reliable format currently available. It supports around 1 million erase/rewrite cycles, compared to the ~100 with CD-RW. But it doesn't compare nearly as favorably to write-once optical media.
      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    14. Re:... what? by evilviper · · Score: 1

      What about 2D barcodes? Just PRINT the damn info onto paper (the 2D barcode stuff has pretty good data density) and stick it in a cabinet or two.

      The reason paper is a preferred storage method to digital formats is NOT because paper has some special properties that prevent any degradation from occurring over the centuries. The reason paper is reliable, is that the written word is so incredibly low density, that extensive decay of paper over centuries does not render it unreadable.

      As soon as you use high-density data formats to write on paper, that advantage disappears entirely, and every single lost particle becomes unrecoverable data.

      If you took high-density bar-codes to the extreme, using a reliable backing material like metal, and putting it in a circular form to make reading it easier, you'd have reinvented the CD.
      --
      Slashdot gets worse every day... Pipedot: News for nerds, without the corporate slant
    15. Re:... what? by Anonymous Coward · · Score: 0

      Why not use a linear digital optical media?

      Use celluloid but use 1's and 0's with some nice redundancy and error checking so the info is resilient.

      Possibly a much better mass storage solution for archival purposes. Higher density physical storage for data that does not need to be high speed and quickly retrieved.

    16. Re:... what? by zig007 · · Score: 1

      end of the day you will have managed to build an expensive data center Well, yeah, but I'd say that a quarter of a million dollars is a totally ridiculus figure anyway. I have run some storage systems in my day, and that figure would only be reached if you consistently chose the most expensive options, and then thew a LOT of man hours on it. Especially considering that one probably wouldn't build one datacenter for each movie, but rather one(with 2 co-locations on different places on the globe) for each studio...
      --
      Baboons are cute.
    17. Re:... what? by k8to · · Score: 1

      Your mod file example is great. It's a now archaic format which is no longer in vogue.

      Fortunately the LPT port nonsense was a hardware specific nonsense completely independent of the format, and open source code which can reproduce the music on any modern platform is readily available. http://mikmod.raphnet.net/ http://www.modplug.com/ (sourcecode for modplug is availble, believe it or not)

      There are also closed solutions: http://www.un4seen.com/

      And there are industry standard sound libraries that do the job fine: http://www.fmod.org/

      So, it seems that these antiquated technologies (mod dates to 1987) tend to get supported just fine.

      --
      -josh
    18. Re:... what? by Anonymous Coward · · Score: 0

      I don't know of anyone who would willingly store 10TB of data on DVD's. 2500 disks is simply unmanageable, and the likelihood of a few failures is pretty well a damn sure 100%. If this is where these idiotic $12k/movie/year or $210k/movie/year figures are coming from, then frankly, all you people deserve exactly what you are about to receive.

      But I understand the "storage professionals" need to put food on the table like everyone else, so what's a few embellishments and a healthy serving of pure FUD? If you want to pay me $210k/movie/year, hell, I'll take your money, sure, no problem, sucker!

    19. Re:... what? by TheSync · · Score: 1

      All the motion image archivists I talk to prefer digital tape currently because of the long history and understanding of archiving analog tape that can be applied to digital tape (a 50+ year history now). None of the archivists I've talked to trust any of the optical media yet, but time may change this.

      LTO is currently the preferred archival tape format because it is open, multi-vendor, and has a fairly predictable migration path to higher densities over time.

  11. Re:Perhaps they need to learning about DUPLICATION by Marcos+Eliziario · · Score: 1, Insightful

    Stupid mods....

    --
    Your ad could be here!
  12. I have dozens of 20+ year old CD's by gatkinso · · Score: 1

    that still play just fine.

    Just an observation.

    --
    I am very small, utmostly microscopic.
    1. Re:I have dozens of 20+ year old CD's by Anonymous Coward · · Score: 0

      And I have dozens of 80+ year old records that still play just fine.

      There is some advantage to analog.

    2. Re:I have dozens of 20+ year old CD's by oneiros27 · · Score: 1

      Pressed or burned CDs? Pressed tend to have a much longer shelf life, but they're significantly more expensive to master, as they expect to make up for having cheaper per-copy costs.

      And how many 20+ yr old CDs do you have that _don't_ play just fine? If you have 24 ("dozens") that are fine, but 200 that aren't, then it's not particularly good for archiving. Even if you only lost 1%, someone has to determine at what point they need to do a media refresh so they don't lose the 1% and/or how many copies they need to create to increase the odds of there being at least one copy preserved.

      And how many of them seem to be just fine, but actually have bit errors that your ear can't tell? CDs are intentionally written in such a way that a single bit won't be as significant. Whereas, with other types of data, a bit may corrupt the entire file.

      I might be more paranoid than normal, but I'm in a field where I manage large amounts of data which we're required to preserve forever. (well, once they've exceeded their useful life, we pass them off to other folks for long term preservation, but we do manage data that we've had to refresh multiple times, and it sucks having to hand-load a few paper case sized boxes filled w/ CDs so you can get the data verified and put on new media.)

      --
      Build it, and they will come^Hplain.
    3. Re:I have dozens of 20+ year old CD's by Anonymous Coward · · Score: 0

      Yeah, 'cuz mechanically pressed mass-produced CDs are JUST LIKE digital movies! You sure are a cretin, how do you manage to breathe without a respirator?
      Just an observation.

    4. Re:I have dozens of 20+ year old CD's by gatkinso · · Score: 1

      Just pointingout that digital media can last just fine, regardless of the FUD.

      --
      I am very small, utmostly microscopic.
    5. Re:I have dozens of 20+ year old CD's by gatkinso · · Score: 1

      Pressed.

      Sure they are more costly than burned, but when you pay Arnold $20 million for his role, I expect that cost in this area fades as an issue.

      Actually, I have only had a few that won't play - because they were all mechanically damaged (huge ass scratches and such). While that is an issue, I haven't experienced any degradation in the media iself.

      --
      I am very small, utmostly microscopic.
    6. Re:I have dozens of 20+ year old CD's by gatkinso · · Score: 1

      Reply in 80 years and then let's compare. Can't speed up time so it is impossible to say - but so far (1/4 century) the pressed CD's are still going strong.

      --
      I am very small, utmostly microscopic.
  13. unedumicated by peas_n_carrots · · Score: 2, Insightful

    This story must have been written by a journalist clueless in the ways of technology. How does storing a hard drive in a salt mine any more costly than storing a film version? Where does the extra electricity come in? Have one primary version, make a backup (or 2 or 3) and put them in storage. If you're paranoid, verify and/or re-duplicate every few years. The cost of verifying regularly vs reconstructing degraded film should be a wash at worst. It should easily favor the digital versions.

    1. Re:unedumicated by HatofPig · · Score: 1
      From TFA

      Digital audiotape, it was discovered, tends to hit a "brick wall" when it degrades. While conventional tape becomes scratchy, the digital variety becomes unreadable.
      "Discovered"? You mean once you can tell the ones from the zeros, they "discovered" it becomes unreadable? Compare a photograph to a 1000 words -- when one degrades it's a blurry picture, but once you can't make out the letters the paragraph is a useless grey blob.

      And besides, digital audiotape? For movie archiving? I guess they mean magnetic tape, but the word "audio" should have been the first tip-off there, IMO.

      --
      Silicon & Charybdis McLuhan Kildall Papert Kay
    2. Re:unedumicated by Anonymous Coward · · Score: 0

      I was wondering how to make digital more expensive; (*A) I think I figured it out:

      1. Buy a brand new mainframe. (big name brand helps up the price)

      2. Put a shipload of RAM in it, and store the film in RAM.

      3. Store the film in a proprietary format, and pay the software vendor yearly fees for the right to view the film. (*B)

      4. Keep it running for 50 years.

      5. Pay the salary of a computer tech to fix any broken parts, and restore a backup of the data from a hard drive backup, or tape, if it crashes.

      6. Pay the salary of a nightwatchman to guard the place.

      Yes, it'd cost more than having to store and reprocess a decaying tape, but it would be much better quality.

      * A Heck, most of my old 5.25" floppies from my TRS-80 still work!
      * B Of course, one could keep it stored in a normal, open, format and just use VLC media player, but that solution shouldn't be used unless one wants to pay less.

    3. Re:unedumicated by AJWM · · Score: 1

      And besides, digital audiotape? For movie archiving? I guess they mean magnetic tape, but the word "audio" should have been the first tip-off there, IMO.

      They probably meant DAT and someone expanded the acronym. DAT and DDS tapes (4mm) are physically the same although DDS originally had higher specs (lower error rate). DDS-5 is also called DAT72, DDS-6 is also called DAT160 (160 GB compressed, 80 GB raw capacity).

      It's a not-uncommon tape storage format, although LT has higher capacity and is more prevalent for larger backups.

      --
      -- Alastair
  14. could someone link to the actual study? by Anonymous Coward · · Score: 0

    I looked around, but couldn't find it. The NY Times is not very good at linking to anything but their own site.

    1. Re:could someone link to the actual study? by GregPK · · Score: 1

      I could see the cost exploding if they keep the data in a data wharehouse so that they can actively access it at any given time. However, if they were to put it on laser disc, blue ray, dvd, HDDVD and a hard drive. Then, leave it sitting in a vault they wouldn't have to worry about it. The hard part is still having ready easy access to the original file.

    2. Re:could someone link to the actual study? by Wildfire+Darkstar · · Score: 1

      This is not the first time this story I've seen people comment on how digital footage can be archived by storing it on DVD.

      This is, in a word, ridiculous. MPEG-2 is a lossy format. The quality is good, of course, and perfectly acceptable to most audiences, but it's entirely unacceptable for an archival copy, which should ideally be stored in whatever format it was recorded in (which is typically lossless).

      Ultimately, that's the difference between preserving analog and digital video: it's fairly cheap and easy to maintain a copy of a digital film of reasonably acceptable quality for viewing purposes. But preserving a pristine archival copy that can be later used as a master is considerably trickier than that, and requires a lot more overhead (currently) than analog preservation. There's also the degradation factor: degraded analog material is easier to restore than degraded digital material. Likewise, digital material typically requires more complicated (and more expensive) hardware to access than analog material.

      The numbers seem slightly high to me, but not alarmingly so. The costs will come down over time, but digital will remain more expensive than analog for these purposes for a long time to come.

      --
      Sean Daugherty "I have walked in Eternity -- and Eternity weeps."
    3. Re:could someone link to the actual study? by RKThoadan · · Score: 1

      I believe the idea is to store them as data-DVD's, where it's just another way to store the bytes, in whatever format you want.

    4. Re:could someone link to the actual study? by GregPK · · Score: 1

      I didn't know if it was lossy or not. That's why I advocated copying it onto multiple formats. Also, I never said you should shrink it out of it's original format. If I was to backup onto a dual layer dvd I'd keep it in it's original lossless format and just burn the data. It might take a 50 pack or so. But, in storage on high quality DVD's I'm willing to bet it'll last a while.

    5. Re:could someone link to the actual study? by Wildfire+Darkstar · · Score: 1

      The thing is, movies are typically shot in high definition nowadays. Those aren't going to fit on a DVD uncompressed, even a double layer DVD. Honestly, you'd have trouble fitting them on a Blu-Ray or HD-DVD disc without some form of lossy compression. And that's just the actual film itself, mind you, with all of the cut footage and extraneous material that is typically excised from the final product. It's not unusual for the total amount of deleted scenes, alternate takes, and so on, to equal or exceed the amount of material actual kept in the final cut of the movie.

      And DVDs are a problematic storage medium, anyway, for archival purposes. Kept in a controlled environment, modern analog film will last for a very long time (a hundred years or more). And even if there is some degradation, it can be more easily reconstructed than digital media. On top of that, you need to contend with format shifting and other hurdles facing any kind of digital technology. Analog film from 1900 can still be played back on most modern projectors, and, even if you're deal with an atypical format, it's still relatively easy to deal with (frames of analog film are human readable). DVDs have been around for less than fifteen years, and we're already looking at BR or HD-DVD as possible successors. In fifty years I wouldn't be even slightly surprised if you have a hard time finding hardware that can read DVDs. Which means that a realistic preservation schedule will need to factor in format shifting every decade or so, which is a lot more attention than is required for analog media.

      And that, of course, assumes that we're talking about legitimate DVD pressing facilities: DVD+/-R discs are not suitable for archival purposes, as their lifespan is considerably shorter. And that's an additional expense that is frequently beyond the means of smaller studios and independent filmmakers. The benefit of digital media is that it is comparatively inexpensive to produce and distribute. But only if you're doing so on a level that is not suitable for long-term storage and maintenance. The costs climb very quickly when trying to deal with those concerns. Until rather recently, the standard solution to this has actually been to shift back into an analog format for preservation purposes, but there's an increasing awareness that this is unacceptable for a variety of reasons.

      --
      Sean Daugherty "I have walked in Eternity -- and Eternity weeps."
    6. Re:could someone link to the actual study? by GregPK · · Score: 1

      The ultimate solution is one that lets you pull up the original from the archive in less than a day and be editable. You don't have to make a single large file out of the movie when you put it on disc. You can spread it out over serveral discs quite easily. Every operating system since dos supports this. No big deal. Also, the reason the file storage is so huge is the number of cuts they use. The 30 plus extra renders etc. All that plus the movie probably consumes a terabyte of space. Thats the equivalent of roughly 100 Dual layer discs or more. So that kinda of rules out DVD as a storage medium anyways. BR, and HD-DVD make a better storage option overall. But I'd use them as an onsite backup more than anything else. The other direction you can use is half a dozen Data tapes and stuff them in a Nitrogen filled safe. Companies have used it for years with no major issues. It's not like the data storage is really prohibitive unless you need same day access to it. Thats where the costs start to really climb.

  15. more people who don't know how to properly by geekoid · · Score: 1

    calculate computer costs.

    --
    The Kruger Dunning explains most post on /. http://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
  16. It's just a format refresh by davidwr · · Score: 3, Funny

    /. is refreshing their file-storage format to avoid obsolescence. This thread is in the new format. The one from two days ago is in the old format.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
  17. Not really by ArchieBunker · · Score: 3, Insightful

    Its all about the storage medium used. You're telling me you want to rely on a hard drive thats been sitting in storage for half a century or film? Film can be restored and if the picture degrades then you stil have something to work with. What happens when you lose bytes here or there in your digital film? Pixelation or loss of a frame all together. Then comes the problem of codecs? Will anyone be able to play a VC-1 file 50 or 100 years from now?

    --
    Only the State obtains its revenue by coercion. - Murray Rothbard
    1. Re:Not really by orclevegam · · Score: 4, Insightful

      Then comes the problem of codecs? Will anyone be able to play a VC-1 file 50 or 100 years from now? They will if you also store the algorithm the codec uses. You can always re-write a codec in the future, so long as you know how it's algorithm and data structures work.
      --
      Curiosity was framed, Ignorance killed the cat.
    2. Re:Not really by Anonymous Coward · · Score: 0

      You can't even tell ITS from IT'S right now!

    3. Re:Not really by uradu · · Score: 2, Insightful

      I assume those ridiculous costs include periodic refreshing of all the data onto new media, and not just the physical cubbyhole to store the drives in. In that case your objection is moot. The great advantage digital storage has is that given proper media maintenance and periodic replication you will have pristine copies indefinitely, something that simply cannot be said of any analog technologies. Given the right equipment, this refreshing and replication process can be automated to such a high degree that little human intervention is required.

    4. Re:Not really by TedTschopp · · Score: 1

      I recommend that you try a different datacenter design. My point is that we are not talking about storing a file on a hard drive we are talking about storing a movie in a storage system. Just abstract the file system away from the physical hardware and the movie away from the file, and you solve this problem. These layers of abstraction, including with the codec, are all very easy, and very old, problems to solve in enterprise computing.

      --
      Fantasy remains a human right; we make in our measure and in our derivative mode... -- JRR Tolkien
    5. Re:Not really by paulatz · · Score: 5, Funny

      The cost is really ridiculous, releasing the master on bittorrent would be so much cheaper.

      --
      this post contain no useful information, no need to mod it down
    6. Re:Not really by encoderer · · Score: 2, Insightful

      exactly.

      This "study" is probably from a manager barking off orders to a bean counter:

      1. determine how much HD space we need per movie
      2. figure out the cost
      3. multiply that by a format refresh every 2 years
      4. come up with an absurd guess on how expensive it will be to maintain codecs and compatible systems
      5. act like this system will have no business utility other than storing archived movies
      6. add it all up
      7. divide by number of movies sold so we can figure out how much to raise prices, then multiply that number by 2.

    7. Re:Not really by CyberLord+Seven · · Score: 1
      Your are neglecting the cost of replication. That is one of the factors in the article.

      This is not trivial. Codecs and hardware change. To preserve a digital copy of a film requires a paid employee to watch for changes in codecs and hardware. Then the production company must purchase a copy of the license to any new codecs. Then someone has to go back into the ever-growing vault of films with many multiples of data larger than film stock (that's also in the article) and basically re-create the Y2K fix again.

      Oh, yeah, it doesn't stop there.

      What happens when a company goes bust and their codecs are not updated?

      --
      We have always been at war with Eurasia!
    8. Re:Not really by CyberLord+Seven · · Score: 3, Informative
      It's not that simple.

      The article is very clear that digital film production creates much more data!

      Directors no longer need to husband expensive film stock so they often leave camera rolling while they work out scenes. This is not necessarily garbage footage that can be discarded. Some of this material will be valuable to film historians and also financially valuable as it can be filler for the "extras" that are now included on DVDs.

      Digital production creates a much larger set of data that needs to be preserved and updated.

      --
      We have always been at war with Eurasia!
    9. Re:Not really by PopeRatzo · · Score: 4, Insightful

      It appears to have finally happened: the ever-shrinking distance between now and nostalgia has finally reached its zero-state. We are now nostalgic for our present.

      Maybe we should rethink the importance of preserving popular culture indefinitely in all its pristine digital glory. Why should we spend any money storing the Dukes of Hazzard movie for 100 years, except to fuel the campy nostalgia of future wankers who probably should find something better to do with their time? It's possible that we've already wasted enough time and energy on kitsch.

      I mean, it's nice that I can buy a boxed set of all the Francis the Talking Mule films, but I'm pretty sure I could live without it. It's the navel-gazing egotism of this generation that thinks every speck of its cultural exhaust is gold that needs to be protected for future generations.

      I'm willing to see society put a few bucks aside to preserve culture, but I think we should wait at least a decade before deciding to go long-term with any given artifact. That would allow us to better vet the material that we're going to keep. Maybe we can have a second and third-tier of stuff that can be saved using a lossy format. I bet it wouldn't cost me more than $200k to keep a divx of the 2005 film Son of the Mask. I'm pretty sure that's plenty good enough to insure that future generations don't miss out on anything.

      --
      You are welcome on my lawn.
    10. Re:Not really by ColdWetDog · · Score: 2, Funny

      Why should we spend any money storing the Dukes of Hazzard movie for 100 years ...

      Because at the rate we're going in terms of quality (vs. quantity), the "Dukes of Hazzard" may represent a pinnacle of entertainment achievement. A scary thought, but look at what's on the tube today and run that out for a couple of more decades....

      --
      Faster! Faster! Faster would be better!
    11. Re:Not really by MightyYar · · Score: 1

      You can't even tell ITS from IT'S right now! You know, a real grammar Nazi would have put "it's" and "its" in quotes instead of simply capitalizing them.
      --
      W..w..W - Willy Waterloo washes Warren Wiggins who is washing Waldo Woo.
    12. Re:Not really by orclevegam · · Score: 5, Funny

      Coming up next "Ow! My Balls!" on the Violence Channel.

      --
      Curiosity was framed, Ignorance killed the cat.
    13. Re:Not really by ArsonSmith · · Score: 1

      So you're saying that it's going to cost more to store more?

      wow big surprise there.

      --
      Paying taxes to buy civilization is like paying a hooker to buy love.
    14. Re:Not really by orclevegam · · Score: 1

      So does that mean if we continue at the current rate in the future we'll be nostalgic for things that haven't happened yet? Also xkcd weighs in on nostalgia.

      --
      Curiosity was framed, Ignorance killed the cat.
    15. Re:Not really by MightyYar · · Score: 2, Insightful

      Couldn't you set up a giant datacenter that does nothing but store data in a safe way? The copying would come automatically as you upgrade the datacenter with more storage, and I doubt that the cost would increase too much over time since data constantly becomes more inexpensive to store.

      I don't know what kind of data volume we are talking about, but for the $1059/year that it costs to store a film print, Amazon's S3 will store over 588 GB worth of data. For the $12,514 quoted in the article, they could store almost 7 TB. I'm having a bit of trouble believing that they couldn't store an archival-quality digital copy of a film (and all interesting outtakes) in 588 GB, let alone 7 TB. And the cost of keeping that data on Amazon would actually go DOWN over time, which you cannot say about storing the print.

      I'm not necessarily suggesting that they use S3 - just using it for the sake of cost comparison.

      --
      W..w..W - Willy Waterloo washes Warren Wiggins who is washing Waldo Woo.
    16. Re:Not really by tm2b · · Score: 1

      You're telling me you want to rely on a hard drive thats been sitting in storage for half a century
      Absolutely, if that content is raw, uncompressed DV and the "hard drive" is a network of NAS systems duplicated across several storage depots across the world. It's not like we're talking about home hobbyists here.
      --
      "It is our blasphemy which has made us great, and will sustain us, and which the gods secretly admire in us." - Zelazny
    17. Re:Not really by Captain+Splendid · · Score: 2, Insightful

      What happens when a company goes bust and their codecs are not updated?

      That's where OSS comes in. Give it time.

      --
      Linux, you magnificent bastard, I read the fucking manual!
    18. Re:Not really by AJWM · · Score: 1

      It appears to have finally happened: the ever-shrinking distance between now and nostalgia has finally reached its zero-state. We are now nostalgic for our present.

      Heck, I've been nostalgic for the future for a while now. It's almost 2008, where are our flying cars and cities on the Moon?

      --
      -- Alastair
    19. Re:Not really by xSauronx · · Score: 1

      so he's just a grammar socialist then?

      --
      By and large, language is a tool for concealing the truth. -- George Carlin
    20. Re:Not really by CyberLord+Seven · · Score: 1

      C'mon moderators! That's FUNNY even if you haven't seen the movie.

      --
      We have always been at war with Eurasia!
    21. Re:Not really by JDWTopGuy · · Score: 1

      From Idiocracy (a fine film), for the un-educated.

      --
      Ron Paul 2012
    22. Re:Not really by no1nose · · Score: 1

      If I had mod points I would mod you up.

      I was wondering the same thing, is it worth saving any/many of the movies released today, especially in lossless formats? What would be the point? How would keeping a perfect copy of "Dude, Where's my Car?" around for generations help anyone?

    23. Re:Not really by Saxerman · · Score: 1

      Your are neglecting the cost of replication. That is one of the factors in the article.
      What happens when a company goes bust and their codecs are not updated?

      This is a cost of their own manufacture. By keeping digital information locked up under proprietary third party protocols, you're forever at the mercy of their market whims. I'm certainly not going to claim that open standards would eliminate hardware/software obsolesce, but it would definitely help mitigate the problem. I, for one, will not be feeling sorry for them having painted themselves into an expensive corner.
      --

      A steaming cup of soykaf would be real wiz right now.

    24. Re:Not really by WhatAmIDoingHere · · Score: 1

      We best learn from the mistakes those who came before us have made.

      --
      Not a Twitter sockpuppet... but I wish I was.
    25. Re:Not really by Hucko · · Score: 1

      The only true way to ensure life after production is mass redundancy. If they upload the movies to torrents, we the obliging public will preserve their films for them! Unless they are undesirable.

      --
      Semi-automatic amateur armchair Australian philosopher; conjecture ready at any moment...
    26. Re:Not really by tepples · · Score: 1

      I'm having a bit of trouble believing that they couldn't store an archival-quality digital copy of a film (and all interesting outtakes) in 588 GB, let alone 7 TB. Including the raw footage before compositing and editing? Who decides what outtakes are interesting enough to preserve?
    27. Re:Not really by tepples · · Score: 1

      multiply that by a format refresh every 2 years What format refresh? How long does it take for the C language to become no longer compilable? Otherwise, you could just store the reference implementations of the Free codecs you used (e.g. Theora and Vorbis) along with the raw footage. I could see archiving the data to a redundant (e.g. par2) tape set, and then copying it to a new tape set every five years, but not every two.
    28. Re:Not really by gatkinso · · Score: 1

      In that time frame there will be crypto available to the public that would decode that content in under a mircosecond with absolutely no knowledge of the encoding scheme - hell not even knowing if it was video in the first place.

      Assuming of course there is something availible to read the disk.

      --
      I am very small, utmostly microscopic.
    29. Re:Not really by Score+Whore · · Score: 4, Insightful

      You keep saying "store the codecs" which means you're not thinking about this problem in a sane fashion. You don't compress. At all. That's the point of archival. It's not a matter of some geek boy lossfully reencoding his porn collection to fit on CD. It's a matter of keeping the original source material forever. There's no codec here. Just store the data flat with as many bits of precision as you have in your source material. End of story. The only real question is do you store this on spinning disks or stopped disks. Put it on a bunch of hard drives with some parity and error correction codes. Then shut them all down along with the entire infrastructure needed to read the data. Periodically fire it back up to verify that any bit rot that has come along can be corrected and then shut it down again. Every ten years or so, migrate the whole thing to whatever is new in storage. But don't ever compress this shit.

    30. Re:Not really by stuboogie · · Score: 2, Insightful

      "Directors no longer need to husband expensive film stock"

      You provided your own solution. The directors were more prudent with expensive film stock, so they didn't leave the cameras rolling. If they were financially responsible for all the additional footage not directly related to shooting a scene, I believe they wouldn't leave the cameras "rolling". Just because the directors can leave the camera "rolling" for extended periods of time doesn't mean they get to archive that footage.

      Financial waste and abuse run rampant when you place no restrictions on someone. Just look at how our government operates.

    31. Re:Not really by Anonymous Coward · · Score: 0

      It's funny, but it just might help someone. Not "Dude, Where's My Car" in particular, but archaeologists are willing to literally dig through garbage pits to discover what human societies of the past were like. Researchers painstakingly piece together shards of pottery which probably did nothing more impressive than store someone's rice. I'm sure there are people who would die to know what the stupid pop-culture of ancient times looked like. People studying the 20th and 21st centuries will have access to more information about their past than ever before, it could change the very way that we understand and relate to the past - if we can keep our digital media alive, warts and all.

    32. Re:Not really by BronsCon · · Score: 1

      And me with no mod points...

      --
      APK quotes people (including myself) without context and should not be trusted. Just thought you should know.
    33. Re:Not really by MightyYar · · Score: 2, Interesting

      I think that you could probably safely compress all of the "extra" footage that you don't know whether it is worth keeping or not. Maybe hundreds of hours of the crew talking to one another while re-doing scenes will be interesting to someone down the line, but probably not. And I doubt that they will need the original quality to be intact in any event.

      Note that in the days of real film, you wouldn't have that extra footage at all, since film is expensive and they couldn't afford to just keep the cameras rolling.

      By my rough estimate, 700 hours of extra footage would compress nicely in 1080i to about 10 GB/hour (going way overboard - blueray quality), giving you 7 TB. I can't believe that there would be 700 hours of stuff worth keeping... I mean, Christopher Guest is pretty famous for letting the camera roll, and his stuff usually comes in at about 80 hours. So you could back up every single shred of a Christopher Guest movie at blueray quality in less than 1 TB. Then you could preserve a "raw" version of the final cut of 2 hours in another 2 TB (even the bleeding-edge "4K" format only uses about 220 Mbps). So you could store an entire Christopher guest movie plus - what the hell - another TB of audio, data, and photos, and still come in under 4 TB. 10 years from now, that amount of data will be so infinitesimal that people will be laughing about there being any debate at all. Hell, in '93 a hallmate of mine bought a 1GB drive for $1000. You can now fit that in your pocket for $10. 1TB would cost you about $500, and I suppose that it is possible that in 15 years, you'll be able to get that for $10 and fit it in your pocket. So then you'd be able to store a raw Christopher Guest movie in your pocket for $20 :)

      But you are probably right, they probably think that they should keep every scrap of digital data completely uncompressed. They'll have to get over that or accept that they are keeping more raw data than they were in the past, and thus will have to pay more. In some cases (George Lucas, for example), it is patently obvious that they should keep every last scrap of digital output that he has. George has made more money remastering Star Wars than most producers will make in their entire career. Keeping the computer file that stores Jar-Jar Binks is similar to keeping the giant model of the UFO from "Close Encounters of the Third Kind".

      --
      W..w..W - Willy Waterloo washes Warren Wiggins who is washing Waldo Woo.
    34. Re:Not really by zippthorne · · Score: 2, Insightful

      "What happens when you lose bytes here or there in your digital film?"

      Your error-correcting codes do their job and correct the error. They also gives you a tangible warning sign for when it's time to refresh the media: when you no longer get 100% reads (or when the error% exceeds some acceptable threshold that happens to be well below the ecc's max error rate), you move to new media.

      And you do ridiculous amounts of parity bits, like O(size of the data) amounts of parity.

      If you're really concerned about future proofing you can print, in plain language, an explanation of the ECC and video codec on a metal plate and bolt that to the drive, but you're probably going to need to refresh before anyone forgets how either of those were done.

      --
      Can you be Even More Awesome?!
    35. Re:Not really by PopeRatzo · · Score: 1

      Because at the rate we're going in terms of quality (vs. quantity), the "Dukes of Hazzard" may represent a pinnacle of entertainment achievement. A scary thought, but look at what's on the tube today and run that out for a couple of more decades....
      I was referring to the horrible movie, not the fine television show.

      Ultimately, without Dukes of Hazzard (TV show) there would never be a Squidbillies, and the world would truly be a poorer, sadder place.
      --
      You are welcome on my lawn.
    36. Re:Not really by Wes+Janson · · Score: 1

      Parent is modded funny, but I don't see why that couldn't work out just as well. If it's something popular (although hell, there's a fanatic out there for anything) there will be a tremendous number of geographically-distributed backups available at any time. Besides the inevitable studio objections, what's wrong with having them all put up onto P2P services (or making one specifically for archival purposes)?

    37. Re:Not really by Total_Wimp · · Score: 1

      "They will if you also store the algorithm the codec uses. You can always re-write a codec in the future, so long as you know how it's algorithm and data structures work."

      Similar logic fixes most of the other problems as well. Who cares if hard drive spindles freeze up. Are we really predicting they won't be able to make new electric motors in 50-100 years?

      How about the idea that film merely "degrades" where digital files become "unreadable?" Well, not really. It only becomes "unreadable" to the average Joe who only knows how to click. For data retrieval experts, restoring files with some degradation to the media shouldn't be a terribly lot more difficult than trying to restore water-damaged film stock frame by frame. Both are difficult and expensive, but can certainly yield usable results. And for those damaged bits, it's very conceivable that in 50 to 100 years, the process will be easily automated, while film restoration will most likely remain a manual process.

      And while we're talking about the miracle of film stock merely "degrading," digital will always have a "degraded" format that is readily available if the original gets damaged. Just grab DVDs/HD-DVDs or Blue-Ray disks. If the disks have degraded, grab the rips that have been passed from hard drive to hard drive over the years. No, these are not as good as the originals, but if we're comparing film to digital, these degraded forms are certainly no worse than what happens in many of the ways film can get damaged.

      Finally, what about that cost? The article gave numbers, but gave absolutely nothing to back them up. Nothing. Sure, they showed potential problems, but didn't give us any information about why it costs so much to solve them. There's no way to determine if that's for equipment that will be half the cost in a year, if it's for data vault storage where they're getting significantly more value than they do in their film vaults, or if it's for manpower for processes that will be automated within the next five years.

      I won't go as far as saying that this is a non-issue. There's some work that needs to be done. But these are most certainly solvable problems, and the solutions have the potential to yield far better results than film archiving could ever hope for.

    38. Re:Not really by justleavealonemmmkay · · Score: 1

      Lossless allowed ?

    39. Re:Not really by hughk · · Score: 1

      You keep saying "store the codecs" which means you're not thinking about this problem in a sane fashion.
      You must store the codecs because you are still talking about mapping between R,G and B channels (or YUV or whatever), n sound channels and a single stream of data. Yes, I know that some file systems store multiple streams in one file but this must be synchronised.

      You don't compress
      You do, but you do it in a lossless way and with an open codec. For audio, we know about things like FLAC, but there are also ways to do it for video. Examples include ffmpeg and Lagarith amongst others.
      --
      See my journal, I write things there
    40. Re:Not really by hjf · · Score: 1

      Don't be ridiculous. Every time you recode a movie, it loses quality. You simply don't. You keep your file and name it something Example.Movie.2008.DVDRip-XviD.AC3.PROPER.SHiTmOVIeS-SC3NE.avi There. Bulletproof system. If you're in doubt, just add a nice NFO file along.

    41. Re:Not really by swv3752 · · Score: 1

      They make money on that extra footage, so you might as well archive it. Still their figures seem absurdly expensive. Mostly this is probably just another salvo at protecting their copyright from those dastardly pirates. "Look Congress! It is extremely expensive to maintain these movies so we need longer copyright extensions to make money."

      --
      Just a Tuna in the Sea of Life
    42. Re:Not really by TheSync · · Score: 1

      Will anyone be able to play a VC-1 file 50 or 100 years from now?

      Of course, VC-1 is a SMPTE standard (SMPTE 421M) :)

      SMPTE 1 for 2-inch videotape from the 1960's is still available...

      However there is today a feeling that it would be wise to put a copy of the codec source code in with the digital archive, just in case.

    43. Re:Not really by TheSync · · Score: 1

      The archival codec of choice currently is JPEG 2000. That is what the Library of Congress National Audio-Visual Conservation Center is using (http://www.pictureshowman.com/articles_restprev_NAVCC_part2.cfm).

      That said, I suspect that in a few years even JPEG 2000 will seem silly, and most archives will move to uncompressed as digital costs decline.

    44. Re:Not really by Gax · · Score: 1

      You keep saying "store the codecs" which means you're not thinking about this problem in a sane fashion. You don't compress. At all. That's the point of archival. It's not a matter of some geek boy lossfully reencoding his porn collection to fit on CD. It's a matter of keeping the original source material forever.

      Codec is commonly used as a combination of COder-DECoder, not simply COmpressor-DECompressor. All digital files are encoded in a specific manner, as defined by the type and version of the software used in its creation. There are many different types of formats available - proprietary, defacto, and open. It's preferable to use open formats, as they are well documented and can be recreated on GoogleOS 2120 or whatever, with little difficulty. The problem is the digital masters are created in software applications that use proprietary formats, which often require reverse engineering, in order to understand the method that they use to store information.

      Every comment I've read in this thread has mentioned duplication. Data backup is the easy part. However, it doesn't help you to access the files in 5 years time. There needs to be some method of decoding the bits into an understandable information stream. If you intend to store the original files, you often need the original software to access the content. In addition to backup, you need to periodically check your files and convert the information to other formats that can be read by modern software. This is the difficult part - there's a possibility that something that you consider important will change during the conversion and you won't realise it. I can convert my MS Word files to OpenText and break loads of things - the navigation has messed up, the automatic numbering has stopped working, etc. Movie objects - 3D objects, scripts, audiovisual data, etc. - are much, much more complex, presenting an increasing likelihood that something will go wrong. It's expensive to develop curation methods that are reliable and maintain everything.

      G
    45. Re:Not really by Score+Whore · · Score: 1

      Codec is commonly used as a combination of COder-DECoder, not simply COmpressor-DECompressor.


      I understand what a codec is and it has always meant coder - decoder. It is a way of transforming data it's not a way of storing data. Data stored in it's native format doesn't need a coding or decoding even though it may not be intuitively obvious what it is or how to interpret it. But it's not been coded via means of a codec pair.

      You document the container format and you are done. Your actual data format will be the simplest possible format that will store the necessary information. People bringing up any kind of compressed format just don't understand the problem that is needing solving.

      And as I briefly said in my original post, the equipment to read the files and export in a number of currently known formats would be included in the mothballing. As far as formats go... JPEG was developed in 1992 and approved as by an ISO committee in 1994. TIFF comes from even earlier. So even if you chose a compression method, it seems likely that you'd have no problem accessing it five years from now. At which time you upgrade to the then current data formats.

      Storing assets other than raw frames and audio tracks, is a completely different story and I agree that it will become hard to manage beyond just packing up the entire workstation, OS and software included. But I suspect that people aren't really going to be wanting to archive that kind of asset in this sense. You don't want to be going back fifty years for a model of Godzilla for use in Godzilla Stomps Salt Lake City in the year 2052. Studios will instead be continually migrating their assets and keeping them in the active library available for immediate use.
    46. Re:Not really by mabhatter654 · · Score: 1

      that would be the point in a nutshell WHY digital storage is "expensive". Execs expect cheap storage for film because they've got away with it for years.. never mind the rooms of movies ruined by water leaks, neglect, heat, rats, etc. The original Star Wars was subject to their "cheap" practices and the film master was DESTROYED.. beyond usefulness. Lucas had to recreate parts from stock and CGI because the master was unusable.

      Digital storage requires somebody maintain the drives, somebody test them, not just stick it in a dark closet and forget.

      As a side note they could just upload their movies to Pirate Bay and thousands of people would willingly back them up for free!!!

    47. Re:Not really by mabhatter654 · · Score: 1

      remember that quote from Universal's exec... they're new to tech stuff. they don't have "experts" yet!

      That would sum this up nicely too. They are probably getting raped by some data warehouse using 5 year old backup tech versus calling up Amazon or Google and getting it done right.

    48. Re:Not really by mabhatter654 · · Score: 1

      first, they are not doing a good job of "husbanding" their film archive.. if Lucas lost the original Star Wars masters to laziness, then a good share of the 20th century is ruined at this point.

      Second, if the extra digital film wasn't used in the release, and wasn't added to extras, the pitch it and move on. If you didn't make money from it then... Your not going to. Preserve the movie, important cut scenes, and perhaps enlightening retakes, alternate scenes, etc... but the vast majority of the stuff is crap.. you didn't sell it the first time around, don't pay to keep it.

    49. Re:Not really by justasecond · · Score: 1

      1TB would cost you about $500

      Sorry buddy, but you musta blinked: Newegg's now selling Samsung 1TB drives for half that amount. (Linky)

      Petty, but it goes to prove your point about rapidly-shrinking storage costs, no?

    50. Re:Not really by mgiuca · · Score: 1

      So you're saying, the reason digital storage is so much more expensive is because it's so much cheaper? Perhaps if directors realised this they could curtail their recording just a smidgen, so as to balance out the storage costs?

  18. Not a dupe! by MiniMike · · Score: 2, Funny

    This is just Slashdot's method for reducing storage costs!

  19. Space Reduction? by davidsyes · · Score: 1

    Sounds like they need Slimfast or Sego....

    CelluLOSE in humans is fat?

    CelluLOID in film is SLIM

    ANY ideas for product names (other than CompressFAST)?

    --
    Previously: "Linux... Toward the Sunrise..." Now: "Linux... Toward the-- No, now, part of Every Sunrise"
    1. Re:Space Reduction? by avandesande · · Score: 1

      Cellulose is also a name for the fibers found in wood. Film stocks were originally made from cellulose nitrate and then cellulose acetate (much safer).

      --
      love is just extroverted narcissism
  20. an easier solution by FudRucker · · Score: 1

    just store the master on HD-DVD or Blueray and put it in your refrigerator next to the milk and butter...

    --
    Politics is Treachery, Religion is Brainwashing
  21. Another Idea by avandesande · · Score: 4, Funny

    How about they just shitcan everything and spare us another needless re-release?

    --
    love is just extroverted narcissism
  22. Read the previous /. story by davidwr · · Score: 2, Informative

    Most of the points worth discussing were brought up there.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
  23. Re:afterlife will be an incredible bargain for som by Snaffler · · Score: 1

    Why is it that the idiots of the world are the ones that make comments like these? Does this idiot think that people will be moved by this?

  24. My God! We've done it all wrong! by PHAEDRU5 · · Score: 2, Funny

    Back to analog, everyone.

    --
    668: Neighbour of the Beast
  25. Not dupe, rerun. by JamesTRexx · · Score: 1

    Looks like /. has also been affected by the screenwriters strike. o.O;

    --
    home
  26. the cost of greed by pxuongl · · Score: 1

    you know, all this cost is only for movie studios and publishers who wish to keep their stranglehold on these movies. Yes, they're old, and they require money to keep them up and preserved... so that they may rerelease or resell them in the future. An obvious solution would be to release these old films into the public domain... then i'm sure any number of operations or groups would be more than happy to spend the money maintaining these films.

    1. Re:the cost of greed by sm62704 · · Score: 1

      An obvious solution would be to release these old films into the public domain

      Change the copyright laws back to what they were in 1900 and every movie, TV show, LP, CD, and tape made before 1987 will be in the public domain.

      -mcgrew

      --
      mcgrew's razor: Never attribute to stupidity that which can be explained by greedy self-interest
    2. Re:the cost of greed by westlake · · Score: 1
      An obvious solution would be to release these old films into the public domain... then i'm sure any number of operations or groups would be more than happy to spend the money maintaining these films.

      Name one.

      You need serious money, specialist skills and significant technical resources to do any of this stuff.

      Eastman, MoMA, The Smithsonian... all hold prints or negatives of films they know urgently need conservation and will likely never get it.

      The only studio whose prodeuctions are in no immediate danger is Disney:

      Walt Disney Treasures [December 25]

    3. Re:the cost of greed by pxuongl · · Score: 1

      that would not only be awesome, but also the way things should be.

  27. So..In 50 years.. by Anonymous Coward · · Score: 0

    So.. In 50 years we may lose all the Rob Schneider films?
    Oh the humanity!

  28. bittorrent by freg · · Score: 1

    They should just upload the data to the web and with all the copies made they could easily recreate the original. In other words...we'd be glad to help.

  29. Re:Slashdot Dupe Finder by Anonymous Coward · · Score: 0

    Perhaps it would be easier to parse the RSS rather than screen scrape?

  30. Bittorrent is the answer by kueball · · Score: 0

    The MPAA continually states that file sharing is costing them tons of money.

    Sounds like they can save money by just using torrents. Think of the benefits

              geographically diverse storage of their "raw data"
              the end user can export it to whatever the "format of the day" is
              they can terminate the lawyers used to sue everyone
              crappy movies will disappear via process of natural selection (bye bye Pauly Shore)

    I'm sure there are a million more reasons this makes sense. Please add on to this list!

  31. Maybe they should store it... by rodrigoandrade · · Score: 0

    on P2P networks... oh wait...

  32. Its the format, not the memory. by Snaffler · · Score: 1

    I read the original article and I gather that the problem with maintaining digital copies is as much the choice of format as anything else. My newest PC can no longer render avi movies that my 2001 era digital camera took. I am sure that if I invested the time to find the right codec, I could read it, but the point is that even after you manage to find an archive medium that will last for decades without any deterioration, you next need to find a format that will survive. This includes the technology and software necessary to read the medium. It is becoming increasingly likely that all optical-based disks will become obsolete within the next ten years. Will the readers still work after that period of time? Or will some of the components fail over time? The problem of the movie industry is the same problem we face for our own digital archives, whether for business or personal use. If anybody wants to be able to read the current digital data you have to be prepared to constantly reformat and convert material or you will have to hire engineers and programmers to figure out how to extract the data.

    1. Re:Its the format, not the memory. by Firethorn · · Score: 1

      You'd be correct here, but storing a codec, heck entire computers and operating systems, isn't that big of a deal here.

      This data is probably being stored in the studio quality MPEG standard I read about - it's like keeping a JPG of each frame, instead of deltas and occasional keyframes.

      Increases the storage needs tremendously, but is less lossy than most formats, while still keeping storage needs to something sorta sane. That shouldn't be going anywhere anytime soon. Worst case, somebody should be able to knock up a converter as long as a drive that can read the media is still operational.

      In the other thread I proposed rating technologies on a four scale basis - Modern(HDDVD/Blueray), Current(DVD), Outdated(VHS), and Legacy (Betamax). My standard was simple - Modern is just that, the best industry-standard tech. Current is 'still in common use', Outdated is 'obviously on it's way out, but 'equipment capable of handling it is still in regular production', and Legacy is pretty much 'You're pretty much stuck with used equipment or special order for new stuff'.

      The goal would be to transition from outdated to modern formats on a regular basis. If anything ends up legacy - priority on transfer.

      --
      I don't read AC A human right
    2. Re:Its the format, not the memory. by The_reformant · · Score: 1

      The software should be embedded in the data and the whole lot stored as a tape for a universal turing machine.

      Or you could just document the format I suppose, whichever.

      --
      I have discovered a truly remarkable sig which this post is too small to contain.
  33. There is an easy explanation by Anonymous Coward · · Score: 0
    http://en.wikipedia.org/wiki/Hollywood_accounting

    Hollywood accounting is like music industry accounting. It is designed to rip off everybody who may get royalties or taxes from a successful project. With Hollywood Accounting, you can make anything cost a thousand times what it is really worth.
    [joke]

    If SCO had hired Hollywood lawyers and accountants instead of amateurs like BSF, they would be winning now instead of in bankruptcy and in danger of going to jail. (Just kidding ... really ...)

    [/joke]
    My guess is that the money it costs to archive a digital film is almost 100% profit for somebody.
  34. the preservation is better, though by Trepidity · · Score: 1

    Even when film is "preserved", it degrades significantly over time. There are a lot of older films where copies exist but are nearly unwatchable. The more expensive digital preservation has the extra benefit of actually preserving the film intact.

  35. duped because _SLASHDOT DOES NOT GET IT_ by dtolman · · Score: 1

    If all they stored was the finished film, then 90% of the commments in the original article would be applicable. But read the article - thats only a factor of 10 more expensive - not a big deal. The real problem is that they aren't storing the finished film. They are storing EVERYTHING. Every shot from every camera used during production (and because digital is "cheap", that means that a film can have 1000's of hours of footage, that now needs to be stored in lossless high definition format). Not to mention storing everything related to the post production special effects (dozens of effects in typical movies - 100's or 1000's in a big effects movie). Before digital, what was there that could be saved besides the dailies (which weren't that bad because directors were forced to be frugal with film do to its expense)? Now the storage needs require 100's or 1000's of hours of footage to be saved...with formats that take up a gig or more per second, on media that needs to be replaced or refreshed every few years.

    1. Re:duped because _SLASHDOT DOES NOT GET IT_ by joeytmann · · Score: 1

      If I only had modpoints...+insightful.

      --
      Insert funny smart-ass comment here.
    2. Re:duped because _SLASHDOT DOES NOT GET IT_ by avandesande · · Score: 1

      They need to store all the props and sets too. Another good idea would be to freeze the actors in liquid nitrogen, maybe one day we could revive them for a second take.

      --
      love is just extroverted narcissism
    3. Re:duped because _SLASHDOT DOES NOT GET IT_ by boyko.at.netqos · · Score: 1

      Well, this is a simple problem with a simple solution: Don't save it in lossless high def!

      One of my plans is to archive every shot from the documentary I'm currently making, shot in 1080/24f progressive. Of course, the files are going to be huge, but with H.264 compression at 10Mbps, you can archive -great- quality material, and still store 60 minutes of data on one 4.5GB disc. To me, that's one disc per tape; tedious work, but for educational purposes.

      Of course, if I had Spiderman's budget...

      --
      I used to work for NetQoS. I no longer do, but want to keep the excellent karma attached to this account.
    4. Re:duped because _SLASHDOT DOES NOT GET IT_ by dtolman · · Score: 1
      Thats great for personal storage, but what is a film company going to do with useless low def footage in 20 years when they want to rerelease SpiderMan in IMAX 3D at 10000x7000 resolution? Plus you need new extra's, maybe a new director's cut - maybe emphasize that young actor in the background who became the new Samuel L Jackson, etc...

      Course we could all solve this problem by going back to reading or whatever. Then the studio's won't have to worry about archiving new films.

    5. Re:duped because _SLASHDOT DOES NOT GET IT_ by TapeCutter · · Score: 1

      Yes, TFA is comparing an apple to a truckload of oranges.

      --
      And did you exchange a walk on part in the war for a lead role in a cage? - Pink Floyd.
  36. Cool! by Anonymous Coward · · Score: 0

    Does this mean that I can get free karma for disproving the article by linking to the Pirate Bay like that comment on the last did? :-)

  37. Come up with something. by Lord+Apathy · · Score: 1

    Shit these fuckers talking about conventional technology. If current technology doesn't cut it, make something that will. Don't just sit around and whine about it.

    --

    Supporting World Peace Through Nuclear Pacification

    1. Re:Come up with something. by Anonymous Coward · · Score: 0

      They already have archival medium that will work, if they would bother to google.... its called Holographic storage. It was invented about 7yrs ago in IBMs labs, and since then, a development level solution has been produced (reader/writer) and medium which is currently in the form of a disc like a CD or DVD, however, the original holographic storage medium IBM was working with stored an estimated 100TB/cm3 thats per cubic centimeter... no electricity needed to store it per year, and since its a crystal (the storage medium), there is no degredation... so.... why aren't we using this? thats the real question...

  38. Re:uneducated by CodeShark · · Score: 1
    Guess who's uneducated here, and not counting the fact that film is still considered superior in terms of contrast ranges compared to digital...?

    It has only been in the last 5-7 years that professional photographers have started to consider '35mm' format digital cameras as production ready for still photography, i.e. close enough to equaling film to make it worth their time. It is commonly accepted that a high-quality 35mm full frame color image contains about 20-25 megapixels of color and luminance data. Most Hollywood films were historically shot in what you might call "half 35mm", i.e., basically a frame size of 24x18mm, so use half that. A 70mm format image contains about 8-1/2 times more image size than a half frame 35, which is where IMAX size screens get their detail and fun. Times 24-30 frames per second, seconds per hour, 2 hrs, you get a minimum of around 2 terabytes of data. AKA 120-2 sided high density DVDs for the half 35mm copy, or 18 terabytes for the IMAX version. i.e. roughly 1100- 2 sided high density DVDS for the Imax version.

    For archival purposes, consider the expense of all those DVDs vs keeping one master copy of the film in a can....

    --
    ...Open Source isn't the only answer -- but it's almost always a better value than the alternatives...
  39. Original Article - it's about IP rights by argent · · Score: 1

    The original article, The Digital Dilemma, is all about licensing, redistribution rights, things like whether reformatting to avoid obsolescence is equivalent to making a derived work and thus require license fees and royalties (an issue even for the studios, depending on the artist's contracts). I've only briefly browsed it, but given that background I suspect that they're factoring guesstimates of this kind of thing into the costs... at any rate, it's more information to argue about.

  40. Paper, the other white substrate by EB+FE · · Score: 1

    They should just print the data in hex on some acid-free paper and throw into vacuum bags. Religious documents lasted (fairly well) for thousands of years on primitive paper. For extra security, print the MD5 sum of each page in its footer. W00t!

    --
    Vital papers will demonstrate their vitality by moving to where you can't find them.
    1. Re:Paper, the other white substrate by Guysmiley777 · · Score: 1

      Punch cards! 80 characters wide and 12 rows per card, that's a whopping 960 bytes per card. So you could fit a double sided DVD on about 10 MILLION punch cards.

      --
      Coding with assembly is like playing with Legos. Coding an application in assembly is like building a car with Legos.
  41. Someone needs to come up with a new method by Mike+Buddha · · Score: 3, Interesting

    Someone who cares ought to come up with a method of transferring digital information to celluloid so that it can be stored with the cheaper storage costs. I'm not talking about a print, but storing binary files on film. A 70mm reel ought to hold a ton of properly formatted digital data and error correction.

    --
    by Mike Buddha -- Someday the mountain might get him, but the law never will.
    1. Re:Someone needs to come up with a new method by jd · · Score: 1
      The problem there is that celluloid is not chemically inert. Unless you plan on storing it at absolute zero, degredation over time is inevitable. The real problem with optical formats (such as CDs and DVDs) is that they are also not inert. Because you have different layers of different materials, you are also going to have problems with differing rates of expansion. Core memory won't degrade for hundreds of years, but unless there's a plan to hollow out one mountain for each movie made, there won't be space enough to store several terabytes of data in core.

      Ok, what does that leave us? Historically, long-lasting data has been placed in stone. Texts lasting thousands - sometimes tens of thousands - of years can be preserved in such a format. Now, clearly you're not going to get far if you etch each bit plane of each colour plane of each frame of the movie into rock on the macroscale, but we can borrow ideas. Lithography is at the point where you can etch at the 25-33 nanometer level. Etching bit planes at that scale would be hellishly expensive but would be practical in terms of scale. You want a solid whose structure is so completely locked that there is no possibility of distortion ruining the data, and which is so inert that you have much greater freedom over the environmental conditions needed. Are there any good candidates?

      Crystals would seem a logical place to start. The structure is prety much locked, which means your etchings are unlikely to degrade over the lifetime requirements of archival media and stand an excellent chance of surviving intact over the lifetime requirements of a typical civilization. Semiconductors, such as silicon and gallium arsonide, are also excellent candidates - they're not reactive within themselves and the experience with etching at these sorts of levels on such media would be a definite plus.

      The downside of this approach is the expense. You have to make the lithographic mask at a wafer-scale (the pattern is not repeating), and each mask is good for only one wafer. Yes, the lifetime is now a hundred times greater than with conventional media, but the cost has increased a thousand, maybe ten thousand, times. In terms of cost per unit time, lithography is definitely a Really Bad Idea. The total cost of preserving for the same amount of time would be far less by using less durable media. It's also far more evenly distributed, making it far more practical for companies to adopt.

      The upside is that the media is vastly more likely to survive neglect, abuse, war, natural disasters, bad management, and all the other catastrophies which have resulted in so many historically significant recordings being lost forever. Using a lithographic storage format, you don't need efforts such as "Missing: Presumed Wiped" and you won't need the very expensive technique of digitally cleaning, repairing, restoring and re-mastering old recordings. (Digital recordings generally don't need the cleaning part, unless there was a lot of noise on the original recording, but that would be true no matter what medium was used to store the digital data.)

      The question then becomes one of return on investment. Are the sorts of catastrophies that lithography can deal with common enough that the additional cost is more than covered by the additional return from having a greater range of recordings survive? If yes, then lithography is the sensible approach. If no, then except in matters that absolutely should be preserved even at great cost, standard media should be used.

      I would have to say that no, the cost of using lithography as a storage format is far in excess of the benefits, for most things. There might be a very few things that should be preserved this way, but not much.

      --
      It's a small world and it smells funny; I'd buy another if it wasn't for the money; Take back what I paid (SoM)
  42. Re:uneducated by orkysoft · · Score: 2, Insightful

    You could store it as a big stack of DVDs, but how about a few 500-1000GB hard drives?

    --

    I suffer from attention surplus disorder.
  43. Cleaning and restoring film costs loads by gilesjuk · · Score: 1

    Not to mention the digitising process that starts it all off. Few people use analog media for watching films these days.

    1. Re:Cleaning and restoring film costs loads by downix · · Score: 1

      Really?

      **looks in the newspaper**

      Funny, I see whole pages dedicated to group showing of analog films, run every 2-3 hours, with tickets for sale from $6.50-$9.00..... and they'll even sell you popcorn to eat while watching it.

      --
      Karma Whoring for Fun and Profit.
  44. I know people worked hard on this stuff... by Chysn · · Score: 1

    ...but most of it isn't worth archiving anyway. Keeping everything because it might be culturally enlightening someday is "hoarding." It's a mental disorder. Seriously: make your money on it, get your screen credit, release it on DVD, and then just stow it somewhere. If the original footage of Waterboy doesn't last 100 years, my great grandchildren will be none the worse off. The good stuff will stand the test of time due to continual reformatting as time goes by. We're not obligated to make things easier on future anthropologists.

    --
    --I'm so big, my sig has its own sig.
    -- See?
  45. Slashdot articles have a very uneasy afterlife... by Enleth · · Score: 1

    ...they come back from the grave and haunt on the front page, no matter how hard you hit them on the head with the "dupe" tag - I think Max Brooks should update his Zombie Survival Guide to include dealing with undead Slashdot stories...

    --
    This is Slashdot. Common sense is futile. You will be modded down.
  46. I really don't get it by 91degrees · · Score: 1

    Do hard disks really sieze up if they don't get used?

    Isn't there a better form of archival storage? Tape or something? Or better hard disks?

  47. Repeats by fred+fleenblat · · Score: 1

    Must be the writer's strike.

  48. Are we supposed to... by cyber-dragon.net · · Score: 1

    feel sorry for them that the codec and format changes they are implementing to try and get us to buy three copies of the same movie are costing them money? Awww... poor MPAA. I will shed a tear for you next time I think about paying $10 to see a movie while eating my $30 popcorn.

  49. Re:afterlife will be an incredible bargain for som by Anonymous Coward · · Score: 0

    Why is it that the idiots of the world are the ones that make comments like these? Does this idiot think that people will be moved by this?

  50. I cried. by Lewrker · · Score: 0

    Oh the poor movie industry. And they can't even release the films into public domain.

  51. Re:uneducated by Belial6 · · Score: 1

    Or even a RAID, so you actually have to have degradation on 2 drives in the same place to lose any information.

  52. Re:uneducated by CodeShark · · Score: 1
    Well, ya could do that. Hoping of course that there's no electromagnetic pulse, that the hard drives are accessible in 50 years, etc., that the data error rate and file structures don't get scrambled at all.

    Or ya could store it in film in the can-- seems like the rate of decay for Kodachrome was supposed to be about 180 years before Kodak pulled it [due to Fuji's competitive product Velvia making the K-14 process obsolete, by the way], and scan it into whatever digital format you need in 50 or 100 years....

    --
    ...Open Source isn't the only answer -- but it's almost always a better value than the alternatives...
  53. This looks familiar by Tim+C · · Score: 1

    Ah yes, here it is. I don't usually complain about dupes, but 30 seconds with the site search turned that up - and it only took that long because the search was so slow.

  54. Easy way to lower storage costs by Maxo-Texas · · Score: 1

    Once you reach a point you are going to drop the film; post a copy of the data for download by whoever wants it.
    You are the only person who can sell it; but lots of people will keep your data for you for free. And even offer it up for others to save for you as well.

    The lost profits are probably less than the cost of archiving the material in 95% of the cases.

    --
    She was like chocolate when she drank... semi-sweet at first and then increasingly bitter.
  55. Real movie makers don't need archives by XHIIHIIHX · · Score: 1

    They just upload their movie to the FTP server, and everyone in the world backs it up.

    1. Re:Real movie makers don't need archives by petrus4 · · Score: 1

      I remember the saying from my IRC days.

      "The Warez must flow." ;-)

  56. Sounds Great To Me!!! by Jane+Q.+Public · · Score: 1

    I think I would like to go into the storage business. If this is even halfway true, then it looks like very little real cost, and boatloads of profit...

    1. Re:Sounds Great To Me!!! by rholland356 · · Score: 1

      I think I would like to go into the storage business. If this is even halfway true, then it looks like very little real cost, and boatloads of profit...

      I suppose you might think that if you had an abandoned salt mine among your assets. Consider the downside, though! You have collected digital data and 25 years after first storage clients come knocking to retrieve that data. And you don't have it, or you don't have all of it. Or you have it all in a format that cannot be played through theater projectors without several steps of conversion.

      Or, in a fit of cost-reduction pressure 7 years into your venture, you decided to compress all your videos with Divx and you then destroyed the original files.

      Aw, give it up. We all know that professional film production will fall into the hands of kids with cellphone cams. And they don't expect to pay for anything!
    2. Re:Sounds Great To Me!!! by Jane+Q.+Public · · Score: 1

      Well, fine. But if they don't expect to pay for anything, then they can't realistically expect to profit from it either, can they? Some people think that young people today lack "ethics". But mostly, they are just tired of getting ripped off by corporations that don't have "satisfying consumer interests" on the agenda. Young people today are NOT stupid... thinking they are just because they do not accept the status quo would be a mistake. A mistake kind of like the ones the big media companies have been making the last 10 years or so.

  57. Re:afterlife will be an incredible bargain for som by joeytmann · · Score: 1

    Hi, ever have an original thought? Oh sorry....

    --
    Insert funny smart-ass comment here.
  58. Don't you be Disrespectin'! by zehaeva · · Score: 1

    Duplicating is taking place. And, when duplicating takes place, that means there's more than one. There may be two or three, Miss Tyler, two, three, or four. I'm taking about dup'in'! Dup'in'! Duplication!

  59. Didn't have any sympathy the first time, either by macwhizkid · · Score: 1

    Ironically, if they would just release older (say >10 years) material into the public domain; the collectors, fans, libraries, etc would have no trouble ensuring continuity of the data for hundreds of years.

    Oh wait - that's right - it's about the future profit potential, not about altruistic archival of material for humanity. Personally, I make my living by copyright, as I'm guessing most Slashdot folks do. And yet, I maintain no illusions that my copyrights are going to maintain my income for the rest of my life, let alone my children's lives. This is just another example of how Hollywood feels they are somehow entitled to what the rest of the world has to work for.

    Hey Hollywood: If you intend to make future profits from your copyrighted works, then fine - figure out the logistics of digital archival (and how to pay for it) yourselves. But don't think I'm going to shed so much as a single tear of sympathy over your "problems" of ensuring your future income.

  60. Thank God by edwardpickman · · Score: 3, Funny

    That's a relief it's a dupe. For a second there I thought I'd zoned out and it was still two days until Christmas.

  61. Buy CHEAP TRAMADOL Online by pol32 · · Score: 0, Troll

    Online Consulting Buy Cheap Tramadol Buy Cheap Tramadol

  62. Hard drive storage??? by wfstanle · · Score: 1

    Hard drives, tapes and other devises store the data as magnetic fields representing bits. If I remember correctly, these magnetic fields will fade over time. For short term storage this is fine but, with time,the adjacent bits will eventually blur together. For long term storage, shouldn't optical storage be used? This would also eliminate the need for additional hardware, all you would need is some form of an appropriate vault.

  63. They're doing it wrong by aflag · · Score: 1

    Getting the torrent is free.

  64. That seems a bit steep... by JerryLove · · Score: 1

    Although some of the suggestions I've read on slashdot seem to have missed the article addressing them; the price in question seems high.

    How big is a digital master with a lossless compression? Would 40 Terrabytes do it?

    To pick a technology at random: That would be 100 LTO3 tapes... 200 to have a duplicate of each tape.

    That would be $16,000 to archive whatever you could fit on 40 Terrabytes.

    According to Verbatim, an LTO3 tape has a storage life of 30 years. Assuming we halve that, we have just over $1000 per year in physical storage devices. We also have a days work for one individual for 15-years of storage (let's tack on another $1000 in inscidentals).

    In 15 years you'll have to fire up the LTO3 you kept in storage and retrieve them to transfer them to whatever you are using then, but I doubt the costs will go up.

  65. Storage is not a problem. by Anonymous Coward · · Score: 0
    From the article:

    All of this may seem counterintuitive. After all, digital magic is supposed to make information of all kinds more available, not less. But ubiquity, it turns out, is not the same as permanence.

    No, actually it is - in a filesharing network. As others have suggested, sharing copies of the original files via ftp, bittorrent, etc will ensure that said files are not only stored somewhere, but reformatted as necessary. This being such an obvious solution to the problem of storage, the article should have made it clear that the problem lies with making a profit off of stored digital media with the outdated business models we currently have in place.
  66. How do they arrive at that annual cost? by djl4570 · · Score: 1

    Buy a copy of WinRAR and a few spindles of quality media. Break the digital master into RAR files. Burn the RAR files DVD's as data files. Store the DVD's in the vault next to the film. Profit. How can this be more expensive than storeing film? Soulds like the people who are saying this be the same people involved in the production of so many awful movies. Same apparent lack of intelligence, they exhast their technical aptitude sharpening pencils, they have never backed up their own system and have probably lost data. All of this leads them to drool on themselves when confronted with something that requires a mildly technical solution that an above average middle school kid could implement.

    1. Re:How do they arrive at that annual cost? by toddestan · · Score: 1

      You forgot to generate 10% redundency PAR files, and upload to Usenet.

  67. huh??? by rice_burners_suck · · Score: 1

    Repost? What is this supposed to accomplish? Fighting bit rot of yesterday's news?

  68. It's not like they do a good job with film.... by Above · · Score: 1

    I've seen more than a few TV shows documenting the great measures taken, at extreme expense, to "restore" old film footage that is about to turn to dust. While there is a lot of amazing work going on, it may illustrate that part of the problem is that they quite literally "toss the film in a warehouse and forget about it" for the next 50 years.

    I believe to accurately represent the long term cost the film storage option needs to include the 10's or 100's of millions they have spent to restore old films that were degraded due to poor storage. At the price given I suspect it does not.

    So the real news here is when you keep things on massive disk arrays the computer tells you each time a drive fails and someone goes out and replaces it. Where as when film turns to dust there's no warning; and often no one notices until it's too late.

  69. Simple Solution by jgoemat · · Score: 1

    Why not outsource it? There are thousands of people willing to maintain digital copies of those movies FOR FREE! Just create and submit a torrent and you would be amazed at all the free storage you'd get...

  70. WTF?? by IchBinEinPenguin · · Score: 2, Insightful

    $200K to keep a few bits from rotting?

    ...just as Hollywood's writers began their walkout.

    Oh... that explains it.
    It's a conveniently timed report to bolster a negotiating position: "you can't possibly ask for more money, look how much it costs us to store this stuff!!"

  71. Holographic storage by Anonymous Coward · · Score: 0

    Most of the early adopters of holographic storage are the TV/Film industry - primarily because of the 300Gig capacity and 50 year archival life.

    Inphase Tech

  72. Silly New York Times... by Anonymous Coward · · Score: 0

    I guess noone told them about Gmail Drive.

    1. Re:Silly New York Times... by Phroggy · · Score: 1

      Can you use that to store 4 terabytes permanently? If not, then it's not very useful for this purpose!

      --
      $x='S24;r)>63/* h@<5+oZ)32"5cz';$me='phroggy'x$];
      $x=~y+ -xz+\0-Tx+;print$_^chop$me for split'',$x;
    2. Re:Silly New York Times... by Anonymous Coward · · Score: 0

      Can you use that to store 4 terabytes permanently? If not, then it's not very useful for this purpose! Look here Mr. Naysayer, all you would need is 800 gmail accounts set up to be accessed as a virtual partition.

      Simple.
  73. Re:Perhaps they need to learning about DUPLICATION by Anonymous Coward · · Score: 0

    "Only wimps use tape backup: real men just upload their important stuff on ftp, and let the rest of the world mirror it." [Linus B. Torvalds]

  74. Industry report assumes everything stays the same by kenh · · Score: 1

    The question isn't where can we store our terabytes and terabytes of information for a 100 years and never touch it, the real question is where can we store our terabytes of information and allow it to be used to generate copies for sale at any time in a current format? I imagine the answer for the industry will resemble the Internet Bookmobile, where a consumer needs only submit the name of the movie they want, indicate a format and shipping preference, and the movie arrives for set price - a portion of each sale will be applied to keep the data migrated to a fresh format, and when interest wanes, a studio could decide to migrate to a "final copy" and "burn" the film to celluloid. That would the last hope for a film, resulting in lowered storage costs for the long haul, at the expense of accessibility and flexability.

    The problem is the current storage model doesn't take into account the long tail of retail, and ignores the ability of technology to create new revenue streams to fund storage options...

    Just think, if a movie house could order up a "print" of any movie ever made and show it in a theater - and offer DVD, HD or Blu-Ray copies to be delivered to the home of anyone that wanted one..Heck, I'd pay REAL MONEY to see Stop Making Sense on a big screen with the sound turned up to 11 ;^)

    --
    Ken
  75. Uh, no. by earlymon · · Score: 1

    More quasi-informative tripe from mainstream media. I like old movies - a lot - so I'm a fan of Turner Classic Movies. From time to time, they've gone over what it took to restore this or that film to viewable, and those were in cold storage (and not all on celluose, either). The costs given by the article don't match reality.

    While the subject is an interesting intellectual one, the entire comparison is specious for obvious reasons, including entropy.

    Nothing to see here.

    --
    Pathological kinda promises Path + Logical - but instead, you get stuck with pathetic.
  76. Use old technology by natebizu · · Score: 1

    If hard disks and DVDs will not last for 100 years, use early technology like punch-cards. If the film CAN last that long, make a new digital format, punch-film.

    P.S.
    Now, hire illegal aliens to make all the punches, and you can store a movie for the cost of two cases of beer.

  77. Re:Slashdot Dupe Finder by beckerist · · Score: 1

    myminicity link... again
    --your friendly neighborhood anti-troll

  78. Millions of sheets of A4? by sd.fhasldff · · Score: 1

    Not being sure if this is meant to be funny or not, I'll provide a little math:

    "Watercode" (a high density 2D barcode) is rated at 440 bytes/cm2 (Microsoft has a color 2D barcode which has maybe a 25% higher data density).

    Disregarding the fact that you'd probably be storing the data on drums of paper, and not sheets, what follows is a calculation of the number of A4 sheets required to store a movie in original format.

    A4 is 210x197 mm2 = 413.7 cm2.
    At 440 bytes/cm2, that's 440*413.7 bytes/A4 = 182028 bytes/A4 ~ 0.2 MB / A4 (with very generous rounding up, so it covers the MS color barcode as well).

    At several TB for a digitally shot movie master, that's... well... a lot. More than 5 million sheets of A4 paper per TB, in fact.

    I'm not going to get into the whole weight or storage space issue here, let's just agree that's an unmanageable amount of paper...

    Feel free to argue that modern laser printers have whatever high resolution you feel like using.... but there's a reason no commercially available barcode has that kind of data density. If you feel the job can be done much better, I suggest heading down to the patent office...

    1. Re:Millions of sheets of A4? by toddestan · · Score: 1

      5 million sheets of A4 isn't unmanageable, though it would be a lot. It'd probably fit into a shipping container. Though I wouldn't want to be the poor sap who has to scan all those back into the computer shtould the worst case scenario happen.

    2. Re:Millions of sheets of A4? by BranMan · · Score: 1


      "Data Matrix from Siemens(look here for more information) is a 2-D matrix code designed to pack a lot of information in a very small space. A Data Matrix symbol can store between one and 500 characters. The symbol is also scalable between a 1-mil square to a 14-inch square. That means that a Data Matrix symbol has a maximum theoretical density of 500 million characters to the inch! The practical density will, of course, be limited by the resolution of the printing and reading technology used."

      Cut that back by 2 orders of magnatude to 5 million characters per square inch, add Reed-Soloman or other error correcting to cut it back to 4Mb / square inch, which is close to 400 Mb/page. And that is assuming 2 orders of magnitude less than the format is capable of. I think you can squeeze out 1 Gb / page (front and back)

      So, yes, I think this can be done. Between this and compression techniques on the original, yes - a few thousand sheets of paper. Fairly cheap and effective.

  79. Re:Slashdot Dupe Finder by beckerist · · Score: 1

    I know that it is going to change, and soon I'm thinking, but if you notice the pattern...they write something slightly relevant, then provide a link to ripway, contactlog, dwarfurl, xrl.com, etc...

  80. First thing that came to mind... by StarfishOne · · Score: 1
    "Real men don't use backups, they post their stuff on a public ftp server and let the rest of the world make copies." - Linus Torvalds


    ;-D

  81. Codecs don't change by tepples · · Score: 1

    Codecs and hardware change. Codecs don't change as long as compilers for ISO C language continue to exist. Store the source code, the video encoded as a sequence of JPEG frames, and the audio encoded with Vorbis, and you'll be able to decode it on anything that can compile C programs such as the libjpeg and libvorbisfile demos. Then all you have to do is preserve the bits.
  82. Re:Expensive Duplicates Duplicates Duplicates by Tablizer · · Score: 1

    Yeah, it costs a ton of money in disk space, mirroring, bandwidth, and power bills to maintain all those duplicates of the original.

    Further, it costs a ton of money in disk space, mirroring, bandwidth, and power bills to maintain all those duplicates of the original.
  83. In a few years 4Tb will be a freebie USB keyring by Joce640k · · Score: 1

    Disk storage is increasing at an *exponential* rate. Think of the parable about grains of rice on a chessboard...that's what exponential is.

    In fifty years a single desktop PC will be able to store every movie ever made in uncompressed format (no codec necessary). Your entire datacenter will cost less than the cost of storing a single film print.

    --
    No sig today...
  84. Store it uncompressed... by Joce640k · · Score: 1

    Compression? We don't need no steenkin' compression...

    --
    No sig today...
  85. Uneducated? That'd be you... by Joce640k · · Score: 1

    >"not counting the fact that film is still considered superior in terms of
    > contrast ranges compared to digital...?"

    Ummm....movies are filmed, edited and post-processed in digital format.

    >"It has only been in the last 5-7 years that professional photographers have
    > started to consider '35mm' format digital cameras as production ready for still photography"

    Oh, you're comparing professional studio equipment to 8-bit digital cameras...

    >"roughly 1100- 2 sided high density DVDS for the Imax version."

    You need to think outside your bedroom. I don't think they'll be using DVDs for this....

    --
    No sig today...
    1. Re:Uneducated? That'd be you... by CodeShark · · Score: 1
      Okay, I'll bite...
      Ummm....movies are filmed, edited and post-processed in digital format.


      Correction. A FEW movies are filmed completely in digital format, with the trend to increase in the future. Even the Lord of the Rings has it's color scale and scope primarily because the main images on the frames are still mostly shot on film, with all of the digital wizardry layered over the top. That said, nearly all editing is now digital, and the resulting film may or may not be digitally post processed. But to contain the full contrast and color ratios available, it still takes at least one layer of true filmed background.

      Oh, you're comparing professional studio equipment to 8-bit digital cameras...

      No, I'm comparing 35mm film to 35mm digital. The resolution for a full frame 35mm image based on Kodachrome has been estimated to be as high as 6000px by 4000px by 36 bits -- 24 bits of color and 12 bits of luminance. So a half frame 35mm would be half that. Current pro-rig 35mm digital cameras have about 12 megapixels, which is enough for a good enlargement up to about 20x24 without tricks.

      ...I don't think they'll be using DVDs for this....

      Neither do I. But the comparison between DVDs and film in a can is useful, no?

      --
      ...Open Source isn't the only answer -- but it's almost always a better value than the alternatives...
  86. Forget that, just press disks. by Anonymous Coward · · Score: 0

    Your analog stored bits would still degrade, and once you lose digital data, it's lost. what is needed is a line assembly method of stamping one off data disks (using the current disk data standard, or even a better one), instead of burning them. Stamped disks would be more robust.

  87. The Future...Obscure Formats by Easy2RememberNick · · Score: 1

    [500 years in the future]
      Zernot, "Come over here I found an ancient data storage module!"
      Flormplop, "Let's see if we can see any ancient videos."
      *put data module into their super complex quantum computer*
      Flormplop, "What's a W...M...A and Do You Want To Update Your Licenses?"
      Zernot, "Shazbot!"

  88. Obviously by gr8_phk · · Score: 1
    There's a lot of discussion about how low the cost should really be - and I agree. I think the point is that MPAA wants to inflate all costs in order to NOT PAY actors or anyone else who may claim a cut of the "profit". Claim the cost of a data center, an IT guy etc *for each film* and say just keeping the thing around is eating up all future revenue, so no royalties for you sir.

    When something is claimed to cost an order of magnitude more than it should, it's because someone WANTS it to be expensive.

  89. Wow by bratwiz · · Score: 1


    If only they'd toss all that stuff into the public domain and bit-torrent. Then it would circulate forever "on-the-net" and not cost them a dime.

  90. Re:In a few years 4Tb will be a freebie USB keyrin by Anonymous Coward · · Score: 0

    "In fifty years a single desktop PC will be able to store every movie ever made in uncompressed format (no codec necessary). Your entire datacenter will cost less than the cost of storing a single film print."

    The reason these predictions never come to pass is because they consistently fail to take into account that the file sizes of typical media increase at the same rate. In 50 years, there won't be room on your computer drive to store every movie ever made in uncompressed format, because the format will have expanded to model each individual original film grain for maximum fidelity, and on top of that, you'd rather store the 3D models of your virtual social network, and lord knows those take a couple of petabytes per file.

    In the past 20 years, the amount of storage on personal computers has gone beyond "going through the roof," it's gone to the moon. But users still consistently run out of disk space!

  91. Re:Perhaps they need to learning about DUPLICATION by Forge · · Score: 1

    And both versions speak in general terms. I want to know the numbers.

    I.e. How much DATA is saved for an all digital, big budget feature like Superman Returns (the example from TFA).

    Is it Gigabytes, terabytes or Petabytes? That basic starting point would help me know if the $208K per year figure even begins to make seance.

    --
    --= Isn't it surprising how badly I spell ?
  92. Re:Perhaps they need to learning about DUPLICATION by Kagura · · Score: 1

    That basic starting point would help me know if the $208K per year figure even begins to make seance.

    If you're having a hard time figuring it out, why not ask the spirits? :)

  93. Solid State by DijiTao · · Score: 1

    Why hasn't anybody mentioned solid state disk yet? With no moving parts and presumably a ridiculous life span it seems like the way to go. If your willing to use lots of small disk instead of one large one, the price per GB is manageable. The cost per GB is also dropping steadily so this clearly becomes and more attractive solution in time. When coupled with codecs that have open source implementations it seems to be maintenance free future proof archival solution. No proprietary codec head aches, no dye deterioration, and no HD motor / lubrication problems.

  94. problem solved by bataras · · Score: 1

    just do what linus does. make the digital movie freely available and let internet maintain your backups...

  95. Re:Perhaps they need to learning about DUPLICATION by Forge · · Score: 1

    They haven't been forthcoming either.

    Can I borrow your crystal ball?

    --
    --= Isn't it surprising how badly I spell ?
  96. trimmed and served Re:Not really by gregconquest · · Score: 1

    In the initial editing, they need to dispose of obvious over-runs. Then a copy goes on fault-tolerant servers. The servers need to be mirrored around the world as well. Codecs are included on the servers. Amazon could do this for them today. Google could really set them up -- and make a backup copy of their own. G-)

  97. The internet will never die.... by argStyopa · · Score: 1

    ...so, how about removing ALL digital rights management from the materials, and putting them up on the web? Suddenly, *someone* will have a copy of every movie, every nuance, every little clipped edit (there are fanbois for everything) FOREVER. Cost? Nothing.

    (And yes, I know that some catastrophe could happen to our civilization, in which the internet would indeed go dark, like, say, a giant jet of relativistic particles from a nearby black hole. But in this case, all of humanity would be extinguished thus the loss of "Ice Pirates" and "The Muppet Movie" would perhaps not be such a big deal.)

    --
    -Styopa
  98. what about a new format? by Anonymous Coward · · Score: 0

    Why can't sony go in and make a super sized blu ray disc (think laser disc size) and store the movies on there? Think of the capacity of something like that.

  99. Patently Absurd by wonkavader · · Score: 1

    Clearly, these guys are taking one film, and saying all the costs of storing that film, including technology changes, are attributed to the cost of storing that film.

    Anyone serious about storing the film would give it to someone who stores a LOT of films.

    Yes, storing it on redundant arrays in multiple locations in an uncompressed format is expensive. You have to buy the arrays, pay the rent, and pay some guy to make sure the arrays aren't going sown, and replace hard drives. But that's not the cost of storing a film. That's the cost of storing a BUNCH of them! An uncompressed film is 140gig. A several terrabyte array is $15k. Three of those plus rent, plus computers ($6000 for the three) and you're good for five years, at least. And that hold 15 films or so. I make the price of hardware $1k per year on hardware. Labor is almost nothing, since that laborer will be taken as just a few hours a week out of someone doing something else.

    And as space scales up, the cost of doing this gets absurdly small.

    Dumb study.

    1. Re:Patently Absurd by rholland356 · · Score: 1

      Compare, then, the cost of running a storage vault in a salt mine vs. the cost of running banks of storage devices in a salt mine for 30 years.

      The salt mine keeps the temperature low, so you don't need refrigeration equipment. All you need is to keep the vault dry and secure.

      Running a data center has much higher operating costs AND you know that ALL the equipment you install today will have become obsolete and been replaced in 30 years. Maybe it cycles every decade.
      And, over 30 years that electric bill keeps coming. And you need to keep a higher degree of security, because digital media is so damned tempting. Once it is stolen, it is easily replicated and shared.

      So, don't be so quick to dismiss the study. Think it through and the light will come on.

      For reference, the 49ers want to build a stadium in Santa Clara. Estimated electric bill over 30 years is $100 million.

    2. Re:Patently Absurd by wonkavader · · Score: 1

      Nope, still absurd. You don't do this math for one movie. Yes, storing a movie or a thousand movies in an analog storage system is cheap -- there's no denying it. (Until you start having to duplicate the films as they begin to deteriorate simply because of time -- remember the "Acetate Can't Wait" era of film preservation, where we were frantically trying to get all those beautiful old acetate-based films put on yucky new film stocks without the nice contrast range of acetate, because cellulose acetate films spontaneously COMBUST?)

      But we're not talking about one film here. We're talking about libraries, and the ability to manage many, many films using the same system. The numbers from the study are absurd.

      The realities of analog mean that you'll never know if your film is alright without looking at it and imposing some wear and tear on it. (Schroedinger's cat-like, huh?) This is not to say you cannot be PRACTICALLY certain, based on what you did to preserve it, but if there was a defect in the stock you used, or a day when some environmental effect happened that you couldn't control, analog storage media can decay. Recovering from such a disaster, if it even can be recovered from, has astronomical costs.

      Digital systems require a simple checksum. If the file was OK when you stored it, it's still OK, now. Yes, you have to replace equipment, but when you do move the files, you can prove that they're all fine. All of them. At once. No defects. ZERO.

      Digital is more expensive, yes, but it's predictable, reliable, and cheap enough, in bulk.

    3. Re:Patently Absurd by rholland356 · · Score: 1

      Recovering from faulty, aged filmstock has astronomical costs? You lack perspective. Go rent the DVD of My Fair Lady and you will see a brilliant documentary of how this film was rescued from failing filmstock and how the images were repaired, and how the audio was restored.

      The restoration cost was not high enough to prevent the release of this movie on DVD. And the disk sells at discount prices. So, there is profit to be made restoring one print and replicating digitally.

      Excellent tools exist today for restoring damaged analog original prints, whereas we have very few tools or techniques for restoring damaged digital works. We focus on recovering damaged media (disks, platters, tape) to the point where we can interpret ones or zeroes, and that's about all.

      As to your off-the-cuff dismissal of a study conducted by film archival experts, (and YOUR credentials are what, precisely?) I'll have to point out that your analysis fails to take into account datacenter operating costs--humans, power, HVAC, obsolescence, redundancy. You also failed to account for the mass of digital data generated with each film. Essentially, each digital film IS a library of data much larger than the film itself, all of which consumes time, power and human resource to preserve.

      You mentioned a simplistic use of checksums as a means of validating data. You failed to mention data format changes over time and the labor needed to convert older formats to newer formats. You also failed to mention what to do when a checksum test fails. How many backup copies can you rely on, and how much labor went into assuring that those backup copies were made correctly and remain accessible.

      For these reasons I don't find the study absurd at all.

  100. Re:Perhaps they need to learning about DUPLICATION by Anonymous Coward · · Score: 0

    Or you could just come over to my place and look at my hard drive... should have enough dupes of movies to satisfy Hollywood's needs

  101. Whippersnappaz don't get it... by rholland356 · · Score: 1

    The young people here don't understand what the old fogeys know.

    That box of family photos you haul out once or twice a year to share with others around the settee? Cost is one cardboard box and some space in the back of the closet. Brew a pot of coffee, place ladyfingers on some small plates, open the box and pass around the memories. Instant gratification, if you used instant coffee. And the photos look just as good, if not better, 30 years down the pike. Can't find that photo you remember, just dig down deeper in the box, you'll find it quickly.

    Those photo collections you digitized and put on your hard disk, or uploaded to flickr, or left in your camera? Gotta run the electric. Gotta keep upgrading your PC because of planned obsolescence built into the software and OS. Can't easily share the pix around the settee, and - don't get ladyfinger crumbs in the keyboard, Uncle Fred! - there are no notes written on the pix so you're not certain when and where and who, and you can't find the photo you are looking for? Tough for you--all those sequentially numbered file names make no sense.

    And the technique for cutting out that rat bastard who divorced your sister is more pleasing when you can snip him away with shears, rather than trying to photoshop him out of your collection.

    So the family box of photos is the more pleasing and cost-effective way of storing and sharing photos.

  102. Mass distribution by thexile · · Score: 1

    Just put it up on p2p. As long as someone is seeding/uploading, it doesn't matter if you lose part of the data.

  103. /. Duplication Works by Anonymous Coward · · Score: 0

    The thing is, that /.ers make it work. At the time I am posting this comment, there are 235 other comments. Either many people missed out during the first round, everybody's repeating themselves, or there are 235 comments discussing the nature of duplicate /. content. I wonder if anyone purposely does a literal copy/paste of their comments from the first article to the second?

    Pointless sidenote: interesting captcha I had to fill out this time around: "floured". I feel like /. is trying to bake me into a pie.