Slashdot Mirror


The Afterlife Is Expensive for Digital Movies

A new study shows that storing the digital master record of a film costs much more than storing archival prints. "To store a digital master record of a movie costs about $12,514 a year, versus the $1,059 it costs to keep a conventional film master. Much worse, to keep the enormous swarm of data produced when a picture is 'born digital' -- that is, produced using all-electronic processes, rather than relying wholly or partially on film -- pushes the cost of preservation to $208,569 a year, vastly higher than the $486 it costs to toss the equivalent camera negatives, audio recordings, on-set photographs and annotated scripts of an all-film production into the cold-storage vault."

41 of 289 comments (clear)

  1. Perhaps they need to learning about DUPLICATION? by Anonymous Coward · · Score: 5, Funny

    It seems Slashdot could teach them.

  2. You know... by Omeger · · Score: 2, Funny

    DUPLICATION is a lot easier with digital forms of media. I mean, holy crap /., this is probably one of the fastest dupes in the same field of interest I've ever seen.

    1. Re:You know... by sm62704 · · Score: 5, Funny

      DUPLICATION is a lot easier with digital forms of media. I mean, holy crap /., this is probably one of the fastest dupes in the same field of interest I've ever seen.

      --
      mcgrew's razor: Never attribute to stupidity that which can be explained by greedy self-interest
  3. time by Lord+Ender · · Score: 3, Insightful

    This may be true, but the cost of preserving digital content is halving every year, and can digital content can persist indefinitely; while the cost of preserving film is generally going up, and film can not be preserved forever.

    --
    A slashdotter who didn't build his own computer is like a Jedi who didn't build his own lightsaber.
  4. dupe by Lars+T. · · Score: 2, Funny
    --

    Lars T.

    To the guy who modded me down from perfect to terrible Karma - Apple haters still suck

  5. Expensive Duplicates by mosel-saar-ruwer · · Score: 5, Funny


    Yeah, it costs a ton of money in disk space, mirroring, bandwidth, and power bills to maintain all those duplicates of the original.

    1. Re:Expensive Duplicates by Falladir · · Score: 4, Insightful

      Because nobody wants to expend more than a few dozen gigabytes (at the MOST) on a movie for personal viewing purposes. The task here is to preserve the "originals," the full-resolution, lossless cuts that were filmed on the set. I think I read that the footage that actually appears in Spiderman 3 constitutes 4 TB of information. Consider that a bunch of un-used footage also needs to be saved, and you'll agree that only a few insane enthusiasts would ever be willing to download and preserve that amount of information (at least with technology as it is now).

    2. Re:Expensive Duplicates by smittyoneeach · · Score: 3, Funny

      The obvious way to capitalize on the 4TB of data is to sell a new version every year with slightly lengthened scenes, out-takes, alternate endings, tie-ins, and boxed sets containing the previous and subsequent installments.
      By 2015, you'll have "Deluxe Duke Spiderman 3 Power Gold Director's Cut Nukem Forever".
      And you will like it.

      --
      Get thee glass eyes, and, like a scurvy politician, seem to see things thou dost not.--King Lear
    3. Re:Expensive Duplicates by TooMuchToDo · · Score: 4, Funny

      By 2015, you'll have "Deluxe Duke Spiderman 3 Power Gold Director's Cut Nukem Forever".

      I think you misspelled "Blade Runner, The Final Cut"

  6. I must be missing something here... by Pojut · · Score: 2, Insightful

    How does it cost more to store a bunch of files on a few duplicate hard drives than it does to maintain the facility AND personnel required to keep film negatives in excellent condition? I mean, isn't that one of the advantages to an all-digital film? Everything gets stored as a 0 and a 1, and can easily be duplicated however many times you want with no loss or degradation to the original source?

    Someone care to explain why it costs so much to buy a few hard drives?

    1. Re:I must be missing something here... by ILuvRamen · · Score: 2, Interesting

      what the hell are you talking about? Put the video on a high capacity plastic storage medium like HD DVDs or holographic disks (yes they exist) and stick em in the cold storage. How fucking hard is that? Plus, can't hard drives sit there and keep their data unpowered, out of a server, out of a datacenter, in the regrigerator for a long time too? Surely not as long as plastic but why would you even say that they'd be constantly live and powered in a server? There's absolutely no point to that

      --
      Google's Super Secret Search Algorithm: SELECT @search_results FROM internet WHERE @search_results = 'good'
    2. Re:I must be missing something here... by pla · · Score: 3, Interesting

      It is not just buying another drive
      $300/TB, currently.

      power for the drive(s)
      Approaching zero (minus a few hours per year for making a copy) if you store them offline.

      power for the server(s) using the drive(s)
      Ditto.

      costs of the backup architecture for DR
      A minimum-wage drive-jockey and a handful of PCs with EZ-Swap drive cages.

      costs of cooling the datacenter housing all of the above
      AKA "the dry and somewhat temperature controlled (40-110F) basement of any office building in the world"

      maintenance agreement costs for all of the above
      See "minimum-wage drive jockey" and add a broom.

      costs related to the admins who manage all of the above (salary, benefits, etc.)
      See "minimum-wage drive jockey".


      And that presumes they use HDDs and make a new copy once a year (keeping a few years as redundant backups and "working" masters)... Although I normally consider tape drives a waste of time and money, in this situation, they seem even more ideal than HDDs. The "handful of PCs" cost goes up, but the cost-per-copy drops drastically.

      Even if you replace "minumum-wage drive jockey" with "qualified IT professional or three", I can't see how you'd get anywhere near $12k per year.

    3. Re:I must be missing something here... by Tsunayoshi · · Score: 2, Insightful

      As I responded to someone else who mitigated costs in the same manner:

      If your business machine depends guaranteed access to millions of $$ of digital IP, are you going to rely on "minimum-wage drive jockeys" swapping out cheap disks to archive your data?

      --
      "Get a bicycle. You will not regret it, if you live." - Mark Twain, "Taming the Bicycle"
    4. Re:I must be missing something here... by Cromac · · Score: 3, Interesting
      It's to bad there isn't any warning when a drive interface is going to be retired, also to bad it happens so often people can hardly keep up...oh wait...

      Even if it did cost a quarter million a year that's still a fraction of the salary the so called "talent" makes for the big movies, there is plenty of money in the movie industry to pay for a datacenter for long term storage of the film.

      Maybe the movie industry should hire some people from Google to help them design a large scale redundant storage facility, Google seems to have the entire web cached, adding movies - even at a few TB each - shouldn't be a problem for them.

    5. Re:I must be missing something here... by dtolman · · Score: 2, Interesting
      Your numbers are way off. Actual filming tends to last around 6-10 weeks. But during that time they are filming 10-12 hours per day, with multiple film crews, each with multiple cameras.


      Television shows aren't much better. I have a friend who does TV editing - a major complaint he has is that there is dozens of hours of footage for hour long TV shows now - movies are worse. Major motion pictures can have over 200+ hours of footage for a 2 hour movie. Here a few cites I could find with a quick google on "feet of film" (the industry standard):
      Titanic - 1.3 million feet of film (about 240 hours of footage) - http://www.northern.edu/wild/th100/flmprod.htm/
      Dukes of Hazzard - 620,000 feet of film (120 hours of footage) - http://www.avid.com/profiles/080805_dukes_filmcomposer.asp?featureID=910&marketID=/
      Knocked up - over 1 million feet of film (180 hours of footage) - http://www.orange.co.uk/entertainment/film/19332.htm?linkfrom=%3C!--linkfromvariable--%3E&link=link_1&article=filminterviewknockedupsethrogenpart1/

  7. unedumicated by peas_n_carrots · · Score: 2, Insightful

    This story must have been written by a journalist clueless in the ways of technology. How does storing a hard drive in a salt mine any more costly than storing a film version? Where does the extra electricity come in? Have one primary version, make a backup (or 2 or 3) and put them in storage. If you're paranoid, verify and/or re-duplicate every few years. The cost of verifying regularly vs reconstructing degraded film should be a wash at worst. It should easily favor the digital versions.

  8. It's just a format refresh by davidwr · · Score: 3, Funny

    /. is refreshing their file-storage format to avoid obsolescence. This thread is in the new format. The one from two days ago is in the old format.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
  9. Not really by ArchieBunker · · Score: 3, Insightful

    Its all about the storage medium used. You're telling me you want to rely on a hard drive thats been sitting in storage for half a century or film? Film can be restored and if the picture degrades then you stil have something to work with. What happens when you lose bytes here or there in your digital film? Pixelation or loss of a frame all together. Then comes the problem of codecs? Will anyone be able to play a VC-1 file 50 or 100 years from now?

    --
    Only the State obtains its revenue by coercion. - Murray Rothbard
    1. Re:Not really by orclevegam · · Score: 4, Insightful

      Then comes the problem of codecs? Will anyone be able to play a VC-1 file 50 or 100 years from now? They will if you also store the algorithm the codec uses. You can always re-write a codec in the future, so long as you know how it's algorithm and data structures work.
      --
      Curiosity was framed, Ignorance killed the cat.
    2. Re:Not really by uradu · · Score: 2, Insightful

      I assume those ridiculous costs include periodic refreshing of all the data onto new media, and not just the physical cubbyhole to store the drives in. In that case your objection is moot. The great advantage digital storage has is that given proper media maintenance and periodic replication you will have pristine copies indefinitely, something that simply cannot be said of any analog technologies. Given the right equipment, this refreshing and replication process can be automated to such a high degree that little human intervention is required.

    3. Re:Not really by paulatz · · Score: 5, Funny

      The cost is really ridiculous, releasing the master on bittorrent would be so much cheaper.

      --
      this post contain no useful information, no need to mod it down
    4. Re:Not really by encoderer · · Score: 2, Insightful

      exactly.

      This "study" is probably from a manager barking off orders to a bean counter:

      1. determine how much HD space we need per movie
      2. figure out the cost
      3. multiply that by a format refresh every 2 years
      4. come up with an absurd guess on how expensive it will be to maintain codecs and compatible systems
      5. act like this system will have no business utility other than storing archived movies
      6. add it all up
      7. divide by number of movies sold so we can figure out how much to raise prices, then multiply that number by 2.

    5. Re:Not really by CyberLord+Seven · · Score: 3, Informative
      It's not that simple.

      The article is very clear that digital film production creates much more data!

      Directors no longer need to husband expensive film stock so they often leave camera rolling while they work out scenes. This is not necessarily garbage footage that can be discarded. Some of this material will be valuable to film historians and also financially valuable as it can be filler for the "extras" that are now included on DVDs.

      Digital production creates a much larger set of data that needs to be preserved and updated.

      --
      We have always been at war with Eurasia!
    6. Re:Not really by PopeRatzo · · Score: 4, Insightful

      It appears to have finally happened: the ever-shrinking distance between now and nostalgia has finally reached its zero-state. We are now nostalgic for our present.

      Maybe we should rethink the importance of preserving popular culture indefinitely in all its pristine digital glory. Why should we spend any money storing the Dukes of Hazzard movie for 100 years, except to fuel the campy nostalgia of future wankers who probably should find something better to do with their time? It's possible that we've already wasted enough time and energy on kitsch.

      I mean, it's nice that I can buy a boxed set of all the Francis the Talking Mule films, but I'm pretty sure I could live without it. It's the navel-gazing egotism of this generation that thinks every speck of its cultural exhaust is gold that needs to be protected for future generations.

      I'm willing to see society put a few bucks aside to preserve culture, but I think we should wait at least a decade before deciding to go long-term with any given artifact. That would allow us to better vet the material that we're going to keep. Maybe we can have a second and third-tier of stuff that can be saved using a lossy format. I bet it wouldn't cost me more than $200k to keep a divx of the 2005 film Son of the Mask. I'm pretty sure that's plenty good enough to insure that future generations don't miss out on anything.

      --
      You are welcome on my lawn.
    7. Re:Not really by ColdWetDog · · Score: 2, Funny

      Why should we spend any money storing the Dukes of Hazzard movie for 100 years ...

      Because at the rate we're going in terms of quality (vs. quantity), the "Dukes of Hazzard" may represent a pinnacle of entertainment achievement. A scary thought, but look at what's on the tube today and run that out for a couple of more decades....

      --
      Faster! Faster! Faster would be better!
    8. Re:Not really by orclevegam · · Score: 5, Funny

      Coming up next "Ow! My Balls!" on the Violence Channel.

      --
      Curiosity was framed, Ignorance killed the cat.
    9. Re:Not really by MightyYar · · Score: 2, Insightful

      Couldn't you set up a giant datacenter that does nothing but store data in a safe way? The copying would come automatically as you upgrade the datacenter with more storage, and I doubt that the cost would increase too much over time since data constantly becomes more inexpensive to store.

      I don't know what kind of data volume we are talking about, but for the $1059/year that it costs to store a film print, Amazon's S3 will store over 588 GB worth of data. For the $12,514 quoted in the article, they could store almost 7 TB. I'm having a bit of trouble believing that they couldn't store an archival-quality digital copy of a film (and all interesting outtakes) in 588 GB, let alone 7 TB. And the cost of keeping that data on Amazon would actually go DOWN over time, which you cannot say about storing the print.

      I'm not necessarily suggesting that they use S3 - just using it for the sake of cost comparison.

      --
      W..w..W - Willy Waterloo washes Warren Wiggins who is washing Waldo Woo.
    10. Re:Not really by Captain+Splendid · · Score: 2, Insightful

      What happens when a company goes bust and their codecs are not updated?

      That's where OSS comes in. Give it time.

      --
      Linux, you magnificent bastard, I read the fucking manual!
    11. Re:Not really by Score+Whore · · Score: 4, Insightful

      You keep saying "store the codecs" which means you're not thinking about this problem in a sane fashion. You don't compress. At all. That's the point of archival. It's not a matter of some geek boy lossfully reencoding his porn collection to fit on CD. It's a matter of keeping the original source material forever. There's no codec here. Just store the data flat with as many bits of precision as you have in your source material. End of story. The only real question is do you store this on spinning disks or stopped disks. Put it on a bunch of hard drives with some parity and error correction codes. Then shut them all down along with the entire infrastructure needed to read the data. Periodically fire it back up to verify that any bit rot that has come along can be corrected and then shut it down again. Every ten years or so, migrate the whole thing to whatever is new in storage. But don't ever compress this shit.

    12. Re:Not really by stuboogie · · Score: 2, Insightful

      "Directors no longer need to husband expensive film stock"

      You provided your own solution. The directors were more prudent with expensive film stock, so they didn't leave the cameras rolling. If they were financially responsible for all the additional footage not directly related to shooting a scene, I believe they wouldn't leave the cameras "rolling". Just because the directors can leave the camera "rolling" for extended periods of time doesn't mean they get to archive that footage.

      Financial waste and abuse run rampant when you place no restrictions on someone. Just look at how our government operates.

    13. Re:Not really by MightyYar · · Score: 2, Interesting

      I think that you could probably safely compress all of the "extra" footage that you don't know whether it is worth keeping or not. Maybe hundreds of hours of the crew talking to one another while re-doing scenes will be interesting to someone down the line, but probably not. And I doubt that they will need the original quality to be intact in any event.

      Note that in the days of real film, you wouldn't have that extra footage at all, since film is expensive and they couldn't afford to just keep the cameras rolling.

      By my rough estimate, 700 hours of extra footage would compress nicely in 1080i to about 10 GB/hour (going way overboard - blueray quality), giving you 7 TB. I can't believe that there would be 700 hours of stuff worth keeping... I mean, Christopher Guest is pretty famous for letting the camera roll, and his stuff usually comes in at about 80 hours. So you could back up every single shred of a Christopher Guest movie at blueray quality in less than 1 TB. Then you could preserve a "raw" version of the final cut of 2 hours in another 2 TB (even the bleeding-edge "4K" format only uses about 220 Mbps). So you could store an entire Christopher guest movie plus - what the hell - another TB of audio, data, and photos, and still come in under 4 TB. 10 years from now, that amount of data will be so infinitesimal that people will be laughing about there being any debate at all. Hell, in '93 a hallmate of mine bought a 1GB drive for $1000. You can now fit that in your pocket for $10. 1TB would cost you about $500, and I suppose that it is possible that in 15 years, you'll be able to get that for $10 and fit it in your pocket. So then you'd be able to store a raw Christopher Guest movie in your pocket for $20 :)

      But you are probably right, they probably think that they should keep every scrap of digital data completely uncompressed. They'll have to get over that or accept that they are keeping more raw data than they were in the past, and thus will have to pay more. In some cases (George Lucas, for example), it is patently obvious that they should keep every last scrap of digital output that he has. George has made more money remastering Star Wars than most producers will make in their entire career. Keeping the computer file that stores Jar-Jar Binks is similar to keeping the giant model of the UFO from "Close Encounters of the Third Kind".

      --
      W..w..W - Willy Waterloo washes Warren Wiggins who is washing Waldo Woo.
    14. Re:Not really by zippthorne · · Score: 2, Insightful

      "What happens when you lose bytes here or there in your digital film?"

      Your error-correcting codes do their job and correct the error. They also gives you a tangible warning sign for when it's time to refresh the media: when you no longer get 100% reads (or when the error% exceeds some acceptable threshold that happens to be well below the ecc's max error rate), you move to new media.

      And you do ridiculous amounts of parity bits, like O(size of the data) amounts of parity.

      If you're really concerned about future proofing you can print, in plain language, an explanation of the ECC and video codec on a metal plate and bolt that to the drive, but you're probably going to need to refresh before anyone forgets how either of those were done.

      --
      Can you be Even More Awesome?!
  10. Not a dupe! by MiniMike · · Score: 2, Funny

    This is just Slashdot's method for reducing storage costs!

  11. Another Idea by avandesande · · Score: 4, Funny

    How about they just shitcan everything and spare us another needless re-release?

    --
    love is just extroverted narcissism
  12. Read the previous /. story by davidwr · · Score: 2, Informative

    Most of the points worth discussing were brought up there.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
  13. My God! We've done it all wrong! by PHAEDRU5 · · Score: 2, Funny

    Back to analog, everyone.

    --
    668: Neighbour of the Beast
  14. Someone needs to come up with a new method by Mike+Buddha · · Score: 3, Interesting

    Someone who cares ought to come up with a method of transferring digital information to celluloid so that it can be stored with the cheaper storage costs. I'm not talking about a print, but storing binary files on film. A 70mm reel ought to hold a ton of properly formatted digital data and error correction.

    --
    by Mike Buddha -- Someday the mountain might get him, but the law never will.
  15. Re:uneducated by orkysoft · · Score: 2, Insightful

    You could store it as a big stack of DVDs, but how about a few 500-1000GB hard drives?

    --

    I suffer from attention surplus disorder.
  16. Re:... what? by Chrisje · · Score: 4, Informative

    You are obviously not an electronic mass storage professional, because your answer could not possibly be further from the truth. The fact that it got modded 2, Interesting) is interesting in that it proves that people on /. haven't got a clue either.

    A hard drive is a mechanical part that will cease to function if the lubrication (I kid you not) goes dry. So sticking a whole bunch of hard drives in a safe for ten years most likely results in you scrapping 8 out of 10 disks for mechanical reasons. Then the magnetic information that is stored on those disks will degrade with time even under perfect conditions. This is why the shelf life of data on an inactive hard drive doesn't surpass 2 years.

    DVD's and CD's supposedly should last for 20-100 years depending on whose marketing bullshit you are reading, but in practice up to 15 years is the maximum before the thing starts degrading. Tape suffers, albeit less, from the same ailment hard disks suffer from, even the current batch of LTO-3 and 4 WORM media.

    The current generation of MO or UDO drives however use a laser to heat up particular clusters of particles after which it uses a magnet to create the 1 respectively the 0. This means that they are (nigh) impervious to magnetism or heat as long as those two are not combined. MO/UDO is therefore the only medium that will survive for long times on a shelf.

    The obvious solution therefore, since HDD's are getting cheaper and bigger, is to stick all that data on active hard-disks, and keeping it alive. Keeping it alive means also having to do backups. All of this requires system administrators. And rules, management, business processes and whatnot, and at the end of the day you will have managed to build an expensive data center. It works, but not as cheaply as putting boxes of film in a basement for 50 years, sorted by title/alphabet.

    Obviously, the physical survival of the media is not the only worry, we're also aware of the fact that the .mod file I could play out of my LPT-port-sound-contraption 18 years ago is now useless because mod players and those devices are far from ubiquitous (I found the .mod format converter, but can't find any schematics for that capacitor-LPT-sound-thingy I put together back in the day).

    But all that aside, this article is a dupe. And so are the comments claiming it's a dupe. I'm getting a strange sense of Deja-Vu, because it's not the first time I see ignorance on the subject of electronic data management either.

  17. Thank God by edwardpickman · · Score: 3, Funny

    That's a relief it's a dupe. For a second there I thought I'd zoned out and it was still two days until Christmas.

  18. WTF?? by IchBinEinPenguin · · Score: 2, Insightful

    $200K to keep a few bits from rotting?

    ...just as Hollywood's writers began their walkout.

    Oh... that explains it.
    It's a conveniently timed report to bolster a negotiating position: "you can't possibly ask for more money, look how much it costs us to store this stuff!!"