Slashdot Mirror


MXF+JPEG-2000+HDD = Future of Video Preservation?

Anonymous Archivist writes "Media Matters, a technical consultancy specializing in archival audio and video material, recently completed a Mellon Foundation funded Digital Video Reformatting Preservation Project for the Dance Heritage Coalition. They conclude that MXF is the recommended container format, JPEG-2000 is the recommended encoding format and HDD is the recommended storage media. It's a very valuable series of experiments and offers a strong indication of where the archival preservation of analogue video is heading."

11 of 214 comments (clear)

  1. Re:Lossy file formats... by iezhy · · Score: 5, Informative

    JPEG standart defines several encoding formats, which include lossless compression as well

  2. Re:MXF? by Raul654 · · Score: 5, Informative

    " The Material eXchange Format (MXF) is an open file format targeted at the interchange of audio-visual material with associated data and metadata. It has been designed and implemented with the aim of improving file based interoperability between servers, workstations and other content creation devices. These improvements should result in improved workflows and result in more efficient working than is possible with today's mixed and proprietary file formats." -- What is MXF

    --


    To make laws that man cannot, and will not obey, serves to bring all law into contempt.
    --E.C. Stanton
  3. Recommended Storage Media by Antonymous+Flower · · Score: 5, Funny

    Recommended Storage Media: Peer to Peer network.

    1. Re:Recommended Storage Media by remahl · · Score: 4, Insightful

      Definitely not!

      Most if not all peer to peer networks require a certain level of interest in an item for it to be retained. Popular items are always easy to find while obscure / old items gradually disappear from the network.

      Try finding a movie that's a few years old. You'll have more trouble finding the original Jurassic Park than Jurassic Park III.

      Peer to peer is not a great way to reliably and systematically preserve cultural heritage.

  4. Why HDD? by Orinthe · · Score: 5, Interesting

    The HDD recommendation doesn't seem to make much sense. The article talks about cost-per-gigabyte, but obviously it is much cheaper to use CDRs or DVDRs. This is video preservation, after all, not storing indefinitely for video /editing/, which would require a more malleable storage medium. And before someone points out that there are studies showing that the longevity of CDR/DVDR discs is questionable, surely proper storage of discs (and not buying the Best Buy free-after-rebate special) would be sufficient. HDD, after all, is susceptible to head crashes, and being a magnetic medium can be more easily overwritten.

    --
    SELECT quote.text AS sig FROM quote NATURAL JOIN attribute WHERE attribute.description = 'witty';
    0 rows returned
    1. Re:Why HDD? by drinkypoo · · Score: 4, Insightful

      It would be smarter to use PAR2 (or similar) on a filesystem basis, than to use a RAID filesystem. It's easier to deal with user space programs for reconstructing data.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    2. Re:Why HDD? by Jah-Wren+Ryel · · Score: 4, Informative

      If you mirror across two disks and put the into storage, and one develops some minor errors, it is not possible to tell which one has the errors

      Exceptionally incorrect, prepare for smackdown.

      All data on a hard disk is protected by very sophisticated error detection and correction elgorithms. The chance of getting "some minor errors" is effectively nil - either they are corrected by the disc's controller, or the controller returns a "sector unreadble" error - which is what keys any effective mirroring system to go get the data from the second disk. You just don't get bad data from modern hard disks.

      This is why God RAID-5 was invented.

      No, raid-5 was invented to maintain the I in RAID. Mirroring doubles your costs, RAID-5 only increases them by one disk out of the N disks in the parity group, where N is usually but not limited to 4-5 drives.

      --
      When information is power, privacy is freedom.
  5. Nonsense by sql*kitten · · Score: 5, Insightful

    OK, let's talk archiveability. Let's talk about a medium that you can leave in a shoebox for a hundred years and read just by shining a light through it. I'm not talking hypothetical here - this technology is proven by the fact that people used it a hundred years ago and it worked. And the technology is even better now, even more stable.

    I am of course talking about film. It is very very easy now to write digital images onto film, not very much more difficult than it is to scan film. There's no need to worry about whether the file format will be supported in the future, as I've already said. You don't need to shovel money into vendor's pockets every few years just to copy it to the latest trendiest type of disc. You can build a machine to project film out of junk if you need to, or you can scan it if you want a digital image and when you have a better scanner (e.g. a higher DMax), you can just scan it again.

    The dude who wrote this report is just blowing smoke. He's trying to sell snake oil.

  6. Graceful degredation by Dwonis · · Score: 4, Informative

    Avoiding inter-frame compression means that, if you have some small amount of data corruption, you only get one, maybe two corrupted frames of video.

  7. Re:"it" being JPEG2k by TheoMurpse · · Score: 4, Informative

    When there isn't patent litigation surrounding the format.

  8. Intraframe vs. interframe by Wesley+Felter · · Score: 4, Interesting

    For whatever reason (I'm not a video expert) many people prefer intraframe codecs for archival. As you probably guessed, Motion JPEG 2000 just treats each video frame as a still image and compresses it with JPEG 2000.

    Dirac will give much better compression that JPEG 2000, but it also introduces the possibility of interframe artifacts.