Slashdot Mirror
'Hobbit' Creates Big Data Challenge
CowboyRobot writes "In the past five years there has been an 8x increase in the amount of content being generated per every two-hour cinematic piece. Although 3D is not new, modern 3D technologies add from 100% to 200% more data per frame. In 2009, Avatar was one of the first movies to generate about a petabyte of information. The Hobbit: An Unexpected Journey was shot in a new digital format called High Frame Rate 3-D, which displays the movie at 48 frames per second, twice the standard 24-fps rate that's been in place for more than 80 years."
But with digital storage transcending some other limitations of conventional projection techniques, it's not just framerate that directors are now able to play with more easily; it's the length of movies themselves, which stats suggest just keep getting longer.
I read TFA, and nowhere does it say how big The Hobbit was.. only that Avatar was about a Petabyte. Why isn't this stated anywhere? It's very frustrating, and also makes the article less useful, since its entire premise is that "The Hobbit creates big data challenge" with no specificity.
Am I the only one who longs for the return of an intermission? If only for a little relief rather than ducking out for 3-4 minutes and missing that one important little line of dialogue on which the whole thing pins?
So there I was, scribbling down some notes off the PC screen by hand, when I reached for the keyboard and Ctrl-S'd.
It was so classy. I'm sure it would help with the theater owners concession sales as well.
There may be no "I" in team, but there's also no "F" in way.
:poor guys that pirated avatar.. they had to download over a petabyte:
The Petabyte figure is almost certainly for all of the working copies of the movies while it was being produced. Nobody is sending a Petabyte to every theater in the country, and much less to every home. Once the movie is finished a final copy is compressed and sent to theaters and the disc authoring house. The disc authors have to further compress the image to make it fit on the Blu-Ray or DVD. Your average pirate is going to compress the movie even further because full Blu-Ray rips are still rather unwieldy for most broadband connections and personal storage solutions.
I read the internet for the articles.
Tolkien writes that Hobbits are between two and four feet (0.61–1.22 m) tall, the average height being three feet six inches (1.07 m).
I know people who are still downloading it, you insensitive clod!
How does this have anything to do with Big Data? Storing large amount of data isn't the important part, it is being able to analyze that data. You do not analyze a movie's data file. You just load and display the movie, which can easy be stored in one large continous file. A Big Data problem would be Netflix trying to determine what kinds of movies to recommend, not storing and then displaying a long movie to users.
-- All that is necessary for the triumph of evil is that good men do nothing. -- Edmund Burke
The standard pirate sizes ate 700MB for a recompressed DVD-rip and 4.4GB for a recompressed blu-ray rip. These sizes are used because they are just small enough to fit onto a CD-R and DVD-R respectively. It's not universal though. Especially long or difficult films might go up to 8GB in HD, and there has been a recent trend towards smaller files where quality wouldn't be compromised rather than just assuming media-size for everything.