Slashdot Mirror


Macs Do Star Wars Dirty Work

bfl writes "The BBC is running a story about Lowry Digital Images and how they used 600 dual G5s and 400 TB of storage space to clean the dirt off of the old Star Wars reels, and upgrade the resolution to get them ready for their DVD release."

24 of 219 comments (clear)

  1. Movie dirt by 2.7182 · · Score: 5, Informative

    Movie dirt is a special kind of "noise" in images, from a statistical point of view. Thus special filters can be applied.

  2. This story has been around a while.. by jcr · · Score: 5, Informative

    Apple has it on their own web site here.

    -jcr

    --
    The only title of honor that a tyrant can grant is "Enemy of the State."
  3. 180,000 frames by helfen · · Score: 4, Interesting

    just imagine:
    they have 180 000 frames
    1 frame = 70 MB
    use your calc folks ;)

    1. Re:180,000 frames by l3v1 · · Score: 4, Informative

      To the guys with how-does-it-fit-on-a-DVD: the resolution they work with is the scanning res needed to process the cleaning on high quality. The size is the uncompressed size of th scanned frames. When putting on a DVD the resolution is highly reduced and compressed into mpeg2.

      Well, and that is not what's usually the biggest size. I participated in a project in which we cleaned up a pretty much damaged color movie from the 1950s. It was about 130000 frames, each frame was scanned into ~2K files (w/ 3 channels, 10 bit log density / channel - this res was enough for this movie, but usually higher scanning res is required). If you add that up, multiply it by a few times for storage of during-the-work duplicates for checking, quick back stepping, etc. and you end up with lotsa-lotsa hard drives.

      Then calc up how much space you would need to process all that stuff on e.g. 4 or 6K res.

      --
      I am putting myself to the fullest possible use, which is all I can think that any conscious entity can ever hope to do.
  4. The MACS did it! by nebenfun · · Score: 5, Funny

    The MACS made Greedo shoot first!

    1. Re:The MACS did it! by Dirtside · · Score: 4, Funny
      The MACS made Greedo shoot first!
      Don't laugh. Rumor has it that the Mac responsible for doing the "Greedo shoots first" changes later became clinically depressed, turned to pills and booze, and finally committed suicide.

      Lucas, you maniac! When will this abuse of innocent computers end?!

      --
      "Destroy science and religion. Science would re-emerge exactly the same; but not religion." - Penn Jillette, paraphrased
  5. Don't forget the "Jedi Clause." by sakusha · · Score: 5, Interesting

    Most people don't realize, much of the primary CG work done on the Star Wars films are done on Macs. But ILM signed contracts with SGI which prohibits them from acknowledging the contribution of any system other than SGI. Inside ILM, this contractual obligation is known as "the Jedi Clause." So the contribution of Macs and Mac users to these films go largely unrecognized.

    1. Re:Don't forget the "Jedi Clause." by Anonymous Coward · · Score: 4, Interesting

      I've read several articles about ILM supposedly replacing their Windows and SGI IRIX workstations with GNU/Linux systems.

      So obviously that contract didn't prevent them from announcing their use of GNU/Linux on x86 workstations.

      Some related articles:
      http://www.linuxjournal.com/modules.php ?op=modload &name=NS-lj-issues/issue99&file=6011s1
      http://www .zdnet.com.au/news/business/0,39023166,2 0266843,00.htm
      http://preview.millimeter.com/mag/ video_linux_holl ywood/

    2. Re:Don't forget the "Jedi Clause." by SideshowBob · · Score: 4, Informative

      You have all three: -faltivec turns on vector optimizations in Apple's GCC. Also there are the vImage and vecLib frameworks (contained under the Accelerate.framework umbrella) for a set of altivec optimized library routines. Finally there is -mabi=altivec in gcc to turn on support for vector keywords and altivec asm (this switch is implied when -faltivec is given)

  6. Re:Thats like, how many dvds now ? by GerbilSocks · · Score: 5, Insightful
    There's only a finite number of old films. Of those old films, most are either shoddy or have been long forgotten. Only a very small number of movies are beloved enough that studios are willing to cost out the restoration work.

    Most films shot now are digitized, or shot digitally in the first place.

  7. Overheard at a Lucas meeting by Anonymous Coward · · Score: 5, Funny

    "Hey, you know what would be cool?"
    "What's that?"
    "These G5s are pretty cool...we should make a beowulf cluster of them!"
    "Well, we're obscenely rich, so..."
    "Yipee!"

  8. Macintosh = The Industries Retarded Son by Anubis333 · · Score: 4, Interesting

    I love Apple and I love the spirit of competittion, I have been a Mac user much of my life. But why are Macs always treated like the retarded child of the computer industry? Look at the guy pictured in the article; he's smiling, he's so proud 'THEY DID IT!'

    It seems like any time the Mac platform does something that is remotely interesting people rejoice and it is plastered everywhere. Would this story be on the front page if PCs were used? I doubt it, even if they were running Linux.

    It's just like this weird thing where anything, even commonplace events get blown out of porportion just because Macs were used, as if the entire platform blows and it's amazing anything gets done, which is not the case. Maybe it is just the Mac user hubris as pictured above, but it comes across as this weird feeling I mentioned earlier. Touting that the macs 'can do!' things PCs do all the time makes them seem inferior and retarded, like they need the positive reinforcement.

    1. Re:Macintosh = The Industries Retarded Son by SideshowBob · · Score: 4, Informative

      Only people then invest their own personality in something refer to themselves as "literati"

      A computer is a tool. A mac just happens to be a good video tool because it was built that way. Calling someone illiterate because they chose a good tool for the job is just assinine.

      A really good vector unit, vectorizing compiler, vector libraries, and a host of system and application software make the Mac platform well suited for the task described in this article. Why people feel so threatened by this fact is beyond me. Linux is great at the things it was built to excel at, Windows (gasp!) does some things very well, too. BIG FUCKING DEAL.

      If you were a true computing enthusiast you would have one of each. I do.

  9. Re:CmdrTaco Does Slashdot Dupe Work by magarity · · Score: 5, Funny

    Dude, that old article about the 378TB is so Sept 12. Now it's 400TB. Ergo: new article.

  10. Re:CmdrTaco Does Slashdot Dupe Work by Anonymous Coward · · Score: 5, Funny

    No, it's a conversion rate thing. 378TB American = 400TB UK.

  11. List of Movies restored by Lowry Digital by Danathar · · Score: 5, Interesting

    Amazon has a list made up by Chuck Kahn of movies that have been cleaned up by Lowry.

    http://www.amazon.com/exec/obidos/tg/listmania/l is t-browse/-/1X2DZ42QS8OVB/103-1368633-4717431

    I've picked up THX1138, Once upon a time in the west, North by Northwest, The Ghoul and of course Star Wars.

    The results are INCREDIBLE. Except for some obvious dubbing with sound, Once upon a time in the west looks like it was filmed yesterday. So does THX1138!

    I've tried finding the Lowry Digital Web site. But INCREDIBLY it seems like they don't have one! Seems strange. You would think they would have a web site telling people the films they have done so people might go out and buy them.

    If somebody knows it....PLEASE post it!

    1. Re:List of Movies restored by Lowry Digital by smallpaul · · Score: 4, Informative

      They really do not have a website. I know someone who works there and he says that they don't bother to market because they are overwhelmed with business.

  12. Overheard at the render farm.... by nebenfun · · Score: 4, Funny

    Node 23543: "What's the sickest thing you've done for cash?"

    Node 25685: "I once had to render a goat hobbit monkey sex video...I was depressed for a year!"

    Node 65423: "I had to do pitch correction on three hours of Britney Spears audio! I still find myself waking up and crying like a baby..."

    Node 27928: "Once, I had to work on a Lucas proje..."

    All of the other nodes: "Say no more! You poor bastard!"

    Unidentified node : "You whore!"

  13. Re:Thats like, how many dvds now ? by EtherAlchemist · · Score: 4, Interesting


    Most films shot now are digitized, or shot digitally in the first place.

    Most films are not shot digitally, very very few films are shot digitally. Most films are still shot on film.

    I wouldn't say older films are forgotten, not at all. Almost all of the studios (the big ones at least) started sending the old, original reels to the massive underground storage facility that I believe is run by Iron Mountain. Here they are kept in controlled temps and dust free.

    --
    R(k)
  14. Actually, MTI (running on Windows) is dominant by Thagg · · Score: 4, Informative

    It turns out that a huge part of the film restoration/cleanup work is done using programs from MTI Right now huge film libraries are undergoing scanning and cleanup using MTI's products in preparation for high-def DVD release (once the standards get, uhm, standardized)

    These MTI workstations might have highest software/hardware cost ratio of any widely deployed system. The hardware costs are a couple of thousand dollars, and the software is well over $50,000 per system. But, they get the job done like nothing else, and it is my experience that studios demand that particular software for their restoration.

    It's not a completely automatic process by any means. The software can do a lot on its own, but it does require an artist to painstakingly review and correct the things that the software misses, or to guide the software to a correct solution.

    A friend of mine who is building a large restoration facility would love to have a Linux solution, but unfortunately none exists at this point.

    Thad Beier

    --
    I love Mondays. On a Monday, anything is possible.
  15. Re:Shot noise in optical systems by badasscat · · Score: 5, Informative

    Can someone elaborate on how shot noise applies to optical systems, specifically, cinematography? Since the original source material is conventional 'analog' film, at what point is the noise introduced? How is it introduced?

    Well, it's all explained in the article. And you've got half the answer yourself. But I'll try to explain further...

    (Yes I realize that film is not a pure analog format; the resolution being limited by the grain size of the emulsion - but at the same time, it's not what we consider digital.)

    Film grain itself is a noise component. Film grains are nothing more than crystals sensitive to a particular light wavelength. In commonly used 35mm film stocks, there are three layers of emulsion - one red, one green, one blue. Think of the grains as "pixels", although they're somewhat randomly distributed, they're not all of a uniform size, and they're not all uniformly sensitive to light. The end result is that the minute differences between adjacent grains makes them easily discernible on a theatrical-size screen, and somewhat visible on a large TV set. They appear as noise.

    Optical effects also involve compositing several layers of film on top of each other. According to the article, the light saber scenes were the worst. I'd imagine at that time, shooting a light saber duel probably involved three layers of film; the master shot and one optical shot for each light saber. Obviously this triples your noise and also softens the image. It can also introduce color casts because the light is being altered through each layer of film.

    As films age, chemical reactions also cause color shifts in the grains. This can lead to even more noise.

    Films also get just plain dirty over time. The Star Wars negatives have been handled a lot, so they're probably dirtier than most. 35mm not being very big, when you blow it up onto a theater screen or even a TV set, a small layer of dust or tiny particles of dirt will add a lot of crud to the image.

    The software they used to clean up these films apparently works by comparing each frame of film to the frame before and the frame after, to see what's picture information and what's noise (random noise will be easy for a computer to pick out, because it will not match at all from one frame to the next). It should have no problem removing both film grain and dirt, as well as other types of noise.

    I'd imagine they must have manually isolated each individual edit in the film to reduce errors, but this wouldn't have been that big a deal in the grand scheme of things. There's probably only maybe a couple thousand cuts per film (assuming a high average of 5-10 cuts per minute), so it wouldn't take more than a couple days for one person to do this.

  16. Not just the graphics explaining the gap! by Fantastic+Lad · · Score: 5, Insightful
    This may be why Star Wars was so popular when if first came out, but when little kids and others watched it many years later in re-release or on video they were somewhat less impressed by the lesser quality film they were watching.

    Or... "Gee it was more fun the first time when I was 10!" Well, that's because it actually was a better-looking film.


    The original versions of the films also didn't have the new editing, new scenes, new shots, all of which greatly diminished the pacing and believability of the film.

    There's a reason they give Oscars out for editing. --It really doesn't take much to ruin an otherwise good work. A single nail standing up on a water slide can make the whole ride a lot less enjoyable. And the re-release versions of Star Wars had a whole hardware store's worth of junk added!

    Every three minutes while watching that thing, I felt, at best that I was having to deliberately overlook stupidity, (like those new digital droids floating around Mos Eisley which it was clear from the actors' body language, were not really there and thus created a discordant effect), to my feeling like I was being stabbed when Luke Screamed while falling down the throat of Cloud City.

    So yeah, if I was a kid today watching those lousy re-release versions of Star Wars, I'd also think my elders were doddery and out-dated for raving about them; that they needed a patronizing pat on the head and a, "There, there, old timer; I'm sure they seemed like nice films in your day."

    The wide-screen, color and sound restored, but otherwise un-adultered LD copies from the mid nineties are the best versions available of the original trilogy. --There are yet to be any pirate copies of those ripped to DVD floating around, but there damned-well ought to be!

    Some of you out there have the capability to create these. DO IT. Star Wars is a vital part of our culture, and what Lucas is doing to erase it is as insidious as any 'terrorism'. --If Phantom Menace hadn't sucked, there is a good chance we could have avoided being in Iraq today.


    -FL

  17. How many Macs does it... by DrRobert · · Score: 4, Funny

    to fix all the bad acting in the films... that seems like it would be a worthwhile investment for film restoration.

  18. Color Quality in Star Wars DVDs by Anonymous Coward · · Score: 4, Interesting

    Although the sharpness and lack of scratches/dirt is great, the color quality is pretty awful in the restored DVDs. The saturation is way too high; for example, sometimes it looks like ObiWan is wearing lipstick, the desert sand often looks bright orange, and C3P0 looks like he was painted with a flourescent marker or something. In the Millennium Falcon scene when Luke is training lightsaber, his lightsaber is bright green for some reason - even though it was originally pale blue.

    If not for the wonky color, I might be able to stomach the Lucas changes; as it is, I much prefer watching my bootleg DVDs based on the pre-special edition Laser Disks, which are basically perfect except for slightly lower sharpness than it could be.