Slashdot Mirror


ILM Now Capable of Realtime CGI

Sandman1971 writes "According to the Sydney Morning Herald, specialFX company ILM is now capable of doing realtime CGI, allowing actors and directors to see rough CGI immediately after a scene is filmed. Actors on the latest Star Wars film watch instant replays of their battles with CG characters. ILM CTO Cliff Plumer attributes this amazing leap to the increase in processing power and a migration from using Silicon Graphics RISC-Unix workstations to Intel-based Dell systems running Linux."

32 of 259 comments (clear)

  1. Errm... by bconway · · Score: 4, Insightful

    According to the Sydney Morning Herald, specialFX company ILM is now capable of doing realtime CGI, allowing actors and directors to see rough CGI immediately after a scene is filmed.

    Wouldn't realtime by WHILE the scene is filmed?

    --
    Interested in open source engine management for your Subaru?
    1. Re:Errm... by UCRowerG · · Score: 5, Insightful

      Technically, perhaps. I think this is a great tool for directors and actors. Instead of having to wait weeks/months to incorporate CGI and see the interaction, it can be done in minutes/hours or as fast as the CGI people can splice things together. The director can give near-immediate feedback to the actor(s), which could really help the movie get done more quickly and with fewer costs in the long run. Think about it: changing the expression/pose/color on a CGI character is fairly easy. Re-filming live actors, especially with live fx, can take much longer and be more expensive (salaries for actor, director, film crew... lighting, film, makeup, fx expenses).

    2. Re:Errm... by jeffgreenberg · · Score: 5, Insightful

      This is particularly important as they aren't using film.

      WIth HD Lucas is shooting actors on Video...and now doing previsualization with the CG elements on set.

      Did Liam look in the general direction of, but not AT the eyes of the CG character? Reshoot. etc. etc. etc.

      Additionally a rough edit can be done off the video tap on set with the rough CG edit.

      Unfortuantetly this still means nothing without good acting, a good script, or alternate footage to make decisions from.

      You make a film three times.

      Once on the page, once while directing, and once in the edit. But if everthing is so storyboarded and timed down the moment that you can't have options, you can't discover anything in the edit at all.

      Oh well, at least you can see what the giant CG creature looks like

  2. That's nothing... by say · · Score: 5, Funny

    ...my webserver has been doing realtime CGI for years.

    --
    Roses are #FF0000, violets are #0000FF, all my base are belong to you
  3. How long til... by BeninOcala · · Score: 5, Funny

    We have Real-time CGI Porn?

    --
    Where ever you go, there you are.
  4. Realtime by Anonymous Coward · · Score: 4, Funny

    Maybe it IS realtime, but the actors just don't have the skill to watch themselves on a monitor WHILE acting, so they use the obvious 'i'll watch when i'm done method'

  5. What's the point about this? by cdemon6 · · Score: 4, Interesting

    "Realtime CGI in Movie Quality" would be impressive, but:

    "It's not at full resolution, but at least it gives them something to work with rather than working completely blind after each take."

    1. Re:What's the point about this? by deadfishhotmail.com · · Score: 3, Funny

      This will be resloved with the new nVidia GeForce FMXP 41000x It's supposed to be 3rd quarter this year. It's supposed to totally smoke anything ATI has right now, with photographic quality and with at least 6 times the Q3 fps. And it has outputs to a film projector. And built in lasers. And 7.1 Audio onboard. And a soda/Pizza exhaust port.

      ....and it's supposed to be profitable.

      --


      Who is this "Poster" guy and why does he own all of my comments?!?
  6. Serious Question by Anonymous Coward · · Score: 4, Interesting

    With all the excitement over ILM using Linux I'm wondering exactly how many Hollywood visual effects studios use Linux.

    1. Re:Serious Question by MrMickS · · Score: 3, Insightful
      Linux will be used on commodity x86 hardware for render farms by all effects studios, if not now in the near future. The reason for this. Bang for buck density. In order to render complex scenes you need a large render farm, the more faster units you have in the farm the better. It's cheaper to do this with x86 kit that anything else and the render software has Linux render engines written for it.

      More and more manufacturers are coming out with blade servers using x86 processors which will increase this density and likely increase the use.

      This is not saying that the studios are not running SGI kit for animation, modelling etc. Linux/x86 kit has a way to go to catch up there.

      --
      You may think me a tired, old, cynic. I'd have to disagree about the tired bit.
  7. nothing inherantly special about dell/linux by AssFace · · Score: 5, Interesting

    The way that is worded, it makes it sound as if the processing power of an Intel/Linux combination is superior - whereas it is a matter of the bang for the buck instead.

    You can get more processing power with the latter since it is cheaper (I would imagine even moreso with AMD) and easier to maintain. But not because it is inherently special or faster in any way.

    I wonder if this will bring Silicon Graphics back into the favor of Intel boxes - for awhile they were okay with WinNT and Intel boxes, but then they dropped all of that - presumably for a higher profit margin and less hassle of maintaining multiple systems (also likely some break in business politics - perhaps someone at MS pissed someone off at SGI).

    --

    There are some odd things afoot now, in the Villa Straylight.
    1. Re:nothing inherantly special about dell/linux by Alan+Partridge · · Score: 4, Interesting

      I take your point, but the fact remains that the FASTEST SGI workstation is treacly slow - in absolute terms - vs the fastest Intel-based 'station. ILM couldn't care a fuck how much it costs, they want cutting edge speed (hint - they didn't buy their previous solution based on cost, they bought it based on capability).

      I work in TV, and I know first hand that SGI is losing out to commodity hardware running Linux, Windows and even to the Mac. SGI gear is just about hanging on thanks to discreet - but it's just a matter of time before an inferno for Intel product lands and a lot of Onyx racks hit eBay.

      Unless, of coures, SGI fights back...

      --
      That was classic intercourse!
    2. Re:nothing inherantly special about dell/linux by AssFace · · Score: 3, Interesting

      I think we are "arguing" the same points here. But I'm pointing out the semantics of it and how it comes about - but in the end I think the end result is likely the same.

      The article states that they upgraded their hardware and the new hardware is faster and cheaper than the prior hardware... uhhh, right - I'm pretty sure that is how the hardware world works.

      Where you could argue that Linux has its edge is stated right in the article - it is the driver support. SGI doesn't support certain drivers, and for good reason - they want to push their own stuff. So if they want to work with new hardware - like the new NVidia chips for realtime rendering the same way SquareSoft did, then SGI isn't going to help.

      Also, workstation speed is all relative - it depends on what you are doing on the particular workstation - are they slower at working with real-time video? are they slower at network filesharing? is their memory bandwidth too slow for the hardware to make full use the processor?
      To say it is too slow is a cop out - the hardware exists for a specific reason - SGI makes very action specific workstations, and they are areguably useless outside of that realm.

      And while it is a fantastic thing for you to be able to throw around that you "work in TV" as if what you say is now backed by all of that business instead of just your opinion - then by me saying that I once worked at a special effects house, I should now have more power in what I say right?
      I assure you that whether the effects house is SquareSoft, ILM, Digital Domain, or whatever - they all are businesses and have a single bottom line - they need to make money.
      In order to make money, they won't ignore cost as you say. But it might look like that if they are rationalizing cost (a 100 node cluster of SGIs might be a million dollars, but a 200 node cluster of Alpha boxes might be 1.75million - they are spending more money, but they are getting a much faster overall cluster).

      To argue over their workstations is silly in the end - the workstations are constantly being turned over at these places and nobody is ever satisfied with their performance. They don't really care if your workstation is top notch - what they care about is how fast the end product can be realized - if a faster workstation would result in that, then you get a faster one based on cost - but almost always, the entire focus of the drive of machines purchased is the rendering farm.
      Even then, it hardly ever is truly purchased - it is a lease type deal since the turnover is so high.

      I personally hated SGI when we worked with them and I much preferred the Intel boxes. So I'm not exactly standing up for SGI here, I mainly just thought the article was poorly written and should have called out the reason for switch better than just a reason to add one more article to the linux circle jerk.

      Also I should note that I wrote SGI/Intel on WinNT up there - that is wrong - it was SGI/Alphas with WinNT. I would imagine that Intel and AMD now making the new 64bit chips will lead to a lot bigger jump over SGI.

      --

      There are some odd things afoot now, in the Villa Straylight.
  8. Two Towers by alnya · · Score: 5, Insightful

    In the Fellowship of the Ring DVD, Peter jackson can clearly be seen watching golum on a monitor (low poligon, but golum none the less) performing the mo-cap Andy Serkis is performing IN REAL TIME; as it is happening (not after).

    So does this make this old news??

    I dunno, I feel the ILM have been behind the bleeding edge for sometime now...

    alnya

    1. Re:Two Towers by Zzootnik · · Score: 3, Informative

      No-no-no-no-no....That was Motion Capture.

      Sensors on Andy S's Body capturing movement data and feeding it into a computer...Much like the mouse you're waving around right now...

      --
      Sig currently under construction. Mind the gap....
    2. Re:Two Towers by chrisseaton · · Score: 3, Informative

      "Sensors on Andy S's Body capturing movement data and feeding it into a computer"

      Yes... and then rendering the character on top of the real from using the motion capture info.

      It's still realtime rendering.

  9. Oh well by stephenry · · Score: 5, Funny

    Its a pitty they haven't got one of those to write the script!

    Steve.

  10. Hrmm by acehole · · Score: 5, Funny

    well, I guess they need to get that jar jar binks death scene juuuuust right.

    --
    Be you Admins? nay, we are but lusers!
    1. Re:Hrmm by docbrown42 · · Score: 4, Funny

      well, I guess they need to get that jar jar binks death scene juuuuust right.

      Naw. The actors kept screwing up just so they could kill Jar Jar again...and again...and again. Given the chance, I think most fans would do the same thing.

      --
      Ed Wedig
      Graphic design services
      docbrown.net
  11. Don't get so excited by derrickh · · Score: 3, Informative

    The realtime images aren't -final- renders of the scene. They're just rough drafts. The scene still has to be rendered in full res/texture, which still takes hours per frame.

    What ILM has is a supercharged 'preview' button. Just like when you switch to wireframe mode in Lightwave or Maya and see a 'realtime' preview of the animation you're working on. But I'm sure ILM's version looks little bit better.

    D

  12. Another nail in the SGI coffin by binaryDigit · · Score: 5, Interesting

    Well, as more and more cgi houses move off of SGI (and on to whatever), they are only really left with their server business. It's really a shame to see a once proud pioneer in the industry reduced to a mere shadow of their former selves, though I guess in this industry, its very common (e.g. DEC, Lotus, Compaq, etc). At this rate it's hard to even see them being around in 4 years, a definite takeover target.

    ob /. comment:

    SGI (aka Silicon Graphics Inc.) was found dead today at the age of 20. After being a high flyer in his youth, often seen hobnobbing with Hollywoods power elite, the latter years were not so kind and saw him in the throes of an identity crisis. Eventually his reliance on a small circle of friends was his undoing, as he was slowly replaced by more mainstream competitors. He will be sorely missed, as while he was at the top, he was a role model for "cool" in the industry, and helped to usher in one of the most exciting (and abused) technology shifts in the motion picture/video entertainment industry since the advent of talkies and color.

  13. Re:further proof by Alan+Partridge · · Score: 5, Interesting

    not even close

    further proof that commodity hardware is killing innovative companies like SGI, and a FREE UNIX is helping it happen.

    Linux is great for a company like ILM which is stuffed full of coders who can adapt it to suit their needs, not so good for many other companies.

    --
    That was classic intercourse!
  14. The next innovation by imadork · · Score: 5, Funny

    would be to develop a program that re-writes Lucas's inane dialogue in real time...

  15. A stunningly inaccurate article by sgi_admin · · Score: 4, Interesting

    This is, largely, nonsense.

    These images are *not* realtime! A PC is not capable of rendering a CGI screen, in realtime, and merging that, in realtime, with a video feed, and then displaying that, in *realtime*.

    Say what you like about Linux, or high speed CPUs, or XXX vendor's high end GFX card - the architecture and the tools are physically incapable of this.

    If you look at the extras on the LOTR:FOTR DVD set, you'll see people walking around, with a camera on a stick. This *is* displaying real time camera images, merged into a low res, non final rendered, scene of the Cave Troll fight in Moria.

    A point of reference - the machine's they are using for this are SGI Octanes. Not Octane2s, but Octanes.

    They did that work around, what, 3 years ago? And the Octane, at that time, was only 3-4 years old.

    Can anyone show me a PC from 1997 that can manage that? Anyone?

    Despite the fact that the Octane is an ancient piece of kit, there is nothing from the PC world that can match it's capabilities.

    SGI have always been, and always will be, a niche player.

    You would be a fool to buy expensive SGI kit for a renderfarm - buy Intel PCs with Linux. Similarly, you would be fool to try and do realtime CGI with that same kit - that's a specialist task that calls for specialist skills.

    This article does not show that SGI is dying, or that they're being thrown out of the GFX workstation market.

    This article *does* confirm what is widely known - the once cutting edge ILM are now many years behind people like Weta Digital.

    Throwing around "Linux" and "Intel replacing SGI" sound bytes to try and get some news coverage for a dated effects house isn't going to change that.

  16. It's the video card, not the CPU.... by Faeton · · Score: 4, Insightful
    Carmack himself (on Slashdot no less) has predicted this would come to pass, due to the increasingly feature-rich and faster video chipsets.

    SGI laughed at the unassuming threat of the video chipsets, thinking that they would never be as fast as brute force. Even Pixar thought the same. Boy, were they wrong though. You can set up a cheap-ass render farm for about $250k, taking up minimal space that can do the same job as a SGI render farm that costs a cool $2 million (Shuttle SFF PC w/ 3 gig CPU + ATI 9700). Of course, there's still the software side.

    The Nvidia's GeForceFX and ATI's Radeon 9800 both contain features that even through the marketing-hype has some real value to programmers out there. Just look at Doom 3. It will run well on some computers that are just 6 months old. Now, imagine taking 250 of them, as a Beowulf cluster!!1

    1. Re:It's the video card, not the CPU.... by _|()|\| · · Score: 3, Informative
      SGI laughed at the unassuming threat of the video chipsets, thinking that they would never be as fast as brute force. ... You can set up a cheap-ass render farm ... that can do the same job as a SGI render farm ... (Shuttle SFF PC w/ 3 gig CPU + ATI 9700)

      A high-end video card is used in a workstation for content creation. Final rendering, however, is still done in software (i.e., by the CPU), whether it's LightWave, Mental Ray or RenderMan. Don't waste your money on a Radeon for your render node.

  17. oh yeah by Anonymous Coward · · Score: 5, Funny

    Post your server's url to slashdot, and we'll see just how realtime it is.

  18. Open? by Diabolical · · Score: 4, Interesting

    ILM developed its proprietary file format, OpenEXR

    Hmm.. i sense a trend in calling things open when they are actually closed. This is eroding the intended meaning of "Open" in front of fileformats or products.

    1. Re:Open? by Kupek · · Score: 4, Informative

      It was released under a modified BSD license.

  19. Had do be said... [Spaceballs ref] by caveat · · Score: 5, Funny

    Dark Helmet - "What the hell am I looking at? When does this happen in the movie?"
    Col Sandurz - "Now. You're looking at now, sir. Everything that happens now, is happening now."
    Dark Helmet - "What happened to then?"
    Col Sandurz - "We passed then?"
    Dark Helmet - "When?"
    Col Sandurz - "Just now. We're at now, now."
    Dark Helmet - "Go back to then."
    Col Sandurz - "When?"
    Dark Helmet - "Now."
    Col Sandurz - "Now?"
    Dark Helmet - "Now."
    Col Sandurz - "I can't."
    Dark Helmet - "Why?"
    Col Sandurz - "We missed it."
    Dark Helmet - "When?"
    Col Sandurz - "Just now."
    Dark Helmet - "When will then be now?"
    Col Sandurz - "Soon."

    --

    Facts do not cease to exist because they are ignored. - Aldous Huxley
  20. If they were using the preemtive kernel by teamhasnoi · · Score: 4, Funny
    they could watch the CGI *before* it happened.

    Now that's Cost Savings!

  21. It's neither by sgi_admin · · Score: 3, Informative

    You need to be able to render something in realtime, combining rendered scenes and a live video feed, and then to display that on a monitor or writing it out to digital storage - and all in real time.

    This is not a function of the CPU of the GFX card - they both play a part, but not as much as you seem to assume.

    The main thing here is *bandwidth*. You have to have a large amount of non-contentious bandwidth to chuck all that data around.

    Point to point bandwidth between multiple devices - CPU to memory, CPU to GFX, GFX to memory, CPU to output pipe, input pipe to GFX, etc. etc.

    One approach was UMA, which SGI pioneered in the O2. A 7year old SGI O2, even a low end one, can handle 800mb textures in realtime with ease. There is little available today that can even approach that.

    Another approach is some sort of IO switch. SGI have the crossbar in the Octane/Octane2, which is old tech based on the IO infrastructure of the Origin 2000.

    The Octane's crossbar switch gives you a large amount of non-contentious bandwith, which is why, for instance, a low end 195mhz SGI Octane from 1998 can apply in incoming digital feed as a texture to an object, and display that on digital output, in real time.

    Remember the Anubis warriors in The Mummy Returns? Their skin was a texture from a feed that was applied in real time - this was so the animators could get a good feel for how their animation changes effected the scene.

    Sun have a similar sort of setup with their UPA crossbar on their Ultrasparc kit. IBM and DEC^W^Compaq^WHP a similar deal.

    The reason UNIX vendors can charge lots for their kit is the years of R&D they've put into solving problems like this, which just don't appear on low end commodity kit.

    The Origin2000 can scale to 1024 CPUs in a single system image - it's one OS, no partitions. Sure, that's for a niche market, but it doesn't change the fact that there is a serious IO contention issue that needs to be solved in that scenario. SGI have then taken that solution and thrown it into their graphics workstations.

    CPU speed and gfx speed will not help here - neither will the OS. Linux or Windows, ATI or Nvidia, PC solutions will not cut it in this area - the underlying architecture is poorly suited to those sorts of tasks.

    Niche markets for people like SGI will always remain small, but despite the ill-informed nay sayers, they will never die - because there is a need there, and there is no commodity kit that can do the job.