Cinematic Game Graphics

CowboyRobot writes "LucasArts engineer Nick Porcino has an article detailing what to expect from graphics in the next generation of game systems including the "influence of cinematic realtime rendering, the promise of advanced lighting techniques and high-dynamic range images, the uses of the rendering pipeline, and the future of multiprocessor-based rendering and advanced geometry." These will allow run-time rendering of high quality backgrounds and characters, ultimately resulting in games that are closer to full-blown Pixar animations, allowing better narratives and more immersive user experiences."

Comments

Where are the "Sound Acceleration" cards?

[Jezral]

Off-topic, I know, but I've been wondering...

ok, so we've been able render Toy Story in real-time for a while...

But, where are the cards that can generate the sound of one arbitrary object hitting another? I don't just mean positional sound of pre-recorded samples, but really create the sounds from scratch (or an "audio-enabled model").

Re:Where are the "Sound Acceleration" cards?

[Jerf]

But, where are the cards that can generate the sound of one arbitrary object hitting another? I don't just mean positional sound of pre-recorded samples, but really create the sounds from scratch (or an "audio-enabled model").

Not to put too fine a point on it, but... we don't know how to do that .

Even what you may have heard of is wild, wild cheating compared to what you describe.

I've given some (intelligent, educated) thought to this issue, and here's the problem. Light is adequately simulated with a line in the macroscopic world. It is, technically, a wave, but it is so high frequency that we can ignore it unless we're trying to simulate at quantum scales. This keeps the complexity down to merely polynomial, and some smart people have figured out how to shrink that polynomial down to a surprising degree.

Sound is not so friendly. Imagine some reasonably complex object, like, oh, a chair. We'll even cheat and make it all out of one material and go ahead and make it as geometrically simple as you like, as long as it's a chair, which is to say, at least three legs and a sitting surface, preferably with some sort of back support. Now, mentally give the chair a tap.

Now, odds are you're not too practiced at this sort of mental visualization, but here's what happens. For the sake of argument, let's tap it on the direct middle top of the sitting surface. Let's cheat some more and assume that one impact is what makes the sound, rather then an oscillation at the tap point. (See how much we're cheating, and we'll still end up with an uncomputable scenario.) So the tap radiates outward from there and starts wiggling the legs. The sound partially bounces off the legs, and goes back, and some of the sound wiggles into the legs. The sound bounces all around in the leg, and every time it bounces off of the edge, it loses some of the sound to the atmosphere and some of it bounces back. By the time it hits the bottom, it's bounced several times. (See, sound can't turn except at one of those boundaries, where it is essentially absorbed and re-emitted.)

Meanwhile, the same thing is happening in the back of the chair. Plus, on the sitting surface, we have reflections of reflections of reflections to deal with, and thanks to the wonders of resonance, we absolutely have to track each and every one of them until they hit a really low level. In a fraction of a second, we have hundreds upon hundreds of seperate waves to track, and they aren't even rays, they are "wavefronts".... imagine a wavefront hitting the edge of the chair at an angle, like an ocean wave bouncing off the beach. It doesn't bounce like a particle, it is two entirely new waves, the one that reflects and the one that continues on.

Basically, we can't even simulate this horrid simplification, the real world is even worse. Sound is highly, highly parallel. Ultimately, sound simulation is firmly exponential and the constants are very, very high. Maybe if those magical quantum computers come online we'll get this, but we'll quite possibly never get it with conventional technology; we're always going to have to cheat.

(One can try to imagine a transformation of the chair where the sound travels in a straight line in some space, but I'll be damned if I know what that actually looks like in real code, nor am I sure that it would be any easier to compute then a straight-forward simulation anyhow. Bright ideas in this regard should probably not be posted on Slashdot and saved for your PhD thesis in Mathematics/Physics/Computer Science; they'll all be waiting with bated breath.)

Re:Storyline!

[MistaE]

I agree with ya dude, but one thing that must be taken into consideration is that developers can't be carried away with a game focusing on narrative too much. I really don't think that gamers would like to play "interactive movies" like Xenosaga (I enjoyed the game, but geeze, the cutscenes were way too long and plentiful).

The trick is going to be balancing the amount of graphical detail with story lines and such. We know that a game that combines the two in just the right amount is pretty damn rare, but I look forward to the days developers get it right.

Personally, tho, I feel that one of the more important aspects is game play. You can have a beautiful game with an interesting story, but if you can't even stand to work inside of the world in terms of control and rules, then what's the point?