Slashdot Mirror


Carmack Speaks On Ray Tracing, Future id Engines

Vigile writes "As a matter of principle, when legendary game programmer John Carmack speaks, the entire industry listens. In a recent interview he comments on a multitude of topics starting with information about Intel, their ray tracing research and upcoming Larrabee GPU. Carmack seems to think that Intel's direction using traditional ray tracing methods is not going to work and instead theorizes that using ray casting to traverse a new data structure he is developing is the best course of action. The 'sparse voxel octree' that Carmack discusses would allow for 'unique geometry down to the equivalent of the texel across everything.' He goes on to discuss other topics like the hardware necessary to efficiently process his new data structure, translation to consoles, multi-GPU PC gaming and even the world of hardware physics."

32 of 256 comments (clear)

  1. There is a great disturbance in the source... by Ferzerp · · Score: 5, Funny

    It as if hundreds of ray tracing fanboys cried out at once, and were silenced.

    1. Re:There is a great disturbance in the source... by AmaDaden · · Score: 5, Interesting

      Ray Tracing has a place. New high speed FPS games are not it.

    2. Re:There is a great disturbance in the source... by luther2.1k · · Score: 5, Informative

      Bog standard ray tracing, which is what intel are harping on about at the moment isn't the be all and end all of global illumination algorithms, as many people who get all misty eyed about the technique would have you believe. It's terrible for diffuse interactions for one thing. Photon mapping is a more realistic technique which simulates light more accurately.

      Tim.

    3. Re:There is a great disturbance in the source... by Goaway · · Score: 4, Informative

      "Ray tracing" traditionally means specifically tracing rays from the eye out into the scene. Other methods are usually referred to by different names.

      And even so, while tracing either photons or eye rays may be the most feasible method at the moment, it is by no mean the only way to solve the rendering equation, nor any kind of theoretical best.

    4. Re:There is a great disturbance in the source... by flyingsquid · · Score: 4, Funny
      It's the most realistic possible way of rendering, so when computers get fast enough we'll be able to everything with ray tracing.

      When that happens, will it also become possible to wield a flashlight and a shotgun at the same time? Or is there some kind of fundamental law against that, like how you can't know the position and velocity of a particle at the same time?

    5. Re:There is a great disturbance in the source... by DragonWriter · · Score: 4, Interesting

      It only provides realistic rendering of reflections, refractions, and shadows.


      Everything light does is a combination of reflections and refractions (shadows are an artifact of those).

      So, yeah, what you are in effect saying is that raytracing only provides realistic rendering of things that light actually does.

      There are still many more properties of light that take different, also intensive algorithms reproduce like; color bleeding, caustics, sub-surface scattering, depth of field.


      Color bleeding and caustics are effects of reflection, subsurface scattering is reflection and refraction, depth of field is refraction (through a lens between the viewpoint and the image). Now, its true, that there are shortcuts that provide tolerable approximations of those effects faster than actually tracing rays in most cases, and that even static raytracers often prefer those to what would be necessary to do those effects through raytracing alone. Its also true that some real effects, to do well with raytracing, would require shooting separate rays for different wavelengths of light, which while conceptually possible (and I think some very specialized systems have been made which do this), is probably utterly impractical for realtime systems for the forseeable future (this is a lot bigger load increase than anti-aliasing would be.)

      But as for realism (but not necessarily practicality, especially in a realtime setting), I think raytracing still, ultimately, wins on all of those.

    6. Re:There is a great disturbance in the source... by ultranova · · Score: 5, Informative

      Everything light does is a combination of reflections and refractions (shadows are an artifact of those).

      Except the double-slit experiment. It's based on the fact that light has wavefront qualities, while ray tracing treats it as particles.

      I also strongly doubt that the discreet ray approach will ever produce very good global illumination, since the number of rays bouncing between surfaces quickly grows towards infinite as the desired accuracy grows.

      You'd need to do "wavefront racing" to fix these, and I for one have no idea how to do this - solve the quantum field equations for each particle in the scene after inventing the Grand Unified Theory ?-)

      --

      Forget magic. Any technology distinguishable from divine power is insufficiently advanced.

    7. Re:There is a great disturbance in the source... by DragonWriter · · Score: 4, Interesting

      Except the double-slit experiment. It's based on the fact that light has wavefront qualities, while ray tracing treats it as particles.


      Good point.

      I also strongly doubt that the discreet ray approach will ever produce very good global illumination, since the number of rays bouncing between surfaces quickly grows towards infinite as the desired accuracy grows.


      Well, yeah, the "raytracing is ideally photorealistic" argument does rely (even ignoring the wave effects that raytracing misses), essentially, on unlimited processing power and memory, and isn't necessarily applicable in any particular practical domain. My reference to shortcut techniques to directly model particular phenomena instead of tracing all the necessary rays being a feature of even static raytracing package, and to many of the idealized advantages of raytracing not being realized in practice was based on that.

      You'd need to do "wavefront racing" to fix these, and I for one have no idea how to do this - solve the quantum field equations for each particle in the scene after inventing the Grand Unified Theory ?-)


      That sounds about right, probably using a quantum computer "graphics card" (QGPU?).
    8. Re:There is a great disturbance in the source... by kb · · Score: 4, Informative

      As far is I've understood it he isn't exactly using the octree for LOD but for storing all voxel data in s parse (there we have it ;) manner. If you only have one "layer" of voxels at whatever resolution defining eg. only the surface of things, most nodes of the octree will remain empty, and so you can reduce the data set to storing only what's necessary for rendering instead of having to store a full-resolution 3D representation of your space. Of course this leans happily towards a LOD system, as storing the data in different resolutions aka mip-mapping the geometry and then accessing the right detail level would essentially be for free if you do it right. In the end it's a promising approach with of course many details to be sorted out - there's still a lot of data to be stored per-voxel (texture coordinates, normals, basically everything that now goes into a vertex) if you want the full feature set like eg. lighting and such. But given dedicated hardware and combined with his mega texture stuff (which is basically only glorified unique UV mapping, perhaps somewhat generalized and with a good resource management system behind it) this could be pretty cool.

  2. voxel? texel? But I want a pony! by davidwr · · Score: 4, Funny
    This just came through the time vortex, dated 3 weeks from yesterday:

    Voxel? Texel? Just make my pink pony look nice and pretty.
    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
  3. Re:So, by BigJClark · · Score: 5, Funny


    Don't feel bad, he has probably never heard of you either.

    --

    Hi, I Boris. Hear fix bear, yes?
  4. Re:Stunning! by Bob+of+Dole · · Score: 5, Insightful

    A developer who coded the engines that nearly all PC first person shooters have run on. That's obviously not enough to accept his words without hesitation, but obviously the person knows more about high-performance 3D rendering than a random coder like myself.

  5. How does it play with Physics? by Telvin_3d · · Score: 4, Interesting

    My biggest concern with where he is going with this is that it does not sound like it will play very nice with physics. In page two he makes some comments on how characters and other animated elements will still likely be done with more traditional methods and then mixed with this for the static objects like the world.

    The problem with this is that we are moving more and more towards interactive environments where everything from the ground to the flowerpots are breakable, bendable or movable. It doesn't sound like this new system will play very nice with physics intensive or highly interactive environments. Now, i could be completely wrong. He doesn't address the point directly. But it is still a point for concern.

    1. Re:How does it play with Physics? by ghostlibrary · · Score: 5, Insightful

      Having developed octtree voxel methods for astrophysics sims (crashing galaxies into one another), I suggest they are ideal for physics. The idea of a tree is you group things to maintain a certain amount of accuracy. For example, if you have 3 items interacting just with gravity:

      A (longdistancetypedheretoavoidlamenessfilter) B .. C

      A non-tree method would just calculate all the interactions: A-B, A-C, B-C. But you can group B+C together when calculating their interaction with A because, at that distance, the result for (B+C)-A is the same as the result for B-A + C-A. Then the interaction between B & C must be calculated separately. So you've (even in this tiny example) reduced your calculation from 3 to 2.

      And, of course, all the 'voxels' between A & B/C that are empty need not be considered at all. If you'd set it up as an NxNxN voxel cube, you'd be wasting time on calculating empty voxels between the occupied items.

      So if you want realistic interactive environments, sparse voxel octtrees are the way to go-- you pump all the calculation time into the parts where it matters, and let the other stuff be 'smoothed' when such smoothing is indistinguishable from rounding error.

      Typically, you can traverse the tree for a given error percentage, e.g. 'walk the tree and do interactions preserving 99% energy conservation' or similar. So your have predictable error, as well, despite being able to use arbitrary geometries and spacing for your elements.

      --
      A.
    2. Re:How does it play with Physics? by Chandon+Seldon · · Score: 4, Insightful

      Yea. Because interactivity trumps photorealism for every single possible type of game. Oh wait, that's false.

      You sound like the people who said that StarCraft was crap because sprites were outdated junk and every good game (like Total Annihilation) had already moved to 3D. Different engineers will make different design choices for different applications, and there is no total order of correctness among a single class of design choice.

      --
      -- The act of censorship is always worse than whatever is being censored. Always.
  6. Re:How about.... by Broken+scope · · Score: 4, Insightful

    Because he is more of an engine/renderer designer than game developer.

    Its his job, and im pretty sure his passion to think about stuff like this.

    --
    You mad
  7. Re:Stunning! by Falesh · · Score: 4, Insightful

    Why not analyse his argument and judge it on it's merits rather then throw it out simply because he is working on an idea of his own?

  8. Re:Right... by Jerf · · Score: 5, Insightful
    Yeah!

    Plusses:
    • One of the primary fathers of the FPS genre.
    • Wolfenstien 3D
    • Doom
    • Quake 1
    • Quake 2
    • Quake 3
    • Endless articles and commentary on the field
    • A shitload of stuff I'm forgetting
    Minusses:
    • "Thought multiplicative lighting was the way to go, rather than dealing with the performance hit of additive lighting in Quake 3."
    Conclusion: Carmack sucks!

    I mean, seriously, what's your point? The man's not actually a God so we shouldn't listen to him? Is there somebody more experienced I should prefer to listen to? Is "n3tcat" the handle for somebody with thirty years experience in first-person shooter engines or something?
  9. Re:So, by nschubach · · Score: 4, Informative

    John Carmack == Commander Keen == id Software == Doom = Wolfenstein == Quake == ??

    You've never heard of any of those? the guys you mention might not even be in gaming if it weren't for Carmack and John Romero.

    --
    Every time I start to have faith in humanity, I ruin it by driving to work between 7 and 8 am.
  10. Limited graphics by goatpunch · · Score: 5, Funny

    In other news, all games will now consist of reflective spheres moving around on checkerboards...

  11. Re:Stunning! by DragonWriter · · Score: 5, Insightful

    Why not analyse his argument and judge it on it's merits rather then throw it out simply because he is working on an idea of his own?


    Commenting on the fact that it is unsurprising that someone working on a different technique favors that technique over raytracing is not throwing anything out.

    Its not a comment either way on the merits.

    Were I to comment on the merits, I would point out that his position is both fairly obviously correct (in that sparse voxel octrees or something quite like them is almost beyond question the key to raytracing that's useful for reasonable quality in realtime), and entirely incorrect in his characterization of what everyone else is pushing: he pretends that "everyone" is pushing the most naive, brute force approach to raytracing, in which you don't use any kind of bounding volume structure and just do intersection tests against triangles. I've seen literally no recommendations that do that: almost all involve some form of bounding volume heirarchy, and sparse voxel octrees are just one instance of that (perhaps a fairly ideal one, and that's great). (Also, raytracing isn't limited to triangles, although most performance comparisons of raytracing to raster-based rendering methods use models constructed from triangles because it allows you to compare same-model performance of the different mechanisms; raytracing engines, however, don't generally need to decomposed curved objects into triangle-based approximations to render them in the first place, although this can sometimes be more efficient.)

    TFS further misleads by suggesting that Carmack is proposing an alternative to raytracing, when really what he is proposing is a particular approach to raytracing, and, particularly, a particular approach in one well-known problem area in raytracing to which there are currently a whole array of approaches. And his focus on what he wants to get out of raytracing is a little different. But, essentially, his piece, while there are some potentially good criticisms on some particular aspects of and arguments for Intel's specific approach to raytrace, is in accord with (not opposed to) the general idea that raytracing techniques are going to be increasingly important in gaming.

    Is that enough "on the merits" for you?
  12. The Most Telling Quote.... by Applekid · · Score: 4, Insightful

    It won't be right, but it will look cool, and that's all that really matters when you're looking at something like that. We are not doing light transport simulation here, we are doing something that is supposed to look good. I'm the sort of guy that watches a movie and notices the compression artifacts in black, listens to music and hears mushy cymbals. I walk by a screen and notice dead pixels and that the input source isn't in the LCD's native resolution.

    Yet, when I play a game, I'll admit, I'm not playing glaring attention to these faults. The last thing that really bothered me in games was 16-bit color banding and I haven't seen any of that in, oh, like 3 or 4 years.

    The gamer side of me agrees with Carmack on things looking cool who cares if it's wrong, the geek side of me is angry and demands it be pixel-accurate.
    --
    More Twoson than Cupertino
  13. Re:So, by nschubach · · Score: 5, Informative

    Funny. It's just freaking amazing that someone would even stoop so low as to mention Gabe Newell and not know Carmack. Hell, the original Half-Life is written on the Quake engine written by Carmack.

    --
    Every time I start to have faith in humanity, I ruin it by driving to work between 7 and 8 am.
  14. Re:So... what this tells me... by AKAImBatman · · Score: 4, Insightful

    Wow, these articles have all been so informative. I could not possibly have predicted those outcomes.

    Meanwhile the rest of us have been enjoying these articles immensely because we get to obtain some insight about what each of the major players are thinking in regards to Real-Time Raytracing. The great thing about obtaining insight from others is that you can then use your newfound insight to come to your own conclusions.

    If you're simply looking for a consensus from the industry, don't expect one for a long while. The concept won't entirely be accepted until someone goes out there and proves it out. Just like high-quality 3D graphics were thought to be too slow on the PC. Until game creators proved out a few different methods to make them usable, that is. (Starting with Wing Commander, moving to Wolf-3D, Doom, Duke 3D, and eventually Quake. After that, the industry said, "Welp, we better make some hardware for this." And thus 3DFX was born. ;-))
  15. Re:Right... by DeltaSigma · · Score: 4, Interesting

    I doubt any mod team was hit harder by that fact than mine. Yet, I can't fault him for the decision. It's unlikely anyone on my team did/does. By supporting almost every hardware graphics accelerator on the market at the time, Quake 3 almost single-handedly fostered the feedback loop that drove mainstream adoption of dedicated graphics accelerators.

    You sound like someone that's had the same thought every serious modder/engine-licensee has ever had; "if they could have just included/modified this ONE feature, my game would be feasible/better."

    Yet you haven't encountered that phrase enough times to appreciate the fact that engine developers have to draw a performance line somewhere. Your desired feature just happened to be on the wrong side of that line.

    Further, engine-developers of John Carmack's caliber would (I promise you this) love to have supported every feature you've ever thought of (and more). John Carmack's always been on the cutting edge, usually refining it. He sometimes makes decisions that are a matter of taste that you can feel free to disagree with him on, but that particular feature wasn't one of them.

  16. Re:So, by omeomi · · Score: 5, Insightful

    Now if John Carmack is as legendary as /. is making him out to be, why isn't it John Carmack's Quake/Doom?

    George Washington is pretty legendary, but we don't have a George Washington's America, do we? The name is irrelevant. How could the guy who basically invented the First Person Shooter not be legendary? When it first came out, the original Wolfenstein was the most highly optimized game I'd ever played. I still remember thinking it wouldn't run on my slow-ass computer, and being blown away when it ran fast as can be.

  17. Re:Stunning! by John+Carmack · · Score: 5, Interesting


    Give me a little credit here. I am not suggesting that everyone blindly intersects rays with a huge list of triangles. That would be absurd, and I assumed everyone understood that. What you might have missed is that I'm not proposing a sparse voxel octree as some form of bounding hierarchy to reduce intersection tests against triangles, I am proposing that it REPLACE hierarchies of triangles or other primitives for some data sets, and this brings about significant improvements (data size) that you wouldn't have with even infinitely fast conventional ray tracing. I'm also not trying to say that this is some novel brainstorm of mine, but I have some practical experience with the direction, and I think it has promise.

    One of my major points is that this is all still theoretical. I don't know what is going to be the right architecture for next gen systems. Neither do you, or Intel, Nvidia, Microsoft, Sony, or Nintendo. If I had to place a bet, it is that rasterization will still be dominant, but it is a Good Thing to have lots of people doing research into various alternatives. All the players have their own agendas, but we will all know the big win when we see it.

    John Carmack

  18. Re:Stunning! by Anonymous Coward · · Score: 5, Funny

    RTFA, you didn't understand what the guy who wrote the article was saying.

  19. Re:Stunning! by Fescen9 · · Score: 5, Funny

    Dude, you got pwned by JOHN CARMACK!

  20. Re:Right... by blahplusplus · · Score: 4, Insightful

    "I mean, seriously, what's your point? The man's not actually a God so we shouldn't listen to him? Is there somebody more experienced I should prefer to listen to? Is "n3tcat" the handle for somebody with thirty years experience in first-person shooter engines or something?"

    Many people with years of experience still make god awful mistakes. Experience can only take you so far considering that experience is also the reason why companies stagnate because people get locked into a certain way of looking at things.

  21. Re:Senor Carmack, one question by John+Carmack · · Score: 4, Informative

    In our current generation codebase we have moved to completely separate representations for rendering and physics, and I expect that to continue in the future. The requirements are different enough to merit different internal storage.

    John Carmack

  22. Re:acceleration structures, etc... by John+Carmack · · Score: 4, Informative

    Tracing into an SVO structure can be done with almost a Bresenham algorithm, and when you reach whatever depth of descent you want (a critical factor, you aren't going all the way to final detail on every trace), you pop out whatever data is stored there (probably some vector quantized BRDF sort of thingy) and run a "fragment program" on it.

    The data sets for a game world represented like this would be massive, but it is intrinsically well suited for streaming, even over the internet, which may well be the dominant media distribution channel in the timeframe we are looking at.

    John Carmack