Ask Slashdot: How Did Real-Time Ray Tracing Become Possible With Today's Technology?
dryriver writes: There are occasions where multiple big tech manufacturers all announce the exact same innovation at the same time -- e.g. 4K UHD TVs. Everybody in broadcasting and audiovisual content creation knew that 4K/8K UHD and high dynamic range (HDR) were coming years in advance, and that all the big TV and screen manufacturers were preparing 4K UHD HDR product lines because FHD was beginning to bore consumers. It came as no surprise when everybody had a 4K UHD product announcement and demo ready at the same time. Something very unusual happened this year at GDC 2018 however. Multiple graphics and GPU companies, like Microsoft, Nvidia, and AMD, as well as other game developers and game engine makers, all announced that real-time ray tracing is coming to their mass-market products, and by extension, to computer games, VR content and other realtime 3D applications.
Why is this odd? Because for many years any mention of 30+ FPS real-time ray tracing was thought to be utterly impossible with today's hardware technology. It was deemed far too computationally intensive for today's GPU technology and far too expensive for anything mass market. Gamers weren't screaming for the technology. Technologists didn't think it was doable at this point in time. Raster 3D graphics -- what we have in DirectX, OpenGL and game consoles today -- was very, very profitable and could easily have evolved further the way it has for another 7 to 8 years. And suddenly there it was: everybody announced at the same time that real-time ray tracing is not only technically possible, but also coming to your home gaming PC much sooner than anybody thought. Working tech demos were shown. What happened? How did real-time ray tracing, which only a few 3D graphics nerds and researchers in the field talked about until recently, suddenly become so technically possible, economically feasible, and so guaranteed-to-be-profitable that everybody announced this year that they are doing it?
Why is this odd? Because for many years any mention of 30+ FPS real-time ray tracing was thought to be utterly impossible with today's hardware technology. It was deemed far too computationally intensive for today's GPU technology and far too expensive for anything mass market. Gamers weren't screaming for the technology. Technologists didn't think it was doable at this point in time. Raster 3D graphics -- what we have in DirectX, OpenGL and game consoles today -- was very, very profitable and could easily have evolved further the way it has for another 7 to 8 years. And suddenly there it was: everybody announced at the same time that real-time ray tracing is not only technically possible, but also coming to your home gaming PC much sooner than anybody thought. Working tech demos were shown. What happened? How did real-time ray tracing, which only a few 3D graphics nerds and researchers in the field talked about until recently, suddenly become so technically possible, economically feasible, and so guaranteed-to-be-profitable that everybody announced this year that they are doing it?
The short answer is that it isn't brand-new. As the article mentions, nVidia has been doing real-time ray-tracing demos for about a decade. Various tricks and approximations are used to make this a reality. Game developers have largely shied away from it because similar results can be achieved with typically better performance using other methods.
This announcement, particularly with the involvement of Microsoft, indicates that the companies finally feel that the technology is mature enough to actually be used in a game. My guess is that it will likely still be some time before it is put to use. The fact that it was announced at the same time likely indicates that the three companies have been working together for some time behind closed-doors to agree upon the DirectX Raytracing API.
More specifically, Nvidia made custom hardware to do the calculations.
Be careful with your terminology.
Real Time Ray Tracing with one primary ray and one shadow ray for each pixel, was viable last year as well (at 1080p.)
But this will not render indirect light, thus no Global Illumination.
You may be referring to Real Time Path Tracing, where you need to shoot a lot of rays for every pixel.
This is currently not possible, and also not possible in this year's GDC demos: I think most of the demos were hybrids (rasterizing+tracing), and definitely not full Global Illumination.
http://www.stolk.org/tlctc
Real time ray tracing was a topic since I was in college 20 years ago. A lot of PhD students have done their research. Algorithms optimized. Hardware advancing. Futurists at major corporations (fancy name for people responsible for monitoring tech) saw hardware evolving.
So Microsoft probably saw that it was going to be viable in 5 years (or whenever) in 2013. They probably starting developing an API in conjunction with major hardware manufacturers. So they all worked together to bring ray tracing to the masses eventually.
Now all this work is paying off and consumers get the end product.
This is no different than major corporations using augmented reality to validate construction designs. Ya, they are doing that atleast in labs. Take the 3D model as built and validate that it is as built. Or quickly look at something in the real world and figure out where the 3D model data is and figure out in a second what vendor supplied the broken part. Ya, this stuff is happening!
You're probably not paying enough attention to planes. They crash less frequently than they did and airports are switching to systems where the planes make a smooth approach without the stair-step approach pattern that was previously used.
Other than that, there's not going to be much difference because by the '80s planes were just that good. Any other changes are ones that are mostly only going to be noticed by people actually working with them.
The computing technology stuff tends to be more accessible and more present in our day to day life than it was, so we tend to notice it more. But, there again, we're getting close to the point where additional improvements aren't going to be as obvious as they were previously. I've had this computer now for a few years and the previous one was quite a few years old when I replaced it. That would have been inconceivable to me 20 years ago as the technology was improving that quickly.
Demos of real time raytracing have dated back to 2009 or earlier, albeit with various limitations. Raster based rendering is faster and going to raytracing means much better lighting, at the expense of some resolution/geometric detail/hardware requirements.
I think what is being seen is that we've been well beyond the point of diminishing returns as far as raster can reasonably get in terms of better quality. Sure, we can cram more and more polygons and sure we can raise the bar to 4k resolution, but the bang for the back is small. Given that situation, video card market has an issue, they need to do demand generation.
So pushing 4k for gaming helps, and 8k would be nice, but it's just really hard to tell the difference at this point.
If that's a hard sell, then VR certainly can knock things back if it gets traction. With wider FOV, stereoscopic rendering, and optimal experience being at least 90Hz, that would certainly deliver. However, as much as I am a fan of it, it's far from a given that VR is ever going to be large enough to drive adoption. at volumes that can sate the business needs of the GPU vendors.
So raytracing is a third option to make best of breed graphics card noticeably struggle with something that's very visually apparent. Suddenly the market content with status quo of ever refined raster graphics simply must make the leap to have some marketable advancement.
The people pessimistic about any such advancement just continuously have their expectations calibrated to how fast it can perform raster graphics. Raytracing does mean having to step back, but we have enough headroom to take the hit.
XML is like violence. If it doesn't solve the problem, use more.
This story reminded me of https://www.euclideon.com/ ... They compose everything as "atoms" instead of triangles. If I ever make it to Oz, i'd like to check it out.
I would guess they figured with graphics cards having 3500+ cores and ample memory for massive lookup tables, suddenly it seems feasible. That or a patent just expired, or both.
It is using rasterization for the scene, and then hybrid ray tracing for the reflective, shadow, and opacity components were it applies. This is not true ray-tracing, but rather another rendering "trick" to optimize for speed. Most of our rendering for games today is approximations, because it is good enough. Same thing here.
Ray tracing is an impressive technical feat, but the argument against it for gaming still stands:
However fast you get at ray tracing, you can instead use that power for rasterization and do far far more.
The day may come where that gap doesn't matter anymore, or where we find a way to overcome it... but for now, I think this technology will primarily be used to help accelerate very simple environments, and more complex for offline rendering.
Remember the jump from the SNES/Genesis to Playstation/Saturn? How about the first time you saw a Dreamcast game? Those were big leaps. But PS2 to PS3? If you'd been paying PC games you'd seen stuff on par with PS3. And PS3 to 4 was hardly a leap at all.
The trouble is modern graphics have gotten _hard_ to make. Pixel shaders are a bitch. They're too labor intensive. What's needed is something that lets you do great graphics with less man hours and fewer bugs. If ray tracing isn't gonna do that then it might as well be PC's answer to 3D TVs. Especially if it's only kicking out 30 FPS.
Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
You misuse the term "raster graphics", as that refers to bitmaps, not vector based real-time 3D rendering. Real-time ray-tracing has been around for almost two decades, but it wasn't mainstream until recently. As the parallel computational power of GPU increases, ray-tracing becomes the inevitable future.
Second just because they call it real time ray tracing does not mean it really is. It could be a technique to create a low res ray tracing to calculate the radiosity, reflectivity etc and then use the standard raster graphics to use these to adjust the texture maps of raster graphics.
So let us wait and see if what they call real time ray tracing and what we call real time ray tracing are one and the same.
sed -e 's/Chuck Norris/Rajnikant/g' joke > fact
All the companies that announced this and the media that is reporting on it all gloss over the fact that the Ray Tracing that is being talked about is supplementary the standard rasterized shading engines. We aren't going to be getting 100% ray traced scenes. We'll get rasterized scenes with things like reflections and shadows being ray traced. This will fix the issue that rasterization has where objects outside of the viewing frustum are computationally ignored. 100% ray tracing is still a pipe dream with the current hardware standards that most consumers have.
According to this video it is not just more powerful hardware but also that they came up with the idea to use only a fraction of the rays normally required and to then used a power denoise algorithm to generate the final image.
What the fuck is the poster on about. Ray Tracing has been a known researched thing that was on the horizon for years, it hasn't suddenly miraculously appeared and was always expected once the hardware crossed the threshold of performance for it to be released for more general consumption.
As long as magic leap has been vaporware, the graphics vendors have known real time ray tracing was going to be required in a big way and have been working on it behind the scenes.
They have been working on it for 10+ years
now.
The first thing to understand is that the Nvidia and MS press releases are complete crap. Oh it "works". The UE4 Star Wars thing is real enough. It's also running on $12,000 worth of GPUs at 30fps in 1080p, and is only partially raytraced.
Now does this mean realtime raytracing isn't here? Well the answer is no, it is here. The game Claybook is entirely raytraced, unlike the DirectX demos. It's in early access and runs on nothing more than an Xbox One or PS4, and does so at 60 frames per second. Here's the trailer: https://www.youtube.com/watch?... Now THIS is possible because graphics programmers have gotten quite clever over the years. The cleverest bit is called signed distance fields. This can be thought of a volume of points, or boxes, that all store the nearest distance to a solid "surface". Going through this structure allows you to raytrace very very quickly, as you know how much empty space you can skip each time without hitting anything. And since this data is relatively small for each point it doesn't use up a lot of memory either. It's so fast and low memory you can run a demo in your browser here: https://www.shadertoy.com/view...
Obviously there's a bunch of other clever programming going on in Claybook and other titles. But SDF's are the biggest thing to understand. That and that the MS Raytracing API is totally uninteresting from a performance perspective. In fact it's rather awful.
I disagree; flying cars are hitting the market any day real soon now -- but you will be required to have a pilot's license for most of them.
I've abandoned my search for truth; now I'm just looking for some useful delusions.
They started using neural networks and machine learning to look at optimizing algorithms. Things like solving anti-aliasing problems. Normally they had to super-sample every pixel hundreds of times. Most cases, the result is the same. An ML algorithm let them figure out the most important cases and reduce the number of samples needed. Instant speedup.
Vintage computer adverts: http://www.vintageadbrowser.com/computers-and-software-ads
Other than that, there's not going to be much difference because by the '80s planes were just that good.
What has been touted as big passenger-visible advancements in commercial airlines in the last few years is slightly larger windows, slightly higher pressure in the cabin, and slightly higher moisture. That's it. As for safety, while it is true that airplanes are safer than they have ever been, the truth is that they were already extremely safe in the 70s. The sad, depressing truth is that it takes exactly the same time to fly from London to San Francisco as it did fifty years ago. That's half a century ago. It is indeed cheaper than it used to be, but the experience is, if anything, more miserable than it has ever been. And, bearing in mind that the airline industry has become a race to the bottom in the last 10 to 15 years, the experience is going to become, if anything, worse.
Full realistic ray tracing to provide real global illumination be it real time or otherwise has always been impossible. Ray tracing is only a simulation and has always employed artificial cutoffs and other hacks. Why? Well light is analogue, to simulate it properly requires a literally infinite amount of processing power. I doubt there'll be anything different about this tech, it's just a new api.
You fundamentally misunderstood the technology; partial solutions for partial rendering with interpolation is not 100% raytracing.
it's just used for effects not for full scene. they are not shooting a ray per pixel(or multiple). and following it where it goes. for most of the scene they don't need to do that and for the reflective surfaces they only need to do it once sfor every so many pixels.
people we're doing partial limited realtime raytracing to make some effects on pentium 100mhz's.. that you use raytracing as part of an effect is just.. well, it's not the same as raytracing with povray - not at all.
world was created 5 seconds before this post as it is.
It sounds like OP is asking "Why are GPUs so damn powerful so soon?"
In a word: Cryptocurrency mining
People were willing to pay for faster and faster GPUs for their mining farms and their profits allowed it. Look at the overwhelming demand for dedicated space heaters, er, miners. If there was no money in it, it wouldn't have happened.
It has been said that porn built the internet. Based on traffic share, that's a safe bet. There was money in being a 1 frame per second camgirl and there was money in video, which was difficult to get over a dial-up modem. A few fibers and cables later, even T1 lines were eclipsed.
In a world of the blind, the one-eyed man is king--and the two-eyed man is a heretic.
Aircraft safety sucked in the seventies. Planes that were knowingly defective were released and killed people.
"It's such a fine line between stupid and clever" -- David St. Hubbins, Spinal Tap
The sad, depressing truth is that it takes exactly the same time to fly from London to San Francisco as it did fifty years ago.
It's unfortunate that we can't change the laws of physics, yes.
It is indeed cheaper than it used to be
Ticket price is linked to fuel consumption. The price of air travel would rise sharply if we tried to fly any faster.
No sig today...
It's still not possible (in high resolution/high framerate) on current consumer GPU's.. The star wars demo for instance was done on a set of very VERY expensive (not available to the public) GPU's which will not be available for another few years.
You have discovered the "good enough" problem. At some point in development of pretty much anything, you hit the 80/20 barrier where improvement becomes prohibitively expensive, to the point where it is economically unfeasible. The Concorde was one of those 20% that are unfeasible. Hence it vanished.
You will notice that most of the technology you mention has been around for much longer than computers. Cars, houses, clothing, buildings, even planes. The computer, with integrated circuits, is less than 50 years old. The first halfway affordable graphical interface came 40 years ago. Windows 95 was just over 20 years ago. And hardware supported 3D processing in mainstream computing is barely 20 years old.
And remember that it always takes at least 3-5 years for a technology to take over and replace its predecessor to a point where development focusing on the new technology becomes economically feasible.
Now think back to when the technologies you mentioned were 20 years old. Was there room for improvement? Hell, there was even a lot of room for improvement 50 years after their first appearance.
We used to have a Bill of Rights. Now, with the rights gone, all we have left is the bill.
Raytracing and rasterizing behave in memory differently, making the tradeoff between them less about processing and more about memory size. Rasterization and raytracing perform the same functions, but in a different order. Rasterization iterates over every triangle to see if it covers each pixel, and repeats that loop over every triangle for every pixel in the image. Raytracing iterates over every pixel, testing for intersection with each scene primitive.
The big difference is how memory is used in this process. Rasterizers can stream triangles in order very efficiently, while raytracers must have the entire scene in memory all at once. We've had more than enough computational capacity in GPUs to do reverse raytracing (perfect shadows and refractions, no support for global illumination, caustics, etcetera,) for more than a decade. Memory *size,* however, has only recently become great enough to support the same quality scene geometry that we're used to seeing from rasterized titles.
Cars dont have carburetors and run for 100,000 miles with essentially no maintenance beyond wear components. My guess is you never owned a car before the 80s to have any idea how much things have changed.
Simple: Hardware got more powerful.
Simple: Graphics card vendors required some new buzzword to sell their most expensive hardware.
We don't even have the Concorde anymore. Airplanes still look, act, and sound the same as in 1969 when the 747 first flew. Cars, houses, clothes, buildings, roads, food, all more or less look the same.
They still look roughly the same because that's a pretty good geometric design. But that doesn't mean they are the same. There have been huge advances in aviation technology over the past 50 years. For example, the average fuel burn of new commercial jets fell 45% between 1968 and 2014. Modern jets have better engines and are made of modern materials (carbon fibre is becoming more and more common). This means cheaper prices and longer distances for direct flights.
Buildings certainly do not look the same. New homes in the '60s were usually 1100 SF or smaller (at least in my area). Compare that to new homes now that are 2000 SF, much more efficient, and have a lot more modern conveniences. Now they're not filled with asbestos and lead paint.
And I could go on and on with food, clothing, and the rest.
I think price is a huge revolution. I can go from LA to Iceland for $400 RT. The shape of planes is the same, but the shape of air travel is completely revolutionized.
Even with a simplistic ray model, the more objects there are in the scene, the more complex the trace becomes. Until you hit an object, you don't know at what angle the ray diverges from that object; it may, for instance, go through several partially transparent objects before it reaches a light source, or it may reflect off of several items that are colored, or metallic (which, if done properly, introduces further complexities.)
The classic ray tracer has to examine every object N for every pixel generated M:. So the more objects and pixels there are, the longer it takes to render the scene. Complexity is straight-up NxM. This is without even thinking about things like soft shadows.
That is the bottleneck; and you're not going to solve it for all scenes just by throwing hardware at it.
You can solve it by simplifying the scene until the hardware can keep up, and as near as I can tell, that's what's being described here.
Or IOW, there's more hype here than truth.
I've fallen off your lawn, and I can't get up.
Don't feed the trolls. ;)
It may never be doable because of Blinn's Law.
Blinn's law says that the time to do something remains constant with the usual result that improvements go into the quality of the result. This is pretty self-evident with real-time video since your time budget is fixed by needed to maintain the frame rate and for any given frame rate you might as well use all the time available. Hence, it says nothing about whether "true" real-time ray tracing will ever be possible. The real question is not whether it will become possible but whether it will become practical. This is determined by whether or not there are alternative, less computationally intensive algorithms that produce visually similar (or better) results for that frame rate. If there are not then real-time ray tracing will the be the algorithm of choice.
It actually takes longer to go from SF to London today. In the past, we had the Concorde, no TSA, and a lot less traffic on the way to the airport. That could easily shave off hours from the trip. I don't recall if Concorde landed on the west coast, but I think it was in Dallas, Tampa, DC, and NYC.
Back in 1980, the University of Waterloo mathematics and computer science building had a locked public display case featuring artifacts from the senior-level computer graphics course, most of which involved ray tracing (standard chessboard-reflected-in-shiny-sphere kinds of things, but with the scenes aggressively simplified—like only three chess pieces of a dozen polygons each and the board reduced to sixteen squares).
What separated the great from the good was treatment of subtleties such as getting the specular highlighting right. I was young and naive and didn't have Wikipedia at my fingertips, so I don't recall much more.
They also had a public information kiosk back in 1980 which used some kind of polygon-fill graphics language to render an interactive dial-up information browser in all the best oversaturated colours. Just like the Internet, if the Internet consisted of exactly one host, and it was dead slow. But shiny! Everyone tried it out—for exactly three minutes (that would be about your third screen rendered).
They also had rooms full of card readers, which they couldn't bother themselves to eliminate until some fancy anniversary shindig a few years later.
In one terminal room you'd have IBM 3270 block-oriented displays, in the next you'd have the god-awful WIDJET terminals, in the next you'd have IBM PCs running APL (for statistics students), in the next you had Commodore SuperPETs, custom tweaked by the Computer Systems Group or related ecosystem (these people were later responsible for the Watcom C++ compiler).
WIDJET (Waterloo interactive direct job-entry terminals) was basically a JCL front-end with the ability to store about six whole files on non-card storage, where mostly you sat twiddling your thumbs waiting for your runs to pass through the job submission queue.
One such room was more advanced and you could *edit* your next assignment with your previous run still in the queue, but you had to sign up way ahead of time to actually get a seat in this room.
In the other room, you might submit a compile, sit there for ten minutes watching it bounce up and down the queue (upper-year jobs had priority) and then decide "oh, I did something wrong in the previous assignment" and you'd click "edit" on some previous source file, only to discover the message "job submission cancelled" popping up on the status line of your display and since you'd already spent years with the immense power of the TRS-80 or Apple II at your fingertips, you'd bash your head into the desk and wonder how you'd become mired in this technological institution of hazing, abuse, and mediocrity.
The SuperPETs were okay, but the custom Pascal did some kind of partial compile to catch syntax errors before running the interpreter. The error reporting was beyond horrible. 50% of all syntax errors were the same message: "syntax error near or before end of file." It was much like Donald Trump tweaking "WRONG!" at you if you got a single brace out of alignment.
"Sorry! I'll hunt through my entire program looking for the one I messed up." This worked for localized changes. But generally what you actually did after a big edit was added or removed braces at random until you found the problem through a tedious process of bisection (which, however, was an order of magnitude less tedious than dealing with WIDJET, even in the good room).
My first year at Waterloo was the biggest computer science mindfuck of my entire life.
Eventually I discovered you could kind of get into a groove with the IBM 3270 terminals—as archaic as they seemed—if you blinked longer than normal after each press of the ENTER key. Plus, these had chat, so you could send "nice sunrise" messages to all your friends at 05:00.
Fro
People who are good at what they do are typically monitoring or communicating with other people who are good at the same thing.
Or they're at least all watching the same thing and great minds think alike and all that. Kind of like telescopes. No one had even thought of a telescope, yet when optics became good enough, the telescope was independently invented by several different people within a year of each other, but all far enough apart that communication among them would have taken longer than a year, so it was impossible for them to have known what was up with the others. Most ideas that seem novel are really obvious to masters of the domain as long as they're presented with the same problem. This has been a sore point of our patent system for a long time. Just because something has never been done before doesn't mean the person who made it is special or put a lot of effort into it. They were just lucky with timing. Yay, lottery!
My guess is a combination of masters being masters and all saw the tipping point around the same time, and keeping their ears to the ground.
IIRC, the Concorde was not allowed at supersonic speeds over land areas, which means that it was no faster than an ordinary airliner going from the East Coast to San Francisco, and much less efficient.
"When you have eliminated the unacceptable, whatever is left, however improbable, must be the truthiness" - Holmes
I remember back in 2004, when Beowulf clusters were still a cool thing, Quake iii getting the real time raytracing treatment. Great to see it in individual machines now, but I also wonder what cluster tech has replaced the old Beowulf...
https://games.slashdot.org/story/04/06/07/2350243/quake-iii-gets-real-time-ray-tracing-treatment
The trouble with the world is that the stupid are cocksure and the intelligent are full of doubt.
-Bertrand Russel