Half-Life 2 Writer on VR Games: We're At Pong Level, Only Scratching the Surface
An anonymous reader writes: Valve's Chet Faliszek has been in the video game industry for a long time, and his writing has been instrumental for games like Half-life 2, Portal, and Left 4 Dead. Valve is now developing a virtual reality headset, and Faliszek was on hand at a VR-centric conference where he spoke about how the technology is coming along. He said, "None of us know what the hell we are doing. We're still just scratching the surface of VR. We still haven't found out what VR is, and that's fine. We've been making movies in pretty much the same way for 100 years, TV for 60 years and videogames for 40. VR has only really been [in development] for about a year, so we're at Pong level." One of the obstacles holding VR devices back right now is getting the hardware up to snuff. Faliszek says, "There's one thing you can't do and that's make people sick. It has to run at 90 frames per second. Any lower and people feel sick. Telling people they will be ok 'Once you get your VR legs' is a wholly wrong idea. If people need to get used to it then that's failure."
A friend of mine who worked on a tavern cleaning crew called me and told me to come to work with him one night. When we got to the tavern, he showed me this big box with a TV screen and two large knobs. Pong was completely unlike anything anyone had seen before. During business hours there would be a continuous line waiting to play it.
It may seem quaint now, but at the time it was truly revolutionary, as was Space Invaders and Asteroids which soon followed. To us, they were much cooler than the pin-ball machines we played at the time, after all they were something completely new.
Yes I was born in B.C. (Before Cellphones) and my kids were born in A.D. (After Direct TV).
Donald Trump, on a crusade to make Nixon look respectable
It causes illness for good reason. A mismatch between visual field angle and vestibular angle doesn't occur very often in a natural environment - the only place you'll find it is on a boat and when wearing head-mounted displays. Before those, it always indicated something impairing the vestibular system, which likely implied a poison. There's evolved response based on this: 'Visual/vestibular mismatch, probable poison detected, initiate purge of stomach contents before any more is absorbed and make a note not to eat the green berries.'
Unfortunately many people think that VR didn't exist before Oculus Rift. Which is, of course, BS. There was good quality VR available before as well but unless you have worked for a large university, the military, NASA or some large aerospace/car company, you were unlikely to encounter it due to the costs of the equipment involved. Industry-grade HMDs still cost $15000, they used to start at $40k but I guess after the cheap Oculus became available, that price point became untenable. `CAVEs and large projection setups that are commonly used for both research and training work can cost millions.
The worse part is that also quite a few people from these companies - Oculus, Valve and others that are jumping on the VR bandwagon now - tend to ignore the decades of existing research. Most people there are businessmen and (briliant) engineers, not researchers (with a few exceptions). They tend to massively reinvent the wheel and to rediscover things known for many years, because they don't know where to look for them. If they didn't, they would know that increasing framerate and decreasing input latencies is not going to fix the motion sickness. Sure, laggy, smeared image in the HMD will make people sick. However, you can and will get sick even at 120fps - it depends much more on what you are rendering than at how you are rendering it. A virtual rollercoaster will make people throw up even at 4k resolution rendered at 250fps with perfect head tracking. It would look awesome, though ...
The problem is mainly the content, not the technology - the content must work with the technology idiosyncrasies (I won't call them limitations - that implies they could be overcome, but sometimes it would require changing the laws of physics or it would cost so much that it just isn't practical), not ignore the specificities of the medium ("let's play COD with an Oculus Rift, that will be awesome!" *BARF*) or expect that the "technology will improve" and motion sickness won't be an issue, no matter what wild camera gyrations, cool fly-throughs and slow motion cut scenes the game designer has put in. It is the same thing as the film directors having to learn how to shoot in 3D - the "film language" (how you convey your message through camera work, lighting, etc) changes quite significantly when you are in 3D and not every film director was/is comfortable with going there. Even the visually stunning Avatar had some issues with stereoscopy here and there. That is why the worst 3D movies were the ones converted from the regular 2D, where the media specificities were ignored.
This is very much where we are still at the begining - virtual reality as an entertainment and story telling medium. It is not a question of technology anymore, it is more about finding sensible ways to do things in VR so that the experience is fun, pleasant and something people will actually like to return to. With careful design work and working with the medium and not against it you can render even at 30fps and nobody will get sick.
In my 15 years of working with VR (involving both large projection setups and HMDs) I have never encountered anyone getting sick because of the frame rate. It was pretty much always because of poorly made content not suitable for the technology being used, poorly implemented navigation that didn't respect the specificities of the medium ("teleporting" camera, forced/constrained camera movement, head bobbing, poorly synchronized/unsynchronized treadmills ...), poor camera work/tracking ("mouselook" in FPS really is wrong for VR - you don't have head bolted rigidly to your shoulders!) and similar issues. Then you have issues like people feeling discomfort/headaches because of eye strain due to poor focus, moire, poorly set up stereo rendering, etc. It often gets incorrectly attributed to "cyber"/motion sickness, but that has nothing to do with it at all. Finally, there are people who will get sick and dizzy even from looking at a static image