Slashdot Mirror


Human Eye's Oscillation Rate Determines Smooth Frame Rate

jones_supa writes: It should be safe to conclude that humans can see frame rates greater than 24 fps. The next question is: why do movies at 48 fps look "video-y," and why do movies at 24 fps look "dreamy" and "cinematic." Why are games more realistic at 60 fps than 30 fps? Simon Cooke from Microsoft (Xbox) Advanced Technology Group has an interesting theory to explain this all. Your eyes oscillate a tiny amount, ranging from 70 to 103 Hz (on average 83.68 Hz). So here's the hypothesis: The ocular microtremors wiggle the retina, allowing it to sample at approximately 2x the resolution of the sensors. Showing someone pictures that vary at less than half the rate of the oscillation means we're no longer receiving a signal that changes fast enough to allow the supersampling operation to happen. So we're throwing away a lot of perceived-motion data, and a lot of detail as well. Some of the detail can be restored with temporal antialiasing and simulating real noise, but ideally Cooke suggests going with a high enough frame rate (over 43 fps) and if possible, a high resolution.

10 of 187 comments (clear)

  1. Bring on HFR by Anonymous Coward · · Score: 5, Interesting

    I, for one, am sick of slow (seconds-long!) pans across scenery that *still* end up with judder and motion blur.

    HFR isn't a gimmick like migraine-inducing stereoscopic "3D", it's more akin to adding color instead of relying solely upon greyscale for film presentation.

    Like all tools, I'm sure it can be used for both good and evil. Blame evil, jump-cutting directors if the dark side is channeled.

    1. Re:Bring on HFR by Anonymous Coward · · Score: 0, Interesting

      Smooth panning is achieved by using pan-tables and movement rate. Unfortunately the modern director/camera personnel consider themselves above mathematical tools when they can "fix it in the studio" (or not).

  2. It's in the image by Diddlbiker · · Score: 5, Interesting

    Movies tend to be shot around 1/50" shutter speed, and that creates motion blur. The motion blur actually helps us see the animation as smooth, even at "only" 24 fps. Games on the other hand are razor sharp and will hence look much more like a staccato sequence of images than as an animation.

    Or so I was told by a moviemaker

    1. Re:It's in the image by Forever+Wondering · · Score: 2, Interesting

      The mayonaise you like is the mayonaise you grew up with ...

      Films are shot at 24 fps, but displayed [in theaters] at 48 fps, each frame is displayed twice: f0, black, f0, black, f1, black, f1, black, f2, ...

      According to one study, when test audiences were shown true 1-to-1 48 fps film, they actually preferred the 24 fps.

      The same is true for audio. Those that grew up on 128 kbps .mp3's preferred that over higher fidelity formats.

      The human optic nerve has [surprisingly] low bandwidth. I worked for a company that developed a [now shipping] video product that models the human optic system and removes detail that the human eye would not see. This allows better compression without sacrificing video quality. In A/B testing of original [uncompressed] video sources vs. the detail reduced video, test audiences preferred the detail reduced video. It was considered "cleaner" and "more pleasing".

      --
      Like a good neighbor, fsck is there ...
  3. Movie FPS by meustrus · · Score: 4, Interesting

    why do movies at 48 fps look "video-y," and why do movies at 24 fps look "dreamy" and "cinematic."

    For the same reason children are picky eaters. They say that people have to take three bites of a new flavor to really know if they like or dislike it. I have personally experienced that, going from "wtf this is so wrong" to "ok it's not so bad and I might actually like this" between bite 1 and bite 3. Well, we all grew up consuming 24 fps movies, and anything higher is new and different. Rather than "take three bites", though, so many of us recoil from the different experience and immediately start talking to all our friends about how it looks wrong, concluding that high FPS just looks bad. Try. Three. Bites.

    --
    I sometimes ask revealing, often ignorant-seeming questions. Maybe they're harder to answer than you think.
  4. Re:Get rid of Frames!!!! by Charliemopps · · Score: 1, Interesting

    All recording mediums, even Tapes and records are digital if you look close enough. There is a limit to how fine a change you can have even in a record groove. So the fact of the matter is, eventually digital will be able to surpass any conceivable analog source in sampling rate.

  5. Re:The human eye is proof God exists by morgauxo · · Score: 4, Interesting

    That would be Pascal's wager. The problem with it is that an all-knowing God would know the difference between you telling yourself that you believe in him in order to secure your salvation vs you actually believing. So... you go through the motions all your life just to burn in hell anyway.

    I don't know about you but for me belief is a conclusion I come to based on the evidence I know about, not a decision that I make. Anything else would just be lying to myself. The evidence I see and know about overwellmingly supports evolution. If the reality around me is just an illusion planted by Satan to test me or a corruption resulting from the fall or planted by God to test me then I guess I am just screwed because what I see does not match up with any supernatural creation myth I have ever heard of.

    By the way, evolution has nothing to do with purpose, progress or meaning. You have to make that for yourself. Evolution is just change and an explanation of why the change hapens the way it does.

  6. Mushrooms (may work with other drugs) by r_naked · · Score: 1, Interesting

    Anyone that has done mushrooms can tell you that seeing the world at the frame rate that the brain is capable of processing is a load of fun. I have no idea how psilocybin affects the visual processing center of the brain -- or hell, it may affect the eye itself, what I do know is stepping out into a room and looking around without the brain discarding the frames that it doesn't feel like processing is amazing. However, it does look completely fake. It is too clear / crisp. Our brains aren't used to seeing every little change -- they discard information. So, if you are watching a movie at 48 or 60fps, it looks fake is the best way I can describe it. That is because when you are looking at the screen, you have a central place to focus, and my guess is the brain doesn't discard information if you aren't moving.

    Again, this is just my guess, but I think the reason video games look much better at high frame rates is the fact that they already don't look realistic. We are expecting really crisp, sharp, fast graphics. Literally -- it is all in your mind.

    As a test, pan your head from left to right and notice the "jumpiness" that is reality. Now, eat about a half gram of shrooms, and do the same thing. It is no longer jumpy, and you get a REAL smooth pan.

    --
    -- http://anonet.org -- The internet the way it was meant to be. Check it out, you may be surprised.
  7. Motion blur is temporal AA by tepples · · Score: 3, Interesting

    There are several ways to apply temporal antialiasing or "motion blur", each of which is analogous to a well-known spatial antialiasing method. One is to render the scene twice at a slight time offset and average the two; this is the temporal counterpart to FSAA. Or find the motion vector around the frontmost mesh in each 8x8 pixel section of the screen and add a local blur filter; this is more like MSAA. But in the march from 240p (PlayStation and Nintendo 64) to 1080p (current consoles) and higher (PC master race), the preference has been for more detail in each frame rather than a better illusion of motion within a frame.

  8. Re:"Your eyes oscillate"?? by Solandri · · Score: 4, Interesting

    Some representations of what our eyes really see.