Slashdot Mirror


3-D Surveillance Technology

scubacuda writes "According to this Technology Review article, a new surveillance technology called Video Flashlight melds 3-D models from background scenes. This "tweening process" allows security persononnel to fly around a subject such as a pedestrian, getting a detailed look without jumping between widely separated views." That's just flat out cool.

39 of 93 comments (clear)

  1. From what I understand by ObviousGuy · · Score: 2

    This is a direct descendant of the technique used in the Matrix.

    From the rumormill, this technique will be used in the Matrix 2 to create even better effects than was done previously.

    --
    I have been pwned because my /. password was too easy to guess.
    1. Re:From what I understand by kindbud · · Score: 2

      When I first saw The Matrix, I thought they did the opening scene's jump-kick with tweening, and thought it was too cool. Then I saw The Making of The Matrix, and that they did it with the multiple computer-timed still cameras, and was not as impressed as I was before.

      If the 2nd movie uses tweening, and the result is better looking than the timed cameras used in the first, I will be impressed again.

      --
      Edith Keeler Must Die
    2. Re:From what I understand by clifyt · · Score: 3, Informative

      Hmmm...Probably not. This technique has been around for a while, but not really practical or smooth except with recent technologies. The Matrix trick was very unsophistocated in terms of electronics. Its just a few hundred cameras that are synched and can be switched from in a linear method giving the illusion of 1 single camera.

      Several years ago, there was a product released on the Mac (and then simply disappearing) called Canomera. It took 2 camera positions and after you filled in a few details such as corners of buildings and all that stuff, it could interpolate between the 2 (or more) picts and allow this same sort of trick. If one had static cameras with these corner positions prelocated, it would be dead simple to create a realtime fly through with the same software base.

      clif

    3. Re:From what I understand by WolfWithoutAClause · · Score: 2
      Its just a few hundred cameras that are synched and can be switched from in a linear method giving the illusion of 1 single camera.

      Actually no. There would have had to have too many cameras to get a smooth camera movement- and the cameras would have got in each others way. The Matrix effects really did have to do inbetweening between the different cameras digitally in fact.

      I am uncertain as to how much of this was done by software and how much was hand hacked in practice, frame by frame; but it wasn't as simplistic as you said above.

      --

      -WolfWithoutAClause

      "Gravity is only a theory, not a fact!"
    4. Re:From what I understand by uradu · · Score: 2

      > If the 2nd movie uses tweening, and the result is better looking than the timed cameras used in
      > the first, I will be impressed again.

      Uh, how exactly can an interpolated, computer generated image of a human be better looking than an actual photograph, which is what M1 used? It might buy you more flexibility and more otherwise impossible scenes, but it's certainly not going to be looking more realistic than the real thing.

    5. Re:From what I understand by WolfWithoutAClause · · Score: 2
      Did you even read the url you reference?:

      "A technician deals with all of these imperfections one image at a time using a computer and digitized versions of the images. Once the still images are perfect, the morphing software interpolates between them. Then the background images are laid into the green area. A technician has to build a complete 3-D computer model of the computer-generated scene and then key the rotation through this scene to the position of the camera in each frame of the film."

      As I said, the cameras are too bulky... they needed to be able to inbetween them to get the effect that the director wanted.

      --

      -WolfWithoutAClause

      "Gravity is only a theory, not a fact!"
  2. Court case by brejc8 · · Score: 2

    I remember a court case where some politician was reported in the paper to have been with a prostitute.
    Later on some late night talk show they got footage of him just walking along to some one and talking to them.
    Then they used software like this to place him on a different background going over to a prostitute.

    It was so convincing he took them to court for making it.

  3. Re:how does this work by telstar · · Score: 3, Informative

    You "DO" see all of someone. As the article says, this technology just uses hundreds of cameras, and merges their information in realtime. Of course the criminal might notice the couple hundred cameras as he walks down the street .... but at least you'll have a 3D view of him as he steals one of them.

  4. pr0n by Max+von+H. · · Score: 4, Funny

    I can foresee a bright future for this technology in the pr0n industry... Combine it with a VR helmet, and you're on the way to re-enact some cool scenes from Strange Days!

    --
    -- It's always darker before it goes pitch black.
  5. Something about this bothers me... by allism · · Score: 3, Troll

    Yeah, I know they say that they are using multiple cameras and just using tweening to fill in gaps between frames, but when you start sticking little stuff in, how do you know what's real and what's not?

    Made me think of the character in Stranger in a Strange Land, can't remember her name, but she was a trained witness of some sort and would not testify, for example that a house was white on all sides unless she had seen all sides of the house and then she wouldn't testify that the sides of the house she could no longer see had stayed white. Granted, that's a little extreme, but the average Joe is gonna believe what he sees is true, and this is mucking with that truth just a little bit. If this is used in court, is an expert going to be able to testify that only certain parts were added? Wouldn't that seem a little odd to a jury, "Hi, we're going to show you a videotape of something that happened and you're going to have to take it as gospel...AFTER we tell you that we added a few little bits to it."?

    Course, I'm paranoid, if someone tells me they mucked with it a little bit, I'm gonna assume they added exactly what they wanted me to see...

    1. Re:Something about this bothers me... by ceejayoz · · Score: 5, Insightful

      If they showed the tapes in court, they'd be able to show the original, uncombined versions too. Remember, it's not some magical camera - there're many many cameras that get their input processed for easier viewing. You can still fall back on the raw data if you need it.

    2. Re:Something about this bothers me... by arn@lesto · · Score: 2, Insightful

      There is a much bigger issue here. Digital images should not be admissible in court. Anyone with a simple image editor can add/remove things. Photographs at least have a negative that will show any tampering.

      Until digital cameras "sign" every image with a unique id, a time stamp and a hash of the image don't expect the courts to accept the images as evidence. The camera should also have some way of verifying that it took the photo image and that it hasn't been altered.

      Digital video would have to have every frame signed. Once you can verify that the original video sources are free of tampering then there shouldn't be any problem with showing a 3D fly through providing the court can locate the original view that contributed to some item of interest.

      --
      - AndrewN
    3. Re:Something about this bothers me... by dpbsmith · · Score: 2

      "Well ... no, I don't. I've never had any dealings with Fair Witnesses."

      "So? Perhaps you weren't aware of it. Anne!"

      Anne was seated on the springboard; she turned her head. Jubal called out, "That new house on the far hilltop-can you see what color they've painted it?"

      Anne looked in the direction in which Jubal was pointing and answered, "It's white on this side." She did not inquire why Jubal had asked, nor make any comment.

      Jubal went on to Jill in normal tones, "You see? Anne is so thoroughly indoctrinated that it doesn't even occur to her to infer that the other side is probably white, too. All the King's horses and all the King's men couldn't force her to commit herself as to the far side - . . unless she herself went around to the other side and looked-and even then she wouldn't assume that it stayed whatever color it might be after she left because they might repaint it as soon as she turned her back,"

      "Anne is a Fair Witness?"

      "Graduate, unlimited license, and admitted to testify before the High Court. Sometime ask her why she decided to give up public practice. But don't plan on anything else that day-the wench will recite the truth, the whole truth, and nothing but the truth, and that takes time."

      --Robert A. Heinlein, Stranger in a Strange Land

  6. Re:Scary... by ceejayoz · · Score: 2

    While the film itself was pretty damn cool, we should bear in mind that the world it depicted would be pretty damn shit to actually live in.

    Only if you knew what's going on. It's an exact simulation of real life - you'd have no idea if you were in it. It wouldn't be "shit to actually live in" - it'd be the same as our world.

  7. Re:Scary... by donnacha · · Score: 2

    It wouldn't be "shit to actually live in" - it'd be the same as our world.
    No.

    It wouldn't be "the same", it would be pretending to be the same as our world.

    It's like when you've got a friend who's living in a complete fantasy world: he might be perfectly happy right now but, as his friend, you have a duty to at least try making him see reality because if he realizes it for himself years later, he'll bitterly regret pissing away valuable years of his life working for and believing in something that actually wasn't at all what he thought it was.

    One of my friends used to work for Microsoft.

  8. Re:Scary... by ceejayoz · · Score: 2

    If this fantasy world is convincing enough for everyone to believe it, I don't really have a problem with it. Remember Cypher - he'd rather live in the Matrix than in the real world, and I suspect most people would feel the same. Steak vs. goop? Hmm... I think I'll live in fantasy world, thanks.

  9. Goop vs. Steak by donnacha · · Score: 2

    Steak vs. goop? Hmm... I think I'll live in fantasy world, thanks.
    If life was just a question of consumption, of watching the pretty colors go by, sure.

    But perhaps it's about leaving your mark on the world, the real world. Cows might be happy but, essentially, we've redirected them from their destiny to serve our ends.

    I'm not saying that there is a specific point to life but, getting very minimalistic about it, you could say that our "purpose" is to pass on our genes in the ongoing dance of evolution. If we are not at least partially in control of our destinies we no longer get to participate in that, the continuance of our lines.

    It's not so much a question of Steak vs. Goop but what you do with your goop.

  10. Re:Scary... by donnacha · · Score: 2

    There are times when this world can be shit to live in too... :-)
    Yeah, but at least it's real and, assisted by a reasonably accurate idea of it's nature, we are free to do our best to improve it.
  11. Canadian Cameras - editorial, news, privacy by FFFish · · Score: 4, Informative

    First, a sensible editorial from the Vancouver Sun.

    Second, some words from the Canadian privacy commissioner, in which he comes down on video surveillance.

    Third, the cameras are ruled illegal.

    Canada has a privacy commissioner who is independent of the government and police and who has one overriding concern above all else: ensuring that the constitutional privacy rights of the Canadian public are respected.

    In the past, he's also prevented the government from creating a super database that merges all information from all sources -- police, medical, political, taxation, etc -- into one system. So ruled because it would make it far too easy for the various branches of government to look at data they shouldn't have access to.

    Thank goodness Canada's got the foresight and commonsense to have an independent commissioner!

    --

    --
    Don't like it? Respond with words, not karma.
  12. Re:tweening by Nurgster · · Score: 2, Informative

    Tweening is just a specific type of interpolation (in graphics, anyway).

    It involings interpolation of vector coordinates, like morphing is interpolcation of bitmaps.

    --
    "Faith is the last resort of a desperate man" - Me
  13. Re:Entertainment? Fine. Surveillance? Not cool. by ZaneMcAuley · · Score: 2

    It would maybe be useful for intelligence gathering or planning.

    --
    ----- Whats wrong with this picture? http://www.revoh.org:1234/whatswrong
  14. scary, really by colmore · · Score: 2

    From the last paragraph of the article:

    But early versions have already been installed at U.S. Army Intelligence headquarters and are under consideration for New York City's three airports--perhaps bringing us all a step closer to living inside the Matrix.

    If by "living inside the Matrix" you mean living in a world where our every action is monitored by technology then, yes, we are getting closer to that.

    I don't doubt that this thing has legitimate uses, but I'm not about to jump up and praise every single development in survelance technology. I think Big Brother's eyes are allready a little too sharp, and I'd rather see them make improvements on how they apply their technology. There was no technical reason for intellegence to miss plans for Sept. 11th, and no array of videocameras etc. would have helped. The problems were organizational, and I don't think sufficient improvements have been made in that area.

    Bottom line: you get watched, the terrorists go unnoticed.

    --
    In Capitalist America, bank robs you!
    1. Re:scary, really by drinkypoo · · Score: 2
      The problem with big brother isn't his eyes, it's his inability to stay the fuck out of your business when you're not hurting anyone. I'm not ashamed of anything I do, but some of it may very well be illegal or considered immoral by people who have the power and inclination to stop me and punish me. But if people were actually only punished for things which hurt other people, and the system were designed to work with such fair overseers...

      heh. heh.

      Anyway, IF those things were true then it wouldn't matter who saw you do what, now would it? The problem isn't what people see, it's what they do about it.

      As a side note; I believe in privacy, but if you were never given any reason to believe that you had been seen - any reason - then it would be like not being watched. Unfortunately, it just doesn't work that way - But the ObDisclaimer snuck in there.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
  15. I can see what this will be primarily used for. by edunbar93 · · Score: 2

    Let's face it. Security is a friggin' boring job. I know people who have done it. About the only thing that keeps it from driving the people doing it completely insane with boredom is the benefit of zooming in the cameras on women with lots of cleavage showing.

    So you can imagine how this software will be abused.

    --
    "No problem. I have the capacity to do infinite work so long as you don't mind that my quality approaches zero."-Dilbert
  16. This is reminiscent of Chen and Williams work by Thagg · · Score: 3, Interesting

    Check out this paper by Chen and Williams. In this work done back at Apple in '93 they describe how to create intermediate camera angles from multiple static images.

    Of course, the capacity to fly around the scene in real time had to wait until computers got a lot faster.

    thad

    --
    I love Mondays. On a Monday, anything is possible.
  17. Blade Runner by No+Such+Agency · · Score: 2

    I'm surprised nobody else has compared this to the "Esper" device used in Blade Runner, which allowed Deckard to "see around corners" in static images. Though, to be fair, I can't think of any *possible* way this could be done using only one image - unless the machine was extrapolating from extremely subtle shadows and reflections on other objects on the picture. Even then you'd get a very crude image of unseen objects at best.

    --
    Freedom: "I won't!"
  18. Re:how does this work by jon_c · · Score: 2

    I really wish someone who knew more about this would post, my super charged troglodyte mind tells me it works something like this.

    you'll need at least 6 cameras:
    the scene from above:

    /**c**\
    /*-----*\
    /**|+++|**\
    c**|*c*|***c
    \**-----**/
    \*******/
    \**c**/

    in this crude ascii drawing we have five cameras(c), there's another one below the middle one, so we could say 6. there the box in the middle is the scene, and the diagonal lines is the cameras viewing frustum. the (*) is just for spacing, i couldn't make it work with spaces.

    Each one actually contains two cameras, very close to each other to create a stereo effect, which presumably some software to extrapolate to create a 3d image.

    The 3d image from any one camera would only be good for what it can see, so you'll have an extrusion, or unknown for what it can't. this is there the other cameras fall into place, they each can generate an image for what they know. Then though math and magic all the 3d images are combined to create one 3d image.

    this is only a guess, maybe it works like this maybe not.

    -Jon

    --
    this is my sig.
  19. So Enemy of the State isn't totally bullshit... by silentbozo · · Score: 2

    I remember a scene from Enemy of the State where the evil NSA geek takes a shot of Will Smith's shopping bag captured from a lingerie store security camera, and rotates it in 3D, filling in information as he goes along. I was like, "this is soo much bullshit. Typical Jerry Bruckheimer film - junk science all the way."

    Well, I guess it wasn't totally bullshit. However, if I find out that the DNA pattern of an ideal brunette can be modeled using only one package of M&Ms, I'll have to shoot myself...

  20. Re:Scary... by donnacha · · Score: 2

    Since it's legal to install cameras in public places, you could potentially be monitored almost anywhere. Hmm, this reminds me of a certain novel by George Orwell (not the one with the pigs.)
    Yeah, well, something tells me there's going to be plenty of pigs involved with this technology.
  21. Videoclip featuring the Video Flashlight by mortal · · Score: 3, Informative

    The Sarnoff corporation has more information available on their homepage, including a downloadable video clip of the the flashlight in action; available here.

  22. Reminds me of something I realized years back by CrystalFalcon · · Score: 2

    When the movie "Outbreak" and its CG F/X with choppers hit the screens, I remember thinking "Wow, you can't tell what's real and what's not anymore. You really cannot tell the difference between a CG scene and a real one. I wonder how long it will take before news studios start using this to fabricate stories."

    Upon which a friend of mine replied, "What makes you think they don't already?"

  23. teleimmersion by cowtamer · · Score: 2

    This could have some really awesome uses in Teleimmersion and Virtual Reality.

    Think about the last videoconference you attended: it was probably a far cry from being face to face. Adding simple stereo vision to that probably would not do much for interacting with your peers. However, a system like the following might change things.

    Here's what I'd propose, if I could build my "dream system":

    Set up the following:
    *Two conference rooms equipped with the cameras mentioned in the article
    *Optical See-through HMDs that the users would wear
    *A very fast network connection between the two locations
    *Software to make it work.

    This way, individuals in disparate locations could walk around, talk to each other, and do everything but shake hands. Actually, get one of these and that might even be possible :)

    You would also somehow do a similar trick with the audio to enable "private" conversations between individuals sitting next to each other.

    This could be the first really useful immersive application. Think about how much travel time would be saved.

    Any thoughts?

  24. Re:Courts? by Dyolf+Knip · · Score: 2

    If they're going to be recording sections of the video, they'd do so from the raw stream, not the omputer generated 3D environment. This is just a better way of representing multiple camera shots of the same scene.

    --
    Dyolf Knip
  25. Re:how does this work by mindstrm · · Score: 2

    This isn't about precise 3d imaging of each person wandering around.. it's about a model that's easier to work with.

    Following people around using discrete cameras is not natural... it's difficult.

    Using those cameras to create a more natural 3d environment for those monitoring to see what's going on will make it easier for security staff to have a good feel for what's up.

  26. Re:how does this work by mindstrm · · Score: 2

    Oh yeah.. it's the end of privacy.
    Hello.. if a camera can't see anything at any given moment, neither can the security guys.

    So if your date is sitting around, they *can't* see it from your point of view accurately, because you would be obscuring the camera. What? The camera is above your head looking at your date? then you never had privacy in the first place.

    The hologram thing is cool.. someone just has to invent the hologram

  27. Re:Courts? by mindstrm · · Score: 2

    Conclusive proof of what?

    The tweening is so the image looks smoother and more realistic, not to change what happened.

    The matrix used tweening to calculate the images between images to make things look smoother and more pleasant instead of jerky.

    Yes, it's an educated guess.. but the tweening doesn't place a guy in a room when he's not there, or make him open up a door that he never really touched.. it just makes it look better and more natural.

  28. Re:Enemy of the State by mindstrm · · Score: 2

    Really? why not?
    The camera saw the bag from several angles over time as the guy walked away.

    You then use a computer to model what the bag should look like from whatever angle. You aren't displaying anything you don't already know.

  29. Cool... NOT; Scary... YES by grokk · · Score: 2, Insightful

    The incessant augmentation of police state powers is NOT a cool thing at all.

    The way a lot of people around /. talk about these things, it's pretty clear that they don't ever expect to be the object of these new 'toys'. I find the complacent, pseudo-cool, abstract discussion of these matters to be almost as scary as this police state 'apparatus'.

    Tell me people: just when do the warning bells go off in your heads (the 'crime' issue is always meant to sidetrack your critical reasoning powers, BTW)?

    1. Re:Cool... NOT; Scary... YES by donnacha · · Score: 2

      I find the complacent, pseudo-cool, abstract discussion of these matters to be almost as scary as this police state 'apparatus'.
      Amen.