Slashdot Mirror


Use Your Cellphone as a 3D Mouse

Roland Piquepaille writes "In recent years, we've started to use our cellphones not only for placing calls or exchanging messages. Now, we take pictures, read our e-mails, listen to music or watch TV. But, according to New Scientist, UK researchers are going further with a prototype software that turns your cellphone into a 3-D mouse. The phone is connected to your computer via Bluetooth. And you control the image on the screen by rotating or moving your phone. As says one of the researchers, 'it feels like a much more natural way to interact and exchange data.' The technology might first be used in shopping malls to buy movie tickets or to interact with advertising displays."

77 comments

  1. Minority Report by calebt3 · · Score: 2, Insightful

    So will I soon be able to have a Minority-Report-like interface for my computer?

    1. Re:Minority Report by mattsgotredhair · · Score: 2, Informative

      Minority Report definitely used a technology closer to Apple's multi-touch or Microsoft's Surface. Both of those get rid an interface to interact with a screen and allow you to use your fingers.

    2. Re:Minority Report by calebt3 · · Score: 1

      But it was still remote and responded to the orientation of the operator's hands.

    3. Re:Minority Report by Anonymous Coward · · Score: 0

      "Earth: Final Conflict" had the hand waving interface first, at least for vehicles.

    4. Re:Minority Report by mattsgotredhair · · Score: 1

      Well I guess I was more talking about the screens that they would use, and not the portable unit they were using for transfers.

    5. Re:Minority Report by delvsional · · Score: 5, Informative
      --
      Oh Crap, I'm an optimist.....
    6. Re:Minority Report by Paul_Hindt · · Score: 2, Funny

      There already exists one in preliminary stages, it is called the Nintendo Wii.

    7. Re:Minority Report by loki_tiwaz · · Score: 1

      if you watch a bit closer, on minority report they have finger thingers one on the index and one on teh thumb if i remember correctly.

      i think a mobile phone could be good for game interfaces but i think it would kinda suck for standard gui's

    8. Re:Minority Report by Lavene · · Score: 1

      Too late. It's already here. http://www.youtube.com/watch?v=0awjPUkBXOU&feature=related That's the coolest Wii hack I've seen so far. Thanks for the link :)
  2. Wii Remote anyone? by LBt1st · · Score: 5, Insightful

    Great, so I get to wait longer in line while each person ahead of me tries to sync up and use their bluetooth phone. This is the kind of stuff touch-screen were made for.
    What we have here is a solution looking for a problem.

    -Bean

    1. Re:Wii Remote anyone? by mattmcm · · Score: 4, Insightful

      Mod parent up. Whilst I can see it being a hassle at public kiosks, it may be useful at home where you're the only user. Johnny Chung Lee has a project similar to this.

    2. Re:Wii Remote anyone? by gotzero · · Score: 3, Insightful

      This is a fantastic point. On top of that, what part of bluetooth technology would be able to pin down 3D positioning?

    3. Re:Wii Remote anyone? by calebt3 · · Score: 1

      The device determines it's orientation and transmits that data to the kiosk?

    4. Re:Wii Remote anyone? by phantomcircuit · · Score: 2, Insightful

      Touch screens are horribly unsuitable for use by the public at large.

      Simply put they break.

      This system puts the device in the users hand and reduces physical interaction significantly, which reduces cost.

    5. Re:Wii Remote anyone? by xaxa · · Score: 3, Insightful

      The touch screens used by Transport for London in most major underground (subway) stations don't break. I wouldn't expect a consumer-grade touch screen to last 10 minutes though.

    6. Re:Wii Remote anyone? by Anonymous Coward · · Score: 0

      but cmu can suck it. just like that sleator guy who destroyed the volunteer-run ICS out of greed.

    7. Re:Wii Remote anyone? by MobileTatsu-NJG · · Score: 1

      This is a fantastic point. On top of that, what part of bluetooth technology would be able to pin down 3D positioning? Given BT's short range, couldn't variances in the signal do it?
      --

      "I like to lick butts!" by MobileTatsu-NJG (#32700246) (Score:5, Informative)

    8. Re:Wii Remote anyone? by Mr2001 · · Score: 1

      Touch screens are horribly unsuitable for use by the public at large. Tell that to Wells Fargo, with their thousands of touch-screen ATMs. Every one I've seen has worked just fine.
      --
      Visual IRC: Fast. Powerful. Free.
    9. Re:Wii Remote anyone? by gotzero · · Score: 1

      Return signal strength might be able to estimate distance, but only in 2D. I do not know enough about the bluetooth standards, and the article mentioned something about cameras, but I just see this as so awkward and limited in application. They do it with the Wii, but I think that is using accelerometers. Regardless I am still not too hot about the idea of waving my phone around. I do enough damage to them already. If this was anything like voice commands, I would probably throw the phone across the room in frustration...

    10. Re:Wii Remote anyone? by Jarik_Tentsu · · Score: 1

      Have they learned nothing after the Wiimote? I can see it now - a sign next to a ticket purchasing kiosk in a mall - "Beware of flying phones!"

      ~Jarik

    11. Re:Wii Remote anyone? by wiz_80 · · Score: 1
      A modicum of RTFA would show that Bluetooth is just the transport, and has nothing to do with positioning.

      Once a connection is established, the computer knows exactly where the phone is pointing because it places a reference target on top of the normal video feed and compares this to the phone's picture [using the phone's camera].

      The distance between the cellphone and the screen is based on the way the screen's size changes due to perspective.

      --
      " There is a rational explanation for everything. There is also an irrational one. "
    12. Re:Wii Remote anyone? by DrSpain · · Score: 1

      All your phone are belong to Applebees.

    13. Re:Wii Remote anyone? by frisket · · Score: 1

      It's not going to be any damn use to anyone while it remains impossible to adjust the step granularity of movement. Right now I can use my SE phone to control the cursor on my Gutsy lapdog, but each click moves the cursor far too much, and there doesn't appear to be anywhere to adjust this. Until they fix fundamental flaws like this, the rest is just pipe-dreams.

  3. I have to ask...... by Anonymous Coward · · Score: 0

    ....Why?

    1. Re:I have to ask...... by calebt3 · · Score: 2, Insightful

      Because we can!

    2. Re:I have to ask...... by Anonymous Coward · · Score: 0

      because using a cellphone as a remote has not dawned on enough people as something more useful yet!

  4. Almost four years ago by tepples · · Score: 4, Informative

    What has changed in the three years and eight months since this story?

    1. Re:Almost four years ago by dotancohen · · Score: 2, Funny

      Since when has Zonk been responsible for checking CmdrTaco's four year old posts? And how did _you_ remember that one? I'm still waiting to hear the other 665 things wrong with that scenario.

      --
      It is dangerous to be right when the government is wrong.
    2. Re:Almost four years ago by pinchhazard · · Score: 1

      665? As in JSP?

      --
      Do you love freedom??? Do you love freedom!!! DO YOU LOVE FREEDOM!!!!!!!!
  5. cool but impractical by blhack · · Score: 5, Insightful

    I have said it before, and i will say it again:

    This type of interface is completely impractical, except for a few high specialized applications (like architecture).
    The problem with things like this is that your arm gets tired after using it for a few minutes. The great thing about a mouse is that you can take your hand off of it and it stays in the same place. I know that personally, I use the arrow and tab keys for navigation WAY more than i use my mouse.

    Mice work really really great because it is a 2D interface to a 2D environment.

    I would rather see grant money pumped into multi-touch than stuff like this.....its cool, its just not going to replace your mouse anytime soon.

    --
    NewslilySocial News. No lolcats allowed.
    1. Re:cool but impractical by wizardforce · · Score: 2, Interesting

      right, another thing about 3d mice is that generally they're less precise- just clicking things can move the cursor elsewhere. really at this point, they're novelty items that don't really do a better job at anything compared to a 2d mouse. maybe 3d mice working in a "3d" environment like 3d design but not 3d in a 2d environment, that's just silly.

      --
      Sigs are too short to say anything truly profound so read the above post instead.
    2. Re:cool but impractical by Anonymous Coward · · Score: 0

      This type of interface is completely impractical, except for a few high specialized applications (like architecture).
      The problem with things like this is that your arm gets tired after using it for a few minutes.


      Hey, guess what genius! Your arm gets stronger! The Wii was a commercial success because of its interface, not despite it.

    3. Re:cool but impractical by Anonymous Coward · · Score: 0

      I must be tired, because my first reading of your comment went like this:

      I would rather see giant monkeys pumped into multi-touch than stuff like this

      In Soviet Russia, giant monkeys pump you!

    4. Re:cool but impractical by TheThiefMaster · · Score: 1

      right, another thing about 3d mice is that generally they're less precise- just clicking things can move the cursor elsewhere. It's even worse when you consider that there are people who have trouble clicking the buttons on a normal mouse without moving it.
  6. I kinda did this by gigne · · Score: 2, Informative

    I had a go at doing this a while ago using AR toolkit plus which uses AR Tags as a reference point to send the mouse data to the computer. I never really did get the camera filter working so I abandoned it. I did ask Daniel Wagner (the lead guy on artoolkit plus) for the DSVideoCE component source, which is a CE directshow filter, but he replied that it wasn't possible to release it. CE is a pain in the backside so I gave up. It worked pretty well from a video file I pre-recorded, so I reckon it would have worked well.

    Pretty much everything about artoolkit plus worked out of the box, and the bluetooth code to emulate a mouse was pretty simple. if someone wants to give something like this article a bash, I would start with something like this.

    My 2p

    --
    Signature v3.0, now with 42% less memory usage.
    1. Re:I kinda did this by SlapperJoe · · Score: 1

      Did the same thing 1.5-2yrs ago. http://www.mquter.qut.edu.au/mobile/ARTFilterDX/ARTDX.html Had to cut some corners, because as you said CE is a pain, but works pretty well to be honest. Managed to get it running on pretty much every WM5&6 Smartphone/PocketPC that I've come across.

  7. My cell phone as a wii-esque I/O device? by mmell · · Score: 1
    Yeah, this is so worthwhile a technology.

    Still, I imagine there are people out there willing to find one more excuse to shake their cell phones around, people with money.

  8. Tired of these cellphone as credit card "dreams" by Lumpy · · Score: 5, Insightful

    WE hear almost monthly how this or that will make it so we can buy movie tickets with our cellphones. grand experiments have been done all over the world to do this and every single one fails.

    I suggest they do something different, start with forcing all financial institutions to adopt a single standard for electronic payment and force them to accept it without fees or charges.

    THEN let's do the utopian buy everything with our cellphones trick. Hell it's been in place in europe in some places for almost 5 years now (German bus line, you pay your bus fare by waving your cellphone near the pay terminal)

    I'm tired of the wheel being reinvented monthly while nobody is inventing roads.

    Start with how to force banks to quit being assholes and create a universal OPEN electronic payment system that has ZERO cost.

    --
    Do not look at laser with remaining good eye.
  9. not just yet by MacarooMac · · Score: 4, Insightful

    Interacting with ticket machines and other public terminals? Think i'll stick to the dedicated interfaces they will continue to provide: more efficiet and more secure.
    Interacting with video advertising displays? Gee, I can't wait.

    Using my handset to interact with public devices will only be cool when I can stop the 07:43 train from taking off without me at Clapham Junction and when I can disable that stereo system the five punks in the Camaro Convertible have blasting my head off at the traffic lights. (Perhaps you can do this one already?)

    What you want is simply to interact with your handset which will replicate the public interface/display on its screen. I.e. Multiple users simultaneously accessing a terminal display and no more queues. Little need to control the external display except as a gimmick.

    --
    "He Who Dares Wins" ...or gets twenty-to-life for totaling their Bimmer on a poodle parade
    1. Re:not just yet by xaxa · · Score: 3, Interesting

      Quoting a rant I heard yesterday at about 3am:
      "Where the fuck is the bus map? Which bus do I need? What's wrong with this fucking city, there's a fucking plasma screen in the bus shelter but no fucking map."
      (That was at one of the bus shelters under Centre Point in London.) There was some kind of interaction with the advertisement, but I didn't see anyone pressing the buttons; I've only pressed them if I've been bored and alone. I don't mind video screens where I don't have to look at them for very long. I like the ones along the escalators in some stations: they're pretty cool, and the old station design (bold tiles etc) contrasts wonderfully with brushed steel LCD displays.

      (You're actually wanting the 0743 to be late? I (was) the one inside thinking "hurry up! Hurry up! Leave, dammit")

      Transmitting the display to the screen would be much, much more useful, that's a great idea. It could be pretty easily done with a website, WiFi and/or bluetooth (or similar) to transmit a URL to nearby devices.

    2. Re:not just yet by eclectechie · · Score: 1

      ...and when I can disable that stereo system the five punks in the Camaro Convertible have blasting my head off at the traffic lights.
      You mean like this?
      --
      "The empty vessel makes the greatest sound." -- William Shakespeare; Henry V, 4. 4
  10. custom do-it-yourself 3D mouse pointers by wehe · · Score: 2, Informative

    If you can't wait for the 3D cellphone mouse. Here are some links to selfmade 3D mouse pointer devices. BTW: at least one of these guides has been on ./ already.

  11. Amazing cell phone applications by Anonymous Coward · · Score: 4, Funny

    The amount of things that one can do with a cell phone is nothing short of amazing. And the end is nowhere near in sight yet: Manufacturers keep coming up with ever more creative, ingenious applications for the cell phone. Indeed, the only thing we can be positive about is that the cell phone service will remain overpriced, unreliable and limited in its coverage, while the sound quality will remain disappointingly awful. Well, at the very least we will be able to use it as a 3D mouse.

  12. This works with the iPhone as well by Malevolent+Tester · · Score: 4, Funny

    But you can't right click.

    --
    If you haven't made a developer cry, you've wasted a day.
    1. Re:This works with the iPhone as well by Darfeld · · Score: 1

      It must be a Mac interface...

      --
      (\__/) This is Lapinator
      (='.'=) copy it in your sig
      (")_(") so it can take over the world
  13. Re:Tired of these cellphone as credit card "dreams by smussman · · Score: 1

    ... and create a universal OPEN electronic payment system that has ZERO cost.
    Because it costs the bank something to set up/maintain the electronic payment system, it is not possible to have a zero cost system. (see TANSTAAFL principle) However, a standardized system with standardized (reasonable) payments would certainly go a long way in the direction the parent poster intends.
  14. Re:Tired of these cellphone as credit card "dreams by Anonymous Coward · · Score: 0

    It isn't a dream, it's a nightmare awaiting its implementation to reality. Some of the tendrils are already here and growing. All it needs to become a full blown cancer is more "simplicity".

  15. Stolen From Nintendo by ZeroSerenity · · Score: 1

    Almost complete duplicate of the Wiimote in a cell phone. Bluetooth connection, interacting with objects and whatnot.

    --
    For those who seek perfection there can be no rest on this side of the grave.
  16. Re:Tired of these cellphone as credit card "dreams by maxume · · Score: 2, Insightful

    An electronic payment system that has ZERO cost is impossible. I guess you probably mean one where retailers build the cost of it into their business and banks charge retailers rather than bank customers, but that still has a cost, just not a direct consumer cost.

    --
    Nerd rage is the funniest rage.
  17. Zonk and Roland by Propaganda13 · · Score: 3, Funny

    Ladies and gentlemen, boys and girls, children of all ages...Slashdot proudly brings to you, the USELESS ARTICLE TAG TEAM CHAMPIONS OF THE WOOOOORLD!

    1. Re:Zonk and Roland by Anonymous Coward · · Score: 0

      Tagged: "rolandsucks" and the new one, "rolandisgay"

  18. Re:Tired of these cellphone as credit card "dreams by Anonymous Coward · · Score: 0

    >Because it costs the bank something to set up/maintain the electronic payment system, it is not possible to have a zero cost system.

    So, your bank pays a certain fee to the central organization dealing with these transactions per transaction you make. Your bank then chooses to bill you this fee, or more, or less, or roll it into your current bank fees. Done.

    It's no different than interac is now, except less BS to deal with.

  19. Great excuse not to design a real 3D input device by ueltradiscount · · Score: 2, Insightful


    Every 3D input device created over the last 15 years has failed without exception. They were either too expensive (datagloves for VR, various space navigator gizmos for CAD), or too crappy to be of any use (P5 glove?), or died because of lack of driver/software support.

    So if anyone wants to create a 3D input device that actually gets used by more than 5 people a) design it so it actually works well b) don't overprice it c) don't count on game or software companies to "support" it unless you create a really easy way for software to interface with your device.

    As for cellphones being used as a 3D wand, that sounds like a marketing gimmick to me, and a stupid one at that.

  20. nokia n95 as a mouse by nostriluu · · Score: 1

    http://www.youtube.com/watch?v=A0lz35Boe_I

    uses the accelerometer and bluetooth.

  21. Re:Great excuse not to design a real 3D input devi by Anonymous Coward · · Score: 1, Insightful

    I heard Nintendo made this thing they call a Wii...

  22. Re:Tired of these cellphone as credit card "dreams by blahplusplus · · Score: 2, Insightful

    "Start with how to force banks to quit being assholes and create a universal OPEN electronic payment system that has ZERO cost."

    It's the perverse incentives of market economies that give rise to this kind of crap and why the banking industry needs to be regulated.

    In canada Pay day loan shops (i.e. legal loan sharking) is quite the business I wish government would shut it down, these parasites do not add anything to the economy.

  23. Amazing [portable computer] applications by Anonymous Coward · · Score: 0

    Haha but the cellphone has done one thing that the OLPC project has never done. Bring a low cost computer to everyone.* The fact that it can be all those other things AND still be cost effective is so much the better.

    *From third-world countries to homeless people.

  24. Buy, don't bring by slapout · · Score: 4, Funny

    Does anyone else find it ironic that they want you to buy your movie tickets with your cell phone and then don't want you to bring your cell phone into the theater?

    --
    Coder's Stone: The programming language quick ref for iPad
    1. Re:Buy, don't bring by Fred_A · · Score: 1

      Does anyone else find it ironic that they want you to buy your movie tickets with your cell phone and then don't want you to bring your cell phone into the theater? There's a great opportunity for "cell phone lockers", $2 per 1/2 hour !
      --

      May contain traces of nut.
      Made from the freshest electrons.
  25. Touchscreen LCDs God's Answer to the Mouse by im_thatoneguy · · Score: 1

    What was wrong with touch screens again?

    How is this faster?

    How is this any different from using your finger to touch the display?

    Are touch screens so expensive that we need to find a free alternative to use normal LCDs instead?

  26. Aww. by Bipedal+Shark · · Score: 1

    I read this thinking it was going to be another Johnny Lee demonstration video. Thanks for nothing!

  27. Nintendo called.... by lord_mike · · Score: 1

    ...they want their wiimote back!

    1. Re:Nintendo called.... by Anonymous Coward · · Score: 0

      I agree.

      Obviously, those researchers are reinventing the wiil...

      []<-

  28. 3D mouse? by kitsunewarlock · · Score: 1

    Thank god. I hate my current 1D mouse. And I can hardly wrap my mind around my 5D mouse.

    --
    Ginga no Rekshiya Mata Each page.
  29. Re:Tired of these cellphone as credit card "dreams by zippthorne · · Score: 1

    We have those in the US, too. I can't figure out what they add to the economy, but I also can't figure out how they manage to get any customers.

    --
    Can you be Even More Awesome?!
  30. Why are cigarettes sold... by A+New+Normalcy · · Score: 2, Insightful

    ...in gas stations when it is illegal to smoke there?

    --
    ...Lorenzo / I'm into kinky crustaceans. I just discovered internet praWn.
  31. Re:Great excuse not to design a real 3D input devi by Josef+Meixner · · Score: 1

    Every 3D input device created over the last 15 years has failed without exception.

    May I present the exception: SpaceNavigator. It is nothing like that waving around stuff but a simple knob with sensors detecting the force you apply. I got one some weeks ago and haven't had time to play with it a lot, but even so after some minutes it started to get quite intuitive.

  32. Dangerous technology! by mangu · · Score: 1

    it's been in place in Europe in some places for almost 5 years now (German bus line, you pay your bus fare by waving your cellphone near the pay terminal)

    Just like that, no other input needed? Suppose someone told you "let's meet by the bus terminal". You are just standing there, waiting. Will the phone in your pocket do the kindness to pay for everyone that comes by, without you realizing it?
  33. Re:Tired of these cellphone as credit card "dreams by maxume · · Score: 1

    They are definitely bottom feeders. The problem with shutting them down is that it ends up pushing desperate people to the black market alternative -- loan sharks and so on.

    --
    Nerd rage is the funniest rage.
  34. 2W in my hands all day long? no thanks! by wikinerd · · Score: 1

    With a normal mouse you may get RSI, but with a cellphone mouse you may get cancer from radiation too. How good!

  35. unintended consequences by wikinerd · · Score: 1

    The researchers forgot to mention the obvious applications of a 3D cellphone mouse on the new academic field of teledildonics. Too bad, they just lost a honorary PhD in Multidimensional Advanced Cellular Teledildonics. But other people will surely develop the new science quite soon. It won't be long until discussions such as this become increasingly common in university campuses and boring corporate meetings:

    • Beep! Beep! Beep!
    • A: Hey, is that your cellphone?
    • B: Opps, yeah...
    • Beep! Beep! Beep!
    • A: Won't you switch it off?
    • B: Oh, it's under my.... oh well, under my... er.. er! Wait a min I've to go to the bathroom!
    • C (on the phone): What's up darling?
    • B (in the bathroom, on the phone): Don't come again while I am on a meeting plz!!!
  36. I'd be happy using my cellphone as a 2D mouse! by vrmlguy · · Score: 1

    I frequently lay my cellphone next to my keyboard. Then, when I want to use the mouse, I'll accidentally grab the phone instead. After wasting a few cycles wondering why the cursor isn't responding, I look at my hand, place the cell phone a bit father from the keyboard, and grab the real mouse. It's only embarrassing if someone is looking over my shoulder.

    --
    Nothing for 6-digit uids?
  37. Re:Tired of these cellphone as credit card "dreams by sco08y · · Score: 1

    Start with how to force banks to quit being assholes and create a universal OPEN electronic payment system that has ZERO cost.

    How are they supposed to make money? Who pays for fraud? Who pays for maintenance of the electronic infrastructure? Customer support?

  38. WTF? by brunes69 · · Score: 1

    Yeah... those VLT machines in use since the 80's are SO UNRELIABLE. They go down at least once every 10 years!

    WTF are you smoking?