Slashdot Mirror


Cellphone as Virtual Mouse, Keyboard

stab writes "Check this out! High Energy Magic have announced a public beta of software to let you use your camera-phone as a physical mouse by just pointing and clicking and rotating it in the air. Some very cool videos available: check out the volume control and flight booking ones in particular! The tags used are really robust - they did a wastebasket torture test for a bit of fun as well :-)"

49 of 186 comments (clear)

  1. Videos? by ryanwright · · Score: 5, Funny

    Some very cool videos available

    Heh. Not anymore, they aren't.

    --
    -Ryan, with the unoriginal sig
  2. Wow... by k4_pacific · · Score: 3, Insightful

    Like the Camera phone itself, this is a solution to a problem I never knew existed.

    --
    Unknown host pong.
    1. Re:Wow... by normal_guy · · Score: 4, Insightful

      Why fly when you can drive and sail? Because it's faster and more efficient. Why carry around a cameraphone when you can easily carry a brick phone and your Nikon 35mm? Because it's smaller and more efficient.

      --

      Linux: Free if your time is worthless.
    2. Re:Wow... by rainman_bc · · Score: 2, Interesting

      Yeah, the problem existed. Not the convergence question, but still. Imagine - you get in an accident, and you don't have any paper; you can take a pic of the license plate. Or someone commits a crime and you're there to witness it. A picture sure does help. From a legal perspective, carrying around a camera can really save your hide. Of course IANAL, but I can imagine the possibilities. It would make the difference in a "my word against your word" kinda case. Same goes for video. Imagine if you were assaulted and managed to catch the assault on video. Kinda makes your case more concrete doesn't it? From a "my word against yours" angle, having a camera on you at all times likely does help a lot.

      And besides, what if you were in calgary right now and want to remember all the b00bs being shown. What better way to relive the NHL playoffs than through the joy of pictures!

      and on that note, what if you were to shag a supermodel? No one would believe you (being a slashdot nerd), so now you can snap a photo while shagging a goddess! You will be the envy of your friends!

      =D

      --
      09 F9 11 02 9D 74 E3 5B D8 41 56 C5 63 56 88 C0
    3. Re:Wow... by Total_Wimp · · Score: 5, Interesting

      Like the Camera phone itself, this is a solution to a problem I never knew existed.

      This kind of statement about the lack of a use for a camera phone tends to tell me something about the person that says it.

      1. They're not very creative. I use a camera-phone all the time for stuff I'd never use a camera for. For example, I take pictures of sales displays to compare the product on the internet when I get home and I take pictures of the sign that reminds me where I parked my car at the airport. Instant notes with no effort. I also have a cool game that lets me move around by moving my phone around. If you were more creative, you would have thought of a few more uses too.

      2. They're not very spontaneous. I take pictures of my friends, family and important events far more often than I ever would if I had to carry around a full-size camera all the time. If you were interested in this kind of spontaneity then I'm sure you would see the use of a camera phone.

      3. They're self-centered. People who don't want a camera phone personally, and seem to be dumbfounded by those that do, tend to be some of the most self-centered people I know. Lots of people have camera phones and lots of people like them. You may not desire or need one, but are you able to learn from and empathize with those that do? If you were interested in the thoughts and feelings of the people around you, you might have asked one of them why they bought a camera phone and realize that not everyone has the same needs and desires that you do.

      Believe it or not, I'm not trying to slam you here. I'm just reporting my personal observations of people who've talked like you have about these devices. Camera phones are interesting because they're very popular, but there's a significant backlash. That backlash crowd, in my opinion, is really more alike than most people realize.

      TW

    4. Re:Wow... by milkman_matt · · Score: 2, Insightful

      Why fly when you can drive and sail? Because it's faster and more efficient. Why carry around a cameraphone when you can easily carry a brick phone and your Nikon 35mm? Because it's smaller and more efficient.

      Interesting point, but by the same token -- Why use your cellphone as a mouse? I can't think of any reason save powerpoint presentations or something, but for that you don't really need a mouse.. Flying is faster than cars and boats, the cameraphone.. well, I'd rather carry my little phone and my Nikon 35mm, because the results from a camera phone are ass at best. I have a camera phone, and I have a little pocket olympus digital camera. If I know I'm going to be taking pictures, I bring the digital, the resulotion and clarity blow my phone out of the water. For a quick "oh wow that's neat" picture, then yes, a camera phone is fine and sometimes very useful. However, usually if you're going to be taking pictures of stuff, you know it, so you bring your camera. Well, "I", not "You", but I can only speak for myself.

      -matt

    5. Re:Wow... by cjpez · · Score: 2, Insightful
      (I know I probably shouldn't feed the trolls, but...)

      ... so your theory is that people who don't like camera phones
      are uncreative, non-spontaneous, self-centered assholes? Whereas
      your camera phone imparts creativity, spontaneity, and a greater
      appreciation for your fellow man? Wonder of wonders! Maybe
      this new phone will come with a feature that makes you less of
      a jerk, too!

    6. Re:Wow... by Yobgod+Ababua · · Score: 2, Insightful

      "Why use your cellphone as a mouse?"

      As the OP notes, the primary use would be to create interactive displays and signs in places where there typically is no mouse, or it would be inadvisable to place a mouse (or other pointing device).

      The idea is to enable people to use a device that many of them already carry with them to interact with these displays, rather than building some possibly expensive or damage prone method of interaction into the display itself.

  3. Here's an idea: by magefile · · Score: 4, Interesting

    If the spot codes can hold a few bytes of info - wave your cell over a tattoo or a shirt someone's wearing to get their name/cellphone number ... um, never mind, that'd be a bad thing.

  4. I don't understand... by Anonymous Coward · · Score: 3, Insightful

    Why integrate a cell phone with all these add on features that aren't nearly as good as things devoted specifically to the task? Cameras on cell phones are horrible compared to a decent digital camera, cell phone games are also quite lame (though, in Japan, you can get some nice looking versions of Dragonquest 1 and FF1), and now this... Why not just fix certain problems with the PHONING (i.e. bad signals) - the main capability for which they were developed, rather than adding a whole number of (useless) features?

    1. Re:I don't understand... by Khakionion · · Score: 5, Insightful
      Why not just fix certain problems with the PHONING (i.e. bad signals) - the main capability for which they were developed, rather than adding a whole number of (useless) features?
      Put yourself in Sprint's shoes. You could spend more on improving your network, thus upping your subscription costs, or you could have Samsung come out with a shitload of useless PCS Vision features. Both sell phones, but there's less risk for Sprint, since Samsung's doing the majority of the R&D.
      --
      OMG! Wau!
    2. Re:I don't understand... by Mz6 · · Score: 2
      Because the phone is the last thing people care about!

      I have a couple friends who work as Spring salespeople and they say that the last thing that people ask about it the actual phone quality itself. They want to know about games, planners, cameras and all the other toys, but the actual phone part is last, if even touched upon at all.

      --
      Hmmm.
    3. Re:I don't understand... by Diaspar · · Score: 4, Interesting


      Didn't Motorola CEO get kicked out because that's precisely what he was saying ("concentrate on quality that's obviously suffering right now, and not race for features")?

      I think in the current market there is always race for features. More, more more and more. Until some complaint gets too loud and bites the company in the ass. Then fixing it becomes a future as well ("Our dialer is now better than ever").

      I found it interesting how Microsoft acted back in the day. They bloated their software with features, many many features, to beat the feature list of the competitor. Well, so what that it crashed constantly, so what that it didn't do the job that well. (sarcasm). For some reason, it's still around...

    4. Re:I don't understand... by Diaspar · · Score: 3, Insightful


      I think the issue here is that the people *assume* that the phone just works. Quality of service is usually attributed to the provider.

      Now that we got that out of the way, once people take reliability for granted they look at optional things, such as camera, organizer, phone book, etc.. nothing wrong with it, just how the mentality works.

    5. Re:I don't understand... by ndykman · · Score: 2, Insightful

      All these toys just allow the companies to churn phones and do nothing about, well, phone service. I agree. Two things I care about.

      Reception. I understand that this is a combination of the network and the phone, but I'm not seeing many companies really making the effort to examine coverage, make investments in infrastructure upgrades. I think the phones may not have much more they can do on reception, save for a breakthrough in antenna design (the PLL for example).

      The second is of course battery life. This is just a fundamental problem, but hey, not sticking a ton of crap in the phone can't hurt. I must admit, I do like some color screens, just because they are bright and easy to read to see who is calling, and whom I'm calling.

      I am looking at switching providers, and I'm really looking at Nextel and Verizon, as they really seem to be about "getting phone calls". Any comments?

  5. seriously... by jbellis · · Score: 2, Insightful

    pretty underwhelming that something described as a "virtual mouse and keyboard" turns out to be more like "virtual touchscreen, as long as you don't have more than a few options you want touchable."

  6. How quickly is this all done? by Fiz+Ocelot · · Score: 3, Insightful
    So how fast is it? From what it sounds like in the description: A bar code like "spot code" is on an object. Your phone reads it with the camera, communicates this to a nearby pc via bluetooth, which then somehow runs code on the phone.

    Sorry but first off, I don't want a camera phone. Second, Will this all run within my 2 second attention span? Most likely just targeted ads anyways. Not to mention what this would do to the phone's battery life.

    1. Re:How quickly is this all done? by stab · · Score: 4, Insightful

      Sorry but first off, I don't want a camera phone

      You're probably posting from the US. In Europe, it's almost impossible to buy a cellphone without a camera these days. You're correct in that I dont particularly want to take pictures with the crappy camera - so why not use it for something useful?

      Will this all run within my 2 second attention span?

      Pretty much ... the decoding happens in real-time (you see the camera viewfinder, and it highlights tags). Once the main slashdotting dies down, the videos hopefully explain it a bit better.

      Not to mention what this would do to the phone's battery life.

      Actually, it's not too bad ... I was demonstrating this stuff at a research demo day recently, and we ran a normal Nokia 3650 for a good 8 hours without seriously killing the batteries - that the camera and bluetooth active at the same time.

  7. Mirror for some of the videos by stab · · Score: 5, Informative

    Since the main site is predictably a bit bogged down, there is also a page at the University of Cambridge Systems Research Group detailing the research side of things. It also has some cool videos :-)

  8. New Policy by bogie · · Score: 3, Interesting

    If a site is unreachable within the first 10 posts the story gets yanked. Delete it like it never happened. Seriously, how the hell are we supposed to have a discussion about something we can't even read about?

    --
    If you wanna get rich, you know that payback is a bitch
    1. Re:New Policy by SwornPacifist · · Score: 5, Funny

      how the hell are we supposed to have a discussion about something we can't even read about?

      Since when has reading the article been a requirement to post authoritatively on Slashdot about it?

    2. Re:New Policy by Pizzop · · Score: 2, Funny

      It's just a ploy by someone who secretly hates the people who did it. They have the site /.'ed and then laugh when the persons computer melts!

  9. ideas by medvezhatnik · · Score: 2, Insightful

    what else can we turn cell phone in to ? i'd like to have web server and ssh installed on it too, wash the dishes, flashlight, what else ? :-)

    1. Re:ideas by gandalphthegreen · · Score: 3, Informative
      flashlight
      You apparently haven't seen this.
  10. Google Cache by jm92956n · · Score: 3, Informative
    --
    An effective signature identifies a particular user amongst a base of thousands.
  11. Gyroscopic mouse technology - patented by networkGhettoWhore · · Score: 5, Interesting

    What wasn't reported though is that the company Gyration already has patent pending on gyroscopic mouse technology. Gyration had already released an open letter last week addressing this when the cell phone mouse was first announced.

    --
    Natural Selection: self-destruction of the poor and lazy
  12. Join us next time... by advance512 · · Score: 2, Funny

    ...when we show you how to take pictures of your family using an optical mouse!

    Actually, this is pretty cool - nice idea. No need to carry around a mouse for your laptop (if you hate the touchpad), just use your cellphone! Simple and smart.

  13. new use for this... by ferrocene · · Score: 4, Funny

    Eliminate beer Goggles! Picture the scene: you're at a bar, gettin' close to closing time. The chick you've been talking to is lookin' pretty good, but all your friend's have abandoned you.

    Whip out the phone, take a pic of the broad. Phone flashes green if she's good, Red if she's not.

    That would have saved me uh...i mean...yeah...

    --
    Most folk'll never lose a toe, and then again some folk'll...
    1. Re:new use for this... by droid_rage · · Score: 4, Funny

      Come to think of it... The only thing I've ever used my cameraphone for is to get a pic of the girl whose number I just got, to decide if I'm going to call her or not once I sober up.

  14. What I really miss in cell phones... by jorlando · · Score: 4, Funny


    a multimeter...

    lots of times I needed a damn multimeter and I looket to the cell phone and imagined it could have a pair of probes...

    at least a AC/DC voltmeter up to 300V...

  15. Might be useful in a museum... by FirstTimeCaller · · Score: 2, Insightful

    If anyone has been to Seattle's Experience Music Project (assuming the outside appearence didn't scare you away), this could be used as a replacement for the MEG devices that they provide. I could see using this to point at an exhibit and getting bluetooth audio streamed to your phone. Might be useful for museums that don't have Paul Allen's deep pockets.

    --
    Wanted: witty unique signature. Must be willing to relocate.
  16. damn it! by Haydn+Fenton · · Score: 2, Interesting

    You wouldnt believe my face when i saw this story.. I've been mouseless for some time now (I'm sure a /.er can help me - details below), this was a god send.. then the site gets slashdotted - im not so happy
    then i see some mirrors - im happy again
    then i find it wont work with my phone - im pissed.

    Anyway, I have two mice (1 USB and 1 PS2), yet neither work (the cursor will not move and clicking has no effect). Windows says the drivers are fine, it's not a virus.. i've been told it might be the motherboard, can anyone verify this?
    The mouse was jumping a little a few days before breaking, then the day before it broke it was stopping and starting. The day it broke.. well, it broke. Right in the middle of making the GUI for a program.

    WHY ARE MOUSEKEYS SO DAMN SLOW?!?

  17. Wait a Sec by ZHaDoom · · Score: 2, Funny

    Dont have a phone call while your using your new mouse. Sure let me see whats playing tonight. One second (scruffing sound) Sorry about the but my phone is also my mouse.

    --
    War isn't about who's right. It's about who's left.
  18. Slashvertisement? by Quixote · · Score: 3, Informative
    Submitter: Stab, a.k.a. Anil Madhavapeddy
    Story is about HighEnergyMagic, for which WHOIS tells me:
    Administrative Contact:
    Madhavapeddy, Anil anil@recoil.org
    100 Carnbrae Avenue
    Belfast, Northern Ireland BT8 6NH
    UK
    +44 7771640674
    Story is mirrored at University of Cambridge Systems Research Group, where we find that the page is "© 2004 Anil Madhavapeddy".

    Seriously, shouldn't the submitter put some sort of a disclaimer somewhere? Or failing which, at least pay Slashdot to run these "ads", dammit! :)

    1. Re:Slashvertisement? by stab · · Score: 4, Interesting

      Give me a break ... where do the disclaimers stop? I mean, the software's being given away for free for non-commercial use, and I think it's of interest to other techies. Notice I didn't submit anonymously.

      And don't start spouting "open-source this, open-source that" to me ... I do my bit there as well. But noone cares about that stuff, so why bother talking about it instead of stuff I think is fun?

    2. Re:Slashvertisement? by Anonymous Coward · · Score: 4, Insightful

      I believe you could avoid any accusations of dishonesty by just writing your blurbs to say "Check this out! My company...etc. etc.". People do that often and it's not a problem if the tech is cool enough (and this tech is cool). People get annoyed when you write the blurb as though you're just a third party bystander who found this out there. Otherwise it smells like astroturfing. This tech is cool enough to stand on its own, why mess around with marketing stuff that will give geeks pause?

    3. Re:Slashvertisement? by stab · · Score: 2, Interesting

      Yeah, I think you're right ... live and learn eh? First time I've heard the term 'astroturfing', not going to forget it in a hurry :-)

  19. Right idea, wrong tool by bo0ork · · Score: 2, Interesting

    I haven't RTFA (./:ed), but these guys have potentially made a great piece of software for the physically impaired. Strap a webcam to the side of your head: Voila, no need to use hand to maneuver a mouse.

    --
    Does everything include nothing?
  20. bad... by proudlyindian · · Score: 2, Funny

    Now how will you (pretend to) listen to your gf/boss when ur actually surfing ;)

    Striving to be common....

  21. Re:and the need for this is...? by Rick.C · · Score: 5, Funny
    But this trend of incorporating everything into one device is annoying.

    That's the same line the Mormons use to justify polygamy.

    --
    You were 80% angel, 10% demon. The rest was hard to explain. - Over The Rhine
    "Math in a song is good."-Linford
  22. Doesn't work on P900 by clmensch · · Score: 2, Interesting

    I installed the app on my P900 (28kb), but when I try to run it I just get a "Folder Not Found" error. And now when I try to uninstall it, I get a "There is insufficient memory available for the specified installation." This after a phone reboot. Ah, Symbian...

    --
    There is no gravity...the earth just sucks.
  23. Blindingly obvious by t_allardyce · · Score: 2, Interesting

    Ok maybe im pointing out the stupidly obvious but.. bluetooth (or even just normal phone/wap) is TWO WAY! why would you need a camera phone with ugly spots all over your poster/screen!? just press cursor keys on your phone and send that over blue-tooth (like a dvd menu interface)?

    What would be totally totally neat would be a dumb-terminal standard using bluetooth so when you walked into say an airport and launched the 'dumb-terminal' app on your phone you would get a screen produced by the airport computer which would be able to tell you exactly where you were (triangulation or bluetooth 'cells') on a visual map. Then you could just tap in the 'customer code' on your ticket and the airport computer would be able to tell you the real time of your flight, delays, where you should go, how much time you had, where you could get discount booze etc etc. the same could work for libraries, train/bus stations, sports-games, malls, towns, tourist attractions, and of course cinemas (where the screen would say "turn your fucking phone off" just before the film started) the protocal could either be like wap/html or pushed by the server, whatever aslong as its a standard, its open, it supports funky graphics, sound and vide and you dont get charged for it.

    --
    This comment does not represent the views or opinions of the user.
  24. They can't be doin too well by foniksonik · · Score: 3, Funny


    They've already put their domain up for sale!

    --
    A fool throws a stone into a well and a thousand sages can not remove it.
  25. SSH on Symbian OS by MoreDruid · · Score: 2, Informative
    Here you will find putty for the symbian OS, so your SSH fix is already available. I have it on my nokia 3650. It's a pain to use because you have to type in the commands and with a cellphone keyboard this is absolutely not intuitive but it works.

    Why you would want to put a webserver on your phone is beyond me though, the bandwidth technology is still a long way from usable for this kind of thing. Maybe in the future though, but still... what do you want to serve? A live stream from your phone that sitting in your pocket? Wow... a dark screen... that would be cool to watch.

    Sure there would be some use for this (live webcast from a convention for instance) but it's more a brag thing than something useful as opposed to an SSH client.
    --
    The best weapon of a dictatorship is secrecy, but the best weapon of a democracy should be the weapon of openness.
    1. Re:SSH on Symbian OS by electrichamster · · Score: 3, Interesting

      You can get both a dyndns client and a webserver for the sony ericsson P800/P900, so there you go, all bases covered :)

  26. I've been doing this for a year now by jgarland79 · · Score: 3, Informative

    Sailing Clicker does just this. I'm using a 12" Powerbook with built in bluetooth and a Sony Ericson T68i. I can controll the mouse movements with the joystick on the phone.

    --
    Microsoft Windows runs on stress and frustration.
  27. That's not how they make money... by dgies · · Score: 4, Insightful

    Carriers generally LOSE money on the phones. A phone with more whiz-bang features is a more expensive phone they have to subsidize. Carriers make money off of charges for using the network. The reason all the carriers are promoting picture phones is because they're hoping you decide to use your fancy new picture phone to send and recieve pictures over the cellular network, which they can charge extra for. That's the same reason they were heavily promoting downloadable ringtones and games last year. All carriers make money off of is your use of the network. The phones are just a nuisance from a carrier's point of view.

  28. OMFG CONVERGENCE IS TEH SUX!!!!111 by dangermouse · · Score: 2, Interesting
    Why integrate a cell phone with all these add on features that aren't nearly as good as things devoted specifically to the task?

    Like what? What device, specifically, will perform the task these guys are describing? Are you going to build a completely new device with a camera, mouse buttons, and wireless connectivity for people to carry around so they can use these interactive installations?

    Doesn't it make more sense just to install some software, which is practically free, on a device which already has all the necessary hardware?

    Doesn't it make sense, if there are a lot of applications which require the same hardware, to just build one damn device and use it for all of them? If you really need a better implementation of one specific application than this convergence device can provide, carry a specialized device when you need it, as well. That still beats carrying a bag full of devices around all the time, when on any given day at least half of them are expensive and complete overkill.

  29. Other 2d barcodes could rapidly outpace this by jhsiao · · Score: 3, Interesting
    It appears that Spotcode supports only 42 bits. Obviously, this is to accomodate the low processing power and camera quality of most camera phones on the market. At only 42 bits, the spotcode can't support any meaningful alphanumeric. But as a numeric value, there are enough unique patterns (over 4 trillion) to support almost 700 spotcodes for every human on the planet.

    But with cameras and processing power on cell phones getting more sophisticated, other 2d barcode like QR Code or semacode will eventually outpace this technology with their considerably larger data capacity (up to as many as 4000 alphanumeric characters). In fact, semacode is already demonstrated on Series 60 implementations.

    The submitter points to an application that uses spotcodes for remote control. In that implmentation, the spotcode translates to a number which the program then uses to send an instruction over Bluetooth.

    However, those wishing to skip the tedium of entering URLs from the keypad using Spotcodes should note that BangoSpot (using the Spotcode technology) almost certainly uses a middleware server which performs a Spotcode number-to-URL lookup. So someone will know that you're using the Spotcodes. It's sort of like the CueCat but the implementation _requires_ them to know what you're looking up in order to provide a WAP URL.

    It's an interesting approach, but I wonder how fast cellular carriers can adopt Spotcode-to-URL servers in their network before phone technology ends up leapfrogging and reading and entering sophisticated 2d barcode data directly into a phone browser.