Slashdot Mirror


Researchers Turn Tables and Walls Into "Scratch Input" Surfaces

An anonymous reader writes "Researchers at Carnegie Mellon University's HCI Institute have developed a new input technology that allows mobile devices to use surfaces they rest on, like tables, for gestural finger input. This is achieved with some clever acoustic tricks — basically taking advantage of high frequency sound propagation through dense materials. Their video highlights some neat applications, such as controlling an MP3 player by scratching on a wall and muting a cell phone by scratching on a table. Further details are available in the academic paper (PDF)."

54 comments

  1. Heh by FlyByPC · · Score: 2, Funny

    Gives a whole new meaning to DIY devices from scratch!

    --
    Paleotechnologist and connoisseur of pretty shiny things.
    1. Re:Heh by Rockoon · · Score: 1

      I am well practiced in one particular DIY gesture. If anyone needs someone to do research with, I can flip a few for you.

      --
      "His name was James Damore."
  2. Wow, by Ethanol-fueled · · Score: 3, Funny

    Imagine the educational possibilities of using a chalkboard for that purpose!

    1. Re:Wow, by DigiShaman · · Score: 3, Funny

      Better yet, a whiteboard with a projected image on it at the same time.

      --
      Life is not for the lazy.
    2. Re:Wow, by Ethanol-fueled · · Score: 1

      Whoa, mods - glad to see it was modded interesting, but it was a joke.

      Have any of you heard fingernails scratching a chalkboard? It's one of the most popularly unpleasant sounds imaginable and a source of much humor when it's compared to your wives' voices. Granted almost all of them have been replaced with whiteboards and dry-erase markers but I'm still too young to make you get off my lawn!

    3. Re:Wow, by camperdave · · Score: 1

      So... scratching across words would be the gestural equivalent of encapsulating them in blink tags?

      --
      When our name is on the back of your car, we're behind you all the way!
  3. Triangulation by Anonymous Coward · · Score: 1, Interesting

    I wonder if 3 stethoscopes could provide enough accuracy to turn your desk into a large drawing tablet.

    1. Re:Triangulation by Timmmm · · Score: 4, Insightful

      The speed of sound in wood is approx 0.6-5 km/s making it not only highly anisotropic (due to the grain structure) but also giving it a long wavelength (20-160 cm @ 3 kHz).

      Sorry; blame physics.

    2. Re:Triangulation by Anonymous Coward · · Score: 1, Insightful

      I wonder how viable it would be to use a surface as a mouse tho using frequency shift (doppler effect) to measure direction of the scratch, not position.

    3. Re:Triangulation by xdor · · Score: 1

      So does this rule out an ability to triangulate the sound?

    4. Re:Triangulation by Timmmm · · Score: 1

      Yep. At least in this case. You could use ultrasound in isotropic materials (e.g. metal) but I don't think scratching produces any ultrasound.

    5. Re:Triangulation by Anonymous Coward · · Score: 0

      How about formulating a surface that minimizes the anisotropic effect? Maybe an uniform plastic that can be used as a virtual whiteboard...

      I can think of some engineers and architects coughing up some cash to get this incorporated into a "redlining" table. Imagine rolling out a plan drawing, scratching the errors and making notes. Then hitting a send button for delivery to an engineer, half the world away.

      TF

    6. Re:Triangulation by GRYBmadsci · · Score: 1

      Nevertheless, it would still be interesting to see what sort of accuracy you could achieve given an increased number of sensors (how many you can add before adding more becomes useless probably depends on the particular situation, but it seems unlikely that it is not useful to have more than 3 sensors) and perhaps a more advanced calibration process than the standard touchscreen "touch the dots in the corners of the screen" routine.

      Also, there are plenty of surfaces made out of other materials than wood for this to be worth playing with, I think.

    7. Re:Triangulation by explodymatt · · Score: 1

      I'm sure 3kHz is slow enough for interferometry to work. If we can do it with visible light sound is probably not an issue. Also most scratchy hissy sounds are around the 16kHz mark and I'm sure there are at least a few overtones in the ultrasonic range (still wavelength of 5-80cm). I'd imagine echoes from the borders of the table would be involved and other non-trivial bits, so I'd say a drawing surface is plausible (maybe not for detailed sketches but for something like a whiteboard).

  4. Rule 34 by RJFerret · · Score: 1

    And show porn websites when another phone sitting on the same table vibrates?

  5. these sorts of interfaces worry me by LiquidCoooled · · Score: 3, Insightful

    these sorts of hidden interfaces worry me.

    If we come to expect interfaces to devices to be hidden and embedded in desktops and surrounding walls we are going to spend half our lives scratching and poking at inanimate things.

    I am all for integration of technology but things like this and the hidden table things will just make us look stupid.

    give us clear interfaces on recognisable devices so that we understand what we are doing.

    --
    liqbase :: faster than paper
    1. Re:these sorts of interfaces worry me by maxume · · Score: 1

      You shouldn't worry.

      If nothing else, you can count on people to be lazy. Lazy people don't like to think any more than they need to, so interfaces that you have to think about simply don't stand a chance.

      --
      Nerd rage is the funniest rage.
    2. Re:these sorts of interfaces worry me by retzkek · · Score: 1

      Sounds like one of those flash games.
      Hmm, can I interact with this? *click* No, how about this? *click* Dammit, what do I do next! *click, click, click, click*

    3. Re:these sorts of interfaces worry me by Lijemo · · Score: 1

      If we come to expect interfaces to devices to be hidden and embedded in desktops and surrounding walls we are going to spend half our lives scratching and poking at inanimate things.

      I am all for integration of technology but things like this and the hidden table things will just make us look stupid.

      Nah, it'll just be like Bluetooth

      .

      Ten years ago, someone walking down the street talking loudly to themselves was assumed to be crazy. Now they're assumed to be talking on the cellphone.

      So it this catches on, there will be a brief period where people using these devices look like they have some sort of nervous tick, followed by a long period of time in which people with certain kinds of nervous ticks blend in better because everyone just assumes they're writing a note to themselves

  6. Has it been named yet? by PearsSoap · · Score: 2, Funny

    I propose scratch 'n' navigate.

    1. Re:Has it been named yet? by dotancohen · · Score: 0

      I propose scratch 'n' navigate.

      My balls already do that.

      --
      It is dangerous to be right when the government is wrong.
  7. ...sound propagation through dense materials by Anonymous Coward · · Score: 0

    If a loud-mouthed schnook is yakking in public and I punch him in the nose, will that turn off his cellphone?

    1. Re:...sound propagation through dense materials by Anonymous Coward · · Score: 0

      If a loud-mouthed schnook is yakking in public and I punch him in the nose, will that turn off his cellphone?

      Unlikely, though you might mute his end of the conversation. And unless in speakerphone mode I'd say success achieved.

    2. Re:...sound propagation through dense materials by dotancohen · · Score: 0

      If a loud-mouthed schnook is yakking in public and I punch him in the nose, will that turn off his cellphone?

      Depends how dense he is.

      --
      It is dangerous to be right when the government is wrong.
  8. Carnegie Mellon... by lxs · · Score: 5, Funny

    ...has an institute devoted to hydrocloric acid? Talk about specialization gone mad.

    1. Re:Carnegie Mellon... by jobin · · Score: 4, Interesting

      HCI = Human-Computer Interaction.

    2. Re:Carnegie Mellon... by lxs · · Score: 2, Funny

      Damn you sans-serif font!

    3. Re:Carnegie Mellon... by Anonymous Coward · · Score: 3, Insightful

      Which is ironically a HCI Problem.

    4. Re:Carnegie Mellon... by SnoopJeDi · · Score: 1

      I'm not a doctor/chemist/etc., but iirc, HCl is important in prescription drugs for delivery, because of it's membrane transport properties. Or something.

      It's attached to a LOT of prescription medications, I do know that.

    5. Re:Carnegie Mellon... by penguin+king · · Score: 1

      Hydrochloride salts often are used, however I don't think a whole institute to study them is required :P

    6. Re:Carnegie Mellon... by g0at · · Score: 1

      That's not ironic. It's a coincidence.

  9. So now PDAs... by MickLinux · · Score: 1

    ... can come with a full keyboard. Just set the thing on the table, and a laser diode outlines your keyboard for you on the table, and you type. Yeah, you'll get fatigue from too much typing like this, but it'll be tons faster than point and click.

    --
    Correct Horse Battery Staple: 72 bits of entropy. Enter "Correct H" into google. When it generates the phrase, that's
    1. Re:So now PDAs... by Orbijx · · Score: 2, Informative

      Except that this has already been accomplished, which already scratches that particular itch, man. Sorry. :)

      --
      One of these days, I am going to flip out. When I flip out, I'll be back in five minutes.
    2. Re:So now PDAs... by Anonymous Coward · · Score: 0

      except that its vision based and it needs to be in front of you to use it.

  10. Applications by Animats · · Score: 2, Interesting

    This has potential for a door lock. A cute application would be something that opens the door when the dog wants to go out. But scratch recognition without location information is going to be very limited in application.

    With some positional information, it could be more useful. The speed of sound in wood is high, so you're going to have to correlate waveforms, not just time events. But that's not hard to do. I have no idea how much accuracy you could get, but it's not an expensive experiment to find out. Try four microphones at the corners of a table and correlate to line up the waveforms. (Three are enough for position, but with four, you get redundancy and can eliminate totally bogus position results.) Multi-touch is going to be hard, though.

    It might be fun to set up a DJ mixing rig this way. No turntables, just a flat surface, maybe with outlines of turntables and faders to guide navigation.

  11. Two Questions by AndGodSed · · Score: 2, Interesting

    Won't a vibrating phone with this technology enabled cause some issues? Or not cleanly picking up the phone might end a call.

    And another thing - how long before some huge corporation buys the rights to this technology (or patents it) and puts this out of reach of most consumers?

    1. Re:Two Questions by cyborch · · Score: 1

      Today we have prior art with a specific date published. Any huge company which did NOT buy this from the guys who uploaded this video have zero chance in court, no matter how many lawyers they have... Publishing your idea to a public media (like youtube is today) is rock solid demonstration of prior art.

  12. Not new... by alexhs · · Score: 2, Informative

    It seems they basically reinvented what Sensitive Objects (and probably others) already does...

    It seems hard to find on their site a specific mention of gestures, but I had an interview there and specifically asked if they were able to track "drags" and not only "clicks" and they said they were able to follow a finger on the surface.

    Also, look for Tai-Chi (Tangible Acoustic Interfaces for Computer-Human Interaction).

    --
    I have discovered a truly marvelous proof of killer sig, which this margin is too narrow to contain.
    1. Re:Not new... by cpicon92 · · Score: 0

      the difference is that he was able to do it with a cheap computer mic and a stethoscope

    2. Re:Not new... by Anonymous Coward · · Score: 1, Insightful

      It's pretty different. This is a manufactured surface. Scratch input uses any old surface you happen to rest the device on. One is portable, one isn't...

    3. Re:Not new... by alexhs · · Score: 1

      Parent post is not insightful, it is plain wrong.

      As you and the modder seem unable to follow links here's one of their technologies pages

      And yet another link about Tai-chi, with videos.

      --
      I have discovered a truly marvelous proof of killer sig, which this margin is too narrow to contain.
  13. Turn Tables by Anonymous Coward · · Score: 0

    I read most of the-friendly-headline, and I have to say I think it's cool that researchers can take time out of their busy lives (you know, researching) and enjoy a relaxing hobby like DJ'ing.

    1. Re:Turn Tables by callinyouin · · Score: 1

      Oh, not cool, I was TOTALLY logged in.

  14. Gestural input? by tulcod · · Score: 2, Interesting

    The article says this researches has accomplished "gestural finger input". Although this would be very cool, it is not the case. The only thing this researcher has done is listening for sound, and if there's sound, do stuff. Compare it to the microphone input of the DS: if there's noise, you can do stuff, if there's no noise, do nothing. What the researcher added was a bit of complexity: a short noise changes mode, and a long noise activates the mode. That's nowhere near gestural input.

    In fact, even if they had used 3 microphones (which would allow for random gestural input), the precision with realistic hardware on, for example, plastics, would be about an inch, or a couple of centimeters best case scenario. Forget about gestures on concrete walls.

    1. Re:Gestural input? by T+Murphy · · Score: 3, Insightful

      The sound varies by acceleration, so it can determine the unique pattern of drawing a circle or drawing a V, for example. If you watch the video where he controls the song, he uses different gestures for different commands. The only thing it doesn't do anything with is how far you are from the mic.

    2. Re:Gestural input? by tulcod · · Score: 1

      This is, however, not gestural input. "If there's a lot of noise three times in a row, a triangle has been drawn" is different from "noise moves from (0,0) to (0,1) to (1,1) back to (0,0)". So maybe a set of figures can be distinguished, but once you move beyond that (limited) set, forget about it. Sure, what these guys have done is pretty complex too, but it's not "gestural".

  15. Much more user friendly by Lord+Lode · · Score: 1

    Yay, now I can mute my phone by scratching the table instead of pressing a button! A new milestone in user-friendliness!

    1. Re:Much more user friendly by ErkDemon · · Score: 1
      Finally.

      A mobile phone user-interface that can be operated remotely by cats.

  16. Tag Pet Peeve by blaster151 · · Score: 1

    What's up with the "inputdev" tag? Are we still working with 8-character limits? :/ I know this is a geek site, but I find it so annoying - why can't it be "inputdevices" or something.

  17. It would be particularly funny to... by V!NCENT · · Score: 1

    ... point this at someones face.

    --
    Here be signatures
  18. Turntables and Scratching by jaminJay · · Score: 1

    From the article's title. What more need be said?

    --
    Leela: "Is all the work done by children?" Alien: "No, not the whipping."
  19. You know, it's unfortunate... by Patchw0rk+F0g · · Score: 1

    I see so many new applications, improvements, and developments out there, and nine-nines of them never make it to consumer use, or even to specialized uses in specific labs and industries.

    I realize (from above) that this isn't new, but it's new to me, and it looks like a very, very interesting interface. Virtual keyboards? Too esoteric, even for a geek like me. Gestural control? No. I've tried those mouse-gesture control thingy's, and they're okay, but too intrusive. But if I could merely tap, click or trace on ANYTHING... now that's something I could readily and easily incorporate into my interface!

    I hope CM pulls an MIT and makes sure this gets a real chance at flowering. Heck, even the non-geeks out there can tap a finger, can't they? Hmmm... paraplegics? What a boon!

    --
    When the going gets weird, the weird turn pro. ~~ Hunter S. Thompson
  20. Turn Table and Scratching by noppy · · Score: 1

    Am I the only one who misread "Turn Table" as the round disk with rhythms?