Slashdot Mirror


Hands Free Computer Operation for Quadriplegics?

Anonymous Coward asks: "Dragon Natural Speaking dropped hands free computer operation support back in version 3. My quadriplegic friend recently upgraded his computer and it came with Windows XP. His old Dragon Natural Speaking will not work on Windows XP. Does anyone know of any complete voice activated computer control for Windows XP or Linux?"

46 comments

  1. Nope by m0rph3us0 · · Score: 1

    I believe however that Mac OS X comes with this out of the box. Maybe ViaVoice still does handsfree on the PC.

    1. Re:Nope by geoffspear · · Score: 2, Informative
      Mac OS X's speech recognition is kind of neat, but it's not really able to completely control your computer out of the box.

      However, it is pretty easy to extend by writing AppleScript that gets executed by voice command. I don't know that one could build a truly complete voice-controlled UI with what OS X includes, though. You'd at least need to add something like ViaVoice for speech-to-text, since Apple's speech recognition doesn't do that itself. In any event, building the AppleScripts to accomplish every single task in all the applications you use would take a really really long time.

      --
      Don't blame me; I'm never given mod points.
  2. Microsoft Speech SDK... by stienman · · Score: 2, Interesting

    IIRC, the Microsoft Speech SDK has just such an example application which is fairly full featured. It should not be difficult to add more features to it if it is inadequate.

    Since it's free, you'll lose nothing except some hard drive space and download time (68MB) to try it out. It's been a year since I've last played with it, so YMMV.

    It probably doesn't plug into the accessability utility included in XP (press windows + U), but I imagine that there are some out there which do.

    Good luck!

    -Adam

    1. Re:Microsoft Speech SDK... by cybermace5 · · Score: 1

      It's interesting, and not very difficult to figure out. I played with it a couple years ago, and had some commands to open a web browser, read the time, etc. Entering "command mode" was triggered by saying "Computer" and the appropriate Star Trek sounds indicated the computer was ready to listen, and your command was acknowledged. ;-)

      Hint: turn off speech recognition if you make the computer say something, you can get a very odd type of feedback loop. You also need a good microphone if you want to talk to your computer from anywhere in the room.

      Don't ask me anything about it, it was a while back and I don't have that application anymore. If I could figure it out, as an EE with zero programming courses, then you can too.

      --
      ...
  3. Sorta off-topic, but I'd reaally like to know by NanoGator · · Score: 3, Interesting

    I'm sorry, I don't have an answer to your question, but I have one of my own. How is your parapelgic friend using the computer? I don't mean from an input kind of view, but rather, how is he using it to entertain himself? Is he doing it to pass time, or is he using it to learn, combination of the two?

    I'm asking simply from a curoisity point of view, not from a cynical "why bother?" PoV. Hope I don't come across that way. It seems to me that a person in that kind of situation could create a new life for themselves on the net. Just curious if this person has managed this. If so, I'd really like to know more about it. (note: these questions are open to anybody who has a paralyzed friend getting using a computer...)

    Sorry for being off-topic. I just get really curious when it comes to using technology to help people.

    --
    "Derp de derp."
    1. Re:Sorta off-topic, but I'd reaally like to know by Beowulf_Boy · · Score: 0, Troll

      10$ says he's using it for porn...

    2. Re:Sorta off-topic, but I'd reaally like to know by gmhowell · · Score: 2, Insightful

      On the contrary: desired use of an application (or OS, in this case) is of paramount importance. The tech that would let the person play games is likely very different from that which would aid in word processing.

      --
      Jesus was all right but his disciples were thick and ordinary. -John Lennon
    3. Re:Sorta off-topic, but I'd reaally like to know by NanoGator · · Score: 0, Troll

      "10$ says he's using it for porn..."

      I'll take that bet seeing as how Quadriplegics aren't generally known for being terribly sexually active.

      --
      "Derp de derp."
    4. Re:Sorta off-topic, but I'd reaally like to know by NanoGator · · Score: 1, Redundant

      Uh.. what?

      Though your point is quite valid, I don't understand why you are saying "quite the contrary" to me. What did I say that triggered that?

      --
      "Derp de derp."
    5. Re:Sorta off-topic, but I'd reaally like to know by Anonymous Coward · · Score: 0

      Oh god what karma whoring! :P

    6. Re:Sorta off-topic, but I'd reaally like to know by gmhowell · · Score: 1

      'quite the contrary' refers to the 'off-topic' phrase in the subject line.

      --
      Jesus was all right but his disciples were thick and ordinary. -John Lennon
    7. Re:Sorta off-topic, but I'd reaally like to know by NanoGator · · Score: 1

      Ah thank you. :)

      Though I have to wonder, why was I modded down for asking for clarification? Today just isn't my day.

      --
      "Derp de derp."
    8. Re:Sorta off-topic, but I'd reaally like to know by Anonymous Coward · · Score: 0
      Quadriplegics aren't generally known for being terribly sexually active

      That's because they can't find the necessary voice control software!

    9. Re:Sorta off-topic, but I'd reaally like to know by an_mo · · Score: 3, Interesting

      A friend of mine (35 years old) had a vein near the cerebellum blown off a couple of years ago (sorry I forgot the exact diagnosis). He is now semi-paralized. Speech is severely impaired (very hard for us to understand him), so voice recognition is not an option. Communication is slow and difficult (sometimes you have to go throug yes/no questions) but you can easily figure out that his brain is pretty much as sharp as before (he was a CPA). He can't walk, he can sort of move his arms but doesnt' have much control of his fingers, plus his arms sometime tremble a lot, so keyboard is also not an option. The best solution for him is an on-sreen mouse-activated keyboard.

      Bottom line, he was trying to use his pc but had difficulties typing with the trembling and all. With other friends we donated him a big monitor and I installed a monitor keyboard so that he can type with using the mouse). He can communicate with friends via the net, expressing arguments and sentences that would take hours for us to understand given the state of his speech. I know he also plays chess. I don't think he is going to create "a new life" on the net, as you put it, for the simple reason that he is not fast enough for IRC and i am not even sure that he is fast enough to post regularly in message forums/email (I think he gets tired after a while). However, it's better than nothing.

    10. Re:Sorta off-topic, but I'd reaally like to know by ummcdou4 · · Score: 2, Interesting

      I have a parapeligic friend who was injured about 5 years ago just after getting his geological engineering degree. He was injured in a car accident with a moose so our provinces insurance is paying his living expenses.

      He went on to get an MBA from from our provincial university while serving as the Student Union's President for two terms.

      He was elected President of our Provincial opposition party and now is a nominated candidate for our federal opposition party and will run for Member of Parliament in the next Canadian Federal Election this year.

      Needless to say he uses his computer a lot, to send emails, compose letters, you name it. I play wargames with him and a bunch of friends about once a month, it really puts your problems in perspective when you see what he has overcome.

    11. Re:Sorta off-topic, but I'd reaally like to know by Covener · · Score: 0, Offtopic

      I'll take that bet seeing as how Quadriplegics aren't generally known for being terribly sexually active.

      Neither am I, doesn't keep me away from my porn.

    12. Re:Sorta off-topic, but I'd reaally like to know by Anonymous Coward · · Score: 0

      Yes, but the lack of manual dexterity probably -would-. Yeesh.

    13. Re:Sorta off-topic, but I'd reaally like to know by AShocka · · Score: 1

      A lot of people with disabilities are liberated by the services on the net. Email liberates them via an alternate method for correspondence where they would normally have to send snail mail (go out, buy stamps and stationary and post it), a lot of disabled people do their grocery shopping online, their banking, bill paying, etc.

      At web accessibility conferences I find so many people with disabilities feel so incredibly liberated by computer technology. Most are just so thankful for it.

      They could complain a lot about in-accessible sites, but it just doesn't seem to be their nature, they are mostly so grateful when they do find anything that assists or aids them to do tasks, tasks that are easy for us, but difficult for them.

    14. Re:Sorta off-topic, but I'd reaally like to know by Anonymous Coward · · Score: 0

      A paraplegic whom I do computer work for wrote a novel. He is paralyzed from the neck down and uses his computer to not only control his living environment (lights, temperature, TV, stereo, DVD player) but he wrote his novel -- one letter at a time. This was before Dragon was good enough to interpret words. We finally got a newer copy installed that was good enough to interpret whole words. It was a pretty amazing upgrade for him.

      Oh, he also does both email and video over IM to keep in touch with family and friends.

      -earl-

  4. Some ideas by Kvorg · · Score: 3, Interesting

    TBI Resources seems a like a good list of resources and information in the field, and it suggests IBM's Via Voice is an alternative. It's web site does not mention Linux and seems to be dictation-oriented, not general control.

    Perhaps some of the mailing lists (such as ViaVoice User's ML) would provide more definite answers.

    No souch tools are available in mainstream Linux distros, to may knowledge.

    --
    -Kvorg
    1. Re:Some ideas by NeoMoose · · Score: 1

      Then it is a good thing we are looking for Windows XP solutions and not Linux.

    2. Re:Some ideas by Kvorg · · Score: 2, Interesting

      While I personally prefer GNU/Linux system for a miriad of reasons, I simply took into account the phrase Does anyone know of any complete voice activated computer control for Windows XP or Linux? in the original question.

      It does look strange IBM's VivaVoice is listed as supporting Linux, but it never says so on the web page. I thought it was worth some attention since hiding GNU/Linux support in a dark corner is not so general these days as it used to be.

      But since most solutions for disabled tend to be disgustingly overpriced or at least pricy, it is rather probable they would target a proprietary system and so a Microsoft platform will probably be better choice for you anyway.

      There is also the problem that most X11 toolkits don't have straightforward and compatible automation interfaces and such a solution might be a lot more difficult to do for an X11 envronment. It would be a worth project, however, and perhaps this question should be rerouted directly to the FreeDesktop project, since a good set of standard and interfaces would probably produce good base for a free solution.

      --
      -Kvorg
  5. What my friend NanoGator is trying to say ... by Anonymous Coward · · Score: 0

    Does the man still have a penis? And, if so, how the fuck does he massage it to Internet porn?

  6. Obvious perhaps by elmegil · · Score: 2, Insightful

    Is there any reason he cannot install his old OS on the new machine? I'm still running Win98 SE on my Windows box, and regardless of M$'s support status, it works just fine...for windows.

    --
    7 November 2006: The day Americans realized corruption and incompetence weren't addressing 11 September 2001
    1. Re:Obvious perhaps by Anonymous Coward · · Score: 0

      Getting drivers for the hardware on a new machine is almost impossible. My shop has win 98 as a standard desktop but when we bought new machines. We found we could not successfully load win 98 due to lack of drivers. Had to use XP that came with the machine.

  7. I have a question by Anonymous Coward · · Score: 0, Redundant

    My quadriplegic friend recently upgraded his computer and it came with Windows XP.

    How the fuck do you upgrade your computer if you don't have any hands or feet? That's gotta be one cool act!

    1. Re:I have a question by smacktits · · Score: 1

      No wonder you posted anonymously. My girlfriend is paraplegic as the result of an accident, and her and every other disabled person has a hard enough time getting accepted by society without the likes of fucking morons like you cracking jokes at their expense.

      Grow the fuck up.

    2. Re:I have a question by cooley · · Score: 2, Informative

      LOL I don't want to blow shit about your girlfriend or anything, but I LMAO seeing such a sensitive post coming from a username like "smacktits".

      --
      Just then the floating disembodied head of Colonel Sanders started yelling Everything You Know Is Wrong!-Weird Al
    3. Re:I have a question by smacktits · · Score: 1

      haha, I know my username is a bit whacked, but I just think that making jokes about disabled people is about as low as you can get, in my opinion anyway.

    4. Re:I have a question by Anonymous Coward · · Score: 0

      Obviously you'd use a tube plugged into her rectum instead of diapers -- then just pull it out when you want to fuck her.

  8. L&H VoiceXpress by DynaSoar · · Score: 2, Interesting

    Says it works with 95, 98, NT and 2000. I have ver. 5, Standard. It came out before XP. I've got 2000, so I can't test for you. I tried the web site listed on the box (www.lhsl.com) but it redirected to Scansoft's page. They have Dragon and ViaVoice listed on the page but sell only Dragon from what I can see. Maybe check for used software places that might have it.

    I got Dragon, but refuse to use it because it tells you it requires Internet Explorer to work (it doesn't; it just requires a DLL). If IE isn't your primary browser, it installs IE from its own installation CD, even if you have a later version.

    --
    "I may be synthetic, but I'm not stupid." -- Bishop 341-B
  9. How about...Dragon NaturallySpeaking by TMLink · · Score: 5, Informative

    I think you need to look at ScanSoft's product again. Contrary to your statement, Dragon NaturallySpeaking 7 DOES allow hands-free use of the computer. In fact within the past 4 months I have trained 2 people to use it in a hands-free situation. From all of the built in shortcuts for the most popular software (including IE and Office) to the command "mouse grid", which allows you to move the mouse around the screen by only your voice, Dragon NaturallySpeaking will work great. You can even use a command (which I forget off the top of my head) to press specific keys on your keyboard. If he has the patients to sit down and learn all of the commands (which can be done over time...learn mouse grid, then slowly pick up the shortcuts over time), Dragon can be faster than a keyboard/mouse combo. If he has a clear voice, training will take 15 minutes. And it works with XP.

    Might I make the suggestion of getting Preferred over Standard. While it's double the cost, it really does seem to do a better job than Standard. Not sure what the difference is (smaller vocab maybe?), but it's there.

    --
    Every time a guy gets a threesome, somewhere in heaven an angel gets his wings. --Cary Tennis
  10. A long time ago... by WildFire42 · · Score: 3, Interesting

    The history of Dragon Naturally Speaking and ViaVoice is pretty interesting. Dragon Naturally Speaking was started by a company called Dragon, several years ago. Originally, they marketed a program called Dragon Dictate, which was designed for command and control, more so than for document dictation. They stumbled on a new technology using phonemes, and were able to create Naturally Speaking, which, like the name, allows someone to speak at normal conversational speeds and the software will still recognize it (Dragon Dictate pretty much made you speak like William Shatner on a bad day).

    Fast forward a little...Naturally Speaking got sold to a company called Scansoft when Dragon went under (I forget why). Scansoft, within the last year bought ViaVoice from IBM, which had dropped sales and further development of their Linux version of the software, which is now nowhere to be found.

    Ultimately, Scansoft pretty much controls the market in terms of Voice Dictation.

    However, there are some interesting things still going on. For instance, Intel has been working on the Audio/Visual Speech Control/Recognition engine, which is part of Intel's OpenCV (face recognition stuff).

    Ultimately, try out this link. There's quite a bit of information there.

    1. Re:A long time ago... by tchapin · · Score: 1

      I work for ScanSoft, so I can fill in the DNS history a bit more...

      Dragon has actually been around as a product since the late 80s / early 90s? Roughly 10 years, in any case.

      Lernout & Hauspie bought out Dragon and axed most of the staff. One of my current coworkers left Dragon shortly prior to that event, and one of my friends joined L&H shortly after. In any event, there was a huge accounting scandal with L&H, and they went bankrupt. ScanSoft acquired the L&H assets (as well as many employees) and now furthers the development of DNS. Another of the L&H products was a dictation / C&C product, which was discontinued.

      I hadn't heard about the ScanSoft acquisition of ViaVoice.

      I work in the network speech recognition group; previously SpeechWorks; acquired in August.

      In fact, today, we announced the acquisition of Locus Dialogue, who is a big? speech-rec autoattendant developer. An interesting thing, is that I believe their main product is based on one that SpeechWorks sold off to them a while ago (SpeechSite).

      ScanSoft has actually eaten up many companies in the speech world. I had heard that we currently embody the IP of something like 15 different companies. That's probably grown by now though...

      Thanks.

      Todd

      --
      -- !todd erases a red dot! I steal music on the internet.
  11. Not voice but... by An+Audience+of+One · · Score: 4, Informative

    Have a look at the Dasher Project. Its not voice input, but they have several input methods which can be used by para- and quadra-plegics (eye tracker, head mouse, breath mouse, toungue mouse, etc) - you pretty much can use any movement you can make. It can be faster and more accurate than most voice recognition systems, and they have it working for controlling the UI as well as textual input now.

    Matt
  12. Sadly... by Anonymous Coward · · Score: 0

    Hands Free Computing is a lagging industry. Unless the pr0n industry comes up with something using that, the innovation just will not be there.

    As you know, they have the $$$ and the resources to drive that industry. We just need to get them involved. And we'll need some, um, beta testers too.

  13. Welcome! by unixbum · · Score: 2, Funny

    I for one welcome our new hands-free Quadriplegic Overlords!

    1. Re:Welcome! by Anonymous Coward · · Score: 0

      That's awesome! Funniest thing I've seen all day

  14. article about the design of VUIs vs GUIs by Anonymous Coward · · Score: 1, Informative

    http://www.informit.com/content/index.asp?product_ id={6029804C-55B7-4E1B-AAA4-ED211D6C5B89}

  15. Head/Eye Tracking by magnum3065 · · Score: 1

    This was mentioned earlier, but I didn't see much information on the Dasher website about actual input devices (though Dasher is a neat way to handle typing).

    As a recent UVA grad I heard a lot about the ERICA project while I was there. It's an eye tracking system that's pretty neat, though I think it's basically just being used for research at this time and I don't know of a way to actually purchase it.

    I believe there are some commercial eye tracking systems out there, but head tracking is simpler, and therefore cheaper. One I've seen is from here. For $300 you can get the package your friend would need which allows for hands-free clicking through either clicking after the mouse pauses for a second, or through use of a big external button.

    I believe Windows XP includes an on-screen keyboard already, but I'm sure typing using only that would get tedious. This is where something like Dasher that was mentioned previously is helpful, as it uses a dictionary to guess which letters you're most likely to type next and make it easier to type those letters. Of course he could still use speech recognition for typing, and rely on something like the head mouse for pointer control.

    1. Re:Head/Eye Tracking by jalessio · · Score: 1

      A friend of mine has been working on the ERICA project for many years and I'm pretty sure that it is for sale for use by people with disabilities. People have been using it for exactly that purpose for a number of years. See the quotes on http://ericainc.com/control.html

  16. There's more by Anonymous Coward · · Score: 0

    I was researching speech engines and actively followed speechworks and Dragon. Once Speechworks announced a partnership with M$, I knew they were doomed. (BTW) M$ speech products are coming along nicely now - wonder why. Anyhow, Dragon was founded, built and developed by the life's work of James and Janet Baker. They sold Dragon for $600Million (in stock) to L&H who, in Parmalat / dot-com style, declared bankruptcy in Oct 2001. The Bakers tried to get back their product to no avail and it was sold to cover L&H's debts for $40Million in Nov 2001. There was also a topic about this regarding the loss of amassed works dying with dot com companies and people who may or may not have extra copies and how to resurrect the products. - Geccie

  17. OOSRI group by Anonymous Coward · · Score: 1, Informative

    I am a member of OSSRI (Open Source Speech Recognition Initiative). We are working to develop an open-source speech product to help those with disablities operate a computer. You can join our mailing list to track progress if you are interested. Any help or input would be appreciated.

    http://harvee.org/mailman/listinfo/ossri

    Dustin Wish