Slashdot Mirror


On Integrating Voice Commands Into Videogames

Thanks to GameSpot for its 'GameSpotting' editorial discussing ways future videogames can use the player's voice more creatively. The writer notes of Rainbow Six 3 on Xbox: "It's the headset that really roped me into this one. While it's often easier to key in your commands from the controller, that's just a lot less fun", and goes on to suggest: "I'd like to be able to have my own macros of my own entry patterns. Heck, it might be cool if they laughed at a joke I cracked. I want a game where I can get in a shouting match with a character in the game - real Gene Hackman or Al Pacino business is what I'm talking about here." How would you like to see voice control in videogames evolve, going forward?

32 of 78 comments (clear)

  1. Yelling at yourself? by JohnLi · · Score: 4, Funny

    What do you do when your girlfriend comes home and finds you yelling at yourself in front of the tv??

    --
    The / in /. would be more accurate if it leaned to the left. http://www.metricnut.com
    1. Re:Yelling at yourself? by fireduck · · Score: 3, Funny

      my wife got fed up with the "imaginary online people" yelling at me when I started playing Day of Defeat, so I went out and bought a headphone/mic combo. Now she freaks out when I start talking to myself in an otherwise quiet room.

      I don't think I want to have to talk to a game. It might be fun in some instances, but yelling at the game a la Jack Nicholson in A Few Good Men would definitely raise eyebrows if anyone else was home.

    2. Re:Yelling at yourself? by nukem1999 · · Score: 5, Funny

      As if the average gamer doesn't do that without voice chat.

    3. Re:Yelling at yourself? by Captain+Splendid · · Score: 3, Funny
      Meh, my wife wouldn't have a problem with this as I'm constantly shouting at the TV, particularly when Bill O'Reilly is on.

      I mean, how else are you going to get it to be interactive?

      --
      Linux, you magnificent bastard, I read the fucking manual!
    4. Re:Yelling at yourself? by Atzanteol · · Score: 4, Funny

      What do you do when your girlfriend comes home and finds you yelling at yourself in front of the tv??

      Ask her who the hell she is and how she got in my house?

      --
      "Ignorance more frequently begets confidence than does knowledge"

      - Charles Darwin
    5. Re:Yelling at yourself? by JohnLi · · Score: 3, Funny

      Doh!

      Isn't that how penthouse letters start??

      --
      The / in /. would be more accurate if it leaned to the left. http://www.metricnut.com
  2. LifeLine by Akai · · Score: 4, Interesting

    Don't forget Konami's Lifeline which is coming in march in the US. It's a game where you "control" another person by having conversations with them.

    Looks really interesting.

    --
    Please send all UCE to scally@devolution.com so I can f
    1. Re:LifeLine by ectizen · · Score: 4, Informative
    2. Re:LifeLine by Anonymous Coward · · Score: 2, Funny
      In a tense situation, do you really want to be yelling "Shoot straight ahead. No, AHEAD. AHEAD!"

      You have shot yourself in the head. Insert 2 credits to continue.

  3. Commanding other characters by droid_rage · · Score: 3, Interesting

    I played a demo of this game for the Xbox the other day, but damned if I can remember what it was called. The premise is that you're a commander of a rebel squad in alternate future US.
    You command your team alternately to guard, follow, attack, etc. I found it difficult to switch to the correct screen to call my group while in the middle of a firefight. It would have been a lot easier if I could've Just issued voice commands.

  4. Being too complicated? by CashCarSTAR · · Score: 3, Insightful

    Myself, if a game is complicated enough control wise to require this sort of voice-control, at least for basic commands, then the game might very well be TOO complicated.

    In this case, they should start thinking hard at putting a bit more focus into their game.

    However, voice is very cool for games, mainly for multiplayer games communicating with your teammates. The Half-Life engine was built with this in mind. It works for the more team based games. I've been playing a lot of Day of Defeat/Natural Selection, and people in those games rely on the voice communication. It works a lot faster than typing things in.

    Then again, in Subspace/Continnuum, Chat Macros are easy enough that voice never took off. Sooo..whatever.

    1. Re:Being too complicated? by Anonymous Coward · · Score: 2, Interesting
      On the other hand, a game with a voice command interface could simplify complex things. The best example I can come up with is a game where you're in command of a squad of soldiers. Try to come up with a better way to do the following commands without voice control:

      "Private, take point."
      "Hold your fire!"
      "Take cover!"
      "Be quiet."
      "Retreat!"
      "Fall back to checkpoint Bravo."
      "Call for an airstrike."
      "Delta team, go to point Foxtrot via waypoint Echo."
      "Call for reinforcements!"

      All of this could be made even more interesting if the enemy could hear you, requiring you to whisper when they're nearby, or if you're squad is far enough away that you have to yell for them to hear you. This could also be combined with specific jobs in such a way that who you give orders to matters. If you want an airstrike, you either have to yell it loud enough for your radio operator to hear you, or walk over to him and whisper it in his ear. Actually, this sounds pretty good! I hope someone makes this game soon. :)

  5. Are you sure? by Unknown+Kadath · · Score: 4, Funny

    "I want a game where I can get in a shouting match with a character in the game - real Gene Hackman or Al Pacino business is what I'm talking about here."

    Are you certain you want to lose arguments to video game characters? They'll have scriptwriters. You won't.

    -Carolyn

    --
    Like Daddy always said: if you can't dazzle 'em with brilliance, baffle 'em with bullshit.
    1. Re:Are you sure? by FlipmodePlaya · · Score: 2, Informative

      Seaman punkd me a few times during arguments... He had some pretty good comebacks, for a digital fish. He could take Big Mouth Billy Bass out to farm.

  6. Re:voice communication between players not command by the+Man+in+Black · · Score: 2, Informative

    TeamSpeak
    RogerWilco

    Both work swimmingly with most MMORPGs (I play Shadowbane). Go with God.

  7. Shields down by Godeke · · Score: 3, Informative

    I tried voice command with the Starfleet Academy game, and decided to revert to keyboard when it decided "one half impulse" = "shields down" repeatedly. Or "fire photons" = "all stop". Perhaps the recognition is better today, but that combined with my cell phone's continual "please repeat the name" on voice dial just don't give me a lot of faith in voice recognition.

    I did get good recognition rates out of the Dragon Dictate program, or whatever it was called. I suspect stress changes voices enough to make it a harder challenge to recognize the same command when it was recorded originally in an unstressed environment.

    --
    Sig under construction since 1998.
    1. Re:Shields down by bmyers · · Score: 2, Informative
      Actual speech recognition is still best when there's a limited vocabulary -- the more limited the better, especially if the vocabulary can be constrained so that the words are very different. I am surprised you got such lousy recognition on things like "fire photons", etc. The recognizer in Starfleet Academy sounds pretty bad.

      Dragon's program was called Naturally Speaking (IIRC). There's also ViaVoice (from IBM) and a few others. My wife works in this field, so I know far too much about it for my own good. ;-)

      Stress *does* affect the recognition, and so does inflection and accents. Using "dictation" mode in games has a long way to go, and probably limited-vocabulary for commands, and player-to-player (hopefully with voice fonts!) is what we're likely to see for the next few years.

      --

      #man woman
      segmentation fault - core dumped.
  8. Spellcasting... by neostorm · · Score: 4, Interesting

    I would love to see a game based around magic and spellcraft where you speak the words. It would be very simple, and with the addition of a peripheral like the eye-cam on the PS2, using hand gestures in addition to vocal commands would be quite engaging.

  9. Glengarry Glen Ross: The Game by jmlyle · · Score: 2, Funny

    Yeah, baby, that's what I'm talking about....

    --
    I have misplaced my pants.
  10. Sing Sing Revolution? by KE1LR · · Score: 2
    No, not a prison escape game...

    Some sort of intelligent voice-recognition work would allow (for example) a Karaoke version of Dance Dance Revolution where the console tracks how well you stay on key while singing along to various tracks? Hmm...

    1. Re:Sing Sing Revolution? by OgdEnigmaX · · Score: 3, Informative

      Karaoke Revolution, you mean :)

  11. SOCOM voice activation by samsmithnz · · Score: 4, Funny

    I've played SOCOM 1 (not two yet), and had great fun yelling into the microphone in an American accent (it didn't understand my Kiwi accent). My flatmates would come home to find me talking to myself "Bravo attack at will" "Bravo ATTACK at will" "Damn it Bravo ATTACK AT WILL!!!" Good fun though once I got the accent right...

  12. Shoot by FrenZon · · Score: 3, Informative

    While this is a generic utility, I've found that Shoot, by Martin Traverso provides an excellent way to add voice control to any Windows game, and it's free. Once trained, the accuracy is phenomenal.

    --
    Freelook - A Free Headtracker for Games and Disabled Access

  13. One word problem for voice control by wowbagger · · Score: 2, Funny

    Consider the most common, vulgar single word utterance made by most gamers, usually when they are killed.

    Now, do you REALLY want your game to be voice controlled?

  14. Of Accents and Multiplayer by Undefined+Parameter · · Score: 2, Insightful

    Alright, the first thing which came to my mind was "what if a person has an accent?" What happens when the game can't understand what you're saying or, worse, misinterprets one verbal command for another? Theoretically, a stuffed up nose could turn "attack the house" into "a tank the how's," leaving the units in a strategy game to stand around looking for a tank when they should be advancing.

    Joking aside, there could be (and have been) problems with voice-recognition/speech-interpretation software. Probably the only device which has the capability to correctly interpret languages through accents, slurs, and illness is the human brain... and even that fails, sometimes.

    Don't get me wrong, I'd like to see some voice control for NPCs in computer and video games. I'm just not daydreaming of A.I. which can engage in arguments and intelligent debates, or a piece of software which can translate any accent correctly, even the accents of non-native language speakers (like Americans speaking Japanese or vice-versa).

    So, in my opinion, there's a long way to go before we should make speech an integral and necessary part of controling actions in a game. And, to answer the question posed, that's an area where I'd like to see voice control progress. The other area is to simply include it in any relatively complicated game which has a multiplayer component.

    Take, for example, Halo PC; it has no voice control built in, but the fast-paced nature of the game prohibits typing out instructions, observations, etc. If I take time to type out "watch left!" while driving across a bridge in a Warthog, I and my passenger(s) will be smoked or the warning will be made useless by the fact that we'll be across the bridge before they can read and react to it.

    After we reach these two aspects of voice recognition/control in games, we can talk about where and how it should be implimented, and why. In the mean time, I'll go back to shaking my fist at my broken PC.

    ~UP

    (P.S. My apologies for the grumpy tone of this message. I didn't get enough sleep, last night.)

    --
    Eat the Path.
  15. SOCOM by GeorgeH · · Score: 2, Interesting

    Voice recognition works well in the SOCOM series. For the single player campaign, you can order your 3 squadmates around, telling them to hold fire, escort you to a waypoint or cover an area. It's a gimmick, but it's a fun gimmick and probably provides enough leverage to get people on the mics for the online game.

    Karaoke Revolution provides a sort of inverse fun to this. It matches pitch but doesn't bother with voice recognition. This means when you're playing with your friends, you can suddenly in the position of improvising clever lyrics to a cheesy song.

    --
    Why can't I moderate something "Wrong" or at least "Grossly Misinformed"?
  16. What I don't like about the current trend by pudge_lightyear · · Score: 2, Interesting

    Here's the thing. Voice control is great if it works... and if it's not tied to simply five or even fifty commands. I think if someone's talking to you in your game, you should be able to talk back freely... and I'm sure that's where it's going. Here's my problem however:

    I'm playing the game with virtually the same joystick that I played the atari 2600 with. Sure, it has a couple of more buttons, but that's about it (and yes, digital and analog blah blah). In fact, with Kirby and some other new games, one button is all you need.

    Voice control is about immersion. And Further Immersion into the game is a good thing... However, the industry is bad this way. The immersive controls (like those where you stand or tilt) don't sell well so they don't invest into them. Joysticks do well by default... there's nothing else. Because there's an immediate payoff with the voice features, we'll have to settle for only partial immersion... and still play with ancient controllers.

    This is why I love the eyetoy. It's completely useless, sure... but could lead the way to real complete immersion into video games.

    Just a rant... no point really :)

  17. Well... by daVinci1980 · · Score: 2, Funny

    If...you...are...willing...to...yell...yell...YELL ...at ...the...game...at...about...this...speed......You ...might...be...able...to...have...an...in-game... conversation...conversation...con-ver-sation...wit h...it.

    Natural language processors kinda suck. :-)

    --
    I currently have no clever signature witicism to add here.
    1. Re:Well... by Ieshan · · Score: 2, Funny

      Captain Kirk Simulation!

      Spock... we seem to have stumbled... upon... a nebulous... galaxy which has no apparent reason... for existing... at all.

  18. Microsoft Game Voice by MBraynard · · Score: 2, Informative
    This is have out for a while. I had one and it worked really well; the headset is exceptionally high quality and is made by Platonic. It worked pretty well for player conversations and you can also macro commands to your voice.

    Altogether it worked pretty well. Personally I am more of a keyboard guy, but this may be just what you are looking for.

    Link Here. Good luck!

  19. Manhunt by angle_slam · · Score: 2, Interesting
    The PS2 game Manhunt has an interesting use of the headset. In the game, you play a person on death row who was not really killed, but instead is being hunted by others.

    In the game, regular sounds come from the TV, but a tormentor speaks to you through your headset (if you are so equipped). Also, stealth is an important part of the game, and people who are trying to kill you hear your voice in the microphone. You can use the tactic to distract others.

  20. Finally! by Thedalek · · Score: 3, Funny

    A satisfying solution for all those people who already talk to the screen!

    "Don't go in there! Don't go in there!"

    "Hmm... I don't think I'll go in there right now."

    Then again, think of all the people who insult the on-screen character whenever they're doing badly.

    "Stupid @$%* Mario!"

    "Oh, yeah? Let's-a see you do any better, wise-a-guy!"

    --
    Happiness is relative, Based upon the way we live.