Slashdot Mirror


Google's Assistant Is Now Bilingual (theverge.com)

Google has announced a new feature for Google Assistant: it's bilingual now. The digital assistant will automatically recognize what language is being spoken to it and respond appropriately -- all without requiring you to change any settings. The Verge reports: You'll be able to set up Assistant to understand and respond to any two of the following languages: English, German, French, Spanish, Italian, and Japanese. Google adds that it intends on "expanding to more languages in the coming months." The behind-the-scenes tech to make this happen is pretty interesting, as Google explains in an accompanying blog post. To make Assistant receptive to two languages simultaneously, the company created a new language-identification model (which it calls LangID) that runs as soon as the software detects speech.

Assistant actually runs LangID in parallel with two separate language processing models that try to transcribe what's been said in the user's two preset languages. Once LangID has identified the language, Assistant then cancels the incorrect transcription and routes all processing power to focus on the correct one. In order to speed up the process of identification, LangID doesn't just consider vocabulary; it also signals the frequency at which each language is used and the type of device it's used with.

42 of 78 comments (clear)

  1. PRISM 2.0 by AHuxley · · Score: 1

    Gets to detect all the languages in a house for the security services.

    --
    Domestic spying is now "Benign Information Gathering"
    1. Re:PRISM 2.0 by ShanghaiBill · · Score: 1

      Gets to detect all the languages in a house for the security services.

      They can already make a good guess by looking at surnames.

    2. Re:PRISM 2.0 by AHuxley · · Score: 1

      Gets the unexpected guests and unregistered visitors, illegal immigrants too.

      --
      Domestic spying is now "Benign Information Gathering"
  2. Re:Bilingual? by Your.Master · · Score: 2

    I see you read sentence two, where it sounds like it's a higher-order polyglot, but didn't make it to sentence four, where it's bilingual.

    Whether that's for reasons of processing power, or language-detection accuracy rates dropping as the number of potential languages goes up, I don't know.

  3. Re:Bilingual? by dgatwood · · Score: 1

    It can automatically decide whether to interpret input in either the selected main language or a selected secondary language. So two languages = bilingual. What did you think it meant?

    --

    Check out my sci-fi/humor trilogy at PatriotsBooks.

  4. Bilingual? Wouldnt that be more like multilingual? by Noishkel · · Score: 1

    Reading over the article it claims that this new update to Google Assistant can understand 6 languages.

  5. Re:Bilingual? by dgatwood · · Score: 1

    I'd imagine it's the latter. The more languages you have to consider, the more words are going to appear to match more than one language. I'd expect Spanish and Italian to be challenging even *without* adding a third language.

    --

    Check out my sci-fi/humor trilogy at PatriotsBooks.

  6. Re:Bilingual? Wouldnt that be more like multilingu by dgatwood · · Score: 1

    Two at a time.

    --

    Check out my sci-fi/humor trilogy at PatriotsBooks.

  7. Recognizes other languages pointlessly. by whoever57 · · Score: 2

    The other day, the wife and I were watching a foreign language TV program. No dubbing, just subtitles. I think it was Swedish.

    Suddenly, Google Assistant on the wife's phone started. I have no idea what it heard that triggered it, but it wasn't English.

    Surely Google should know we speak English exclusively? So what's the point?

    --
    The real "Libtards" are the Libertarians!
    1. Re:Recognizes other languages pointlessly. by ShanghaiBill · · Score: 1

      Suddenly, Google Assistant on the wife's phone started. I have no idea what it heard that triggered it, but it wasn't English.

      Most likely it was triggered by some random string of phonemes.

      Surely Google should know we speak English exclusively? So what's the point?

      I watch mostly English movies, but my wife is Chinese so we occasionally watch movies in Mandarin. So Netflix sees that we like "foreign movies" and fills our recommendation list with French, Italian, and German movies, rendering it useless.

    2. Re:Recognizes other languages pointlessly. by bickerdyke · · Score: 1

      *lol*

      Remeinds me of Granny Weatherwax with the "generic foreign language".

      --
      bickerdyke
    3. Re:Recognizes other languages pointlessly. by AmiMoJo · · Score: 1

      Have you tried enabling Voice Match in the settings? Then it will only respond to your voice rather than random people or sounds.

      You can also disable voice wake up except for in certain circumstances, like when you are in the car using Android Auto.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    4. Re:Recognizes other languages pointlessly. by swillden · · Score: 1

      Surely Google should know we speak English exclusively? So what's the point?

      It's unlikely that it perceived what it heard as another language. This new bilingual feature only works if you set it up, and only with the second language that you choose. More likely, it just heard some phonemes that triggered the "Ok Google" detection, and then couldn't figure out what followed.

      --
      Note to ACs: I usually delete AC replies without reading them. If you want to talk to me, log in.
  8. Re:Merde. by PPH · · Score: 1

    Oblig. Futurama.

    --
    Have gnu, will travel.
  9. Google's Digital Assistant Is Now Bilingual by Sooner+Boomer · · Score: 1

    It understands both Ones AND Zeros!

    --
    Chaos maximizes locally around me.
  10. Re:Bilingual? by ShanghaiBill · · Score: 2

    I'd expect Spanish and Italian to be challenging even *without* adding a third language.

    Indeed. I have found that, as long as you are saying something simple, speaking Spanish in Italy works fairly well.

    In the movie "The Tourist" the character played by Johnny Depp speaks Spanish to Italians thru the whole movie.

  11. Multi Lingual ? by Archfeld · · Score: 1

    Wonder if will speak Klingon, or better yet Tolkien Elvish.

    https://www.youtube.com/watch?...

    --
    errr....umm...*whooosh* *whoosh* Is this thing on ?
  12. Re:BFD by ShanghaiBill · · Score: 1

    never used it. never will

    Yes you will. Sooner or later, voice input will be the only option for many services.

    You won't be able to withdraw money from an ATM without it recognizing your voice, nor will you be able to place an order with the robo-waitress at any restaurant.

  13. Re:Bilingual? by dgatwood · · Score: 1

    And in the movie Mr. Bean's Holiday, Rowan Atkinson's character speaks Spanish to French people through the whole movie. :-D

    --

    Check out my sci-fi/humor trilogy at PatriotsBooks.

  14. damn it. by WindBourne · · Score: 1

    I really need Tamil for in-laws. They are in their 80s and it would be useful for them to be able to simply talk to turn on lights, etc.

    --
    I prefer the "u" in honour as it seems to be missing these days.
  15. Re: Bilingual? by ozduo · · Score: 2

    My missus cant wait until it's cunnilingual

    --
    I got to the chocolate box before you, that's why the hard ones have teeth marks.
  16. Re:Bilingual? by Darinbob · · Score: 1

    Shhh, we're American over here.

  17. Oh, so that's why it no longer works by piojo · · Score: 1

    The other day, I said something very simple to Google Assistant, and was rewarded with a string of 80% Chinese characters and 20% English words which I had not said. The English was probably wrong because it lacked context (as the rest of the sentence was flagrantly misparsed).

    Anyone know if I can opt out of this feature/bug? I assume they are viewing the world as their QA department, planning on the feature not working for a few years until they gather enough data to train the service to do a better job.

    --
    A cat can't teach a dog to bark.
    1. Re:Oh, so that's why it no longer works by bickerdyke · · Score: 1

      Anyone know if I can opt out of this feature/bug?

      Easiest way: Don't opt in.

      --
      bickerdyke
    2. Re:Oh, so that's why it no longer works by piojo · · Score: 1

      Anyone know if I can opt out of this feature/bug?

      Easiest way: Don't opt in.

      I did miss that in the summary, but in Asia (with an account created in the US) it seems to be the default to interpret in multiple languages. I most certainly never told Google Assistant that I speak Chinese, because I don't.

      --
      A cat can't teach a dog to bark.
  18. Bilingual Humans by mentil · · Score: 2

    This presumably helps with code-switching, which bilingual people tend to do all-the-freaking-time. They'll start a sentence in one language, forget how to say something in that language (or don't like how it sounds in that one), then switch to another, sometimes for only a few words before switching back.

    --
    Corruption is convincing someone that the selfless ideal is the same as their selfish ideal.
    1. Re:Bilingual Humans by swillden · · Score: 1

      This presumably helps with code-switching, which bilingual people tend to do all-the-freaking-time. They'll start a sentence in one language, forget how to say something in that language (or don't like how it sounds in that one), then switch to another, sometimes for only a few words before switching back.

      No, it isn't that clever yet. I just tried it with a few sentences of mixed English and Spanish, and every time it assumed that the entire sentence was in one language, correctly understanding the part that was in that language and finding something phonetically close (ish) for the rest.

      I think what it's doing is submitting your words in parallel to all three systems: LangID and the two systems for the languages you have selected. LangID returns its best guess at the language you used, then Assistant gives you the results from the corresponding system.

      --
      Note to ACs: I usually delete AC replies without reading them. If you want to talk to me, log in.
  19. Cute idea, but... by bradley13 · · Score: 1

    It's a cute idea, with an obvious implementation (running both language modules simultaneously). Presumably, part of the input into the language ID is also seeing which language module is successfully making sense of the input.

    However... We have a bilingual household (English/German), and part of the reality is also that the languages get mixed. There is always some word in the "other" language that is handy, or maybe you just can't find the word you're looking for. If you're free to talk to your devices in either language, then you will unvermeidlich talk to them in beide Sprachen (inevitably talk to them in both languages). And that will be a lot more challenging...

    --
    Enjoy life! This is not a dress rehearsal.
  20. Re:does this really matter? by Anne+Thwacks · · Score: 1
    If they ahve Dollars, they probably speak American. That is not English by a very long mile.

    I speak very standard (Cambridge) English and none of the IVR systems I encounter ever understands me. However, everywhere I have ever worked (more than 30 different companies), people from all different backgrounds reported that I was the easiest to understand of all the people they had ever met.

    I, on the other hand, cannot understand the dialogue in a lot of American movies, to the extent that I rarely watch any (not even pirate ones).

    --
    Sent from my ASR33 using ASCII
  21. So it's really hexa-lingual by nospam007 · · Score: 1

    But it refuses to work in more than 2 languages?

    1. Re:So it's really hexa-lingual by bickerdyke · · Score: 1

      I think it's even more than those 6, but you can pick 2 out of these 6 that you will be able to use without manually switching the input language.

      In other words, these aren't the languages that are understood, but the ones that will be recognized. Which is quite a different thing if you keep in mind that current language recognition is based on a fixed dictionary and picking the word from it that comes closest to what the computer just heard.

      --
      bickerdyke
  22. Re:Why stop... by TuringTest · · Score: 1

    How many do you speak?

    --
    Singularity: a belief in the "God" idea with the "demiurge" relation inverted.
  23. Re:does this really matter? by bickerdyke · · Score: 1

    What do you call someone who speaks two languages?

    Bilingual.

    And what do you call someone who speaks only one language?

    American!

    --
    bickerdyke
  24. Re:Bilingual? by bickerdyke · · Score: 1

    Hate to say so, but speaking was jumping the shark for Mr. Bean.

    --
    bickerdyke
  25. Re:Bilingual? by AmiMoJo · · Score: 1

    Shame it doesn't support Chinese yet too. For us the ideal would be English, Japanese and Chinese support so we can both use it in our native and common languages.

    --
    const int one = 65536; (Silvermoon, Texture.cs)
    SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
  26. Re:Bilingual? by Oswald+McWeany · · Score: 1

    Useless without Esperanto.

    --
    "That's the way to do it" - Punch
  27. Re:Bilingual? by arglebargle_xiv · · Score: 1

    Und wos is mid Weanerisch? Kinnts es deppn ned a so a Waidsprach ren, es Zniachtaln!

  28. Re:does this really matter? by quenda · · Score: 1

    If they ahve Dollars, they probably speak American. That is not English by a very long mile.

    Americans are a lot closer to standard English than some of the rural British accents. Even a working-class Glasgow or Newcastle accent is a lot tougher than 90% of Americans to understand for me.

  29. Re:does this really matter? by quenda · · Score: 1

    Having lived in both the UK and US with an oriental parent who spoke broken English, I have no problem understanding anyone speaking English anywhere in the world, except lower-class black Americans.

    That'd be a variant of a Southern accent? If you go to the rural South, you'll hear white folk talkin' same way.
    But I do remember in Chicago really struggling, embarrassed, to understand the working-class black accents, while they understood my foreign accent perfectly.
    Just like in rural Ireland.

  30. Re:does this really matter? by quenda · · Score: 1

    And what do you call someone who speaks only one language?

    American!

    Or Australian. At least the Americans find Spanish a bit useful.

  31. Re:Bilingual? by dgatwood · · Score: 1

    Oui.

    --

    Check out my sci-fi/humor trilogy at PatriotsBooks.

  32. Re:does this really matter? by RogerWilco · · Score: 1

    I've heard quite a few linguists argue that "Ebonics" is a separate language from (American) English, with often a different grammar.
    None of the ones I know seem to have any kind of racial agenda, just observing an interesting linguistic phenomenon of a new language being created.

    When I'm in the US I also notice a large difference between the languages of people with different ethnical backgrounds, which seems to mean that the society is much more segregated than in for example my own country.

    --
    RogerWilco the Adventurous Janitor