Slashdot Mirror


Google's Assistant Is Now Bilingual (theverge.com)

Google has announced a new feature for Google Assistant: it's bilingual now. The digital assistant will automatically recognize what language is being spoken to it and respond appropriately -- all without requiring you to change any settings. The Verge reports: You'll be able to set up Assistant to understand and respond to any two of the following languages: English, German, French, Spanish, Italian, and Japanese. Google adds that it intends on "expanding to more languages in the coming months." The behind-the-scenes tech to make this happen is pretty interesting, as Google explains in an accompanying blog post. To make Assistant receptive to two languages simultaneously, the company created a new language-identification model (which it calls LangID) that runs as soon as the software detects speech.

Assistant actually runs LangID in parallel with two separate language processing models that try to transcribe what's been said in the user's two preset languages. Once LangID has identified the language, Assistant then cancels the incorrect transcription and routes all processing power to focus on the correct one. In order to speed up the process of identification, LangID doesn't just consider vocabulary; it also signals the frequency at which each language is used and the type of device it's used with.

78 comments

  1. Bilingual? by Anonymous Coward · · Score: 0

    Bilingual?

    I do not think that word means what you think it means.

    1. Re:Bilingual? by Your.Master · · Score: 2

      I see you read sentence two, where it sounds like it's a higher-order polyglot, but didn't make it to sentence four, where it's bilingual.

      Whether that's for reasons of processing power, or language-detection accuracy rates dropping as the number of potential languages goes up, I don't know.

    2. Re:Bilingual? by dgatwood · · Score: 1

      It can automatically decide whether to interpret input in either the selected main language or a selected secondary language. So two languages = bilingual. What did you think it meant?

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

    3. Re:Bilingual? by dgatwood · · Score: 1

      I'd imagine it's the latter. The more languages you have to consider, the more words are going to appear to match more than one language. I'd expect Spanish and Italian to be challenging even *without* adding a third language.

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

    4. Re:Bilingual? by ShanghaiBill · · Score: 2

      I'd expect Spanish and Italian to be challenging even *without* adding a third language.

      Indeed. I have found that, as long as you are saying something simple, speaking Spanish in Italy works fairly well.

      In the movie "The Tourist" the character played by Johnny Depp speaks Spanish to Italians thru the whole movie.

    5. Re:Bilingual? by dgatwood · · Score: 1

      And in the movie Mr. Bean's Holiday, Rowan Atkinson's character speaks Spanish to French people through the whole movie. :-D

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

    6. Re: Bilingual? by ozduo · · Score: 2

      My missus cant wait until it's cunnilingual

      --
      I got to the chocolate box before you, that's why the hard ones have teeth marks.
    7. Re:Bilingual? by Darinbob · · Score: 1

      Shhh, we're American over here.

    8. Re: Bilingual? by Anonymous Coward · · Score: 0
      My missus cant wait until it's cunnilingual

      Introduce her to Roomba

    9. Re:Bilingual? by bickerdyke · · Score: 1

      Hate to say so, but speaking was jumping the shark for Mr. Bean.

      --
      bickerdyke
    10. Re:Bilingual? by AmiMoJo · · Score: 1

      Shame it doesn't support Chinese yet too. For us the ideal would be English, Japanese and Chinese support so we can both use it in our native and common languages.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    11. Re:Bilingual? by Oswald+McWeany · · Score: 1

      Useless without Esperanto.

      --
      "That's the way to do it" - Punch
    12. Re:Bilingual? by Anonymous Coward · · Score: 0

      Bilingual?

      I do not think that word means what you think it means.

      It's right there in the summary. While Google may understand multiple languages, it only attempts to identify two languages: "You'll be able to set up Assistant to understand and respond to any two of the following languages"

      As for the person saying that Americans only speak one language, I have differing skill levels in 4: (American) English, Hawaiian Creole English (Pidgin), (Brazilian) Portuguese, and (Mexican) Spanish.

    13. Re:Bilingual? by arglebargle_xiv · · Score: 1

      Und wos is mid Weanerisch? Kinnts es deppn ned a so a Waidsprach ren, es Zniachtaln!

    14. Re:Bilingual? by dgatwood · · Score: 1

      Oui.

      --

      Check out my sci-fi/humor trilogy at PatriotsBooks.

  2. PRISM 2.0 by AHuxley · · Score: 1

    Gets to detect all the languages in a house for the security services.

    --
    Domestic spying is now "Benign Information Gathering"
    1. Re:PRISM 2.0 by ShanghaiBill · · Score: 1

      Gets to detect all the languages in a house for the security services.

      They can already make a good guess by looking at surnames.

    2. Re:PRISM 2.0 by AHuxley · · Score: 1

      Gets the unexpected guests and unregistered visitors, illegal immigrants too.

      --
      Domestic spying is now "Benign Information Gathering"
    3. Re:PRISM 2.0 by Anonymous Coward · · Score: 0

      Gets to detect all the languages in a house for the security services.

      They can already make a good guess by looking at surnames.

      What language does the Young family speak? Is Kim a Korean surname or an English given name? Does the Sosa family speak English, Spanish, or Portuguese? Lee is a populous surname in how many countries? How many immigrants maintained their surnames upon entering the US 100 years ago?

    4. Re:PRISM 2.0 by Anonymous Coward · · Score: 0

      "We're sorry, your citizenship was not detected. Calling integration with border patrol, prepare for deportation..."

  3. Merde. by Anonymous Coward · · Score: 0

    Zut alors.

    1. Re:Merde. by PPH · · Score: 1

      Oblig. Futurama.

      --
      Have gnu, will travel.
    2. Re:Merde. by Anonymous Coward · · Score: 0

      Does it know Bad English?
      'Cuz I only speak English and Bad English.

  4. Bilingual? Wouldnt that be more like multilingual? by Noishkel · · Score: 1

    Reading over the article it claims that this new update to Google Assistant can understand 6 languages.

  5. Re:Bilingual? Wouldnt that be more like multilingu by dgatwood · · Score: 1

    Two at a time.

    --

    Check out my sci-fi/humor trilogy at PatriotsBooks.

  6. BFD by Anonymous Coward · · Score: 0

    never used it. never will

    1. Re:BFD by ShanghaiBill · · Score: 1

      never used it. never will

      Yes you will. Sooner or later, voice input will be the only option for many services.

      You won't be able to withdraw money from an ATM without it recognizing your voice, nor will you be able to place an order with the robo-waitress at any restaurant.

  7. Recognizes other languages pointlessly. by whoever57 · · Score: 2

    The other day, the wife and I were watching a foreign language TV program. No dubbing, just subtitles. I think it was Swedish.

    Suddenly, Google Assistant on the wife's phone started. I have no idea what it heard that triggered it, but it wasn't English.

    Surely Google should know we speak English exclusively? So what's the point?

    --
    The real "Libtards" are the Libertarians!
    1. Re:Recognizes other languages pointlessly. by ShanghaiBill · · Score: 1

      Suddenly, Google Assistant on the wife's phone started. I have no idea what it heard that triggered it, but it wasn't English.

      Most likely it was triggered by some random string of phonemes.

      Surely Google should know we speak English exclusively? So what's the point?

      I watch mostly English movies, but my wife is Chinese so we occasionally watch movies in Mandarin. So Netflix sees that we like "foreign movies" and fills our recommendation list with French, Italian, and German movies, rendering it useless.

    2. Re:Recognizes other languages pointlessly. by bickerdyke · · Score: 1

      *lol*

      Remeinds me of Granny Weatherwax with the "generic foreign language".

      --
      bickerdyke
    3. Re:Recognizes other languages pointlessly. by AmiMoJo · · Score: 1

      Have you tried enabling Voice Match in the settings? Then it will only respond to your voice rather than random people or sounds.

      You can also disable voice wake up except for in certain circumstances, like when you are in the car using Android Auto.

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    4. Re:Recognizes other languages pointlessly. by swillden · · Score: 1

      Surely Google should know we speak English exclusively? So what's the point?

      It's unlikely that it perceived what it heard as another language. This new bilingual feature only works if you set it up, and only with the second language that you choose. More likely, it just heard some phonemes that triggered the "Ok Google" detection, and then couldn't figure out what followed.

      --
      Note to ACs: I usually delete AC replies without reading them. If you want to talk to me, log in.
    5. Re:Recognizes other languages pointlessly. by Anonymous Coward · · Score: 0

      I think that's just Americans lumping their films into two categories: Normal and foreign.

      You're artsy if you like foreign films.

    6. Re:Recognizes other languages pointlessly. by Anonymous Coward · · Score: 0

      Swedish is a lot like English.
      lampa = lamp
      soffa = sofa
      puss = kiss
      kock = chef

  8. Re:does this really matter? by Anonymous Coward · · Score: 0

    Americans are actually majority poor-to-middle-at-best, and Trump supporters are almost entirely brokedick white trash or filthy-rich shady oligarch types. You need to update your stats, the rich Trumpies speak pa Ruskie, comrade.

  9. Why stop... by Anonymous Coward · · Score: 0

    ...at just two languages?

    1. Re:Why stop... by TuringTest · · Score: 1

      How many do you speak?

      --
      Singularity: a belief in the "God" idea with the "demiurge" relation inverted.
    2. Re:Why stop... by Anonymous Coward · · Score: 0

      How many do you speak?

      I speak 4 languages, plus a few dialects of each.

  10. Google's Digital Assistant Is Now Bilingual by Sooner+Boomer · · Score: 1

    It understands both Ones AND Zeros!

    --
    Chaos maximizes locally around me.
  11. Re:does this really matter? by Anonymous Coward · · Score: 0

    Trump won all voting categories at $50K annual income and higher.
    Hillary won all voting categories under $50K annual income.

    The only true fact that can be taken from your statement is that you are an ignorant racist.

  12. Multi Lingual ? by Archfeld · · Score: 1

    Wonder if will speak Klingon, or better yet Tolkien Elvish.

    https://www.youtube.com/watch?...

    --
    errr....umm...*whooosh* *whoosh* Is this thing on ?
  13. damn it. by WindBourne · · Score: 1

    I really need Tamil for in-laws. They are in their 80s and it would be useful for them to be able to simply talk to turn on lights, etc.

    --
    I prefer the "u" in honour as it seems to be missing these days.
  14. Poles by Anonymous Coward · · Score: 0

    I wonder how well it's going to handle Poles speaking English and inserting "kurwa" every second/third word...

  15. Re:does this really matter? by WindBourne · · Score: 0
    --
    I prefer the "u" in honour as it seems to be missing these days.
  16. Read your own link and stop lying by CaffeinatedBacon · · Score: 0
    Did you even look at your own link?

    By income, Clinton led only among voters with a 2015 family income under $50,000 — a group that included 36% of the voters in the exit polls.

    So out of the 6 brackets Trump won the highest 4 and Hillary the lowest 2.

    PS: what's an 'economical bracket' anyway...

    PPS:Trump won the only category that matters, 'votes in the electoral college'.

    1. Re:Read your own link and stop lying by WindBourne · · Score: 0
      Again, porky/Red Tide,
      Did you suffer a nasty fall last year when you were 16? You really have reading and moral issues. All you do is LIE.

      Trump could not win a majority in economical brackets, except for 50-100K. In the end, trump won by having large numbers of uneducated vote for him, in the red states

      Show us the economical bracket where he won 51% or more. Here is a hint; good luck, idiot.

      Im guessing that you were that AC that originally had it wrong.

      --
      I prefer the "u" in honour as it seems to be missing these days.
    2. Re:Read your own link and stop lying by CaffeinatedBacon · · Score: 0

      You really have reading and moral issues. All you do is LIE.

      I already told you to go fuck yourself over this Windy. And showed how much of an immoral prick you are. Why are you still trying to push this nonsense idea of yours?

      You are still yet to show a single lie, yet you claim it all the time. You like to also claim any random AC is me, it's probably you. You are dishonest enough to pull that shit.

      I often point out your lies and lies more lies more lies even more lies lies and lies When you aren't lying, you are just making shit up that is in no way believable, and lying.

  17. Re:does this really matter? by Anonymous Coward · · Score: 0

    Trump won from White then not cities and then age. Hillary was only close because of poor and black people.
    Like you've been told many times. only the college counts anyway.

  18. Re:does this really matter? by WindBourne · · Score: 0

    Actually, Hillary won the popular vote, and since we do not have equal representation in our election, trump won the electoral vote, which is all that matters.

    --
    I prefer the "u" in honour as it seems to be missing these days.
  19. Marketing Genius !! by Anonymous Coward · · Score: 0

    Announced at the start of the school year.
    These guys are good.

    1. Re:Marketing Genius !! by Anonymous Coward · · Score: 0

      This helps -
      https://news.sky.com/story/brexit-prompts-surge-in-brits-signing-up-to-learn-languages-online-11485324

  20. Oh, so that's why it no longer works by piojo · · Score: 1

    The other day, I said something very simple to Google Assistant, and was rewarded with a string of 80% Chinese characters and 20% English words which I had not said. The English was probably wrong because it lacked context (as the rest of the sentence was flagrantly misparsed).

    Anyone know if I can opt out of this feature/bug? I assume they are viewing the world as their QA department, planning on the feature not working for a few years until they gather enough data to train the service to do a better job.

    --
    A cat can't teach a dog to bark.
    1. Re:Oh, so that's why it no longer works by bickerdyke · · Score: 1

      Anyone know if I can opt out of this feature/bug?

      Easiest way: Don't opt in.

      --
      bickerdyke
    2. Re:Oh, so that's why it no longer works by piojo · · Score: 1

      Anyone know if I can opt out of this feature/bug?

      Easiest way: Don't opt in.

      I did miss that in the summary, but in Asia (with an account created in the US) it seems to be the default to interpret in multiple languages. I most certainly never told Google Assistant that I speak Chinese, because I don't.

      --
      A cat can't teach a dog to bark.
  21. it's not funny to you because U don't know English by Anonymous Coward · · Score: 0

    Rich old white guys were probably quite economical. He probably didn't need to spend much at all to win them.

    You do know that if the red bar is bigger and the number is also bigger, they both mean he won more of that bit right?

  22. Re:does this really matter? by CaffeinatedBacon · · Score: 0

    She won the popular votes, has longer hair and bigger tits.
    Unfortunately for Democrats, those three things aren't how you work out who wins the Presidency.

  23. Bilingual Humans by mentil · · Score: 2

    This presumably helps with code-switching, which bilingual people tend to do all-the-freaking-time. They'll start a sentence in one language, forget how to say something in that language (or don't like how it sounds in that one), then switch to another, sometimes for only a few words before switching back.

    --
    Corruption is convincing someone that the selfless ideal is the same as their selfish ideal.
    1. Re:Bilingual Humans by swillden · · Score: 1

      This presumably helps with code-switching, which bilingual people tend to do all-the-freaking-time. They'll start a sentence in one language, forget how to say something in that language (or don't like how it sounds in that one), then switch to another, sometimes for only a few words before switching back.

      No, it isn't that clever yet. I just tried it with a few sentences of mixed English and Spanish, and every time it assumed that the entire sentence was in one language, correctly understanding the part that was in that language and finding something phonetically close (ish) for the rest.

      I think what it's doing is submitting your words in parallel to all three systems: LangID and the two systems for the languages you have selected. LangID returns its best guess at the language you used, then Assistant gives you the results from the corresponding system.

      --
      Note to ACs: I usually delete AC replies without reading them. If you want to talk to me, log in.
  24. Google is a weitrd company. by Anonymous Coward · · Score: 0

    Their voice search is multilingual, and has been for years and years. Without attracting any drums and fanfare.

  25. Finally by Anonymous Coward · · Score: 0

    This means that Google Assistant will flirt with me no matter which gender voice it uses!

  26. Re: does this really matter? by Anonymous Coward · · Score: 0

    Who cares about some weirdo jibber jabber language when everyone civilized speaks English?

    The word you were looking for is 'civilised'. You abase those who don't speak English when you can't speak it correctly yourself.

  27. Cute idea, but... by bradley13 · · Score: 1

    It's a cute idea, with an obvious implementation (running both language modules simultaneously). Presumably, part of the input into the language ID is also seeing which language module is successfully making sense of the input.

    However... We have a bilingual household (English/German), and part of the reality is also that the languages get mixed. There is always some word in the "other" language that is handy, or maybe you just can't find the word you're looking for. If you're free to talk to your devices in either language, then you will unvermeidlich talk to them in beide Sprachen (inevitably talk to them in both languages). And that will be a lot more challenging...

    --
    Enjoy life! This is not a dress rehearsal.
  28. Re:does this really matter? by Anne+Thwacks · · Score: 1
    If they ahve Dollars, they probably speak American. That is not English by a very long mile.

    I speak very standard (Cambridge) English and none of the IVR systems I encounter ever understands me. However, everywhere I have ever worked (more than 30 different companies), people from all different backgrounds reported that I was the easiest to understand of all the people they had ever met.

    I, on the other hand, cannot understand the dialogue in a lot of American movies, to the extent that I rarely watch any (not even pirate ones).

    --
    Sent from my ASR33 using ASCII
  29. WindBourne's fact check - FOOLISH LIAR by Anonymous Coward · · Score: 0

    lie - Trump did win

    verdict - didn't read/understand own link

  30. Re:does this really matter? by Anonymous Coward · · Score: 0

    Having lived in both the UK and US with an oriental parent who spoke broken English, I have no problem understanding anyone speaking English anywhere in the world, except lower-class black Americans.

  31. WindBourne's fact check - DISHONOURABLE LIAR by Anonymous Coward · · Score: 0

    lie / false accusation - liar is WindBourne
    lie / idiocy / didn't read link - Trump did win more

    verdict - dishonourable foolish liar

  32. WindBourne's fact check - TROLL by Anonymous Coward · · Score: 0

    deceitful - pretending to correct, when agreeing

    verdict - dishonourable troll

  33. So it's really hexa-lingual by nospam007 · · Score: 1

    But it refuses to work in more than 2 languages?

    1. Re:So it's really hexa-lingual by bickerdyke · · Score: 1

      I think it's even more than those 6, but you can pick 2 out of these 6 that you will be able to use without manually switching the input language.

      In other words, these aren't the languages that are understood, but the ones that will be recognized. Which is quite a different thing if you keep in mind that current language recognition is based on a fixed dictionary and picking the word from it that comes closest to what the computer just heard.

      --
      bickerdyke
  34. Re:does this really matter? by bickerdyke · · Score: 1

    What do you call someone who speaks two languages?

    Bilingual.

    And what do you call someone who speaks only one language?

    American!

    --
    bickerdyke
  35. Re:does this really matter? by CaffeinatedBacon · · Score: 0

    Found the buthurt Democrat with modpoints who doesn't understand how the electoral college works.

  36. Re:Bilingual? Wouldnt that be more like multilingu by Anonymous Coward · · Score: 0

    Still multi- in that it can understand a total of more than two.

  37. Re:does this really matter? by quenda · · Score: 1

    If they ahve Dollars, they probably speak American. That is not English by a very long mile.

    Americans are a lot closer to standard English than some of the rural British accents. Even a working-class Glasgow or Newcastle accent is a lot tougher than 90% of Americans to understand for me.

  38. Re:does this really matter? by quenda · · Score: 1

    Having lived in both the UK and US with an oriental parent who spoke broken English, I have no problem understanding anyone speaking English anywhere in the world, except lower-class black Americans.

    That'd be a variant of a Southern accent? If you go to the rural South, you'll hear white folk talkin' same way.
    But I do remember in Chicago really struggling, embarrassed, to understand the working-class black accents, while they understood my foreign accent perfectly.
    Just like in rural Ireland.

  39. Re:does this really matter? by quenda · · Score: 1

    And what do you call someone who speaks only one language?

    American!

    Or Australian. At least the Americans find Spanish a bit useful.

  40. Re:does this really matter? by RogerWilco · · Score: 1

    I've heard quite a few linguists argue that "Ebonics" is a separate language from (American) English, with often a different grammar.
    None of the ones I know seem to have any kind of racial agenda, just observing an interesting linguistic phenomenon of a new language being created.

    When I'm in the US I also notice a large difference between the languages of people with different ethnical backgrounds, which seems to mean that the society is much more segregated than in for example my own country.

    --
    RogerWilco the Adventurous Janitor