Slashdot Mirror


Deep Learning 'Godfather' Yoshua Bengio Worries About China's Use of AI (bloomberg.com)

An anonymous reader quotes a report from Bloomberg: Yoshua Bengio, a Canadian computer scientist who helped pioneer the techniques underpinning much of the current excitement around artificial intelligence, is worried about China's use of AI for surveillance and political control. Bengio, who is also a co-founder of Montreal-based AI software company Element AI, said he was concerned about the technology he helped create being used for controlling people's behavior and influencing their minds. Bengio, a professor at the University of Montreal, is considered one of the three "godfathers" of deep learning, along with Yann LeCun and Geoff Hinton. It's a technology that uses neural networks -- a kind of software loosely based on aspects of the human brain -- to make predictions based on data. It's responsible for recent advances in facial recognition, natural language processing, translation, and recommendation algorithms.

"This is the 1984 Big Brother scenario," he said in an interview. "I think it's becoming more and more scary." "The use of your face to track you should be highly regulated," Bengio said. The amount of data large tech companies control is also a concern. He said the creation of data trusts -- non-profit entities or legal frameworks under which people own their data and allow it be used only for certain purposes -- might be one solution. If a trust held enough data, it could negotiate better terms with big tech companies that needed it, he said Thursday during a talk at Amnesty International U.K.'s office in London. Bengio said there were many ways deep learning software could be used for good. In Thursday's talk, he unveiled a project he's working on that uses AI to create augmented reality images depicting what people's individual homes or neighborhoods might look like as the result of natural disasters spawned by climate change. But he said there was also a risk that the implementation of AI would cause job losses on a scale, and at a speed, that's different from what's happened with other technological innovations. He said governments needed to be proactive in thinking about these risks, including considering new ways to redistribute wealth within society.

53 comments

  1. Did anyone else... by Lab+Rat+Jason · · Score: 1

    ... read that name as "B - I - N - Gi -O"?

    --
    Which has more power: the hammer, or the anvil?
    1. Re:Did anyone else... by antdude · · Score: 1

      BINGO! :P

      --
      Ant(Dude) @ Quality Foraged Links (AQFL.net) & The Ant Farm (antfarm.ma.cx / antfarm.home.dhs.org).
    2. Re:Did anyone else... by Anonymous Coward · · Score: 0

      No, Rat Shit Jason.

    3. Re:Did anyone else... by Hognoxious · · Score: 1

      Sounds like one of those dot com companies that went tits-up in the 1990s. So does his other name, in fact.

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
  2. They are truning into Nazi Germany tie to cut them by Joe_Dragon · · Score: 0

    They are truning into Nazi Germany tie to cut them down with a new trade deal.

  3. How to stay comfy while defeating the State by SuperKendall · · Score: 1

    One thing I don't get about China's plan, it seems worrying but also kind of easily gamed - like you could go around in a hood or those face matching block patterns on normally, but just sometimes go out plain-faced doing good deeds to raise your score.

    The face blocking pattern stuff could well get you arrested, but China is not arresting everyone with a hood pulled up are they? That seems unrealistic.

    --
    "There is more worth loving than we have strength to love." - Brian Jay Stanley
    1. Re:How to stay comfy while defeating the State by Anonymice · · Score: 2

      China is not arresting everyone with a hood pulled up are they? That seems unrealistic.

      Perhaps not today, but it wouldn't be a surprising development. France already has a ban on headwear that covers the face, in public places, & I doubt it's the only place with such legislation.

      And China doesn't even need to track its citizens via CCTV. It's already starting to mandate that citizens keep mandated tracking software installed on their phones. Mandating the constant possession of a phone, as the States' does with IDs, would be a logical next step.

    2. Re:How to stay comfy while defeating the State by chuckugly · · Score: 2

      .... as the States' does with IDs ....

      Citation needed.

    3. Re: How to stay comfy while defeating the State by Anonymous Coward · · Score: 0

      They can mandate it, unlike western countries

    4. Re:How to stay comfy while defeating the State by ShanghaiBill · · Score: 2

      China is already starting to mandate that citizens keep mandated tracking software installed on their phones.

      Do you have a citation for this? RFIDs are required in all cars, but I have never heard of such a requirement in phones.

      Mandating the constant possession of a phone

      They don't need to mandate this. Nobody in China would even think about leaving home without their phone.

    5. Re:How to stay comfy while defeating the State by SuperKendall · · Score: 2

      Even the law against headwear that doesn't block your face, doesn't seem like it would apply to hoodies - you can have them pulled up so people at face level can still see your face, but a CCTV (generally mounted up at street light level) could not.

      The phone tracking software would practically eliminate such resistance though as few would be willing to go around without phones, and in many modern societies it would be hard to not have the phone on hand for payments...

      --
      "There is more worth loving than we have strength to love." - Brian Jay Stanley
    6. Re:How to stay comfy while defeating the State by Anonymous Coward · · Score: 0

      So they keep track of terrorists? Who doesn't these days?
      Oh it's a slippery slope, just like if Facebook gets enough data on you it will eventually turn evil.

    7. Re: How to stay comfy while defeating the State by phantomfive · · Score: 1

      In the united states you don't need to carry an id. You need to carry your driver's license if you are driving but that is state dependent. I didn't have an id until after I was an adult, and even now I don't carry it with me most of the time.

      --
      "First they came for the slanderers and i said nothing."
    8. Re:How to stay comfy while defeating the State by Anonymous Coward · · Score: 0

      Perhaps not today, but it wouldn't be a surprising development. France already has a ban on headwear that covers the face, in public places, & I doubt it's the only place with such legislation.

      We need that in my city. Too many fucking burqas. And we're supposed to be a country that "respects women".

    9. Re:How to stay comfy while defeating the State by AmiMoJo · · Score: 1

      So far it's only for people they are actively persecuting: https://www.rfa.org/english/ne...

      --
      const int one = 65536; (Silvermoon, Texture.cs)
      SJW, n: "Someone I don't like, and by the way I'm a fuckwit" - AC
    10. Re:How to stay comfy while defeating the State by TheCastro1689 · · Score: 1

      Try to get anything done without some form of identification, that's what the other comment means. Sometimes you can get away with it, but most places require something. At least in person. Then there are stop and identify laws in several states. Then States with Voter ID laws give away free IDs in many cases. Some cost $25.

    11. Re:How to stay comfy while defeating the State by chuckugly · · Score: 1

      Then there are stop and identify laws in several states.

      What might be required before another private party wishes to engage in or facilitate a voluntary exchange is not the point. Stop and identify laws are not (1) applicable in the general case and (2) don't require a person to carry ID in any case.

    12. Re:How to stay comfy while defeating the State by Areyoukiddingme · · Score: 1

      One thing I don't get about China's plan, it seems worrying but also kind of easily gamed - like you could go around in a hood or those face matching block patterns on normally, but just sometimes go out plain-faced doing good deeds to raise your score.

      The face blocking pattern stuff could well get you arrested, but China is not arresting everyone with a hood pulled up are they? That seems unrealistic.

      What's interesting is Chinese people are way ahead of the government in this instance. All of southeast Asia and China too has already normalized wearing a face mask in public, to "prevent the spread of disease" and "filter out pollution". I suspect it does little or nothing to change the rate of spread of most diseases, or filter pollution, but it does wonders for concealing a huge chunk of your face.

      A small piece of the impetus behind China's newfound zeal for reducing air pollution might be to eliminate that excuse for hiding the face.

    13. Re:How to stay comfy while defeating the State by SuperKendall · · Score: 1

      That is a really excellent point, that they have normalized common wearing of face masks across Asia... I had totally forgotten about that! I just figured masks were right out but respiratory masks are very common as you say. That combined with a little non-obvious eye makeup and a bit of gait adjustment and you should be well-hidden.

      --
      "There is more worth loving than we have strength to love." - Brian Jay Stanley
  4. Re: They are truning into Nazi Germany tie to cut by Anonymous Coward · · Score: 0

    Job losses are the big problem. Regulation is necessary so employees can have confidence that their jobs wonâ(TM)t go away. It is really that simple. If a robot is particularly good at flipping burgers, well then find job training for people who work in fast food. I suppose people will grumble and say well there are all kinds of fast food. Just because a robot can make one kind of food why do you think it can make another? OK sure, but if you surveyed people with some experience in AI and burger flipping, I bet they would be able to tell you very quickly what jobs might be disrupted. But I digest

  5. oh oh by WindBourne · · Score: 0

    We are going to see China send all of its trolls here to speak against it and tell us how China is done wonders for the world.
    Come on Caffeinated Bacon/Crimson Tsunami. Make your masters PROUD.

    --
    I prefer the "u" in honour as it seems to be missing these days.
    1. Re:oh oh by Anonymous Coward · · Score: 0

      your master is truly PROUD for you

    2. Re:oh oh by Ol+Olsoc · · Score: 0

      We are going to see China send all of its trolls here to speak against it and tell us how China is done wonders for the world. Come on Caffeinated Bacon/Crimson Tsunami. Make your masters PROUD.

      Don't forget the But 'MURRICA! Squad. China can be harvesting prisoners organs, but 'Murrica something, something!

      --
      The shepherds did so well protecting the flock that the sheep no longer believed that wolves existed.
    3. Re: oh oh by Anonymous Coward · · Score: 0

      No master we are proud of YOU. After years of abuse for whipping us, we have finally cleared your name. In fact, that was not a whip at all. It was just you slapping us with your hand

    4. Re: oh oh by Anonymous Coward · · Score: 0

      No, your masters are DISPLEASED with you. Better give up your daughter now!

    5. Re:oh oh by Anonymous Coward · · Score: 0

      It's proud of you...
      It's funny when WindBourne mangles English, because he's pretending to be a native speaker.
      'is done wonders' LOL

      But when Ivan's like you you do it in response to stir the pot. It just looks like no Americans understand English.
      How can we single him out for ridicule if everyone does it?

    6. Re:oh oh by Anonymous Coward · · Score: 0

      We are going to see China send all of its trolls here to speak against it and tell us how China is done wonders for the world.

      Come on Caffeinated Bacon/Crimson Tsunami. Make your masters PROUD.

      Don't forget the But 'MURRICA! Squad. China can be harvesting prisoners organs, but 'Murrica something, something!

      Children using dangerous "Freeze peach" don't have a right to be treated as whatever gender they fancy today. I'll never go there but KNOW the US is an authoritarian hellscape. --AmiMoJo probably.

    7. Re:oh oh by Anonymous Coward · · Score: 0

      We are going to see China send all of its trolls here to speak against it and tell us how China is done wonders for the world.

      Come on Caffeinated Bacon/Crimson Tsunami. Make your masters PROUD.

      China's standpoint is irrelevant, they're a totalitarian cabalist shithole without actual laws or rights. Go move there and find out, Libertarian morons. Seriously educate yourself about the differences in our systems...
      oops sorry...

      Windbourne

  6. Face tracking is not the biggest threat by hackingbear · · Score: 4, Insightful

    Face tracking is not the biggest threat. The biggest erosion of personal freedom in China is this one: WeChat Pay.

    Why? Before the advent of WeChat and Alipay, China was mostly a cash based society, so the government had little knowledge of your payment transactions. Which is why China has to rely on state-owned enterprises for revenues, since there were no effective way to collect taxes from ordinary people and 95% of Chinese do not file a tax report.

    Now, that's all changed: everything is paid via WeChat and Alipay, even pant handlers. So every transaction can be tracked, and taxed.

    Of course, in the U.S., people have been on checks and credit cards for who knows how many decades. China is catching up fast on that front.

    1. Re:Face tracking is not the biggest threat by ShanghaiBill · · Score: 1

      China is catching up fast on that front.

      No, China is not catching up, they are way ahead. I was in Shanghai for 8 weeks in Sept and Oct, and I don't think I saw anyone use cash for anything even once.

      Even the bums on the street have QR codes on their signs. Just scan it with your phone to donate.

    2. Re:Face tracking is not the biggest threat by Anonymous Coward · · Score: 0

      LOL Americans can't even do chip and pin properly. And what kind of backwards ass country uses cheques?
      China isn't catching up, they leapfrogged straight past you years ago.

      Businesses paid the tax when they paid your wages, same as any country. No need to file tax unless you are trying to claim 'deductions/tax breaks/loopholes'. Why do you need to file again? Doesn't the Govt already know everything about you? Just tempting you to lie, so they have something on you later if needed.

    3. Re:Face tracking is not the biggest threat by Anonymous Coward · · Score: 0

      ... no effective way to collect taxes ...

      You complained more about taxes than the Big Brother aspects of this policy. So your complaint is your reduced ability to commit the crime of tax evasion. There's a lot of opportunity for abuse when a government demands money but that doesn't entitle you to avoid paying taxes.

    4. Re:Face tracking is not the biggest threat by hackingbear · · Score: 1

      While people in the West value more, or brainwashed to value more, about freedom of speech. Chinese people value the freedom of everyday activities more. That's why China does not have millions of lines of legalese fine-prints like in the US.

  7. "Charity Begins in the Home" by PolygamousRanchKid+ · · Score: 0

    . . . or in the case of Canada, the neighbour's home next door; the USA.

    is worried about China's use of AI for surveillance and political control

    "is worried about the USA's use of AI for surveillance and political control"

    Who knows what experiments the DHS, NSA, CIA, FBI and their pals are performing with this technology . . . ?

    Back to Canada . . . I can't imagine that this would be used by the Royal Canadian Mounted Geese.

    --
    Schroedinger's Brexit: The UK is both in and out of the EU at the same time!
    1. Re:"Charity Begins in the Home" by Anonymous Coward · · Score: 0

      Beaver surveillance?

    2. Re:"Charity Begins in the Home" by Anonymous Coward · · Score: 0

      All governments want to do, AND DO, this. Why do you think Android, Windows 10, Facebook, Twitter, etc, are the privacy nightmare they are? Because they business is NOT to sell you phones, operating systems or serving ads. It is working for the government. There's no other way these SUPER SHITTY companies with SUPER SHITTY products would survive in a real free market.

  8. oh wow. this. this carbon copy post by Anonymous Coward · · Score: 0

    it is like the parent post reached through a dozen Xerox carbon copies before transliterating to Slashdot troll material. Who on planet earth would put a flesh and blood creature through an endless carbon copy press? who? ah ha! you must be Chinese! i can smell the Government accreddited mental illness book all over you like i can smell the burning hair from North Korea government approved haircuts poster.

    Chinese all look and sound the same, nondiversity there!

  9. I was worried more about the beat-downs by Spy+Handler · · Score: 1

    like, government goons physically beating the shit out of you. And also imprisoning you for having the wrong opinions. Oh and harvesting your organs while you're imprisoned. Yeah that's a thing in communist China, they take your organs out.

    But if you're a sheltered computer guy then yeah the government snooping on you via the internets and AI face recognition might be pretty scary too.

    1. Re:I was worried more about the beat-downs by Anonymous Coward · · Score: 0

      You sir, are the classic, stereotypical victim of anti-communist propaganda. Your brain has already been harvested, in situ.

  10. pant handlers... checking... by Anonymous Coward · · Score: 0

    nothing. Aah, pan-handlers. Got it. I was sort of thinking that pant handlers be a direct translation of a Chinese euphemism for the worlds oldest profession.

  11. WeChat Pay and no cash by aberglas · · Score: 4, Insightful

    Indeed, you control a lot when you control all cash transactions. In the west, there is a least some privacy, even from governments. But in China they actually boast about how much they can help the government monitor people.

    This then gets combined with complete control over all communications. That is where AI comes in. To monitor people's emails and worse phone calls is not practical to do except for specific suspects. But AI can do a lot of this automatically, particularly voice recognition. And mobile phones now give the government knowledge of where people are at all times. And then this vast amount of data can be correlated -- e.g. that two people in these groups lived near each other 20 years ago...

    It would be very difficult to quietly organize any grass roots movement about anything in China today without approval from the government. There are some, e.g. people were complaining about some groups eating dogs. But anything to do with the government, like complaining about a school that collapased during an earthquake, is not possible.

    Where it gets scary is that Xi Jinping is also talking about nationalism. He has the South China Sea. He wants Taiwan. And nobody on the ground nor in the citadel could stop him if he started doing crazy things.

    History does not exactly repeat itself, but we do know what this type of thinking resulted in Germany in the 1930s. And Xi is far more entrenched in China than Hitler was before he invaded France. (Hitler faced substantial internal opposition before France.)

    1. Re:WeChat Pay and no cash by Anonymous Coward · · Score: 0

      I don't think Xi is a threat, you're right he has minor regional ambitions, but these are really small fry compared to the ambitions of, say, Russia which is actually invading and annexing it's neighbours (Ukraine, Georgia, and Azerbaijan), as well as countries that aren't even it's neighbours but it believes it has an imperialist right to own (Armenia, Moldova).

      China's problem is that there is too much internal resistance. The South China sea is an easy target because it's undefended and there's no one really to resist island building and military buildup, but if he refocused his military towards Taiwan he'd likely lose Xinjiang province, and Tibet, or at least face an expensive and harmful civil war in those regions. China's stability, and hence it's strength, is currently predicated on calm single-mindedness towards continued economic growth.

      If you're worried about harmful nationalism, I'd be more worried about Trump, Putin, or the rising number of nationalist European leaders like Viktor OrbÃn and Alexis Tsipras, or those waiting in the wings like Nigel Farage, or Marine Le Penn. That's where the real threats are, Xi is small fry in comparison.

  12. TRANSLATION (IMHO)!!! by Anonymous Coward · · Score: 0

    "All governments are EVIL!!! They are SPYING ON EVERYONE!!! 1984 Big Brother!!! & They are "controlling people's behavior and influencing their minds"!!! Your own government should/must not authority to do anything!!! LET'S TURN THE WHOLE INTERNET TO DARK WEB (so EVIL GOVERNMENTS CANNOT CATCH ANY CRIMINALS ANYMORE)!!! Who is with us ANTI-GOVERNMENT ANARCHISTS??? (PS: Don't forget to wear your thin foil hats @ ALL TIMES!!!)"

    IMHO, if any scientist(s) discovered/invented any tech (using public/government money?), is that gives them to right to decide who & how can use that tech, for all future times & @ whole world???

  13. Out come all the usual trolls. by Anonymous Coward · · Score: 0

    Out come all the usual trolls.

  14. Re:They are truning into Nazi Germany tie to cut t by Anonymous Coward · · Score: 0

    Watch dyslexia, twice.

  15. A more deep AI would alternate his mind sooner, on by Anonymous Coward · · Score: 0

    I'm an Chinese person.

  16. Favourtism by Anonymous Coward · · Score: 0

    ... the 1984 Big Brother scenario.

    IIRC, in 2018, at least 2 European cities (London was one) claimed to deploy MAC- or face-tracking technology but he didn't complain when they did it.

  17. hypocrit by SuperDre · · Score: 1

    Well, he could have know this would happen when he created the technology/theories. Also China is using it publicly, but it isn't the only country using that technology, you can bet your sweet ass that the US is also using it in the NSA/CIA offices.
    He should have known that his creation would be used for these kind of purposes, and he also got funding by a lot of these agencies. But he didn't mind it at that time.. Yes it will be used to control people, but it will also be used for the benefit of people, just like any other technology.
    He's just a hypocrit for only commenting on it now.

    1. Re:hypocrit by Anonymous Coward · · Score: 0

      It could be a case of regret rather than hypocrisy. Naiveté is a hell of a thing. Some scientists honestly think their inventions will improve the world, not enslave it, especially in the case of double-edged swords like AI.

      Even Oppenheimer had regrets. "I am become Death, destroyer of worlds."