Slashdot Mirror


How Canada Ended Up As An AI Superpower

pacopico writes: Neural nets and deep learning are all the rage these days, but their rise was anything but sudden. A handful of determined researchers scattered around the globe spent decades developing neural nets while most of their peers thought they were mad. An unusually large number of these academics -- including Geoff Hinton, Yoshua Bengio, Yann LeCun and Richard Sutton -- were working at universities in Canada. Bloomberg Businessweek has put together an oral history of how Canada brought them all together, why they kept chasing neural nets in the face of so much failure, and why their ideas suddenly started to take off. There's also a documentary featuring the researchers and Prime Minster Justin Trudeau that tells more of the story and looks at where AI technology is heading -- both the good and the bad. Overall, it's a solid primer for people wanting to know about AI and the weird story of where the technology came from, but might be kinda basic for hardcore AI folks.

64 comments

  1. It’s because they prounce AI as Eh. by Anonymous Coward · · Score: 0

    And they are a superpower of the word Eh.

    1. Re:It’s because they prounce AI as Eh. by DontBeAMoran · · Score: 4, Funny

      Oh, you mean Eh Aye, eh?

      --
      #DeleteFacebook
  2. Probably because they didn't just cut funding by rsilvergun · · Score: 2

    when it wasn't profitable on a 5 year timescale like they do here in the states.

    --
    Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
    1. Re: Probably because they didn't just cut funding by Anonymous Coward · · Score: 0

      And now we can leverage their work for free. The first to market doesn't always win. That's facebooks strategy for sure (copy or buy the success of others).

    2. Re: Probably because they didn't just cut funding by Anonymous Coward · · Score: 0

      And America probably has patents around this and that, even if its mathematics or formula driven. Thus America patents AI in a car, AI in a TV set, AI in emission computers(sorry VW had it first) and AI in the human brain. And liquid AI, also known in the trade as diarrhoea.

      The only issue is Israel and the Ukraine are profiting from AI better., if automatic guns to protect school perimeters is the solution.

  3. How many large Canadian AI companies are there? by Anonymous Coward · · Score: 0

    How much of the proceeds go to Canada?

    Canada isn't an 'AI superpower'. It's a pleasant storage facility for AI researchers working in the service of the American economy.

    1. Re:How many large Canadian AI companies are there? by Anonymous Coward · · Score: 2, Informative

      Plus, Yann LeCun never went to Canada long term. He was at NYU and now is at Facebook heading up their AI division. Hinton is split between Google and UOFT. The headline and summary are a bit overblown.

    2. Re:How many large Canadian AI companies are there? by Anonymous Coward · · Score: 0

      The headline and summary are a bit overblown.

      Never let facts get in the way of a good story.

  4. Just like Canada did Avro Arrow? by AHuxley · · Score: 2

    Lots of really smart people attracted to doing advanced things in Canada does not result in a product people need later.
    https://en.wikipedia.org/wiki/...
    But its all fun in Canada doing AI until then.
    Could it be like the MCM/70 https://en.wikipedia.org/wiki/... with Canada doing pioneering AI work?

    --
    Domestic spying is now "Benign Information Gathering"
    1. Re:Just like Canada did Avro Arrow? by Anonymous Coward · · Score: 0

      Lots of really smart people attracted to doing advanced things in Canada does not result in a product people need later.

      https://en.wikipedia.org/wiki/...

      But its all fun in Canada doing AI until then.

      Could it be like the MCM/70 https://en.wikipedia.org/wiki/... with Canada doing pioneering AI work?

      I completely agree. Yes, there is some great education but the problems arise down the road. Excessive personal and corporate tax with a bleak VC space.

    2. Re:Just like Canada did Avro Arrow? by dryeo · · Score: 1

      Yes, America pressured Canada to drop the Arrow, that way getting a bunch of engineers to work with their Germans to build Apollo and also so they can forever bitch about Canada not doing enough for defence. Same thing happened earlier with nukes.

      --
      https://en.wikipedia.org/wiki/Inverted_totalitarianism
    3. Re:Just like Canada did Avro Arrow? by Anonymous Coward · · Score: 0

      You're right, Canadian Nuclear talent is a largely unknown story, and sidelined by the US. There's one about a particular scientist that was able to figure out the hardest problem facing the Manhatten Project inside of a weekend, before tossing his notes once satisfied.

      Another is the CANDU reactor tech. So efficient that reactors from the 70s and 80s can still be retrofitted to burn nothing but the waste of existing reactors.

      Canadian engineers also created thorium burning reactors and efficient small reactors (nuclear batteries) by the 80s, but nobody cared.

    4. Re: Just like Canada did Avro Arrow? by Anonymous Coward · · Score: 0

      Source?

    5. Re:Just like Canada did Avro Arrow? by Anonymous Coward · · Score: 0

      Corporate tax has, until recently, been lower in Canada than in the US. Personal taxes also aren't much higher. Consumption taxes, however, are higher. But companies do not pay consumption taxes so this should not affect startups. The problem in Canada is the bleak VC space and it is bleak because of our culture. Specifically, Canadians are more risk adverse than Americans on average. That leads to less business ventures and less venture capital. The little that we do have becomes enamored with the US because the market is right next door, much more robust, and has a lot more opportunity due specifically to its market size. Canada can not be competitive unless they develop an anti-american world view to the same extent as Iran or a buy Canadian world view to the same extent as the US. Both of those options would probably make the average Canadian worse off under our current world order. Basically, a small and insignificant country such as our own is better off being a vassal state of the US.

  5. Is A.I. Ready for Prime Time? by LifesABeach · · Score: 0

    Can I download an A.I. program and have it help me with my tasks and issues? It has to be general purpose in nature, and adaptable to a single person's world view point. It has to constructively inform. From what I can see, A.I. is not there, yet.

    1. Re:Is A.I. Ready for Prime Time? by Anonymous Coward · · Score: 0

      You can try Wolfram Alpha:
      https://www.wired.com/story/ai-is-making-it-extremely-easy-for-students-to-cheat/

      It seems to be good enough for students - sort-of Google on steroids.

    2. Re:Is A.I. Ready for Prime Time? by Anonymous Coward · · Score: 0

      Can you fly to another planet? Guess space technology is not there yet.

    3. Re:Is A.I. Ready for Prime Time? by John.Banister · · Score: 1

      Lots of prime time computing doesn't run on your hardware. Can everyone with internet access connect to an AI and get it to help with daily tasks and issues? I think we do. Frequently, the daily tasks and issues with which these AIs help are not our own.

    4. Re:Is A.I. Ready for Prime Time? by DontBeAMoran · · Score: 1

      Sure I can.

      I just need to redefine the word "planet" to "city".

      --
      #DeleteFacebook
    5. Re:Is A.I. Ready for Prime Time? by LifesABeach · · Score: 1

      Can you suggest a source to try?

    6. Re:Is A.I. Ready for Prime Time? by LifesABeach · · Score: 1

      The kinds of questions I have are a little bit more, cost orientated. Currently I am very interested in topics like Health Care, Auto topics, and Taxes. I guess maybe Wolfram has already solved those singular issues. But it's the questions I will have that A.I. needs to be able to solve for that I would measure usefulness by.

    7. Re: Is A.I. Ready for Prime Time? by Anonymous Coward · · Score: 0

      "AI isn't AI unless it can solve what I want it to solve"

      - that's basically what you just said.

    8. Re:Is A.I. Ready for Prime Time? by Anonymous Coward · · Score: 0

      Word processors help you do automatic paragraph formatting and page layout. Laser printer do automatic font generation and scaling. Those two tasks required an entire print department consisting of hundreds of people. Now there are applications that can automatically generate custom newspapers from news feeds and a specification consisting of region and news topics.

    9. Re:Is A.I. Ready for Prime Time? by John.Banister · · Score: 1

      I don't think I communicated correctly. I don't know of anyone renting general access to their AI for it to perform various tasks like an AI MTurk. However, all the usual network services that people use every day are using prime time AIs to help with the service they perform for you. Google has AIs to decide what you're thinking of when you write search terms and what to show you when you visit Google News. Facebook has AIs to decide what advertising to show you. When you talk to a virtual assistant, there's AIs helping to try and get the assistant to do what you say, and helping to decide what advertisements your requests suggest would be best to throw your way when you're at a site with advertisers that pay for the AIs' suggestions. I feel confident that they're using AIs to help make catchpas that other AIs can't defeat. IBM bought the digital part of The Weather Channel so that they could use its data for selling weather predicting services of its AI. Here's an article telling how more than 100 web services are using Watson instances to power apps and other online business. Here's another article telling how Ross Intelligence is using a Watson to help lawyers act like they've read all the recent decisions. Eviebot and Cleverbot will chat with you. None of these are at the level of science fiction AIs, but they are providing actual value to their owners, and often to the customers of their owners.

    10. Re:Is A.I. Ready for Prime Time? by LifesABeach · · Score: 1

      This is really cool to consider various A.I.'s that are in use today by businesses; for commerce. The subtle application I am in search of is an A.I. that does not represent some mercantile oriented transaction; but as a 3rd party observer in nature. As any observer of elementary economics will agree, "Customers" are the other half of the economic cycle. My search is for a Customer positioned solutoin.

    11. Re:Is A.I. Ready for Prime Time? by LifesABeach · · Score: 1

      Poor A/C, these are solved issues. A.I. is a method, that solves questions, not just issues. Nor would this A.I. be closed source.

    12. Re:Is A.I. Ready for Prime Time? by John.Banister · · Score: 1

      Is Watson beyond your budget?

  6. stop talking about spygate by Anonymous Coward · · Score: 0

    all these spygate revelations this morning... cant we censor the truth sbout Professor Stefan Halper? Shhhhh!

  7. Neural networks by 110010001000 · · Score: 1

    It is funny to see the industry still trying to flog neural networks. Pathetic.

    1. Re:Neural networks by Anonymous Coward · · Score: 0

      Hinton we would kind of agree except that neural networks have been at the heart of the most recent AI breakthroughs and there's been no shortage of trying, hoping that other methods would produce better results.

    2. Re:Neural networks by Anonymous Coward · · Score: 0

      What break through? They edged out the statistical methods by a small margin for a bit, woohoo ... lets see how long it will last.

      The huge investments in surveillance and consumer datamining aren't caused by any break through. It's just a confluence of cheaper computing, growth of advertising based internet firms, multiculturalism, global instability, etc.

      For all the good press ANNs get, it's an awfully scummy business to be in if you look at the applications.

    3. Re:Neural networks by Anonymous Coward · · Score: 0

      Oh I don't know, above human performance in tasks such as voice recognition?

      Just about any technology can be used for evil. Ban plastic knives?

    4. Re:Neural networks by Anonymous Coward · · Score: 0

      Are you already coming out with your quantum lattice based AI, that learns geometrically and will reach self-awareness at 2004 with its cool 50 TFlops of computing power?

    5. Re:Neural networks by Anonymous Coward · · Score: 0

      What is making more money, ANNs which do voice based identification for end users or ones which provide yet another identification input for building profiles of people?

      I'm not saying it should be banned, but the field shouldn't be put on a pedestal. Recognize it for what it is, the premier technology behind the surveillance society.

    6. Re:Neural networks by Anonymous Coward · · Score: 0

      It is funny to see the industry still trying to flog neural networks. Pathetic.

      The problem with neural networks isn't neural networks per se, but a lack of memory and computing power.

      We're reaching a point where neural networks can do quite sophisticated voice and image analysis on medium and high performance home computers.

      As an analogy, I remember how the consensus on Slashdot was that tablet computers would never become popular and mainstream after the market failures of various Apple and Microsoft tablet products.

      That is until CPUs and memory became small enough and powerful enough to create the first successful tablet products and since then tablets and smartphone have left desktop PCs in the dust.

  8. One word, immigration by Anonymous Coward · · Score: 0, Troll

    More money == more taxes == more funding

    Canada has an extremely open policy wrt immigration to the point it favours them over native Canadians. Why this matters is we've had a _massive_ flow of them from quite wealthy families especially in Muslim countries (India being one of the larger sources). While the GTA (Greater Toronto Area) is typically on the news it does not reflect Canada. It's what happens when natives flee and you can see it sprawl to places like Waterloo. They came in, bought up everything and have been forcing everyone else out. The money itself comes in large part from guaranteed financial sectors.

    TLDR; yes, our Universities rock. But not for reasons you think. Trudeau and Harper sold Canada.

    1. Re:One word, immigration by Ichijo · · Score: 2

      "Forcing everyone out" is what happens when you tried so hard to keep out foreigners by restricting new housing and now there isn't enough housing for both the current residents and the newcomers. In other words, you did it to yourself!

      --
      Any sufficiently unpopular but cohesive argument is indistinguishable from trolling.
    2. Re: One word, immigration by SirSlud · · Score: 2

      You're an idiot.

      --
      "Old man yells at systemd"
    3. Re:One word, immigration by Anonymous Coward · · Score: 0, Troll

      DIdn't really get into the details above but you have that backward. Creating the housing crisis is one of the ways Trudeau and Harper sold out Canada. Banks would not lend to locals, but foregners have no problem. Hell you can be fresh of the plane, they don't care, likely because they're more affraid of the PR nightmare around "islamaphobia" and other discrimination aqusations. White people though? Open season.

      Watch / listen to CBC some time, they're the alt-left of Canada. Publicly funded too.

      Even then, the hosuing crisis is being furthered not solved since many of those buildings are not being bought by locals but foreigners to flip / rent. There are a couple families in Ontario for example that own many highrises but rent largely to immigrants. I've lived in several. It's really not uncommon to have the top two floors entirely dedicated to Muslim families, Mosque, daycare, etc. You couldn't get away with that under any other denomination.

    4. Re:One word, immigration by Anonymous Coward · · Score: 0

      Hilarious that this got modded down considering that it is entirely true. But many people are willfully blind to facts, both on the left and right of the political spectrum. Oh well. Reality always finds a way to smack you in the face.

    5. Re:One word, immigration by Ichijo · · Score: 1

      Nice try but I'm looking at Toronto's zoning code and it's filled with laws that limit how many housing units can be built within the city. Minimum parking requirements, minimum setbacks, maximum floor area ratios, height limits, and on and on.

      --
      Any sufficiently unpopular but cohesive argument is indistinguishable from trolling.
    6. Re:One word, immigration by Anonymous Coward · · Score: 0

      Nice try but I'm looking at Toronto's zoning code and it's filled with laws that limit how many housing units can be built within the city. Minimum parking requirements, minimum setbacks, maximum floor area ratios, height limits, and on and on.

      OK? I mean, I never said there weren't any laws. They are selectively enforced and outside specific acts against minorities, there are few of. To give you an example, the right of a teannant against unlawful entry by a landlord (covered under th ORTA). They are required to give 24 hours notice unless it's an immediate emergency. Despite the fact that they simply need to make ANYTHING up and claim it as an emergency, landlords abuse it all the time.

      Leaving this here -- https://www.thestar.com/news/immigration/2017/05/02/tenants-religious-rights-violated-by-brampton-landlord-who-refused-to-remove-shoes.html This is one rather insane part of the current legislation. Basically a landlord can do whatever they want once you give notice. It's part of the law so they went after him on religious grounds.

      Downvote all you want. It IS happening whether you choose to acknowledge it or not.

    7. Re:One word, immigration by goose-incarnated · · Score: 2

      [snipped complaints about laws not being enforced against Muslims]

      it's filled with laws that limit

      Yeah, and laws that target rape didn't get enforced when it was muslims breaking them:

      A neighbour had called the police after hearing the [13 year old] girl scream. The girl was arrested for being drunk and disorderly, but the [muslim] men were not questioned

      ecause most of the perpetrators were of Pakistani heritage, several council staff described themselves as being nervous about identifying the ethnic origins of perpetrators for fear of being thought racist; others, the report noted, "remembered clear direction from their managers" not to make such identification.

      There's more, you can read all about it.

      Like you said, "Nice try" ... but your assertion that this could not be happening because there were laws against it is clearly stupid, and you should feel stupid for making that assertion.

      --
      I'm a minority race. Save your vitriol for white people.
    8. Re:One word, immigration by Hognoxious · · Score: 1

      hosuing crisis

      Y'houser!

      Sorry.

      --
      Confucius say, "Find worm in apple - bad. Find half a worm - worse."
  9. No so fast by Anonymous Coward · · Score: 2, Insightful

    Hi,

    I lived in Canada for over 30 years and this isn't exactly the case. Yes they have courses on it at UofT and some great minds have come out of there - but not so fast. Myself and many of my peers in the same area moved to the US simply because lack of work... Now working at Microsoft in the US and giving speeches on ML topics.

    1. Re:No so fast by Anonymous Coward · · Score: 0

      I disagree. 2018 is very different than 1990-2010 here. I am seeing things change for the better in terms of tech jobs and industries. Have you been to Waterloo lately?

  10. So what, eh? by Anonymous Coward · · Score: 1

    Canadian artificial intelligence is no match for American natural stupidity!

  11. A data superpower, maybe by Anonymous Coward · · Score: 0

    But AI? It doesn't exist there anymore than it does here, though they too, have algorithms. It's telling that tech at large equates 'data' with 'smarts', these days. Having a head or a chip full of data or knowledge is not 'intelligence'. Engineers avoid learning the distinction at their own peril, and it won't come from malevolent machines.

  12. They took off because CPUs became more powerful by Anonymous Coward · · Score: 1

    This is probably the biggest AI hype in the long running AI hype-->trough-->hype cycle we've had going on since the 50s-60s.

    1) the only reason AI and specifically NN are meeting the success they have, such as they are, is brute force. These are the same algos and designs that were around in the 80s and 90s, really, not much "progress" has happenend sionce then however, CPUs have become much more powerful and memory is much bigger and faster and ways of connecting those CPUs together are now well understood and thanks to the internet, theer is a treasure trove of data sutiable to fewed into these designs, for example, VoIP feeding into speech recognition.

    2) the "big wins" of AI like world champioinship at Go and Deep Blue in chess are in fields that are dleiberately constructed by humans to flummox human information processing strengths and play to human information processing weaknesses. That's what a game is. Games generally are designed to go beuyond human capabilities in look-ahead- the ability to reason through a long series of if-then-what cycles . We actually have a short horizon for this kind of thing, along with terrible short-term memory. Computers OTOH have astronomical capabilites in these areas. This gives them a preternatural advantage in games.

    If Kasparov had the on one billioneth of the look-ahead , reason-ahead ability that Depp Blue do you think he still would have lost? Because I ampretty sure he would be unbeatable.

    3) We have zero idea of how the human brains works. Zero. We are at about the same level of understandin our brains as the ancients were when they realized that, hey, the heart... it's a *pump*.....

    As an example, to just grab at another field completely randomly, we still dont understand how dust collection cyclones behave as they fine extract particles from swirling air. People get their PhDs studying this, advancing our understanding. Another example. There are organs in the body which have just recently been recognized as organs. Google these things; I am not making them up.

    But people like Kurzweil (sp?) want people to believe that we're just about ready to upload our consciousness into a computer. Meanwhile self-criving cars are on the road and actually, we havce zero idea how thye do what they do. what their actual representation , if you cna call it that, of what they see, if you can call it that, is. So of course they're killing people. Of course they are. But hey, we're the species who ignited an atomic bomb not yet certain in the knowledge that it wouldn't ignite the entire atomsphere, so hey, what did you expect.

    AI as it is now isn't bullshit, but it's not anythwere near HAL-9000 level AI and it's so far away from it we can't even see the road to it. Everything from the computers it's based on to our understanding of basic physics will have to improve 1000 fold before we're anywhere near where the hype-money-machine says we are now.

    You can also thank the stupid breathless media who take everything their told at face value for contributing to this current mass dleusion.

    1. Re:They took off because CPUs became more powerful by neoRUR · · Score: 1

      You started off good AC, but then you seemed to have gone of into the I just think rather then I know category.

      Yes the hardware is cheaper and GPUs are more powerful, but the math in NNs and CNNs and all that and the levels that you have in them could never have been done before.

      There are many more people studying NN's now than ever, so we can try many more things.

      It's not all about Big data and just processing your shopping habits, there is some real work going on in making these systems recognize the world. I view the current AI as building an intelligent Eye and sensors to the world.

      We know alot about the brain down the how the Neurons work in so much detail it would blow your mind. What we don't know is how it all works together, it's hard to image specific individual neurons.

      Self driving cars are not new, they are building on 15 years of research in the area and are doing some impressing things and with the connected world now, its easier to make them navigate around.

      There are many computational cognitive models of how the mind works But they are not as complex and big enough to do the HAL like stuff we all want, we are brute force engineering a mind, like we did with airplanes, rather than build more organic ones like a birds.

      It will come and AI is not going away, the complex robotic and Siri, Alexa like systems will only get more powerful.

  13. NASA didn't just put americans on the moon by Anonymous Coward · · Score: 0

    NASA actually put american men on the moon, onboard a canadian-designed spaceship, propelled by a german-designed rocket.

    1. Re:NASA didn't just put americans on the moon by ArmoredDragon · · Score: 1

      NASA actually put american men on the moon, onboard a wildling-designed spaceship, propelled by a nazi-designed rocket.

      Well yeah, the US has well been known as the beneficiary of brain drains for a very long time now. This is not news at all. Wernher Von Braun's team of rocket scientists, and Avro's top engineers inclusive. Why be a wildling when going south of the wall gives you a much larger selection of companies to work for (and better weather...why would you want to live in a frozen wasteland? You already know most of them would prefer to be south, given 95% of the wildlings live within 150 miles of the wall.) Each of them will pay more than anything you could get north of the wall, plus you'll have access to much better facilities and resources than you would have had there.

      It's even better these days: Rather than just NASA, there are three private sector companies developing and/or launching rockets, with one of them creating the most technologically advanced rockets in the world; even better than every government.

  14. Look at all the butthurt american snowflakes... by Anonymous Coward · · Score: 0

    Look at all the butthurt little american snowflakes flooding this thread, either trying to downplay the role of Canada in AI compared to the U.S. or claiming shamelessly and proudly that americans acted like parasites while profiting from the work made by others.

  15. Re: They took off because CPUs became more powerfu by Anonymous Coward · · Score: 0

    Self driving cars are partially a form of game, well defined roads, rules of the road etc... yes ppl are advancing nn understanding but the recent boom is due to cpus, gpus and the available corpus of well pruned input from the internet.

    Re brain, actually my degree is in cog sci w emphasis on brain and computation so I know what I am talking about. Re individual neurons vs integration, see recent advances in using low freq. Light to see neural activity in real time.

    Still, we have zero idea how it all works and nothing, even in sci do, about how you get consciousness from electrical chemical signals... but here see recent theorizing yhat consciousness IS what the basic stuff of the universe is..sorry on the move and links not available... hth

  16. Re: They took off because CPUs became more powerfu by Anonymous Coward · · Score: 0

    Re reinventing intelligence, this is Rodney Brooks and his heirs' approach but at the level of say insects is it intelligence or automata. Reinventing intelligence imo means starting lower, applying evolution, and seeing what evolves.. this is somewhere between chemistry and biology..biochem... imo things designed much above this level are purpose built machines..not different from a calculator.

    Aristotle thought calculating , the ability to do math, proved men had not just intelligence but souls. Today, .people think winning at Go means AI is imminent ... this is largely because the AI used to win at Go is a black box and AI is unconsciously defined by society and researchers alike as whatever clever thing a machine does that we don't understand.

     

  17. Re: They took off because CPUs became more powerf by Anonymous Coward · · Score: 0

    Even in sci-fi that was...lol

  18. Re: Look at all the butthurt american snowflakes.. by Anonymous Coward · · Score: 0

    You sound bitter pancake head. Eh?

  19. Easy by Anonymous Coward · · Score: 0

    By not having PS. (Political Stupidity)

  20. Re:It's because they pronounce AI as Eh. by Bitmanhome · · Score: 1, Redundant

    Aye. Well, actually Nay, but you set me up there.

    --
    Not that this wasn't entirely predictable.
  21. Canadian SkyNet by mhotchin · · Score: 1

    Do you want polite Terminators? Because this is how you get polite Terminators.

    1. Re:Canadian SkyNet by RespekMyAthorati · · Score: 1

      "I'll be back"

      Sorry.

  22. The Terminator androids only seem polite by Latent+Heat · · Score: 1

    until you get them going about either not speaking French or speaking French, they hassle you about the alcoholic beverages and sausages in a cooler buried under camping gear, go on-and-on about how much nicer Toronto is than any U.S. city, torture you to boredom with endless gossip about ice dancers or hockey players, and warn you "I'll be back" with the speech accent of Jordan Peterson before they crash a Bombardier Ski-Doo through the glass doors?

  23. So its .. by RespekMyAthorati · · Score: 1

    AI, eh?