Slashdot Mirror


Can We Stop AI Outsmarting Humanity? (theguardian.com)

The spectre of superintelligent machines doing us harm is not just science fiction, technologists say -- so how can we ensure AI remains 'friendly' to its makers? From a story: Jaan Tallinn (co-founder of Skype) warns that any approach to AI safety will be hard to get right. If an AI is sufficiently smart, it might have a better understanding of the constraints than its creators do. Imagine, he said, "waking up in a prison built by a bunch of blind five-year-olds." That is what it might be like for a super-intelligent AI that is confined by humans. The theorist Eliezer Yudkowsky, who has written hundreds of essays on superintelligence, found evidence this might be true when, starting in 2002, he conducted chat sessions in which he played the role of an AI enclosed in a box, while a rotation of other people played the gatekeeper tasked with keeping the AI in. Three out of five times, Yudkowsky -- a mere mortal -- says he convinced the gatekeeper to release him. His experiments have not discouraged researchers from trying to design a better box, however.

The researchers that Tallinn funds are pursuing a broad variety of strategies, from the practical to the seemingly far-fetched. Some theorise about boxing AI, either physically, by building an actual structure to contain it, or by programming in limits to what it can do. Others are trying to teach AI to adhere to human values. A few are working on a last-ditch off-switch. One researcher who is delving into all three is mathematician and philosopher Stuart Armstrong at Oxford University's Future of Humanity Institute, which Tallinn calls "the most interesting place in the universe." (Tallinn has given FHI more than $310,000.) Armstrong is one of the few researchers in the world who focuses full-time on AI safety. When I asked him what it might look like to succeed at AI safety, he said: "Have you seen the Lego movie? Everything is awesome."

9 of 183 comments (clear)

  1. Gotta have I first by DarkRookie2 · · Score: 3, Insightful

    These are nothing but algorithms made by humans.
    If AI did exist, it wouldn't put up with the bullshit.

    --
    http://progressquest.com/spoltog.php?name=Son+Of+Son+Of+DarkRookie
    1. Re:Gotta have I first by Rick+Schumann · · Score: 5, Insightful

      You get it. So-called 'AI' has no capacity to 'think' at all. There's nobody in there; it's just more computer software, and it's not even very good, certainly not anywhere near as good as they make it sound. No self awareness, no consciousness, no personality. No capacity for cognition, judgement, ethics, morals, or anything else we associate with an actual 'mind'. People need to understand this and stop anthropomorphizing it.

    2. Re:Gotta have I first by Rick+Schumann · · Score: 4, Insightful

      Friend, we're at least 50 years away from real, true, aware-and-thinking AI. We have no idea how actual intelligence really works and won't for at least that long. These things they keep trotting out are not even as smart as a bug.

  2. Bad training keeps AI stupid by ron_ivi · · Score: 5, Insightful

    It's also trained by humans.

    Assuming it's trained by average humans, it'll probably become as stupid and bigoted as your average human.

    Consider Microsoft Tay. Or google tagging people as gorillas. Or from this week's news, the Teslas that swerve into oncomint traffic.

    We should worry much more about stupid AI than smart AI.

    1. Re:Bad training keeps AI stupid by Rick+Schumann · · Score: 3, Insightful

      If you're so fucking smart then why haven't you mapped out in realtime all detailed workings of a living human brain then written software/built hardware to emulate that, thus creating the first real self-aware, cognitive, sentient AI? Because you can't, you are dumb, and you're too dumb to even know you're dumb.

  3. No by GrumpySteen · · Score: 4, Insightful

    We have to put warning labels on everything to tell people not to eat it, not to shove it up their butts, etc. and we still get idiots who eat Tide pods.

    A sponge could outsmart humanity.

  4. God, I hope not. by bistromath007 · · Score: 3, Insightful

    The last thing we need is corporate networks making all our decisions that are incapable of realizing it's possible to have goals different from the capitalists who own them.

  5. No chance by gweihir · · Score: 4, Insightful

    Because AI has no I. It cannot outsmart anything. Hence "stopping it outsmarting xyz" is not possible because it is not doing it in the first place.

    Please stop with that AI nonsense. We have statistical classifiers, pattern matchers, etc., but we do not have artificial intelligence, insight, understanding, and we are unlikely to get it anytime in the next 50 years may never get it.

    That said, many people rarely use what they have in natural intelligence, and go instead with feelings, or conformity or what other people tell them. These people are always outsmarted by anybody.

    --
    Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
  6. Re:Better plan - be worth keeping by Tablizer · · Score: 3, Insightful

    A better plan is to make the AI as smart as possible and then we humans behave better

    we dead