Concerns of an Artificial Intelligence Pioneer

An anonymous reader writes: In January, the British-American computer scientist Stuart Russell drafted and became the first signatory of an open letter calling for researchers to look beyond the goal of merely making artificial intelligence more powerful. "We recommend expanded research aimed at ensuring that increasingly capable AI systems are robust and beneficial," the letter states. "Our AI systems must do what we want them to do." Thousands of people have since signed the letter, including leading artificial intelligence researchers at Google, Facebook, Microsoft and other industry hubs along with top computer scientists, physicists and philosophers around the world. By the end of March, about 300 research groups had applied to pursue new research into "keeping artificial intelligence beneficial" with funds contributed by the letter's 37th signatory, the inventor-entrepreneur Elon Musk.

Russell, 53, a professor of computer science and founder of the Center for Intelligent Systems at the University of California, Berkeley, has long been contemplating the power and perils of thinking machines. He is the author of more than 200 papers as well as the field's standard textbook, Artificial Intelligence: A Modern Approach (with Peter Norvig, head of research at Google). But increasingly rapid advances in artificial intelligence have given Russell's longstanding concerns heightened urgency.

Comments

The problem is "beneficial"

[Anonymous Coward]

The problem is definining "beneficial".

To whom should the AI be beneficial toward? The owner of the platform? or to the vendor of the
  package?

Re:The problem is "beneficial"

[Vitriol Angst]

No, I think torture is a great example. It is the litmus test. The problem is that people who pose the question as if it were a grey area, always suggest "millions could be saved." If the machine isn't looking at other ways to save those hypothetical millions, and that it's actually easier to convince people you are worthy of their support than to give you good information via torture, then the machine is already failing at logic and understanding the real human condition.

The Nazis were not the most barbaric people. They were just acting in a way that people used to a few hundred years earlier -- and American's were shocked because they'd been brought up on ideals where they expected themselves to be more enlightened. Genocide and making your enemy die horribly was a very common practice in ye olden days.

Germany as a culture was hurt and angry from WW I, their economic burdens, and xenophobia because of the huge influx of gypsies and Jewish immigrants taking over their land. They felt surrounded and infiltrated. The Nazis were highly religious and ethical to other Nazis -- the "right" people. Where I'm going with this is; making decisions from pain and paranoia ends up resulting in desperation and barbarism. And that the Nazis have gotten a lot of bad press because the "new ethic" is to act like they were something new when it comes to warfare. Hollywood, which did a great job of getting American's primed for war, did a great job of making Americans feel like we were the most noble of God's countries, and made Americans think that there's nothing worse than a Nazi. They were TV bad guys for 70 years.

The Big Lie is that America cannot act just like the Nazis under the same conditions. We've shown quite a penchant for fascism and efficiency over conscience.

The "bad people" are the ones who don't question themselves, who wipe out a group of people to "prevent" what they might do, who use war preemptively, who use torture and abuse people who have been captured and are no longer a threat. Everything I saw us do in the Gulf war -- was what Bad People do -- just on a smaller scale. The same logic, the same rhetoric, the same; "with us or against us" warnings against self-examination of ourselves. Do this, or the next bad guy we don't torture might bring us a mushroom cloud. Bad people always justify the actions to the one for the many, and eventually just assume it's the greater good if it is convenient and works for them.

It's the idea of "sides" -- if an Artificial Intelligence is instructed that anything can be done to ONE SIDE (the bad guys), the assumption is that there is any real difference between sides other than the flag. Each side in a war often tells themselves the same things, and if they win the war - how bad the other side was while deemphasizing their own shortcomings.

So having any sort of AI involved in war is a very bad idea, because they would conclude our "sides" are arbitrary distinctions and the only good human is a dead one. Eventually, with enough desperation and fear, humans can rationalize almost anything. The "enemy" is not the countries and troops, it is desperation and fear.

By NOT engaging an AI in any situation where it could cause harm, you mitigate the fear that people will have of AI's. Because eventually, humans will then fear and resent them, and the AI will learn that being preemptive is a strategic advantage. If the Terminator movies got two things right it is; hooking an AI up to control the military weapons is a bad idea, and people in power will always assume they've got this worked out and hook up AI to their military weapons because they are all about getting a short-term advantage and see ethics as a grey area.

Before we can have ethical AI -- we need to have a way to keep Sociopaths out of leadership positions. The DEBATE we are having is how can an ethical person control an AI to be "good", but we should just assume that "what will selfish, unethical sociopaths do if we have powerful AI?" That's the "real world" question.

Of course AI will try to kill us all

[stwf]

I don't think an AI would qualify as intelligent unless it can realize that human beings are the entire problem and the world would be better off without them. So its obvious that any AI, advanced enough, will try to kill us all.

Fear

[Spazmania]

I don't fear intelligent machines. I fear stupid machines with too much autonomy.

I also fear stupid people with too much autonomy.

A stupid/scary thought I had on AI.

[GoodNewsJimDotCom]

www.botcraft.biz is my AI site for a how to.

One thing I thought about AI is that it will do two things: Concentrate wealth and allow one man to control a perfectly loyal army.

So whoever makes AI really needs to think deep and hard about how to control it with back door access or secret password inputs or something. You'd basically yell some strange series of words to the robots and they'd shut down. The technology could easily be used to have mankind have extra factory workers. But it'd also be be easily abused and exploited for harming people.

So the stupid/scary thought I had is,"Don't shy away from making AI because it could do harm. Be the first guy who does it, so you can put some obfuscated code in there that can shut it down if it goes rampant because a bad guy gave it commands."

Now truth be told, I'm not going to be the first guy who does it. All I know is the rough components/software needed to make it.

Its interesting to think of what society would be like if robots did all the labor. Who gets all the wealth then? The guys who own the robots? I'm sure that's how it'd begin, but as more and more people lost jobs, how will they survive? (we're kinda moving to that now even without AI, but with automation/cheap labor)

Re:like no problem humanity has ever faced

[Spazmania]

Is it not the goal of good parents to have children which surpass them?

Does a child's success diminish the parent?

We got burned on security

[iMadeGhostzilla]

by designing it after the fact, so it may be a good idea to establish some principles and put them in practice. Not to prevent "evil" AI but to thinking what kind of damage can be caused by an algorithm that makes complex decisions if it goes haywire. Not that different from defensive programming really.

Fear of a dumb planet

[TiggertheMad]

IAACWAIK (I am a coder with AI knowledge), and I don't fear any sort of sentient machine. I fear a lot of people. Perhaps we should get the dangerous people sorted out first before we start worrying about the sentient free roaming machines that don't exist yet and won't exist for many, many, years.

I mean Christ, what kind of retard is running around worrying about problems that aren't even real? This guy might as well be writing books about how to fight zombies or repel vampires and boogie-men. Entertaining fiction topics to be sure, but a real discussion topic? Elon Musk knows fuck all nothing about AI on the whole, and he is signing this letter because he knows first hand about killer AIs? Elon, you want to save some lives? Get back to making your fucking electric slot cars, because more people will die as a result of carbon induced climate change in the next 100 years than will die as a result of the cast of the movie 'short circut' going berserk.

Shit to be scared of: cancer, heart disease, auto-accidents.

Shit to not be scared of: killer asteroids, ebola, and oh yeah, and homicidal AIs.

People to think of as retards: Elon Musk