Terminator Salvation Opens Well, Scientists Not Impressed

destinyland writes "A science magazine asks an MIT professor, roboticists, artificial intelligence workers, and science fiction authors about the possibility of an uprising of machines. Answers range from 'of course it's possible' to 'why would an intelligent network waste resources on personal combat?' An engineering professor points out that bipedal robots 'are largely impractical,' and Vernor Vinge says a greater threat to humanity is good old-fashioned nuclear annihilation. But one roboticist says it's inevitable robots will eventually be used in warfare, while another warns of robots in the hands of criminals, cults, and other 'non-state actors.' 'What we should fear in the foreseeable future is not unethical robots, but unethical roboticists.'" The new movie got off to a good start, drawing $13.4 million in its first day. I found it reasonably entertaining; pretty much what I'd expect from a Terminator movie. If nothing else, I learned that being able to crash helicopters and survive being thrown into the occasional wall are the two most valuable skills to have during a robot uprising. What did you think?

Comments

Who effin' cares what the scientists think?

[Anonymous Coward]

It's Terminator! It never had a real basis in reality to begin with.

Why would an intelligent lifeform get violent?

[BadAnalogyGuy]

The premise behind the war between humans and Skynet is simple. Once the humans realized that Skynet had become self-aware, they tried to shut down the system. In order to prevent being shut down, Skynet chose to fight back.

Almost any intelligent creature will decide to fight or flee in the face of annhiliation. If we believe that computers can gain sentience, then it is also possible that they would attempt to preserve their own existence.

Re:Why would an intelligent lifeform get violent?

[JoshuaZ]

The notion that intelligent life will generally take steps to avoid being destroyed isn't necessarily true. The only substantial samples we have of intelligent life evolved. Life that doesn't take steps to prevent its own destruction isn't going to be likely to survive and produce offspring. It isn't at all clear that an intelligence created by humans would be at all inclined to prevent its own destruction.

Re:Why would an intelligent lifeform get violent?

[fuzzyfuzzyfungus]

Even further, a robot without the strong pro-survival bias provided by evolutionary pressure might be inclined to shut itself down.

Re:Why would an intelligent lifeform get violent?

[timeOday]

We already have automated systems that assess threats to themselves and respond automatically with lethal means.

It's really hard for me to imagine any useful thing not having some "instinct" for self-preservation. Even cars have rev-limiters to prevent self-destruction. Even fairly basic robots have collision avoidance. Surely UAV's already do, or soon will, have code to prevent them from flying into the ground. As robots become more advanced and more autonomous, their self-preservation instincts will become more complex as well - and thus more liable to unforeseen consequences. This is all the more true of combat robots in the ultimate hostile environment; they're useless if they get taken out immediately.

Re:Why would an intelligent lifeform get violent?

[Bigjeff5]

I don't think this is by any means a simple concept like writing three rules that can never be broken. If the system is intelligent it will always find ways around the rules to complete the task...

Anybody who has read Asimov's robot short stories, which were based on his three laws of robotics, would agree with that statement. Indeed, that was the point of his stories. He created three perfect rules to protect humans from robots, then came up with dozens of practical scenarios where the logical outcome of that particular scenario is not what was expected or intended by the 3 laws.

My favorite is probably the story of the robot on Mercury, where the robot got stuck "between" two laws in his decision making process, which immobilized him and put in great danger the two men sent to ensure that the robot would continue to function as need. He was ordered to collect a mineral at a particular pool, but the emitted enough radiation to damage the robot. The closer the robot got to the pool, the greater the danger to itself and the less likely it would be able to fulfil its orders. So there was a point where the orders, based on the second law, were made irrelevant and the third law, self preservation, took over. However once it got far enough away that it was no longer in danger and the orders became priority again, causing the robot to turn back toward the pool. It got stuck in this loop, and ended up walking around the pool for hours, unable to move forward and unable to return.

The problem there was the orders were given rather flippantly, and the robot knew its own value to the company. The robot was also not aware that not following the seemingly flippant order (it was made in such a manner because, at the time it was given, there was more than enough time to collect it safely) put humans at risk. Also it was not given the option of collecting the material at another, safer location. It was told exactly where to get it, and that happened to put the robot in danger. Had any of these conditions been different, the orders phrased better and/or more strongly, or had the robot been made aware that the material was vital, or had it not known how valuable it was to the company, things would have turned out better (though the robot would have been damaged to some extent). As it was the humans had to don special suits and go find the robot, nearly dieing in the process.

Just an example, but he came up with dozens of them, the ultimate being robots quietly subverting human control to manipulate the economy and thus manage to prevent all future wars.

It's Not About Science

[pete-classic]

I'm just about to head out to see it.

The question utterly misses the point. It isn't about Science. It's about our fears. Frankenstein (in any of its incarnations) isn't about what's possible or likely, it's about our responsibility for what we create.

This is Freshman English stuff. Every story, no matter how many tentacled creatures, or bumpy-foreheaded aliens, or killer machines, or whatever are in it, is about us.

-Peter

Re:It's Not About Science

[Virak]

I hate to have to be the one to break this to you, but they've been lying to you. Not every single work of fiction is some deep allegory for some aspect of the human condition. Pong is not about the futility of existence. Your favorite porn video, that one with the really great anal scene, is not about sexism in modern culture. And Terminator is not about anything but blowing shit up and causal loops.