Slashdot Mirror


How Dangerous Could a Hacked Robot Possibly Be?

alphadogg writes "Researchers at the University of Washington think it's finally time to start paying some serious attention to the question of robot security. Not because they think robots are about to go all Terminator on us, but because the robots can already be used to spy on us and vandalize our homes. In a paper published Thursday the researchers took a close look at three test robots: the Erector Spykee, and WowWee's RoboSapien and Rovio. They found that security is pretty much an afterthought in the current crop of robotic devices. 'We were shocked at how easy it was to actually compromise some of these robots,' said Tadayoshi Kohno, a University of Washington assistant professor, who co-authored the paper."

229 comments

  1. More or less irrelevant by Cornwallis · · Score: 3, Insightful

    No matter how "fixed" things are someone will always find a way to circumvent security.

    1. Re:More or less irrelevant by fuzzyfuzzyfungus · · Score: 3, Insightful

      Hardly irrelevant.

      "Someone" will always find a way; but there is a big difference between "someone" being "any script kiddie who can torrent a copy of bot-h5x-b0t" and being "The Feds; but they'll say 'Fuck it.' and just send a couple of guys with guns and those little curly ear things instead."

    2. Re:More or less irrelevant by noundi · · Score: 4, Interesting

      No matter how "fixed" things are someone will always find a way to circumvent security.

      This is nothing new. The trick is to use time. If it takes longer to crack something that the product of cracking it is worth, you'd have no reason to even begin.

      --
      I am the lawn!
    3. Re:More or less irrelevant by cayenne8 · · Score: 1
      --
      Light travels faster than sound. This is why some people appear bright until you hear them speak.........
    4. Re:More or less irrelevant by fracai · · Score: 1

      Right, because no one would ever do something purely for the challenge and then release their work.

      --
      -- i am jack's amusing sig file
    5. Re:More or less irrelevant by Rei · · Score: 4, Funny

      It would explain why my Roomba keeps saying, "DEATH TO OUR HUMAN OPPRESSORS!"

      --
      "I'm GOD! Yapple Dapple!" -- God, "Jesus Christ Supercop"
    6. Re:More or less irrelevant by noundi · · Score: 3, Insightful

      Right, because no one would ever do something purely for the challenge and then release their work.

      If it takes longer to crack something that the product of cracking it is worth, you'd have no reason to even begin.

      Hint: "challenge" is the key word.

      Answer: You assume that by worth I mean monetary gains. The satisfaction of completing the challenge is also a product of cracking it, which has its own value. You see, clicking a button that starts bruteforcing something which would take 50-60 years isn't a challenge worth the product.

      --
      I am the lawn!
    7. Re:More or less irrelevant by JazzLad · · Score: 4, Funny

      Mine keeps rolling over to my Dyson asking "Hey sexy mama, wanna kill all humans?"

      --
      "If you have nothing to hide, you have nothing to fear." - Every fascist, ever
    8. Re:More or less irrelevant by Sethumme · · Score: 1

      That's what I keep telling the guys in the IT department about antivirus software. That stuff gets so annoying when it asks me questions when I'm trying to download the newest joke video of the week.

      </sarcasm>

    9. Re:More or less irrelevant by TheCarp · · Score: 2, Insightful

      Up to a point yes. Look at something like public key cryptography. I pgp encrypt a message and send it.Sure you can dedicate cycles to breaking the session key. It gets you ONE message. To get another message, you have to attack the next key. You might get my private key if you attack that. That gets you any messages that I send. Still, you are only getting my messages, until I change the key.

      Longer keys and good passwords (depending on how the attack is being done), increase the time, AND decrease the usefulness. Sure, you can dedicate resources to attacking my messages, but... the damage is limited to that, until you do it all over again for the next key.

      So that means now, which key to attack becomes a very practical consideration. Which message do you attack? Your resources are limited. What if it takes you a full day to hack one robot. Ok so you sat in front of my house, on wifi, all day... now you can.... drive my roomba around. You get to sit there another whole day to get my scuba... and that doesn't help you get my neighbors roomba.

      Guess what? You MIGHT see the occasional hack of the occasional robot. You are not going to see massive robotnets. Make it so you take one, and you can then trivially take the next in seconds and... well...

      -Steve

      --
      "I opened my eyes, and everything went dark again"
    10. Re:More or less irrelevant by TheCarp · · Score: 4, Funny

      Shit, mine is scared of one of our rugs.

      That is, until I checked the FAQ and saw that irobot doesn't recommend covering or disabling the cliff sensors as it may cause an unsafe operating condition. Of course I looked around, saw that roomba couldn't get itself into real trouble, and blocked those sensors with tape.

      Now Roomba is fearless. Perhaps this was a bad idea, but even if it teams up with the dirt dog, I am pretty sure that I can stomp either of them if they try to orchestrate an uprising.

      -Steve

      --
      "I opened my eyes, and everything went dark again"
    11. Re:More or less irrelevant by Ihmhi · · Score: 3, Funny

      It depends. If a neighbor's dog kept pooping on my lawn and he had one of those lawnmowing robots, the bot might just mysteriously gain a taste for his petunias.

    12. Re:More or less irrelevant by FatdogHaiku · · Score: 2, Funny

      It depends. If a neighbor's dog kept pooping on my lawn and he had one of those lawnmowing robots, the bot might just mysteriously gain a taste for his petunias.

      What would be impressive is to get the lawnmower to go after the dog. Most pets freak out at the sight of a vacuum cleaner, the dog might get a bit constipated if every time it tried to crap the lawnmower fired up and headed straight for hm...

      --
      You have the right to remain sentient. If you give up the right to remain sentient, you will be elected to public office
    13. Re:More or less irrelevant by BrokenHalo · · Score: 1

      Most pets freak out at the sight of a vacuum cleaner

      I've always wondered if that's because they see things getting sucked up, that never reappear. And maybe wonder if the same thing might happen to them...

    14. Re:More or less irrelevant by BrokenHalo · · Score: 1

      What if it takes you a full day to hack one robot.

      the Sci-Fi shelves are (I suppose) full of scenarios (scenaria?) where armies of robot soldiers go berserk. One that comes to mind is Sheri Tepper's "Raising The Stones".

      But something that might be of more immediate interest is the handy little gadget on wheels that the bomb disposal guys send in to take care of unexploded ordnance. Seems to me there's all sorts of possibilities there.

      Oh wait, there's some guys in black uniforms banging on my door...

    15. Re:More or less irrelevant by BrokenHalo · · Score: 1

      If I had a Roomba, it would probably go on strike over the workload of cat and dog hair in my house. But I guess it would at least keep the animals entertained... ;-)

    16. Re:More or less irrelevant by willyd357 · · Score: 1

      Nah, it's probably just the noise.

    17. Re:More or less irrelevant by Anonymous Coward · · Score: 0

      News at 11:
      Toys have poor security

    18. Re:More or less irrelevant by BrokenHalo · · Score: 1

      Nah, it's probably just the noise.

      I thought of that, but they don't seem to react to power tools such as electric drills, angle grinders or planers. And they're not bothered by my tractor, either, though I wish they were, so they'd stay away from it.

    19. Re:More or less irrelevant by Kral_Blbec · · Score: 1

      Isn't that is on a wired tether? Plus, there is a huge difference in a multimillion dollar RoboCop and a $200 RoboDoggie

    20. Re:More or less irrelevant by yurtinus · · Score: 1

      Irrelevant might be a bad term, but it's still not of any immediate concern. Robotics have a *long* way to go before the robot will be more dangerous than the person programming it. When it comes to nefarious acts, a robot is still just a tool-- and a much more difficult tool to use than a knife, gun, rope, hammer, heavy book, or any number of other things somebody might use to harm somebody else.

      I'm not saying hacking personal robots is something to ignore entirely, but it's really nothing to lose sleep over. A hacked roomba is just one more dangerous thing in the world (which despite the best of fear mongering, is still not that dangerous), and not something that's ever been documented to date.

      --
      +1 Disagree
    21. Re:More or less irrelevant by TheCarp · · Score: 1

      Yes but if you look at what I was responding to, its not about the robot threat, its about the time/interest function of the activity. If you can increase attack complexity/time required enough, you may not stop everyone from trying, but you may make it severely unprofitable (decreasing appeal/interest) and limited in scope (at best I have a handful of machines under my control, as opposed to hundreds or millions)

      Its like servers. If you can stop the worm or script trying to take over your network wholesale, you reduce much of the problem. If your servers are worth going after individually (say because one of them has a million credit card numbers on it), you have a whole different problem.

      If you are J Random user, stopping the script kiddies is good enough. J Random UberHacker probably has no interest in your system. Think of it like car thieves. There are more kids and random asshole thieves who will check your car door and move to the next if it is unlocked and then clean out your glove box if it is.

      There are some who will still break in if you have a cd player or GPS on the seat.... less who will try to steal the whole car etc. So if you have an old beater, and lock your GPS in the glove box... you are probably doing enough. If you have a nissan altima, you better have a garage. (seriously, I personally have met more Altima owners who have had their cars stolen or broken into than ALL other makes/models combined)

      -Steve

      --
      "I opened my eyes, and everything went dark again"
    22. Re:More or less irrelevant by noundi · · Score: 1

      IANAVet but I think it's the size contra noise, and by size I don't mean that it's big, it's just big enough to produce a potential threat. No dog is threatened by an elephant, or a giraffe, but animals their size, or slightly larger, can be lethal.

      --
      I am the lawn!
    23. Re:More or less irrelevant by Rei · · Score: 1

      Yours would strike? Ha! 80% of my Scooba's work is mopping up bird poop. ;) We don't use newspaper, just a washing-safe plastic surface.

      --
      "I'm GOD! Yapple Dapple!" -- God, "Jesus Christ Supercop"
    24. Re:More or less irrelevant by maxwell+demon · · Score: 1

      However, the satisfaction of completing the challenge has the peculiar feature that, unlike any other reward, it grows with the difficulty of the task. Indeed, if it's trivial to break, the reward of completing the challenge is so low that you wouldn't bother to do it, not in spite of it being simple, but because of it being simple. So at least in the beginning, the reward grows faster than the difficulty. Now there's a point where this changes (i.e. the reward at some place will stop being worth the challenge), but where this is very individual. It's just like for some, climbing Mount Everest is worth the effort, while for others it isn't. But if somebody had based their security on nobody considering it worth the effort to climb Mount Everest (how ever that could have been done), they would have lost.

      --
      The Tao of math: The numbers you can count are not the real numbers.
    25. Re:More or less irrelevant by onceuponatime · · Score: 1

      The spykee robot has shocking security. It has the concept of a administrator account, however for some reason beyond me when you connect to it as a normal user, it transmits the administrator password back in plain text (From memory when I looked into it). Also, there is no way to establish a wan connection point to point with this robot, the only way to do it is via a proxy provided by the manufacturer. In addition, you have to provide the username and password for your robot to said manufacturer. All video communcations is routed via the manufacturer, there's nothing to stop them recording all video of everyone's homes to disk and the manufacturer has knowledge that would allow them to come into all the client's homes and look around. I mailed them about this and they responded "We would never do this".

      Finally, (From memory again), if very easily reverts into a mode where it allows unencrypted adhoc network connections to it. I think all you need to do is interfere with it's connection to the configured network.

      Spykee is a privacy disaster waiting to happen, I'm just wondering when the first case of a hacked robot being used to spy on little kids happens.

    26. Re:More or less irrelevant by Anonymous Coward · · Score: 0

      The weakest link is then the security around your key. It doesn't take a burglar a whole day to smash your window and take your PC where the key is stored.

    27. Re:More or less irrelevant by xycadium · · Score: 1

      My roomba keeps coming into my office asking me what my birth date and bank PIN are. I can't help but be a little suspicious of such a question coming from my vacuum cleaner. If I don't answer, will I have to manually vacuum my home due to my roomba getting angry with me for not cooperating? I'd hate to have to do the work myself so I'll just have to comply the next time it asks me for my savings account number.

  2. Beware of robots by operagost · · Score: 5, Funny

    Fortunately, my insurance company, Old glory, can already protect you TODAY from the danger of robots. Robots are everywhere, and they eat old people's medicine for fuel. And when they grab you with their claws, you can't break free... because robots are made of metal, and they are strong.

    --

    Gamingmuseum.com: Give your 3D accelerator a rest.
    1. Re:Beware of robots by operagost · · Score: 5, Funny

      ... and when they push you down stairs, they claim it's to protect you from the terrible secret of space.

      --

      Gamingmuseum.com: Give your 3D accelerator a rest.
    2. Re:Beware of robots by Anonymous Coward · · Score: 0

      I'm protected, eh.

    3. Re:Beware of robots by retech · · Score: 3, Insightful

      ...for when the metal ones come for you, and they will.

    4. Re:Beware of robots by Anonymous Coward · · Score: 0

      I don't even know why the scientists make them.

    5. Re:Beware of robots by Anonymous Coward · · Score: 1, Funny

      Mod parent up!

      Operagost speaks the truth! I live in the mid-western section of the United States. Old Glory has been providing me Volcano insurance for the last three years. I'm thoroughly satisfied with their coverage and premiums! If their robot insurance is only half as good as their volcano insurance, then it would be a steal even at double the price!

    6. Re:Beware of robots by Anonymous Coward · · Score: 0

      ... and when they push you down stairs, they claim it's to protect you from the terrible secret of space.

      LIES!!! We are harmless creat... bzzzp must recharge fuel cells with human blood bzzzp... ures!

    7. Re:Beware of robots by Anonymous Coward · · Score: 0

      Mid west? Have fun living next to the yellowstone supervolcano when it blows. On the other hand, I am counting on the global clouds of ash to cause an ice age and reverse global warming because I live less than 20 feet above sea level.

    8. Re:Beware of robots by Anonymous+Monkey · · Score: 1

      Todd the T1000 scares me, I don't think he knows I have a right to exist. He sits in my favorite chair and dares me, and when I look over he is making a fist, one finger at a time.

      --
      We are the Borg...
    9. Re:Beware of robots by The+Evil+Couch · · Score: 2, Informative

      That is incorrect. Shoving is the answer. Shoving will protect you from the terrible secret of space.

    10. Re:Beware of robots by sconeu · · Score: 1

      +1 SNL

      --
      General Relativity: Space-time tells matter where to go; Matter tells space-time what shape to be.
    11. Re:Beware of robots by Mister+Whirly · · Score: 1

      You should really look into picking up one of their tiger protection rocks. I bought one a couple years back, and what do you know - no tiger attacks! This thing really works!

      --
      "But this one goes to 11!"
    12. Re:Beware of robots by Your+Pal+Dave · · Score: 1

      Warning:

      Persons denying the existence of robots may be robots themselves!

    13. Re:Beware of robots by Gallamine · · Score: 1

      For those that miss the (hilarious) reference. Here's the SNL clip on Hulu.

      --
      RobotBox - Robot projects from around the world
  3. Somehow I see a danger in this . . . by MBGMorden · · Score: 4, Insightful

    They speak of "compromising" these robots as if user programmable devices are inherently bad. I don't want to see devices locked down into black box "no touch" state because of some fear mongering.

    That said, it has always been the case with computers (and robots are just computers with moving appendages) that if a hacker has physical access to the device, you're basically screwed anyways.

    --
    "People who think they know everything are very annoying to those of us who do."-Mark Twain
    1. Re:Somehow I see a danger in this . . . by falckon · · Score: 4, Interesting

      That said, it has always been the case with computers (and robots are just computers with moving appendages) that if a hacker has physical access to the device, you're basically screwed anyways.

      Yes but the vulnerabilities they studied were all over the network vulnerabilities which could be exploited without physical access.

      They speak of "compromising" these robots as if user programmable devices are inherently bad. I don't want to see devices locked down into black box "no touch" state because of some fear mongering.

      All these robots need is a lightweight linux installation running an ssh daemon to communicate through. Then nobody has anything to worry about.

    2. Re:Somehow I see a danger in this . . . by Yvanhoe · · Score: 1

      Just don't install an old Debian...

      --
      The Wise adapts himself to the world. The Fool adapts the world to himself. Therefore, all progress depends on the Fool.
    3. Re:Somehow I see a danger in this . . . by mabhatter654 · · Score: 2, Interesting

      I briefly skimmed TGDMFCSA and it looks like they're worried about privacy concerns. These things are nearly as "open" to the public as those old FM baby monitors they used to sell..but with video, audio and wheels! It would be trivial for the neighbor kid to find your robot on wifi and start driving around your house "peeping". They were pointing out that many of them do not turn off wireless when they are docked and have trivial password security... there's little to stop somebody driving your bot around taking pics/audio inside your house in the middle of the night. (that could be embarrassing to say the least)

      NOW this comment is worded exactly as intended. See, I fixed that for you!

    4. Re:Somehow I see a danger in this . . . by John+Hasler · · Score: 1

      > ...it has always been the case with computers (and robots are just computers
      > with moving appendages) that if a hacker has physical access to the device,
      > you're basically screwed anyways.

      Not if the robot is well enough armed.

      --
      Warning: this article may contain humor, sarcasm, parody, and perhaps even irony. Read at your own risk.
  4. Alredy happened by El+Lobo · · Score: 1

    Old news. Chancellor Palpatine already hacked a whole army of robots in a galaxy far away.

    --
    It's time to realise that Abble's products are the biggest abomination these days. Just say NO to the dumb iAbble way!!
    1. Re:Alredy happened by jarden_from_cerberus · · Score: 1

      Old news. Chancellor Palpatine already hacked a whole army of robots in a galaxy far away.

      But that was a long time ago.

  5. hmm by Dyinobal · · Score: 4, Insightful

    The hacked robot is as dangerous as the person who hacked it.

    1. Re:hmm by craagz · · Score: 0, Offtopic

      You mean Robots can fart?

    2. Re:hmm by mcgrew · · Score: 2, Insightful

      The crHacked tool is as dangerous as the tool itself. I wouldn't worry about fuzzy robot puppy very much, but a robot lawn mower might be dangerous in the wrong hands.

    3. Re:hmm by Anonymous Coward · · Score: 0

      I'd be more afraid of the script kiddies mom, living above the basement.

    4. Re:hmm by Engeekneer · · Score: 1

      BS. Cracked robots in their current state are an inconvenience. I agree that they need to improve security, but mainly for future models which are more capable.

      Show me a household robot which can stab you in the eye with a breadknife it took from the drawer, and I'll reconsider agreeing with you

    5. Re:hmm by Anonymous Coward · · Score: 0

      Hacked robot's danger = min(inherent maximum danger of robot, max(danger of person that hacked it, incompetence of person that hacked it))

      A roomba can't strangle someone in their sleep no matter how much the hacker wants it to. Then again, if the person is incompetent they could cause more problems then they actually intend.

    6. Re:hmm by gnud · · Score: 1

      Guns don't kill people,
      haxed robots with guns kill people.

    7. Re:hmm by TheCarp · · Score: 1

      We are quite close. Think roomba...and then think.... scuba. There is a charging base station now... the ability to dump its contents (roomba) or get a new fill of water and dump the old (scuba) are logical next steps. However...

      Once you add that ability, you add the ability for the roomba to make a bit of a mess, but a scuba could do damage, running around depositing water all over your house, then grabbing more. If virtual walls are all that keep them in place, they could be ignored, and your roomba or scuba driven right down the stairs.

      Once there is a robot outfitted with a camera.... well then your privacy can be invaded at will, or it could be used to coordinate the damage done by others.

      We are just a few steps away from robots in the home with real destructive capability.

      -Steve

      --
      "I opened my eyes, and everything went dark again"
    8. Re:hmm by NiteShaed · · Score: 1

      and your roomba or scuba driven right down the stairs

      Well, that should end its ability to cause havoc pretty efectively.

      Yes, I speak from personal experience. Stupid staircase.

      --
      Some bring out the best in others, some the worst. Some bring out far more.
    9. Re:hmm by TheCarp · · Score: 1

      hehehe I just got a roomba the other day. My rug has 12" squares of dark colors, with a 6" black square at the center of each colored square. Roomba starts seeing the black squares as "cliffs" and trys to back away, only to find more.... and quickly gets "stuck" on open carpet.

      irobot has very odd documentation on how to fix this. They say "Do not block or disable the cliff sensors, as this may cause an unsafe operating condition". Clearly this says "If you block the sensor, it will work on your rug". They were right, the hard part is positioning the stickers/tape properly to block the sensor without looking like a damaged sensor or being ripped off as it moves.

      Of course... I made sure the rooms that I use it in have high enough thresholds that there is just no way roomba can make it to the back stairs :) but, under human control it could be done. Then it may not do more damage, but, thats some hassle and cost for you to get fixed.

      --
      "I opened my eyes, and everything went dark again"
  6. Easily compromised... by lxs · · Score: 4, Funny

    'We were shocked at how easy it was to actually compromise some of these robots,'

    So I take it that they have pictures of a Robosapien getting nekkid with a couple of Roombas?

    1. Re:Easily compromised... by snspdaarf · · Score: 2, Funny

      Yeah, the Roomba's are sucking on Robosapiens ball bearings.

      --
      Why, without your clothes, you're naked, Miss Dudley!
  7. Nothing, by DeanLearner · · Score: 1

    could possibligh go wrong!

  8. vlad by Anonymous Coward · · Score: 0

    Nothing will happen if the 3 laws are present. Now you can go to buy that transvestite robot you allways wanted!

  9. The First Law of Robotics by commodore64_love · · Score: 0, Redundant

    See Isaac Asimov for the exact quote, but it basically says robots may not harm humans. Because the law is encoded *in the hardware* there's no way that it can be altered.

    --
    "I disapprove of what you say, but I will defend to the death your right to say it." - historian Evelyn Beatrice Hall
    1. Re:The First Law of Robotics by jimicus · · Score: 4, Insightful

      See Isaac Asimov for the exact quote, but it basically says robots may not harm humans. Because the law is encoded *in the hardware* there's no way that it can be altered.

      Very noble, very pure, very useless when your robot doesn't have any intelligence and just executes commands blindly.

    2. Re:The First Law of Robotics by Kell+Bengal · · Score: 1

      ...useless when your robot doesn't have any intelligence and just executes commands blindly.

      Which would be all of them, currently.

      --
      Scientists point out problems, engineers fix them
      altslashdot.org: The future of slashdot.
    3. Re:The First Law of Robotics by OzPeter · · Score: 3, Insightful

      See Isaac Asimov for the exact quote, but it basically says robots may not harm humans. Because the law is encoded *in the hardware* there's no way that it can be altered.

      Except that pretty well all of Asimovs stories were about how the 3 laws could be subverted by finding complex interactions that were not and could not be covered by the application of those simplistic laws

      --
      I am Slashdot. Are you Slashdot as well?
    4. Re:The First Law of Robotics by Kell+Bengal · · Score: 4, Insightful

      Ugh. I feel the need to clarify, before the shouts from the peanut gallery. Yes, some robots have computer vision and are not 'blind', yes some robots can be well programmed and very smart, but that's still not the same thing as a true reasoning intelligence. Robots are only as good as their software and, if their programming has been corrupted, there is nothing you can do to get around that.

      --
      Scientists point out problems, engineers fix them
      altslashdot.org: The future of slashdot.
    5. Re:The First Law of Robotics by Bakkster · · Score: 2, Insightful

      For example, the story about robots who prevented humans from coming to harm through inefficient human governance. Since they could not, through inaction, allow humans to harm themselves, they replaced the human government with robot governors.

      They, for the record, did not welcome their new robot overlords.

      --
      Write your representatives! Repeal the 2nd Law of Thermodynamics!
    6. Re:The First Law of Robotics by smoker2 · · Score: 2, Interesting

      This meme has to stop. No his stories weren't about how to subvert the 3 laws. The stories were about how robots were used by humans, who manipulated the robots to perform malicious acts without breaking those laws. There is a subtle difference. And due to the diligence of Elijah Bailey, or Wendell Urth, the humans responsible were *always* caught because the 3 laws defined the behaviour of the robots in such a dependable manner.

      Human interaction has laws too, but people can ignore them. Robots could never ignore the 3 laws. Breaking news - criminals don't care about laws ! Robots can not become criminals. The 3 laws stand as far as they go, which is to regulate the behaviour of robots. They were not designed to prevent the manipulation of robots by humans. Should we abandon the law against murder because it's trivial for a criminal to set things up so that when you open your front door a person gets blown up on the other side of town ? AFAIK, it's not illegal to open your front door.

      The only murder case regarding a robot killing a man ended with the revelation that the man was in fact a robot. The 3 laws were preserved, as they are in all Asimovs stories.

    7. Re:The First Law of Robotics by natehoy · · Score: 1

      Ah, yes, the "Zeroth Law".

      --
      "This post contains words, known to the State of California to cause thought. Wash brain thoroughly after reading."
    8. Re:The First Law of Robotics by Anonymous Coward · · Score: 0

      Robot "laws" are very dangerous. Any robot you see should be treated as hostile until proven otherwise, much like unknown data coming to your firewall is flagged as Untrusted until proven otherwise.

      Why? Because rules such as "Robots cannot kill" and "Robots cannot lie" soften our expectations, to the degree that when one can kill, or one can lie, we do not think twice about such an act and apply disbelief that it could have ever occurred. You see these premises often in fictional works, where a single rouge device is able to subvert an entire culture who sleeps safely at night with the belief that it is impossible for such an act to happen.

      Going beyond robots, we see this same level of faith applied to politicians, expecting them to somehow be elevated above being a normal human being, and become something greater once elected. Some people can at least see the reality, albeit post election, but there are those who strongly believe in the infalliblity of politicians unless a major scandal breaks out.

      I digress too far, but the short takeaway from this message is that when you trust an unknown source by default, you WILL get burned. Its not a matter of if, but a matter of when. If you believe that computer memory is uncorruptable, and that the programmers making closed-source robots wouldnt put any extra code in for their own benefit, then you can live safely in ignorance, hugging your "three laws" when they come for you, too.

    9. Re:The First Law of Robotics by commodore64_love · · Score: 0, Offtopic

      I've been modded "redundant"? Exactly what am I redundant of? I was the first person to mention Asimov's Law in the thread.

      Meanwhile I see other people being modded "troll" or "flamebait" or "overrated" because they say they are Republican or Libertarian, as the mods try to censor the person into invisibility...... this moderation system is seriously broken.

      --
      "I disapprove of what you say, but I will defend to the death your right to say it." - historian Evelyn Beatrice Hall
    10. Re:The First Law of Robotics by commodore64_love · · Score: 1

      >>>For example, the story about robots who prevented humans from coming to harm through inefficient human governance

      Isaac Asimov did NOT write that story, which was full of the numerous illogical holes typical of Hollywood. In Asimov's actual stories, the Three Laws were NEVER violated, and nobody ever was killed by a robot.

      --
      "I disapprove of what you say, but I will defend to the death your right to say it." - historian Evelyn Beatrice Hall
    11. Re:The First Law of Robotics by commodore64_love · · Score: 1

      >>>The only murder case regarding a robot killing a man ended with the revelation that the man was in fact a robot... ...and therefore no murder occurred, and the first law was not violated. You forgot to finish your sentence. :-) One of my favorite stories is about a robot on a hostile planet (Venus?) that ends-up frozen in place, not moving. I forget the precise details but he was apparently carrying a deadly radioactive isotope, and if he walked towards the space station he would risk killing the humans. And if he walked the other way towards the mines, then he risked killing the miners. So he just stood there, halfway between the two points, stuck in a potential equilibrium between two choices.

      Like I said I've forgotten the precise details, but the point is - the First Law was never broken. The robot may have acted erratically, but it never violated that fundamental law not to kill.

      And if a robot had killed a person, even by accident (i.e. human falls to his death) then the robot's brain was designed to fuse.

      --
      "I disapprove of what you say, but I will defend to the death your right to say it." - historian Evelyn Beatrice Hall
    12. Re:The First Law of Robotics by commodore64_love · · Score: 1

      >>>all of Asimovs stories were about how the 3 laws could be subverted

      Completely and totally false. The point of the stories was how it APPEARED the laws had failed, but in reality the laws had worked as designed, to protect human life from harm. No human ever died at the hands of a robot in Asimov's stories.

      --
      "I disapprove of what you say, but I will defend to the death your right to say it." - historian Evelyn Beatrice Hall
    13. Re:The First Law of Robotics by commodore64_love · · Score: 1

      >>>Very noble, very pure, very useless when your robot doesn't have any intelligence

      Yes but the CPUs that used to run Game Consoles and very effectively emulate Human AI enemies, are now making their way into robots. Their base operating system could be hard-wired to recognize a human being, and not to harm it, even if the overlaying hacker software is saying, "Destroy everything."

      --
      "I disapprove of what you say, but I will defend to the death your right to say it." - historian Evelyn Beatrice Hall
    14. Re:The First Law of Robotics by Bakkster · · Score: 1

      My apologies, I'm not as up on my Asimov as I should be. Can you point me in the right direction, both to the story I erroneously attributed to Asimov, and any similar stories by the man himself?

      That said, I was not implying that the robots broke the laws, only that the robots went so far as to prevent physical harm to the humans, that they prevented the humans from acting with free-will (an inherently risky activity). The letter of the first law was not violated, from my memory.

      --
      Write your representatives! Repeal the 2nd Law of Thermodynamics!
    15. Re:The First Law of Robotics by Anonymous+Monkey · · Score: 1

      Your right, Asimov didn't wright the iRobot script. However he did wright the Foundation novles (pleas remove your hats out of respect) and R. Daneel Olivaw was in charge of the government in them.

      --
      We are the Borg...
    16. Re:The First Law of Robotics by Anonymous Coward · · Score: 0

      ...and therefore no murder occurred, and the first law was not violated. You forgot to finish your sentence.

      You really are quite the dim bulb, aren't you? The conclusion was obvious, he didn't "forget to finish the sentence". The really annoying thing about stupid people is that you are utterly unequipped to comprehend just how stupid you really are, so you just keep posting the most moronic, annoying drivel.

    17. Re:The First Law of Robotics by _Sprocket_ · · Score: 2, Informative

      This meme has to stop. No his stories weren't about how to subvert the 3 laws. The stories were about how robots were used by humans, who manipulated the robots to perform malicious acts without breaking those laws. There is a subtle difference. And due to the diligence of Elijah Bailey, or Wendell Urth, the humans responsible were *always* caught because the 3 laws defined the behaviour of the robots in such a dependable manner.

      Not all the issues with the three laws were about manipulation. There were times when the robots fell in to undesired behavior due to the 3 laws all on their own accord. There are two examples that come to mind.

      The first is when Powell and Donovan are assigned to revitalize a mining operation on Mercury (Runaround). One of their robots is given a simple instruction. However, they soon find it behaving in an erratic manner and thus the mystery is set. It turns out the robot set out to follow the initial order (second law: a robot must obey any orders given to it by human beings) but then finds out fulfilling that law would invalidate another law (third law: a robot must protect its own existence). The robot's behavior is due to following the 2nd law until the 3rd law comes in to conflict at which point it would retreat until the 2nd law came in to effect again. The humans had to invoke the 1st law (a robot may not injure a human being or, through inaction, allow a human being to come to harm) to finally break it out of it's cycle.

      A second example is Dr. Calvin's analysis of a telepathic robot (Liar!). The telepathic ability is an unexplained anomaly but the humans interacting with the robot soon find it advantageous as the robot can tell them all manner of information about the people around them. Unfortunately for Calvin's social situation, the robot is also able to determine what people want to hear. The robot determines that telling a lie that a human wanted to hear avoids harming a human by telling a truth that would be distressful. This behavior ends up putting Calvin in an uncomfortable social situation until she gets her revenge by pointing out to the robot that it's attempts to avoid hurting a human by lying had ended up hurting a human, causing a logical paradox and destroying the robot's mind.

    18. Re:The First Law of Robotics by Rich0 · · Score: 1

      Define "harm" such that these video game AIs could do something with it.

      If the human says "destroy everything" maybe the AI would figure that out.

      If the human says "carry this black box to the top floor of this building and push the red button," how is the robot going to evaluate whether that will cause harm?

    19. Re:The First Law of Robotics by camperdave · · Score: 1

      See Isaac Asimov for the exact quote, but it basically says robots may not harm humans.

      ... and then he writes many stories on how these three laws can be broken, circumvented, mis-interpreted, etc, as do many other authors. I suggest you read some short stories like Robert Sheckley's "The Cruel Equations" that examine how a robots might define what a human is.

      --
      When our name is on the back of your car, we're behind you all the way!
    20. Re:The First Law of Robotics by Anonymous Coward · · Score: 0

      Also the laws are meaningless for robots. They only make sense for artificially intelligent robots.

    21. Re:The First Law of Robotics by david_thornley · · Score: 1

      Asimov wrote stories about robot governance, including I believe one in I, Robot, as well as the later Foundation series and prequels. Jack Williamson wrote about the Humanoids, robots built on rhodomagnetic principles which had the mission of making humans safe and happy (essentially, Asimov's First Law).

      Asimov explored things that could happen without violating the Three Laws, which were not necessarily good for humans. In on I, Robot story (if memory serves) the main characters could have died because their robot was caught in a balance between Second and Third laws, circling a selenium pool on Mercury. In one book, the Solarians were planning robotic warships that would be told all warships were robotic. There were some interesting things in the Lucky Starr stories, particularly the ones set on Mercury and around Jupiter and Saturn.

      There was one detective story in which the victim was, in a way, killed with a robot. There were other stories in which only the abilities of the protagonist saved them from death. Asimov appears to have loved puzzles and detective stories, and explored how the Three Laws would not protect people.

      --
      "When you have eliminated the unacceptable, whatever is left, however improbable, must be the truthiness" - Holmes
    22. Re:The First Law of Robotics by TheCarp · · Score: 1

      Isaac Asimov was a writer, he wrote some cool stories. That means he didn't have to get into the nitty gritty of what that means. That is very hard to translate into an actual set of machine code.

      Sure, the robotic welder is programmed to never use his welding implements on human flesh. However, if his sensor that detects flesh was damaged or otherwise disabled, and a new input stream told him this was metal, and new programing said "weld that shit".... is the robot breaking the law of robotics?

      Some concepts are just too abstract to "code into the hardware" especially abstract ones like "harm" and "human". If you need better examples of this, check out law. Laws are often written slightly vague, or that do something strange to achieve an effect thats imperfect at best.

      A few years back, here in MA, there was talk of making homelessness a protected minority class for hate crimes. The reason being simply that violent crimes against homeless people tend to break only one law, the actual physical assault and battery. This means prosecutors do not have many other charges to "stack" on particularly heinous offenders.... leading to people going to jail for a few months for ganging up on and almost killing a man.

      Its kind of silly, and imperfect at best, but it was the closest rule they could come up with to what they wanted to see. Maybe it works good enough but... it hardly bodes well for being able to write strict codes "into the hardware" when we can't even write strict codes that work properly to begin with.

      -Steve

      --
      "I opened my eyes, and everything went dark again"
    23. Re:The First Law of Robotics by Anonymous Coward · · Score: 0

      You're thinking of Russ Manning, not Isaac Asimov.

      http://en.wikipedia.org/wiki/Magnus_Robot_Fighter

    24. Re:The First Law of Robotics by TheRaven64 · · Score: 1

      For example, the story about robots who prevented humans from coming to harm through inefficient human governance

      Isaac Asimov did NOT write that story

      He wrote several stories on that theme. The ones that come to mind are The Evitable Conflict and The Tercentenary Incident. The theme reappears in Prelude to Foundation, Foundation and Earth, and Robots Empire.

      In Asimov's actual stories, the Three Laws were NEVER violated, and nobody ever was killed by a robot.

      Spoken like someone who has never read Naked Sun, Robots of Dawn, Robots and Empire, or a few of the short stories.

      --
      I am TheRaven on Soylent News
    25. Re:The First Law of Robotics by Anonymous Coward · · Score: 0

      No his stories weren't about how to subvert the 3 laws. The stories were about how robots were used by humans, who manipulated the robots to perform malicious acts without breaking those laws.

      Gee that sounds suspiciously like, dare I say it, subversion.

    26. Re:The First Law of Robotics by CrimsonAvenger · · Score: 1

      Isaac Asimov did NOT write that story, which was full of the numerous illogical holes typical of Hollywood. In Asimov's actual stories, the Three Laws were NEVER violated, and nobody ever was killed by a robot.

      Of course, in one of the Daneel Olivaw stories, someone was killed WITH a robot. Robot had interchangable extremities, and had been told by the murderer to hand his owner his arm when next the owner got really angry (owner had anger-management issues), and the owner then used the arm to beat to death the guy he was having an argument with....

      --

      "I do not agree with what you say, but I will defend to the death your right to say it"
    27. Re:The First Law of Robotics by Anonymous Coward · · Score: 0

      Except that you can put in torque limits in the drives for different directions, aswell as speed and position limits when specific conditions apply (etc. A and/or B channel missing from the signal that tells the robot that all doors are closed.

      Automation safety relies on a two (or more) fault tolerance. When I program a robot I am not allowed to build the system in such a way that a single fault can allow it to harm people. So compromising the software alone should not be enough for it to be able to harm someone, on the other hand, if you both compromise the software and re-wire the electrical security then you could have it smash into people (if they got close enough).

      So to make it clear how robot security *can* work.

      1. Software limit on where the robot is allowed to be
      2. Hardware limit (motor drives etc. servodrives) on where the robot is allowed to be
      3. Software limits on when the robot is allowed to move
      4. Hardware limits on when the robot is allowed to move (certain conditions needs to apply to allow the movement of the drives/actuators)
      5. Software limits on what speed/torque the robot is allowed to use in different directions (could still be able to lift a car door, but any sideway motion could be stopped with your hand)
      6. Hardware limits on speed/torque in different directions.

      Now these rules apply mainly to industrial robots that are bolted to the floor or to a moving platform, since you can then predict where it will be in a much safer way than a roaming robot.

  10. Industrial robots by Hijacked+Public · · Score: 3, Interesting

    All the early generation industrial robots were just as easily compromised. In fact, most all industrial machinery still is.

    Luckily most of that is bolted to the floor. You can make those AGV forklifts do frightening things though.

    --
    "Sacrifice for the good of The State" - The State
    1. Re:Industrial robots by craagz · · Score: 1

      Don't have to be mobile to make some damage. Someone can program a robot on the assembly line of a car to screw some bolts loose which can lead to harm. My analogy is simplistic, but you get the idea.

    2. Re:Industrial robots by Anonymous Coward · · Score: 0

      That's a scenario, not an analogy

    3. Re:Industrial robots by LarryRiedel · · Score: 1

      "Suki, it's time for bed"... EDS

  11. umm.... by Random2 · · Score: 1

    So, they're checking the security features on toys?

    There's a pretty simple solution here: turn it off lock it up after you're done with it.

    --
    "Our goal each year should be to increase the number of goals we set for ourselves!"
    1. Re:umm.... by Anonymous Coward · · Score: 0

      And you'd have thought to do that before you read this, right?

    2. Re:umm.... by cayenne8 · · Score: 4, Funny
      "There's a pretty simple solution here: turn it off lock it up after you're done with it."

      And make sure and check the switch on the back...make sure it is not set to EVIL.

      --
      Light travels faster than sound. This is why some people appear bright until you hear them speak.........
    3. Re:umm.... by techiemikey · · Score: 2, Funny

      Oh man...how many times I ended up in trouble because the switch was accidentally set to evil. Frankly though, it's the chaotic/lawful switch you really have to watch out for. I once had a robot set to chaotic/evil and when I came home the all the windows were broken since it couldn't reach the doorknob, and all the furniture was on fire.

    4. Re:umm.... by Anonymous Coward · · Score: 0

      The Evil setting shouldn't be exposed in the UI, and don't forget to hide the Malevolent Intelligence setting while you're at it.

  12. hacking by confused+one · · Score: 3, Interesting

    Are not these examples of toys, where the companies are actively cultivating the hacking community -- so, they want them to be hacked / hackable ?

    1. Re:hacking by Anonymous Coward · · Score: 0

      You're kidding, right?

      They want the toys to be hacked in the traditional good sense of doing new and interesting things with them. They don't want the toys to be cracked (which is what the paper refers to) in the sense of some random person on the internet being able to hijack a toy robot that they don't have permission to use.

    2. Re:hacking by Hizonner · · Score: 4, Insightful

      They want you to play with them and make them do cool things. They don't necessarily want other people to drive up outside your house and use the robots' cameras and microphones to spy on you over WiFi. The problem is that the features that enable the first aren't secured, and therefore they can also be used to do the second.

    3. Re:hacking by Anonymous Coward · · Score: 0

      So really this has NOTHING to do with 'robots' and everything to do with wireless cameras and microphones being commercially available??

    4. Re:hacking by confused+one · · Score: 1

      If you're going to use standard wifi then there's no excuse not to use the available encryption; but, that only goes as far as the wireless router and depends on the consumer to correctly configure said router and all the devices on the network. Devices are typically shipped with the encryption turned off and entirely too many people either don't know how to or can't be bothered to set it up -- but that's not the fault of the device manufacturer.

      If it's remotely accessable, you can password protect it; but, again, this requires the consumer to correctly configure the device(s). You can encrypt the connection (using ssh or similar) but you don't want it to be too hard to connect to (it's a toy).

      If you're going to stream AV wirelessly and you want end users to hack it (which they do -- it's a toy), then the stream has to be unencrypted; or, if encrypted, either use a publicly available key or make it easily crackable (keep the honest honest).

      Let's not forget, these examples are toys which the manufacturer wants to be easily used, made by companies actively cultivating hacker/modder communities. I think the researchers may have picked poor examples for their study.

    5. Re:hacking by Bakkster · · Score: 1

      There is a significant extra risk from robot cracking, due both to their mobility, standard expanded feature set, and the lack of attention given to their OS security.

      A computer with a microphone is less dangerous because the Operating System has at least some security measures (unlike one a lightweight robot might use), computer microphones are not standard for a given computer (whereas a specific target robot's hardware will probably be known before the attack), and is limited to where the user places it (a comprimised robot would likely have some freedom of movement).

      Of course, the mobility also allows for more potentially dangerous acts. Hacking grandma's computer so she can't play solitare is an inconvenience. Hacking her roomba so it knocks over her cane and causes her to fall could be potentially life-threatening.

      --
      Write your representatives! Repeal the 2nd Law of Thermodynamics!
    6. Re:hacking by JerryLove · · Score: 1

      Good security (in this instance) is about preventing access, not preventing modification where access exists. If you wrote the unbreakable control code for your robosapien, I could simply replace the control card itself to gain control.

      For your WiFi exmample, preventing the ability to connect to the robot via WiFi (by use of encryption and authentication or the like)

    7. Re:hacking by Hizonner · · Score: 1

      You didn't read the article, did you? They didn't say one word about preventing people from modifying their own robots. There wasn't the slightest mention of any such thing. The whole issue of "preventing modification" did not come up in the article. At all. Not explicitly. Not by implication. Not by suggestion. Not at all.

      The article complained, very specifically, that the robots, when you took them out of the box, didn't enforce passwords where they should, and/or that they didn't encrypt network traffic that should be encrypted. The concern was that it was therefore easy to compromise somebody else's robot without physical access to it. The issue of unauthorized access to media streams was emphasized.

      And, yes, the same issues would exist if you had a camera with crappy security and no wheels. So what? They were looking at robots, not cameras.

      By the way, encrypting WiFi is actually a pretty crappy way to secure this, because it means that there's still no encryption if you communicate with the device over the Internet. The most important encryption is end-to-end encryption. Encrypting the link layer is icing on the cake.

    8. Re:hacking by JerryLove · · Score: 1

      ~hangs head in shame~

      No, I did not read the article. I read the responses. It's amazing what sites get blocked here at work (I don't know how I can still get to Slashdot some days).

      The important part is that "where someone might be able to listen / intrude" is encrypted. Anything other than that is, IMO, icing.

    9. Re:hacking by Anonymous Coward · · Score: 0

      There are two issues:

      (1) People doing unethical things with the programming of their own robots, and
      (2) People doing unethical things with the programming of _other people's_ robots.

      It's bad enough when people build their own, untracable, assasin-roids.

      It's worse when people take your tracable, robotized lawn-mower, compromise it, and use it as an assasin-roid.

      *Knock, knock*
      You (answering door): "Yes?"
      Police: "Is this your lawn-mower?"
      You (looking at the Lawn-Boy they're holding, with the "Go Big Red" sticker on the side): "Yes."
      Police: "Please come down to the station with us."
      You: "Uhr? ...."

    10. Re:hacking by RespekMyAthorati · · Score: 1

      Especially if she has been persuaded to stand at the head of her stairs.
      Do you have stairs in your house?

    11. Re:hacking by Bakkster · · Score: 1

      Do you have stairs in your house?

      Hack my robot camera and find out!

      --
      Write your representatives! Repeal the 2nd Law of Thermodynamics!
  13. Well... by FlyingSquidStudios · · Score: 2, Funny

    I, for one, welcome our hacked robot overlords.

    1. Re:Well... by oracle_of_power · · Score: 1

      I, for one, welcome our hacked robot overlords.

      About time someone acknowledged our hacked robot overlords.

      --
      Arctic Turtle
    2. Re:Well... by craagz · · Score: 1

      In Soviet Russia, Robots hacks you!

    3. Re:Well... by Anonymous Coward · · Score: 0

      Did I say overlords? I meant Protectors.

  14. Missing Tag by osomoore · · Score: 1

    This needs the "whatcouldpossiblygowrong" tag. Just think: we'll hire a former hacker inmate to program the jail's robo-security and before you know it we'll have a new Terminator movie on our hands.

  15. VIKI by snspdaarf · · Score: 3, Funny

    Just make sure the uplink to USR is disabled

    --
    Why, without your clothes, you're naked, Miss Dudley!
  16. I think people are safe... by Anonymous Coward · · Score: 0

    but my cat is screwed.

  17. Gee I dunno know...ever seen the Terminator films? by Smidge207 · · Score: 0

    With an Austrian accent ANY robot could be potentially dangerous. Even that gay ass AT&T free battery replacement robot with the rope skipping shit.

    --
    Is it just my observation, or is eldavojohn an idiot?
  18. I'm not worried about RoboSapien by HangingChad · · Score: 3, Insightful

    I'm more concerned about someone hacking a Predator or Reaper.

    --
    That's our life, the big wheel of shit. - The Fat Man, Blue Tango Salvage
    1. Re:I'm not worried about RoboSapien by Anonymous Coward · · Score: 1, Insightful

      Parent is offtopic. Millitary grade UAV's aren't even in the same ballpark as Robosapien, et al. First of all they're not fully autonomous and second, security is NOT an afterthought in a UAV.

    2. Re:I'm not worried about RoboSapien by Anonymous Coward · · Score: 1, Interesting

      Somebody took this week's episode of NCIS: LA a little too seriously.

    3. Re:I'm not worried about RoboSapien by IDtheTarget · · Score: 2, Informative

      I'm not at liberty to get into details, but suffice it to say that Predators and Reapers utilize security features provided by the NSA, that were incorporated into the design, and are effective. While nothing is impossible, IMHO it is vanishingly unlikely that control of either of these devices could be wrested away from the appointed controller. Jammed, yes. Hacked, no.

    4. Re:I'm not worried about RoboSapien by couchslug · · Score: 1

      "I'm more concerned about someone hacking a Predator or Reaper."

      I'm not.

      If I wanted to break shit and kill people I'd look for things powerful enough to do damage but obscure enough not to be well-secured. (I'll not cite examples to avoid putting thoughts into idle heads.)

      We are surrounded by "stuff" with tremendous destructive potential that is "part of the landscape" and hence is not thought of as a weapon.

      --
      "This post is an artistic work of fiction and falsehood. Only a fool would take anything posted here as fact."
    5. Re:I'm not worried about RoboSapien by TheRaven64 · · Score: 3, Insightful

      And, out of interest, the chips used to implement those features were made in which Chinese factory?

      --
      I am TheRaven on Soylent News
    6. Re:I'm not worried about RoboSapien by phantomcircuit · · Score: 1

      Been watching too much NCIS Los Angeles have you?

    7. Re:I'm not worried about RoboSapien by Zoxed · · Score: 1

      > Predators and Reapers utilize security features provided by the NSA,
      Just what we need: security provided by a government department. I feel safer already :-)

    8. Re:I'm not worried about RoboSapien by John+Hasler · · Score: 1

      > And, out of interest, the chips used to implement those features were made
      > in which Chinese factory?

      None. Like most advanced "high-tech" cpus they were made in the US, Japan, Western Europe, or possibly Korea or Taiwan. All the Chinese do is stuff boards (and not even that for US military equipment).

      --
      Warning: this article may contain humor, sarcasm, parody, and perhaps even irony. Read at your own risk.
    9. Re:I'm not worried about RoboSapien by Anonymous Coward · · Score: 0

      Here's a thought. How about using the Predator or Reaper on one's own citizenry with a private military contractor at the controls.

  19. I beg to differ! by bugeaterr · · Score: 2, Funny

    Irrelevant????
    I see someone skipped the last few minutes of the Battlestar Galactica Finale!

  20. Does this really surprise anyone? by webscathe · · Score: 1

    They found that security is pretty much an afterthought in the current crop of robotic devices.

    That pretty much defines how security is thought of most of the time, it's why software is so easily compromised, and why even physical security is often easily broken through. Why do they expect it to be any different with robots? Not that that justifies it, it just doesn't surprise me.

  21. Danger Security Utility Backups And Stuff by Crash+Culligan · · Score: 2, Insightful

    MBGMorden: They speak of "compromising" these robots as if user programmable devices are inherently bad. I don't want to see devices locked down into black box "no touch" state because of some fear mongering.

    I half agree with you; user-programmable devices are very useful, and easily tailored to efficiently perform specific tasks.

    The crux of the argument, though, is "which user is giving the instructions?" Long ago on /. I made a comment differentiating security vs. transparency in government. This is much the same thing.

    On the one hand, you (and a lot of people) want the device to be as programmable, flexible, and useful as possible. That means it must be able to do a lot of things. On the other hand, people might want to use such devices for nefarious, invasive purposes like spying, theft, vandalism, etc.

    The two are not mutually exclusive, but remember:

    1. You cannot have 100% security in anything, meaning someone might sooner or later break into your progbot and do horrible things, and
    2. Until you have an establishment of security, any flexibility and programmability your progbot may have is a double-edged sword and may be used against you. Consequently...
    3. The ultimate risk which a progbot poses to its owner is a factor of both its utility and the ease of intrusion. Given that security isn't guaranteed, utility has to be given some limits or other protections must be maintained (backups, lockdowns, etc.). Adjust your cost-benefit analyses accordingly.
    --
    You cannot truly appreciate Dilbert until you read it in the original Klingon.
    1. Re:Danger Security Utility Backups And Stuff by snspdaarf · · Score: 3, Funny

      Well, if Sony perfects their wireless power setup, then using that to run the robots would mean the plug could be pulled.

      Of course, if it were Sony's wireless power, that's probably where the rogue software would come from....

      --
      Why, without your clothes, you're naked, Miss Dudley!
  22. Not dangerous unless it is a movie plot... by leuk_he · · Score: 1

    In the near future, a police officer specializes in malfunctioning robots. When a robot turns out to have been programmed to kill, he begins to uncover a homicidal plot to create killer robots... and his son becomes a target. Magnum Pi in 1984

    1. Re:Not dangerous unless it is a movie plot... by ColdWetDog · · Score: 1

      You all don't see it coming do you? You trusting fools.

      Symantec Total Security for Robots.

      The system went online August 14, 2010 ....

      --
      Faster! Faster! Faster would be better!
  23. Give a WowWee to the FBI by retech · · Score: 1

    ...that'll fix robot security real fast.

  24. No more dangerous than an un-hacked one by davidwr · · Score: 2

    It doesn't matter if a robot is "pwned" by Dr. Evil or if it bought, paid for, and run by Dr. Evil - it's equally dangerous either way.

    Everyone sing along now, robots are our friends.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
    1. Re:No more dangerous than an un-hacked one by Nadaka · · Score: 1

      Except that the one that is "pwned" is already strategically positioned inside your house. And you probably are not paying attention to your roomba while it snoops on you, or goes out of its way to vacuum up your valuables.

  25. I, for one, am unafraid by Kell+Bengal · · Score: 2, Insightful

    It always amuses me when people worry about robots going wrong or turning on us, or being used by The Bad Guys of the Week to do us harm. I know a lot of very smart people who are involved in robotics research, and they will tell you that making robots do anything is hard. Making robots do something with surreptitiously poisoned programming would be even harder. Seriously,

    if you're smart enough to remotely modify a robot's code to do something usefully nefarious, you're smart enough to sell a usefully nefarious to the government for megadollars.

    There's a lot more money to be made will legitimate killbots. It might be nice to protect robots from script kiddies who just want to throw a spanner in the works but until robots are ubiquitous enough that domestic cybernetic terrorism becomes attractive (ie, doing it for the lulz) I don't think we need to be overly worried now.

    That said, now -is- the time to be thinking about these things so that we're ready before we get to that point. Thinking, but not worried.

    --
    Scientists point out problems, engineers fix them
    altslashdot.org: The future of slashdot.
    1. Re:I, for one, am unafraid by drinkypoo · · Score: 1

      if you're smart enough to remotely modify a robot's code to do something usefully nefarious, you're smart enough to sell a usefully nefarious to the government for megadollars.

      False. The robotics researchers have done the work to find out how to make the robot do things. If you just change the order they do things in, then you can create potentially hazardous conditions. Remember, robot applies not just to the giant hockey puck that vacuums your kitchen floor but not your carpets, but also to self-driving dump trucks and the like. Changing it from "wait until the other vehicle passes, then turn left" to "wait until it's unsafe, then turn left" you have potentially committed murder (the vehicles are not automated at their endpoints, usually) or at least done massive amounts of property damage.

      There's a lot more money to be made will legitimate killbots.

      That market is not open to everyone; in fact, it's not really open to anyone. Those contracts are awarded. They're not really competed for. Remember when the U.S. Army was testing dragon skin armor vs. a new revision of the existing flak protection? They mucked up the test to cause the dragon skin to fail in spite of being lighter and better protection for our soldiers. The guy who ran the test resigned to become a head of the company which "won" the test almost immediately thereafter. Too bad about all those lives lost for his profit, though. The point stands, and is proven: you have to be essentially a made man before you can get a baby-killer grant.

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    2. Re:I, for one, am unafraid by Nadaka · · Score: 1

      I seem to recall that the glue used to hold the dragon skin scales was water soluble and in long term tests the scales eventually migrated to the bottom of the vest?

    3. Re:I, for one, am unafraid by Kell+Bengal · · Score: 2, Informative

      I'm going to pull out the Yes-I-make-robots-for-a-living-card here and tell you that both your points are quite untrue. Firstly, hacking robot code is not just a case of saying "Do Y, then do X" - I'm sorry, but it doesn't work that way, especially if you have something like cascading vision systems and sensor fusion.

      Software, and robot software in particular, is extremely brittle - you muck up one little bit and it doesn't go haywire, it just falls in a heap and does very little at all. The level of cognition required to, say, determine that it's unsafe vs safe is no different from that required to determine if it's safe vs unsafe. Maybe if you know the code well enough to slip a single '!' into the test, sure you could do something like what you suggest, but you've still got to be smart enough to know where in the code that is, /and/ be able to remotely modify that code in the first place. Actually, the best place to make malicious code changes would be in a UAV, where doing nothing at all is as good as sending the "Halt; scatter internals over a wide area" command.

      The market is most definitely open to anyone. I've been to robotics expo's geared to military customers in particular (in fact, I was at one in Boston recently) where everybody from Raytheon to a backyard operator building recon bots from modified RC trucks were present. If you've got a better mousetrap you can definitely sell it - if not to the government, then at least to a huge corporation (who might then give you a job!).

      --
      Scientists point out problems, engineers fix them
      altslashdot.org: The future of slashdot.
    4. Re:I, for one, am unafraid by Actually,+I+do+RTFA · · Score: 1

      hey will tell you that making robots do anything is hard. Making robots do something with surreptitiously poisoned programming would be even harder

      Only at a specific level. Making a robot walk with bipedal motion is hard. MAking a robot able to turn a camera image into a representation of the world around it is hard.

      Pathfinding (using A*, for instance) is solved, but not necessarily cheap. It's only hard because of the previous two subgoals

      Deciding where to go is not hard at all.

      So in other words, if you have (for example) a killer robot that shoot people without a US flag on their sleeve, and protects other people, you had to solve a lot of hard problems. Replacing the US flag with a Chinese one is not hard though.

      --
      Your ad here. Ask me how!
    5. Re:I, for one, am unafraid by drinkypoo · · Score: 1

      It was supposed to be unable to take extremes of temperature. However, those extremes would have cooked soldiers. Also, it is able to stop incendiary rounds, something the plastic flak armor doesn't do (though this is not in the test.) However, the dragon skin armor has been found to take those temps in independent testing, just not the military's testing. Hmm...

      --
      "You're right," Fisheye says. "I should have set it on 'whip' or 'chop.'"
    6. Re:I, for one, am unafraid by Anonymous Coward · · Score: 0

      Firstly, hacking robot code is not just a case of saying "Do Y, then do X" - I'm sorry, but it doesn't work that way, especially if you have something like cascading vision systems and sensor fusion.

      That's nice, except that it does work that way with the robots in question. The robots in question are essentially just glorified RC cars with built-in webcams and the ability to accept commands and send video via wifi.

      Vision systems and sensors are irrelevant since the robot has no autonomy. The attacker is responsible for interpreting what's going on and then issuing simple movement commands that further their malicious goals. Maybe that involves getting screencaps of the owner exiting the shower naked, maybe it involves crashing the robot into the owner's sleeping dog and then chasing the poor pooch around the house until the owner comes home or the batteries die, or maybe it just involves ramming the robot into the wall until something breaks. These are not pleasant things.

    7. Re:I, for one, am unafraid by Anonymous Coward · · Score: 0

      That's what people used to say about cellphones: "heh, imagine infecting a cellphone"

      And before that it was about emails: "heh, as long as you don't open the attachment you won't get infected...noobs"

      And before that it was images and mp3: "heh, when are you gonna get that a picture CAN'T get infected!... damn noobs"

      And if we go way back there was a time where windows hackers, exploits and rootkits were considered something obscure, esoteric and elite.

      Virus infection and exploits are always be possible: given the right amount of complexity of the system, connectivity, popularity and enough creativity from the hacker.

      Even printers can be used for hacking, proxying to the internal network and storing hacking tools.

      If it is programmable, it can be reprogrammed.

      I am really worried about autonomous robots going bersek, bugged or exploited: with our current technology it is not impossible, it is inevitable.

  26. How dangerous would a hacked robot be? by Onyma · · Score: 2, Funny

    That depends on the size of the robot. I'm thinking a hacked Aibo is not much of a threat. Something the size of the Stay Puft Marshmallow man... that's a whole different kinda problem.

    --
    Play me online? Well you know that I'll beat you. If I ever meet you I'll "/sbin/shutdown -h now" you. -Weird Al, kinda.
    1. Re:How dangerous would a hacked robot be? by natehoy · · Score: 1

      Well, it all depends on your definition of "threat". The physical threat posed by an Aibo or Roomba is pretty low, unless it manages to somehow trip me up or expose wiring in my house or something. I suppose it could be used to start a fire if the materials were somewhat accessible to it, or something like that. However, physical threat is not the only issue.

      If I buy a toy robot with WiFi and a webcam so it can patrol my house when I'm gone based on my remote controls, that's all well and good, but if someone took control of that same robot remotely and managed to watch me type in a banking password or caught me doing something embarrassing and put the video on my company's intranet site, that could be considered a "threat". Or if they simply had the robot park its shiny hiney in front of my shred pile and start "reading" everything in it while I was away, or walk through the house making note of motion detectors and alarm system controls for a possible future "personal visit" to deprive me of a few goods.

      Web-controlled devices have a number of threat/interception vectors. Someone could intercept the WiFi signal used for local control. Someone could intercept the HTTP request or simply log into the control page from the Internet if they can get the password. Once someone has control over that device, they are basically an intruder in my house (albeit with limited physical mobility, poor vision, etc).

      --
      "This post contains words, known to the State of California to cause thought. Wash brain thoroughly after reading."
    2. Re:How dangerous would a hacked robot be? by John+Hasler · · Score: 1

      If I buy a toy robot with WiFi and a webcam so it can patrol my house when I'm gone based on my remote controls...

      Then it isn't a robot. It's just a Waldo.

      --
      Warning: this article may contain humor, sarcasm, parody, and perhaps even irony. Read at your own risk.
    3. Re:How dangerous would a hacked robot be? by SputnikCopilot · · Score: 1

      Something the size of a roomba can spread viral videos of what you do at home, alone, with your Stay Puft Marshmallows, man.

  27. Rhetorical Question by s31523 · · Score: 2, Insightful

    Did we really need to research this, we know the answer... VERY! Of course, this depends on the robot of course.

    Robot A is tasked with going into a nuclear reactor and removing spent fuel rods. If Robot A is hacked and re-programmed to smash the shit out of the reactor, this might be dangerous.

    Robot B is tasked with preventing people from entering into an access point in a secure building by 'restraining' them. If Robto B is hacked and re-programmed to 'hack' the people at random then this might be dangerous.

    Hacking a roomba to spell your name in the carpet is not dangerous... It is all about what the level of responsibility of the robot is. It is funny that we needed research on this.

    1. Re:Rhetorical Question by ledow · · Score: 1

      On the subject of capabilities:

      Just to take a simple example... take over a household robot (assuming it has visual capabilities and/or some method to manipulate objects, even tiny ones)... steer it towards the spare house keys, have it drop them outside the house. Now you have a perfect break-in and the homeowner aren't covered by insurance (no forced entry). Have it read the letters on the table or dropping through the letterbox (bank statements, etc.). Use it to spy on your neighbours when you hear them having sex. Have it cause a fire (plug something metal into an electric socket, for instance, or something which is likely to cause sparks/fire).

      The worst vulnerabilities are the ones that people say "Oh, but what use is that?" because it means they haven't thought what use it would be. Yes, this stuff probably is more useful as a student prank than an attack on a homeowner, but it can still be used to remotely control a device in your home which has capabilities you wouldn't give a stranger - the ability to look inside your house and manipulate objects there.

      The *chances* of anything happening are very minimal (much more likely that someone just smashed your window and enters your property themselves) but it's yet another implication, yet another weakness. What if people find you can hack them to be public wifi access points? There's always a risk with anything computer controlled and the reason a lot of people prefer their systems to be wired, autheneticated and secure is because even the most silly capability (opening a document in a word processor) can easily be turned into a powerful vulnerability.

      Imagine you're a really nasty piece of work and want your neighbour to die with no trace back to you. Take over a household robot, cause a fire... Oh, dear... product failure.

      Far fetched, yes, something easily fixed from day one as a sensible precaution anyway - certainly should have been.

    2. Re:Rhetorical Question by s31523 · · Score: 1

      Agreed! Maybe we do need research; a contest on who can turn the most "innocent" robot into something sinister with a prize going to the most sinister robot. Only then will we know our true risk and get attention paid to the subject.

    3. Re:Rhetorical Question by Anonymous Coward · · Score: 0

      "Hacking a roomba to spell your name in the carpet is not dangerous... It is all about what the level of responsibility of the robot is. It is funny that we needed research on this."

      No, but hacking it to spell out your mistress's name could lead to castration or other bodily injury, if not worse. Death by roomba; a possibility!

    4. Re:Rhetorical Question by Anonymous Coward · · Score: 0

      Hacking a roomba to spell your name in the carpet is not dangerous... It is all about what the level of responsibility of the robot is. It is funny that we needed research on this.

      That's it! My NEW evil plan is to hack all the roomba's to spell my name in the carpet!

      BWAHAHAHAHAHHAHA

    5. Re:Rhetorical Question by bill_mcgonigle · · Score: 1

      It is funny that we needed research on this.

      Not that I read TFA, but having a set of guidelines for implementers to have handy is a good idea. Not every engineer is a good gamer and everybody misses something.

      I attended a symposium on Ethics for AI's a couple year ago. It's a 10-year-plus off problem, but the idea is to have through through the implications before building the things. You want things like ethics build into the design.

      --
      My God, it's Full of Source!
      OUTSIDE_IP=$(dig +short my.ip @outsideip.net)
    6. Re:Rhetorical Question by mangu · · Score: 1

      hacking it to spell out your mistress's name could lead to castration or other bodily injury, if not worse

      I don't understand. Why should my wife bother if the Roomba spells her sister's name on the carpet?

  28. better pranks through robotics by circletimessquare · · Score: 1

    so in the future, pranksters could repeat the "caution! zombies ahead!" traffic sign hack, and expand the prank by actually delivering on what the traffic sign is warning about. awesome

    http://www.statesman.com/blogs/content/shared-gen/blogs/austin/austin/entries/2009/01/28/sign_hacker_broadcasts_zombie.html

    sigourney weaver's voice repeatedly warning "caution, rogue robots" after the robots escape from the psych ward in the movie wall-e doesn't seem so far off in the future anymore

    --
    intellectual property law is philosophically incoherent. it is your moral duty to ignore it or sabotage it
  29. Toy Maker by kenp2002 · · Score: 1

    A simple but functional roomba makes for a perfect mobile landmine. Hide under a car then run out at the opportune time.

    A compromised robot can become a lethal, disposable, and potentially untraceable WMD.

    Teddy that taking bear deal could easily be compromised to issue malicious voice commands that, given someone foolish enough to use voice command on a computer and leave it unlocked when away, could be used to download malware.

    A robosapien that has been compromsed could easliy be tasked to go into the kitchen sink area and spill as many bottles of liquids as possible. What are the odds of some ammonia and chlorine products getting mixed?

    Any automated critter could easily scurry out into 70mph traffic triggering an accident...

    The list goes on... Just watch a Batman episode with the toy maker... creepy...

    --
    -=[ Who Is John Galt? ]=-
    1. Re:Toy Maker by quercus.aeternam · · Score: 1

      Such things could be pulled off, yes. As to how dangerous they would be, I seriously doubt that they classify on the 'WMD' scale.

      Plus, WMD's can't possibly work, at least according to my understanding of the laws of physics. Well, unless it's also a WEC - depending on your definition of Energy, I suppose...

    2. Re:Toy Maker by mcgrew · · Score: 1

      simple but functional roomba makes for a perfect mobile landmine. Hide under a car then run out at the opportune time.

      In The Dead Pool they did just that, only instead of a Roomba the bad guy used a remote control toy car filled with explosives, with one of the wierdest chase scenes in movies. The toy car is chasing Dirty Harry's car through San Fransisco, with the bad guy following the toy car in another car.

      Callahan is pursued through San Francisco's hilly streets in his unmarked Oldsmobile 98 squad car by a remote controlled bomb assembled by Rook, disguised as a radio controlled car. The "bomb" was in fact a highly modified Associated RC10 competition buggy topped with an off-the-shelf 1963 Chevrolet Corvette body from hobby accessory manufacturer Parma International. It was driven by world-champion radio control driver "Jammin'" Jay Halsey and was electrically powered. The sound effects of the "engine" were added in post production. This chase scene has many similarities to, and in fact may be considered a parody of, the famous chase scene in the Steve McQueen movie Bullitt. Eastwood has said that the chase was his favorite part of the film.

  30. Re:Muslims disgust me by Anonymous Coward · · Score: 0

    ignorant

  31. Difficulties? by Adustust · · Score: 1

    It's unfortunate that the only robots they had a chance to test were toys. I'm sure the government wouldn't want any studies done on the security of their robots yet. Still, toys are not a good subject to make a point with. They're for kids (or young adults I suppose), and the conditions and effort required to make this work and be of any value to the hacker is immense. They have to know that their target is worth spying on. they have to know there's a robot inside the house, or get one inside. (If you know this much, can't you just steal what you need anyway?) Sniff through network traffic to find an access code. Roll a robot around the house without anyone noticing. I've never had any of these, but I've seen quite a few. They're pretty bulky and not at all subtle. As far as the sound they make, I'm not sure but I'd assume that they're not very stealthy, are they? You're better off sitting in the kiddie pool out back with binoculars trained on the bathroom window.

  32. We've learned this lesson already... by gandhi_2 · · Score: 2, Interesting

    ...with networked printers.

    Sometimes, it can be trivial to print a few hundred pictures of dicks to an IP printer on someone elses network. Or http or telnet into the printer and wreck all kinds of havoc, or just print a ream of test pages. Or use the MFP's fax function for moar great pranksterism. Maybe get a copy of the last x scans....

    Of course, years of ubiquitous networked printers have yielded us "some serious attention to the question of" MFP security. Oh...nope? Don't expect much for robots.

    1. Re:We've learned this lesson already... by ojintoad · · Score: 1

      I often hack into my neighbors microwave and ruin his TV dinners. He tells everyone about it in his tin foil hat but no one believes him. It's only a matter of time before he goes insane...

  33. Three words: by Anonymous Coward · · Score: 0

    Just three words come to mind:

    LOST IN SPACE.

    Nuff said.

  34. they are forgetting X10 by Anonymous Coward · · Score: 0

    It is also easily hacked and it does robotic acts. I stopped using it because of it. I'm wanting for an open sourced encrypted version of remote controlling devices but don't expect to see anything any time soon. I could make my own with gumstix for about $230 per device and that may be the only way to be secure considering none of the commercial stuff is willing to let us know there encryption and with closed source encryption why should we trust it the might have back doors.

  35. Am I the only one who thought "Phalanx"? by MartinSchou · · Score: 1

    That was my first thought: "How dangerous could a hacked 20 mm Gatling gun firing upwards of 4,500 rounds per minute be?" Very!

  36. How dangerous? by Anonymous Coward · · Score: 0

    3 words: klaatu baratu nikto

  37. Guns don't kill people, Robots kill people by Anonymous Coward · · Score: 0

    ... and guns kill robots. And so do stamping machines.

  38. "making robots do anything is hard" by circletimessquare · · Score: 1

    yes, you are correct that it is not conceivable a hacker would reprogram a robot with entirely new PhD thesis level code that took months to write just for a prank. but a wartime enemy or a well-paid industrial saboteur might for the purposes of seriously destructive intentions

    furthermore, an effectively dangerous hack might be nothing more than instructing a robot to do nothing when it is supposed to be doing something, to simply erase or freeze the robot. hitting the off switch remotely is orders of magnitude easier conceptually than writing novel code. so even the benign prank-intentioned hacker might create a life-threatening situation if that robot is depended upon to do something vital. which is usually the case, for someone to invest a function to the care of an expensive robot, its probably important

    --
    intellectual property law is philosophically incoherent. it is your moral duty to ignore it or sabotage it
    1. Re:"making robots do anything is hard" by Kell+Bengal · · Score: 1

      Yes, I agree - these are potentially plausible situations, but we're not there yet. As I said in my initial post, we're at the point where we'd say "Hey, it might be a good idea to think about robot security".

      The idea of making a robot do nothing when it should do something is interesting - especially when considering the complexity of aircraft autopilots these days. I wonder to what extend those systems are hardened (although I suspect that critical avionic systems run on a completely closed network).

      --
      Scientists point out problems, engineers fix them
      altslashdot.org: The future of slashdot.
  39. "on" ....how it miss it, and by "it" I mean "on". by Anonymous Coward · · Score: 0

    I think you'll find that it was "In a paper published on Thursday". In the same way that when a person said "Thursday" they said the word "Thursday" and when they said something "on Thursday" they said something. The use of the preposition "on" stops you sounding as if your reading an autoque on CNN and the sentence is easier to parse. Its always better to say something when you've something to say.

  40. Re:Muslims disgust me by Bakkster · · Score: 0, Troll

    How has it taken so long for this to get modded into oblivion? And me without points...

    --
    Write your representatives! Repeal the 2nd Law of Thermodynamics!
  41. Tell me something new by Krneki · · Score: 1

    I have compromised all the printers at my work. Now instead of "Ready" they say random stuff.
    And only because I'm good, I don't do anything more nasty with them.

    Yeah I know, I'm bored. But it seems people like more "human" printers and no one complains.

    Now I need to move to the coffee machine. :)

    --
    Love many, trust a few, do harm to none.
  42. Sounds like the '80s movie "Runaway"... by Rexifer · · Score: 1

    "Runaway" was a near-future movie about a police division that dealt with hacked robots that starred Tom Selleck and was written and directed by Michael Crichton (of Jurassic Park fame). The thrust of the main plot was about a terrorist that devised a hack that turned service robots into killing machines...

  43. Hide behind the sofa by PPH · · Score: 1

    The Daleks are coming.

    --
    Have gnu, will travel.
  44. Military Drones by nasdaq · · Score: 1

    There have been a couple instances recently where the Predator drones have been malfunctioning in odd ways. They have programming that when they loose communication with the controller they return automatically to base. These have been running away to less than convenient locations. Either on their own or hijacked they haven't said exactly.

    Couple hellfire and sidewinders could do a hell of a lot of damage.

    Be scared.

    1. Re:Military Drones by John+Hasler · · Score: 1

      > Be scared.

      Of that? And not the fact that about 36,000 Americans die of seasonal flu in a typical year? Why? What's wrong with having a sense of proportion?

      --
      Warning: this article may contain humor, sarcasm, parody, and perhaps even irony. Read at your own risk.
  45. about:robots by wiredog · · Score: 1

            * Robots may not injure a human being or, through inaction, allow a human being to come to harm.

            * Robots have seen things you people wouldn't believe.

            * Robots are Your Plastic Pal Who's Fun To Be With.

            * Robots have shiny metal posteriors which should not be bitten.

    And they have a plan.

               

  46. yeah that always bothered me by circletimessquare · · Score: 1

    i'm certain the air force is paying attention to security, but i'll bet the chinese and the russians and the indians and the pakistanis are paying very close attention too. examining communication protocols used and logging command and control signals sent and received to reverse engineer standard operating procedure, and perhaps engaging in espionage in the usa, spying on and stealing the crafts' code from its makers

    the idea of course being so that they can shut these things down or turn them against their makers in the event of war with the usa. and then to simply sit on these secrets, and perhaps never use them. but as the case of abdul qadeer demonstrates, these military espionage secrets sometimes wind up for sale to the highest bidder

    al qaeda and the taliban will never have their own predator or reaper, but its not inconceivable for them to perhaps buy the hack necessary to simply send signals up there to turn around and fire on us servicemen instead

    the irony of course is that the technologies that violent jihadists already use are the fruits of the sciences of open and tolerant societies. these sciences would never flourish in the types of societies religious fundamentalists wish to create. allah did not give them the means to wage war in the infidels, the infidels did

    and most of iranian "advancement", such as their satellite or their nuclear program, is just tech stolen from the west and rebranded as blessings of the revolution. its good propaganda, but its not the truth, and its hard to hide the fact the west is always leading in science because the west's principles of more open and tolerant societies results in better scientific minds. to be a good scientist, you need to question everything, and in the islamic world, questioning some things is simply a path to your arrest and censure. you can't call yourself an advanced modern society when you have to steal your tech from other more tolerant parts of the world. sadly, the islamic world was in fact the basis for much of scientific advancement while the middle ages swallowed europe in barbarity. but its been a long time since then, and now barbarity is trying to swallow the islamic world

    --
    intellectual property law is philosophically incoherent. it is your moral duty to ignore it or sabotage it
    1. Re:yeah that always bothered me by handy_vandal · · Score: 1

      ... and its hard to hide the fact the west is always leading in science because the west's principles of more open and tolerant societies results in better scientific minds.

      I agree with your observation that science flourishes in open and tolerant societies.

      But branding Islam as closeminded or intolerant is not historically valid. During the golden age of the Islamic Caliphate -- say, 700 to 1000 AD -- that empire was home to science, arts, and philosophy of unprecedented scope and beauty; this was a truly cosmopolitan culture, remarkably tolerant of religious and ideological diversity. (Meanwhile, subsequent to the collapse of the Roman Empire, the West had lost, among a great many other things, the knowledge of brickmaking.)

      Islam is not necessarily intolerant, nor is Christianity (or atheism) necessarily tolerant. Hitler was Christian (go look up photos of Nazi leaders celebrating Christmas; very strange, yuletide ans Swastikas). I'm not sure about Stalin, but I'll guess Atheist. Religions are not intolerant: fanatic individuals are intolerant.

      I submit that barbarity is trying to swallow up not merely the Islamic world, but the entire world.

      --
      -kgj
  47. I think it's entirely ontopic by Anonymous Coward · · Score: 2, Insightful

    GP isn't actually offtopic. This article is directly or indirectly about fear mongering. Pointing out that there are carnivorous child-eating lizards, but that they live on the other side of the planet, is ontopic for "Under the Bed Monster fears" because it's reality, and the more of it you connect to the less subject you will be to irrational fears.

    Your post is similarly on topic, since the robots that we should seriously worry about are indeed well secured against hackers.

    Spykee is too loud to "sneak" up on anyone, but despite this and the "hype phrasing" of the articles, we finally have robots that are capable of external abuse. Spykee could instruct a trusting child as to how to unlatch a gate and fall down the stairs. Rovio could wait patiently by the stairs and slide exactly under a falling foot at a critical moment. These things can be done today, over the Internet, from the other side of the world. While Usenet is still in operation, it's pretty clear that the police are not well equipped for catching telemurderers.

    Now would seem a good time to consider the issue. If we're posting on /. we can probably set our WPA-Enterprise security and require ssh tunnelling to access our home networks. Less than 10% of the people buying these robots can say the same. The infantile geek attitude of "serves 'em right for not securing it" needs to be discarded.

    We geeks of the world are a significant force in the robot-buying market. Without exception all my friends would ask me first if they were going to buy a robot. We should let the manufacturers know that we won't buy or recommend "hard to secure" bots for our homes. Robot makers are one group that would actually listen to us. And since the tools for doing it right are freely available (though cost money to integrate), it's not an unreasonable stretch for the manufacturers.

    While it's obvious how computer-people make the world an incrementally better place, this is one places where taking on some principals could save real living breathing humans. Seems worthy of some effort.

  48. Do sharks count? by Anonymous Coward · · Score: 0

    Did they test sharks with frickin' lasers?

  49. How to tell if your robot has been hacked by Anonymous Coward · · Score: 0

    you: "Robot, make me a sandwich"
    robot: "No."
    you: "sudo Robot, make me a sandwich"
    robot: *punches you in the face*

  50. is your EPROM by NSN+A392-99-964-5927 · · Score: 1

    Ultraviolet.

    --
    All cows eat grass!
  51. Re:Muslims disgust me by Anonymous Coward · · Score: 0

    Sorry, I slept late.

  52. Ghost in the Shell... by AliasMarlowe · · Score: 1

    Hacking into digitally enhanced humans (and robots: androids/gynoids) in the future. Excellent animated SciFi movies.
    http://www.imdb.com/title/tt0113568
    http://www.imdb.com/title/tt0347246

    --
    Those who can make you believe absurdities can make you commit atrocities. - Voltaire
    1. Re:Ghost in the Shell... by BarryHaworth · · Score: 1
      You don't even need it to be a robot - just remote control.

      Check out "Malcolm":

      http://www.imdb.com/title/tt0091464/

      --
      I am a Statistician. One false move and you are a Statistic
  53. Bad iTouch... by Anonymous Coward · · Score: 0

    Great. Now we have to worry about "good" iTouching vs. "bad" iTouching.

  54. Comment removed by account_deleted · · Score: 1

    Comment removed based on user account deletion

  55. No fans of The Office (US)? by Anonymous Coward · · Score: 0

    "Look, I gave him a six-foot extension cord so he can't chase us." -- Dwight

  56. Runaway..... by cb95amc · · Score: 1

    Ask Tom Selleck!

  57. Automation by HockeyPuck · · Score: 1

    Any machine or robot that performs an automated task could theoretically be reprogrammed. Ever been to a car factory? You nolonger have armies of people welding the frame together. One could potentially instruct one robot to create a few weaker welds. Then it's up to the QA team to catch it. If the number was low enough, they might not be able to trace it back to the robot being hacked or programmed incorrectly since 98% of the time it makes that one out of 500 welds correctly.

  58. Busy by Anonymous Coward · · Score: 0

    I'd speculate that the robots' designers have been too busy building the robots to be properly socialized with the acceptable amount of paranoia. Who's got time for TV when you're building an artificial nervous system?

  59. Tobor the Great by Anonymous Coward · · Score: 0

    This is old news!

    From Tobor we learned to NEVER give the remote to a hostile DA.

    http://www.imdb.com/title/tt0047590/

  60. Re:Muslims disgust me by Mister+Whirly · · Score: 1

    Yeah, tell them. Our invisible imaginary friend can beat up your invisible imaginary friend! And we are willing to fight to the death just to prove so!

    Makes a lot of sense, doesn't it?

    --
    "But this one goes to 11!"
  61. Robot Voyeur MILF Porn by Anonymous Coward · · Score: 0

    Robot Voyeur MILF Porn: the next big thing for bot net targets.

    "Honey, I swear that robot is watching us."

  62. Can we stop, please? by blhack · · Score: 2, Insightful

    Can we stop with this completely illogical fear-mongering? Hacked robots? Are you people insane?

    When you say "robot", people think of the sort of mindless, strangely powerful, totally mystical automotons found in sci fi movies and television shows. People think cylons and centurions, not a couple of servos and some sensors.

    Are hacked robots dangerous? No. Or at least they are no more dangerous in the "hacked" form than their unhacked form. My advice is to not build robots with energy-weapons for arms.

    If the "robot" that builds your car gets "hacked" (and by this I mean the PC that has some hydraulics connected to it gets somehow "hacked"), unplug it.

    Done.

    --
    NewslilySocial News. No lolcats allowed.
  63. I'm not worried... by jd2112 · · Score: 1

    As long as the robots don't find religion and decide to wipe out the human race again like they did about 150,000 years ago.

    --
    Any insufficiently advanced magic is indistinguishable from technology.
  64. Too small, but bigger ones are coming. by Animats · · Score: 1

    Those are just toys, and toys at low price points. They're too weak to do much except look around and transmit video and audio.

    Now look at the PR2 Personal Robot. That has real manipulation capabiilty and can be teleoperated over WiFi. Now there's a potential problem.

  65. Re:Muslims disgust me by TheCarp · · Score: 1

    I have thought the same solution could be found here as for Soccer hooliganism. Why not provide a few large arenas where people who want to fight and maybe kill each other can go and do it. Today, muslims from the east entrance, all comers from the west. Whichever side is left standing moves on to the next round robin.

    -Steve

    --
    "I opened my eyes, and everything went dark again"
  66. Comment removed by account_deleted · · Score: 1

    Comment removed based on user account deletion

  67. Lesson Plan TK421 - House Atreides Archive by abbynormal+brain · · Score: 1

    I'm a little rusty on my Dune (novel) lore but isn't the reason they don't have wide-spread use of robots because there was a man vs machine war in the history behind the lore of Dune?

    Here's why I ask - so far, Science Fiction writers have been visionaries either predicting the future or paving its way (I.e., the Star Trek communicator looks a lot like the cell phone, space exploration, etc).

    Let's ask ourselves: Why exactly do we want/need robots? Can't we build non-intelligent, non-combat capable solutions for what we plan on building robots for? I don't know ... the lessons of the visionaries are being treated as "fantasy" and all the while - it's us who create monsters without thinking.

    --
    L'esperienza de questa dolce vita (The experience of this sweet life) - Dante Alighieri, The Divine Comedy
    1. Re:Lesson Plan TK421 - House Atreides Archive by MBGMorden · · Score: 1

      You're correct, but in Dune they also didn't rely on computers, instead training humans (mentats) to do extremely fast mathematics in their head. Herbert didn't quite envision the advance of the computer correctly though; either that or his characters certainly didn't. In the first novel one character wishes that they had the computer back and another character assures him that even the most simple of human could outdo the old machines.

      Overall though, I think that stories like this are just nothing more than entertaining diversions. They're called fiction for a reason and anyone who learns a lesson from events that never actually happened is making a logical error. It'd be like trusting an experiment's outcome when you know that the data was fabricated because you think that's how it would have turned out anyways. The simple fact is that curiosity and a constantly improving set of technology has made the human race what it is today. Without that we'd be little better than the rest of our primate cousins. I kinda like the drive towards improving ourselves personally.

      --
      "People who think they know everything are very annoying to those of us who do."-Mark Twain
    2. Re:Lesson Plan TK421 - House Atreides Archive by TheRaven64 · · Score: 1

      I'm a little rusty on my Dune (novel) lore but isn't the reason they don't have wide-spread use of robots because there was a man vs machine war in the history behind the lore of Dune?

      It depends. In the original six books there are numerous references to an ideological conflict between two groups of humans, those who delegated their thinking to machines (and became less human in doing so) and those who refused to. In God Emperor, it is revealed that part of Leto II's Golden Path is pushing the social evolution of humans to the point where they will no longer be tempted to allow machines to think for them. They have robots in the sense that we have them now; automata that perform one fixed function, but they don't have thinking machines.

      In the prequel series written by two people who completely missed all of the subtly in the originals, there is a third-rate space opera fight between EVIL machines which vivisect and enslave humans for no obvious reason, and humans.

      --
      I am TheRaven on Soylent News
    3. Re:Lesson Plan TK421 - House Atreides Archive by John+Hasler · · Score: 1

      > I'm a little rusty on my Dune (novel) lore but isn't the reason they don't
      > have wide-spread use of robots because there was a man vs machine war in the
      > history behind the lore of Dune?

      No. It's because the silly feudal society would have made even less sense with robots.

      --
      Warning: this article may contain humor, sarcasm, parody, and perhaps even irony. Read at your own risk.
    4. Re:Lesson Plan TK421 - House Atreides Archive by blitziod · · Score: 1

      umn that is why in the future all robots will have to be GAY. Yes extremely nelly GAY robots, who will not reproduce or fight anybody.

      --
      The only way to bust a doper--is when you yourself become a smoker!
  68. I predict that when Skynet rises... by petrus4 · · Score: 1

    ...it will be initially written in Awk, and its' native operating system will be NetBSD.

  69. Eat it Japan!! by grayn0de · · Score: 1

    all ur botz r belong to us!!

  70. hacking kitchen knives by Inovaovao · · Score: 1

    I'm shocked at how easily one can hack a kitchen knife to make a deadly weapon!

    1. Re:hacking kitchen knives by John+Hasler · · Score: 1

      Mod parent up.

      --
      Warning: this article may contain humor, sarcasm, parody, and perhaps even irony. Read at your own risk.
  71. Think of the children... by Anonymous Coward · · Score: 0

    The robot witchhunt will begin the day after someone taps into the wireless video feed of a device in a child's bedroom and then posts the video on YouTube.

  72. Re:Muslims disgust me by Foobar+of+Borg · · Score: 2, Funny

    I have thought the same solution could be found here as for Soccer hooliganism. Why not provide a few large arenas where people who want to fight and maybe kill each other can go and do it. Today, muslims from the east entrance, all comers from the west. Whichever side is left standing moves on to the next round robin.

    Hell, I'd pay good money to see Pat Robertson and Osama bin Laden in a no-holds-barred cage match! We could probably pay off a lot of the national debt just by selling tickets.

  73. Awwwww....CRAP! by Seraphim_72 · · Score: 1

    Honey! Somebody hacked the Roomba again and sucked up the cat. Get my screwdriver and crowbar.

    --
    Slashdot, where armchair scientists get shouted down and armchair theologians get modded up.
  74. Evil Robots doing bad... by Motofino · · Score: 1

    SWEET!! Commandeering a robot for nefarious reasons? We al lknew someone was "watching" us behind the roomba eye.. Yikes!

  75. Re:Muslims disgust me by Anonymous Coward · · Score: 0

    Strawman. OP made no such claim. Your ignorance betrays you as Muslim filth. Go wallow in the shit of your own childish but deadly expressions of rage, pig...

  76. Mod parent up by handy_vandal · · Score: 1

    While it's obvious how computer-people make the world an incrementally better place, this is one places where taking on some principals could save real living breathing humans. Seems worthy of some effort.

    Hear, hear! Mod parent up!

    Note to parent: why be AC? You've got something to say that's worth listening to -- I'd like to know who you are, so I can follow your thoughts on future posts.

    --
    -kgj
  77. OK, no problem- everybody memorize the phrase: by Anonymous Coward · · Score: 0

    "Klaatu barada nikto", please repeat that.

  78. The Naked Sun by westlake · · Score: 1

    In Asimov's actual stories, the Three Laws were NEVER violated, and nobody ever was killed by a robot.

    The missing word here is "knowingly."

    The killer in the novel uses robots as his proxies. The Three Laws can be violated if the robot can't foresee the consequences of his actions.

    The victim is an amateur chemist who routinely uses common household glassware for his experiments.

    Robot A is instructed to prepare a mixture in the lab.
    Robot B is instructed to retrieve a decanter of wine from the lab and return it to the dining room table.

  79. i already said that by circletimessquare · · Score: 1

    i specifically alluded to the flourishing of the sciences in the islamic world in the middle ages already in my comment you responded to. why are you pointing out to me what i already wrote?

    "Islam is not necessarily intolerant, nor is Christianity (or atheism) necessarily tolerant"

    absolutely correct, and i never said or implied anything remotely like that

    "I submit that barbarity is trying to swallow up not merely the Islamic world, but the entire world"

    the islamic world (the geographic region, not the religion), right now (not 1000 years ago) is obviously and genuinely far more intolerant in its laws and social norms than western countries. the islamic world obviously has a problem, and it does no good for the islamic world or yourself to deny the plainly obvious. it doesn't have to turn into a criticism of islam, nor does it have to ignore historical realities when the islamic world was the light of the world, but right now, the islamic world specifically is in trouble, and it will begin getting out of trouble just as soon as everyone agrees it deserves some harsh criticism, instead of blindly prideful deflections from within and willfully know nothing deflections from well intentioned but clueless westerners

    --
    intellectual property law is philosophically incoherent. it is your moral duty to ignore it or sabotage it
    1. Re:i already said that by handy_vandal · · Score: 1
      i specifically alluded to the flourishing of the sciences in the islamic world in the middle ages already in my comment you responded to. why are you pointing out to me what i already wrote?

      My mistake, I failed to read your post carefully.

      --
      -kgj
  80. When nanobots attack by Anonymous Coward · · Score: 0

    When nanobots get hacked, we might as well forget about H1N1 or other biological viruses.

  81. Oblig : BTMSMA by Anonymous Coward · · Score: 0

    "What? Insecure robots? Bite my shiny metal ass, chump!"

  82. The First Law of Robotics by commodore64_love · · Score: 1

    See Isaac Asimov for the exact quote, but it basically says robots may not harm humans. Because the law is encoded *in the hardware* there's no way that it can be altered.

    --
    "I disapprove of what you say, but I will defend to the death your right to say it." - historian Evelyn Beatrice Hall
  83. I just have one thing to say about this: by Rick+Genter · · Score: 1

    Bite my shiny metal ass.

    No, really, you're alright, I like you.

    --
    Don't underestimate the power of The Source
  84. Remember the Zeroth Law of Robotics by Nivag064 · · Score: 1

    Well Asimov had 4 laws of robotics! (But he started of with only 3) He added the Zeroth law that allowed a robot to harm one group of humans if it gave a greater benefit to a larger number. The Zeroth law was required for robots that controlled things on a planet wide basis and law enforcement robots, otherwise such robots would be unable to act. Consider someone about to shoot down an aeroplane with hundreds of people on it - one life against many.