Slashdot Mirror


Is It Illegal to Trick a Robot? (ssrn.com)

An anonymous reader writes: Can you get into trouble under anti-hacking laws for tricking machine learning...? A new paper by security researchers and legal experts asks whether fooling a driverless car into seeing a stop sign as a speed sign, for instance, is the same as hacking into it.
The original submission asks another question -- "Do you have inadequate security if your product is too easy to trick?" But the paper explores the possibility of bad actors who deliberately build a secret blind spot into a learning system, or reconstruct all the private data that was used for training. One of the paper's authors even coded DNA that corrupts gene-sequencing software and takes control of its underlying computer, and the researchers ultimately warn about the dangers of "missing or skewed security incentives" in the status quo.

"Our aim is to introduce the law and policy community within and beyond academia to the ways adversarial machine learning alter the nature of [cracking] and with it the cybersecurity landscape."

2 of 82 comments (clear)

  1. Re: Stop sign by javaman235 · · Score: 3, Interesting

    AIs can be tricked with things way different than what would fool human mind:

    https://www.google.com/amp/s/w...

    --
    -The art of programming is the pursuit of absolute simplicity.
  2. Re: Is it illegal trick a neural net? by javaman235 · · Score: 3, Interesting

    Exactly. Just saw this article on advertisers and behavior control. It cited how people respond to the smell of disinfectant by keeping a room cleaner, cited it as a sort of mental weakness. Of course non-sociopathic people, on smelling disinfectant, will take it as a sign someone really wants the room clean, and thus keep it clean as a courtesy and possible medical safety thing...But advertisers see this sort of thing as a behavioral switch, and would feel free to place disinfectant smells in a businesses just to get that behavior. The whole mode of thinking behind advertising is the kind of manipulation that could lead AI astray.

    --
    -The art of programming is the pursuit of absolute simplicity.