Slashdot Mirror


Researchers Built an 'Online Lie Detector.' Honestly, That Could Be a Problem (wired.com)

A group of researchers claims to have built a prototype for an "online polygraph" that uses machine learning to detect deception from text alone. But as a few machine learning academics point out, what these researchers have actually demonstrated is the inherent danger of overblown machine learning claims. From a report: When Wired showed the study to a few academics and machine learning experts, they responded with deep skepticism. Not only does the study not necessarily serve as the basis of any kind of reliable truth-telling algorithm, it makes potentially dangerous claims: A text-based "online polygraph" that's faulty, they warn, could have far worse social and ethical implications if adopted than leaving those determinations up to human judgment.

"It's an eye-catching result. But when we're dealing with humans, we have to be extra careful, especially when the implications of whether someone's lying could lead to conviction, censorship, the loss of a job," says Jevin West, a professor at the Information School at the University of Washington and a noted critic of machine learning hype. "When people think the technology has these abilities, the implications are bigger than a study."

70 comments

  1. Depends on "who's" online polygraph it is by mykepredko · · Score: 3, Insightful

    If this app was put online labeled as "Fred's AMAZING online truth teller" with the usual ads for bikinis, penis enlargement, crockery, the latest Chevy, I don't think you have anything to worry about in terms of it causing problems.

    If it's part of the Google home page or comes up automatically when submitting documents to the IRS, I think there is a great deal of concern regarding whether or not people believe the results are accurate.

    1. Re:Depends on "who's" online polygraph it is by Anonymous Coward · · Score: 0

      If it's part of the Google home page...I think there is a great deal of concern regarding whether or not people believe the results are accurate.

      We care about your privacy and take your data security seriously.

  2. Machine Learning is going to do rocket science! by Hillie · · Score: 2

    But it can't even stop auto correct from sucking!

    --
    - Alex
    1. Re:Machine Learning is going to do rocket science! by DickBreath · · Score: 1

      AI doesn't need to do rocket science.

      I would settle for an online Troll detector.

      And maybe also an AI that tells us what we are supposed to think.

      --

      I'll see your senator, and I'll raise you two judges.
    2. Re:Machine Learning is going to do rocket science! by apoc.famine · · Score: 1

      Since humans can't tell the difference between honest text and sarcastic text, and nor can they reliably determine what's trolling and what's not, I highly doubt that AI will be able to.

      And even if it's able to, a good percent of humans won't agree! What's the use in that then?

      You've helpfully volunteered a perfect example for why both humans and AI fail at this, DickBreath, I know that AI won't get this right, and there's a good chance half the humans won't either.

      --
      Velociraptor = Distiraptor / Timeraptor
  3. Should use it on it's own press release by gurps_npc · · Score: 1

    I suspect it will say "false"

    --
    excitingthingstodo.blogspot.com
    1. Re:Should use it on it's own press release by ark1 · · Score: 1

      Better yet "Fake News!:

    2. Re:Should use it on it's own press release by smoot123 · · Score: 1

      If they need a reliable source of untruths as a dataset, follow @realDonaldTrump.

      Huh. I was trying to think of a reliable source of truthful writings. Give me a minute...

    3. Re:Should use it on it's own press release by Rockoon · · Score: 1

      The sad part is, you have probably already named a reliable source of truthful writings.

      --
      "His name was James Damore."
  4. Likely closer to sarcasm detector by bugnuts · · Score: 4, Funny

    When it can determine its own press release is a lie, then I'll believe it.

    1. Re:Likely closer to sarcasm detector by Anonymous Coward · · Score: 0

      Well done, sir.

    2. Re:Likely closer to sarcasm detector by Nahor · · Score: 1

      "Cake" would be another good test.

    3. Re:Likely closer to sarcasm detector by Anonymous Coward · · Score: 0

      Or death

  5. All Machine Learning systems have an error rate by sfcat · · Score: 3, Insightful

    All ML algorithms have an error rate. Its baked into the design. ML researchers talk about error rate all the time. There is even a term, 'irreducible error' in ML that refers to data points that can never be classified correctly by a specific algorithm. Its a mistake to completely trust what a computer database tells you because the wrong data could have been input or bugs could have changed that data in a weird way. Its all those risks plus the error that comes from the ML algorithm. The way to get around this is to have multiple algorithms "vote" but even then there is still an error rate. The error rate can be double digit % or lower than 1% but its always there. And all of this is on top of the risk of bad data just like a DB gives you. Garbage in/garbage out is a real principle. Trusting this stuff is tricky but the bar isn't perfection. Its better than a skilled human. And since I don't really trust a "skilled human" in lie detection, why on earth would I trust a ML algorithm that at best is only marginally better than that and could be far worse.

    --
    "Those that start by burning books, will end by burning men."
    1. Re:All Machine Learning systems have an error rate by Anonymous Coward · · Score: 0

      What about the human side of lie detection? Can it tell if a person is mistaken instead of lying? What about an accomplish con man that can lie convincingly? Or my mother who genuinely believes the stories she makes up? What about a white lies, where the intent it is be polite not deceive? What about propaganda and campaign promises where what is said has no bearing on anything really? What if a statement is only partially a lie? What if a statement, while completely true, is misleading, like lying by omission?

    2. Re:All Machine Learning systems have an error rate by sfcat · · Score: 1

      What about the human side of lie detection? Can it tell if a person is mistaken instead of lying? What about an accomplish con man that can lie convincingly? Or my mother who genuinely believes the stories she makes up? What about a white lies, where the intent it is be polite not deceive? What about propaganda and campaign promises where what is said has no bearing on anything really? What if a statement is only partially a lie? What if a statement, while completely true, is misleading, like lying by omission?

      That's all 'irreducible error'...aka the real world...aka gray area...aka it depends

      --
      "Those that start by burning books, will end by burning men."
    3. Re:All Machine Learning systems have an error rate by DamnRogue · · Score: 2

      Also, most ML algorithms of this type produce a continuous score and not a binary Yes/No classification. Human users/customers provide a score cutoff that gives an acceptable confusion matrix for their use case.

      Alternatively stated, the machine does not say "Bob is lying", rather, "I think Bob is lying with X confidence".

    4. Re:All Machine Learning systems have an error rate by sfcat · · Score: 2

      Also, most ML algorithms of this type produce a continuous score and not a binary Yes/No classification. Human users/customers provide a score cutoff that gives an acceptable confusion matrix for their use case.

      Alternatively stated, the machine does not say "Bob is lying", rather, "I think Bob is lying with X confidence".

      You are confusing Regression with Classification. Classification produces a yes/no, choice A/B/C type answer. Regression produces a number or set of numbers often in a given range. You can turn a Regression system into a classifier with a simple cutoff but not vis-versa. Its common that ML algorithm implementions come in a Classification and Regression flavors. Also, getting a confidence interval out of a ML algorithm is possible but really difficult and of potentially questionable use. Its more honest to just list the overall error rate of the algorithm next to the prediction.

      --
      "Those that start by burning books, will end by burning men."
    5. Re:All Machine Learning systems have an error rate by Creepy · · Score: 1

      Pretty sure I can tell some stories that are 100% true but only about 5% believe them, much less machines. Weird things happen when you work in the music industry (which I did when I was in my 20s, not anymore). Really. Effing. Weird. Things. Like finding a 2 foot long, 2 inch thick rubber cock under a couch with a rubber chicken, which we HAD to use in our show... because. Bad things followed, but it was ridiculously funny until then.

    6. Re:All Machine Learning systems have an error rate by Rockoon · · Score: 1

      You are confusing Regression with Classification. Classification produces a yes/no, choice A/B/C type answer.

      Stop modding this guy up as he really doesnt know what he is talking about. Grossly so.

      All the top image classifiers produce probabilities, and further produce many probability not just a single one. They arent answering the question "Is this an image of a cat?" They are answering the questions "Whats the chance that there is a cat in this picture? What the chance that a horse is in this picture? Whats the chance that there is a burned up Tesla Roadster in this picture? Whats the chance that someone is standing in this picture?"

      In this way, the image classifier can make far more specific statements, such as "Image of four girls playing volleyball"

      --
      "His name was James Damore."
  6. And then the next day... by Anonymous Coward · · Score: 0

    Then someone will invent an online lie corrector to massage your lies to look like truth.

  7. Online Lie detector Bunk by foxalopex · · Score: 1

    You can't tell if someone is lying online from just text. Humans tell if people are lying by their Facial expressions, Tone of voice and body language. It's actually very hard to lie without slipping in one of these areas unless you're a psychopath or a very skilled actor. It's much harder to tell from say a chat.

    1. Re: Online Lie detector Bunk by Anonymous Coward · · Score: 0

      I don't need to see your face to know that All statements are lies.
      Forget about a lie detector, we need a TRUTH detector.
      And no they are not the same or direct opposites, truth and lie is not a simple binary choice.

  8. A text-based "online polygraph" that's faulty... by Merk42 · · Score: 1

    Much like the "real" polygraph that is prone to false positive and easy enough to fool.

  9. Re:Dems are gonna shit by Anonymous Coward · · Score: 0

    Norway is a democracy. Sweden is a democracy. Canada is a democracy. France is a democracy. UK is a democracy. All five of which have better quality of life standards than the US.

    But yeah, shut up

  10. Re: Machine Learning is going to do rocket science by Anonymous Coward · · Score: 0

    Keep adding to your post and the machine will increase its accuracy and post a scathing rebuke

  11. Re:Dems are gonna shit by jellomizer · · Score: 1, Offtopic

    So you don't care how bad things get, just as democrats suffer.

    It isn't that the Democrats and Republicans have irrefutable differences, they are both Americans, and share many of the same culture and ideals.

    Unfortunately you have influenced by propaganda and are no longer objective, and allowed the crudity instinct in you to become dominate.

    --
    If something is so important that you feel the need to post it on the internet... It probably isn't that important.
  12. Is everyone a liar? by Anonymous Coward · · Score: 0

    Yes

    1. Re:Is everyone a liar? by Anonymous Coward · · Score: 0

      "Yes"

      Dr. House?

    2. Re:Is everyone a liar? by Anonymous Coward · · Score: 0

      The Doctor

  13. Future Slashdot by Anonymous Coward · · Score: 0

    Maybe Slashdot of the near future could be telling me if I'm lying or not as I type? It's a helpful service, in a Clippy kind of a way.

    1. Re:Future Slashdot by UnknownSoldier · · Score: 1

      /Oblg. Clippy: I see that you are trying to lie! Would like help embellishing the truth or just out right lie and ignore facts; calling everyone who disagrees with you sexist, racist, and misogynistic supporting the patriarchy?

  14. False positive generators by Anonymous Coward · · Score: 0

    False positive generators are great for going fishing if you need an excuse to bypass people's rights.
    Oh my dog "detected".

  15. I'm sure Kirk and Harry Mudd can deal with this .. by fahrbot-bot · · Score: 2

    Captain Kirk: Everything Harry tells you is a lie. Remember that. Everything Harry tells you is a lie.
    Harry Mudd: Now listen to this carefully, Norman. I am... lying.

    --
    It must have been something you assimilated. . . .
  16. Polygraphs aren't supposed to work by rsilvergun · · Score: 1

    they're supposed to provide probable cause for a search warrant.

    --
    Hi! I make Firefox Plug-ins. Check 'em out @ https://addons.mozilla.org/en-US/firefox/addon/youtube-mp3-podcaster/
  17. Re:Dems are gonna shit by Anonymous Coward · · Score: 0

    How have things gotten bad?

  18. It will be (ab)used by wbr1 · · Score: 2
    This 'AI' and others of it's ilk will be jumped on by law enforcement and government. They do not care if it is wrong. Just like existing polygraphs, it will be used to psychologically bully people and fool juror/the populace while having no basis in real science.

    With the current trend towards anti-intellectualism we have now, this will only get worse, not better.

    Read some of the info here about 'lie detection'. https://antipolygraph.org/

    I have some intimate experience with polygraphs. As a convicted sex offender, I have had to submit to them as part of a treatment regimen. I have passed polygraphs I lied on, and failed them while telling the truth. The judgement lies in the examiners subjective whims, not anything objective.

    --
    Silence is a state of mime.
    1. Re:It will be (ab)used by PopeRatzo · · Score: 1

      This 'AI' and others of it's ilk will be jumped on by law enforcement and government.

      No. It will first be used extensively in private industry. Watch and see.

      --
      You are welcome on my lawn.
  19. Re: I'm sure Kirk and Harry Mudd can deal with thi by Anonymous Coward · · Score: 0

    Kirk: we know how this will end asshole

  20. Erk by cascadingstylesheet · · Score: 1, Insightful

    But when we're dealing with humans, we have to be extra careful, especially when the implications of whether someone's lying could lead to conviction, censorship, the loss of a job,

    We already hit people with all that stuff just for typing stuff online that we don't like, to say nothing of whether it's true or not!

  21. LoL by meerling · · Score: 2

    As nobody has actually built a "lie detector" that is significantly more effective than random chance, and yes that includes the polygraph, those "researchers" are fooling themselves.
    Even the inventor of the polygraph agrees that it's just b.s.

    Are we sure these people aren't actually from North Korea?
    You know, the place where "researchers" have claimed to have found a Magical Unicorn Cave, and have perfected human cloning, and so many other absurd claims.

  22. Polygraphs only work if you believe in them by Anonymous Coward · · Score: 0

    The equipment used is just a prop. The actual test is a 'process'. The 'test' is designed to place stress on a subject and then the subject is told they are lying and or inconclusive results, etc and their behavior is observed. Little scratching machines with dials or the newer fancy laptop doodads are nothing more than props designed to make the subject believe they will be caught in a lie. You have to believe that the prop works for the 'test' to work. It's basically conditioning a person to believe, sometimes over a period of hours up to being called back in and told their results were 'inconclusive' a week or later or whatever. Oh noes!
    The only 'science' involved in the equipment is the equipment between the polygrapher's ears and their ability to manipulate the testee.

  23. Re:Dems are gonna shit by Anonymous Coward · · Score: 0

    People do things, despite how others may feel

    Chuds do things, to spite how others may feel.

  24. Re:A text-based "online polygraph" that's faulty.. by Anonymous Coward · · Score: 0

    Because a polygraph only measures arousal (in the brain sense), and cannot explain why - and if you can remain calm you can fool it. There's a reason they are not used as evidence in court, the supreme court saying the results are "little better than could be obtained by the toss of a coin" is a huge part of it.

  25. Ever read Asimov's Foundation? by Anonymous Coward · · Score: 0

    Psychohistory predicts the actions of 'mobs' but NEVER the individual...

    Or a more common fallacy. Most women are murdered by someone close they know- BUT this does not mean that in an individual murder case the husband is 'guilty' cos of this statistic.

    This 'online' 'lie' detctor uses the same fallacy. Process a lot of known online lies for commonality in the form of the text. Then FALSELY reverse this process to analyse new text and declare it 'lies' or 'true'.

    Mid Betas and lower fall for this garbage every time.

    'Universal Education' exploits the credulity of mid Betas and lower for political control purposes. To weaponise mob stupidity when the mob has been 'educated' to thinks itself 'smart'. And the thickos that fall for such fallacious arguments make up the majority of those that still visit this site. Otherwise the Deep State could never have shipped billions of dollars of arms from ex-Soviet states to Syria to arm wahhabi terror gangs backed by Turkey and Saudi Arabia in an attempt to end the SECULAR regime of Syria- and act of pure satanic terror that required the backing of the same thickos of the West.

  26. Let's feed this thing the bible and quran by HaroldJ.Wolfe · · Score: 2

    I'm dying to see what it says. It will be fooled like 85% of the population

  27. This is a weapon by Anonymous Coward · · Score: 0

    This is a weapon, no problem. Protected by the constitution. Next.

  28. What would this result be by nitehawk214 · · Score: 1

    If I typed in to it "This thing is a fraud."

    --
    I'm a good cook. I'm a fantastic eater. - Steven Brust
  29. NO COLLUSION by PopeRatzo · · Score: 1

    Wait, why is that computer laughing at me?

    --
    You are welcome on my lawn.
  30. From 2018, AI has been sugested for L.D. by pgmrdlm · · Score: 1

    I actually lost the original article I was going to post, but found a completely different AI for lie detection. Both were from 2018.

    https://futurism.com/new-ai-detects-deception-bring-end-lying-know-it/
    This was developed for determining if someone is lying in a court.

    https://www.fastcompany.com/40575672/goodbye-polygraphs-new-tech-uses-ai-to-tell-if-youre-lying/

    This one seems to be being developed for homeland security.

    --
    Anonymous comments are as pathetic as the anonymous "sources" that contaminate gutless journalism from the New York Time
  31. Error rate by Livius · · Score: 1

    I have to agree with the skeptics. Certainly, the right software could analyse text and make some kind of assessment about the potential for deception. I have no doubt that that can be done. Some people have a good intuition about other people's honesty. I do transcription professionally and have to listen to spoken word very carefully, and I can tell that people who are lying sound a bit different from people not lying.

    But it's far from a reliable measure, and it's certainly not anything I could convince someone to accept as objective proof.

    And that brings us to what's really dangerous about these kinds of computer-based assessments. Does saying something is probably (but not definitely) a lie tell you anything useful? You still don't know for sure. And is that partial insight valuable enough to outweigh all the false positives that you will inevitably get? Maybe sometimes incomplete information is not better than none at all.

  32. Honestly! by Daralantan · · Score: 1

    Honestly! Gosh darn it!

  33. Deception by h4x0t · · Score: 1

    It isn't deception if the deceiver believes the statement. 9X% of garbage on the internet is people parroting false statements.

  34. Slashdot posts clickbait title by Anonymous Coward · · Score: 0

    Honestly that is a problem.

  35. Use it on Kickstarter Projects by Anonymous Coward · · Score: 0

    Run it on Kickstarter projects and see if it can detect when the poster is lying about doing the project, or they are just going to run off with the money.

  36. I have to ask. by bigdavex · · Score: 1

    What happens when you put the claims about the lie detector in the lie detector?

    --
    -Dave
  37. Shall we test it? by 3seas · · Score: 1

    I can, and if it fail it should be made widely known.

  38. Sigh. by ledow · · Score: 1

    "Could be a problem?"

    Not in the vast, vast, vast majority of the world, where people know - and have always known - that the polygraph is a load of bullshit, always has been and has basically never been admissible in a court of law in most places.

    Only the US are stupid enough to think you can actually make a lie detector with any accuracy whatsoever.

  39. We know it works from the beta test. by Anonymous Coward · · Score: 0

    Robert Mueller says it's perfect.

  40. get by Anonymous Coward · · Score: 0

    If Slashdot had one of these, its useability would increase exponentially.

  41. Heres the Code by vlad30 · · Score: 1

    If (Posters Occupation) = "Politician" or "salesman" then text = lie

    --
    Your'e all thinking it, I just said it for you
  42. We can tell WindBournes lies from text alone by Anonymous Coward · · Score: 0

    What idiocy is this?

    Or did you mean good liars and not the bottom of the barrel obvious liars like WindBourne.

  43. They could train it to recognize lies by mark_reh · · Score: 1

    using in-duh-vidual 1's tweets!

  44. Basically an "Automated Snopes" by knorthern+knight · · Score: 1

    Want an excuse to ban conservatives on various online platforms? Simple; feed the AI the DNC election platform and the SPLC;s pronouncements as "the truth sample".

    --

    I'm not repeating myself
    I'm an X window user; I'm an ex-Windows user
  45. Lie Detector by Anonymous Coward · · Score: 0

    The Lie Detector has been possibly the greatest fraud perpetuated upon man, Cops always present it as the ultimate means to interrogate people with to find out the truth. THE MACHINE IS A FRAUD!!! Don't be one of the fools who has submitted to a test. Especially in Ohio and some other places where the results are allowed as evidence in a trial. Have you not heard of or read the free book "The Lie Behind the Lie Detector"? Maybe you are such a present day tittle nothing of a wimp snowflake that you don't have even a mouse size backbone to say "NO" if or whenever asked to take one. A lie detector will prove absolutely nothing concerning what the truth actually is. I have watched over 3500 police show on TV and the web and in many, many cases someone is said to fail a test to later be found to be absolutely innocent, many, many cases where people were said to have passed a test who were to later be found to be without a doubt guilty, and many, many cases where the cops said that the test was inconclusive. If the lie detector is reliable, then there can be no "inconclusive". I have seen some cop feigning to be so, so serious when talking about lie detectror results. I have seen other cops actually laugh when the word lie detector is mentioned. You must at least try to grow a backbone if ever asked to take one of these notoriously unreliable test and say NO! Stop thinking that cops and prosecutors are men and women of integrity seeking truth and justice and shun them. Some of you will think to yourselves, if I don't cooperate with whatever the authorities want from me, then they will think I am guilty and have something to hide. My friends and family will think the same. They will think the same regardless of what you decide to do, you need to recognize and know that. You are going to have to say to hell with them and their suspensions. Better to remain free with some people hating you than to be hated by vicious strangers in prison.

  46. Watch out, Wikipedia! by Anonymous Coward · · Score: 0

    It'll be interesting to see how some Wikipedia articles rate with it.