Slashdot Mirror


Machine Learning System Detects Emotions and Suicidal Behavior

An anonymous reader writes with word as reported by The Stack of a new machine learning technology under development at the Technion-Israel Institute of Technology "which can identify emotion in text messages and email, such as sarcasm, irony and even antisocial or suicidal thoughts." Computer science student Eden Saig, the system's creator, explains that in text and email messages, many of the non-verbal cues (like facial expression) that we use to interpret language are missing. His software applies semantic analysis to those online communications and tries to figure out their emotional import and context by looking for word patterns (not just more superficial markers like emoticons or explicit labels like "[sarcasm]"), and can theoretically identify clues of threatening or self-destructive behavior.

38 comments

  1. Turns out by Anonymous Coward · · Score: 0

    Just about all Britons are terminally suicidal. Says this bit of software.

    1. Re:Turns out by catsRus · · Score: 1

      More of the one size fits all BS. Sadly humans are not binary thus are a bitch to really understand their motivations.

    2. Re:Turns out by Anonymous Coward · · Score: 0

      Quit being so sarcastic.

    3. Re: Turns out by Anonymous Coward · · Score: 0

      Eat, drink, fuck, dominate as an option.

    4. Re:Turns out by Anonymous Coward · · Score: 0

      Maybe not at the Micro level, but at the Macro level we are very predicable. This means that such a system will most likely never hit 100% accuracy, but it may be able to get 80% to 90% accuracy if trained correctly. It's not even graduate work any more, i did similar work as an undergrad.

      If you don't want to believe me then it's your loss. This fact is being used by stores to place items in locations your more likely to buy them, create speed traps used by police, predict stock market changes, the NSA and FBI to determine who is really a terrorist, etc... This is a science now, and just about any computer scientist can do it will little effort. The only hard part is the data collection, which is getting easier and easier. You cant really do much of anything anymore without a computer analyzing your actions and trying to figure out a way to optimize it behind the scenes. (What did you really thing a human was sifting through the petabytes of information generated on you every day?) The sad thing is that this in most cases actually makes things better for you, but yes it can easily be misused, and there are often as many false positives as false negatives. This is no longer theory this is now life, learn to accept it or get crushed by those who already have.

    5. Re:Turns out by Anonymous Coward · · Score: 0

      Yeah, you sound just like a silicon valley marketing bot - "xx is here whether you like it or not, accept or be left behind"....never heard that one before.

    6. Re: Turns out by Anonymous Coward · · Score: 0

      Maybe I am. But my message is more a warning. This is life now, like steroids but for human behavior. We are taking advantage of our psychology. I don't really like it, but I have devloped similar systems before. It is scarry how easy it was.

      Want to get really scarry, try this. Computers are getting close to good enough to read our body language. Experts already know that you can practically read a persons mind using body language. Wait until a computer can do it, combine it with software like this. And I don't think we will have many secrets any more.

    7. Re: Turns out by Anonymous Coward · · Score: 0

      Your warning is a bit late. We've been long warned.

      Books:
      - 1984
      - Brave New World

      Movies:
      - Minority Report
      - The Matrix

      While these are fictional works many consider them prophetic of our current and near future times. In retrospect, they certainly seem to be.

    8. Re: Turns out by LifesABeach · · Score: 1

      I was thinking of "I Robot"

    9. Re: Turns out by tehcyder · · Score: 1

      Those four works are radically different, so I suppose between them they're bound to get a few things right.

      --
      To have a right to do a thing is not at all the same as to be right in doing it
  2. could it have predicted reddit's implosion by Anonymous Coward · · Score: 0

    and suicide?

  3. That could actually be handy... by Anonymous Coward · · Score: 0

    ...for commentors terminally unable to see sarcasm or humor in posts. For example, see the comments for the recent /. about implementing Tetris via templates.

    Then again it probably wouldn't help much for the humourless.

    1. Re:That could actually be handy... by rioki · · Score: 1

      Interesting twist on the Turing test, can a program detect sarcasm in comments more accurately than humans?

    2. Re:That could actually be handy... by tehcyder · · Score: 1

      Interesting twist on the Turing test, can a program detect sarcasm in comments more accurately than humans?

      Yeah, sure it can.

      --
      To have a right to do a thing is not at all the same as to be right in doing it
  4. Simpsons Did It! by Edis+Krad · · Score: 1

    Finally, I can use this

  5. But by penguinoid · · Score: 1

    Can it tag a switch to Beta (either all at once or feature by feature over a year) as suicidal behavior?

    --
    Don't waste your vote! Vote for whoever you want, unless you live in a swing state it won't matter anyways
    1. Re:But by Anonymous Coward · · Score: 0

      When even notoriously suicide-happy Japanese* are running away....

      * slashdot Japan renaming itself

  6. These stories suck they need to fit the format.... by Tatarize · · Score: 1

    Machine Learning System can detect X with such high accuracy and with so few false positives as to be actually useful.

    Frankly detecting X is basically defined as getting better than random chance. If you decide that anybody who posts "I am so sad" is suicidal, you'll bound to get a few hits, so there. I developed an algorithm that can detect suicide and depression. The problem here is that it's useless unless it's really really accurate.

    --

    It is no longer uncommon to be uncommon.
  7. Dude! Can't you see I'm shaving? by Anonymous Coward · · Score: 0

    Oh. Sorry, false positive.

    "But really, it's true. Our algorithm can distinguish between people who are committing self directed acts of lethal violence and those engaging in other activities with 85% accuracy!"

    Am I the only one who's a little bothered by the use of the word "behavior" to include thinking about behaving, or a statistical predisposition toward behaving in a certain way?

  8. I'm of two minds about this. by jenningsthecat · · Score: 4, Interesting

    FTA: “Now, the system can recognise patterns that are either condescending or caring sentiments and can even send a text message to the user if the system thinks the post may be arrogant”

    On the one hand, maybe it's a good idea to notify users that their comments will likely be interpreted by most readers as having 'X' emotional tone. On the other hand, it may result in people habitually self-censoring to the extent that they show no warning signs before they explode, (literally or figuratively), in some destructive action or activity.

    I'm also thinking that this kind of ongoing **parentalistic monitoring is the wet dream of corporate overlords and wannabe dictators the world over.

    --

    **A word I coined, not a spelling mistake...

    --
    'The Economy' is a giant Ponzi scheme whose most pitiable suckers are the youngest among us and the yet-unborn.
    1. Re: I'm of two minds about this. by TinyTheBrontosaurus · · Score: 1

      Parentalistic... I like it. I'm gonna try this out and see how it works

    2. Re:I'm of two minds about this. by qaz123 · · Score: 1

      >>I'm also thinking that this kind of ongoing **parentalistic monitoring is the wet dream of corporate overlords and wannabe dictators the world over.

      This is what we heading to with all these technologies. Face recognition, thought recognition, etc

    3. Re:I'm of two minds about this. by swell · · Score: 1

      Science fiction sometimes has a theme in which someone wants to die but is prevented from doing so. Often by law, sometimes by some magical immortality gene. It's technically illegal to commit suicide in many places, with or without help.

      I'm of two minds. Suppose your employer considers you essential to her business; takes a life insurance policy on you and surrounds you with protection to prevent any 'accident'. You aren't allowed near any sharp objects. You are a wage slave (if not a sex slave), an investment, and whether you want to live or die is irrelevant. You live to serve the machine as long as technology can keep you alive.

      The right to die is critical in a free society. For whatever reason, no power should intrude. Sure, offer counseling, try to minimize the reasons to commit suicide, but in the end stand back and let the person decide for himself.

      The *other* mind suggests to me that some people may not be mature enough to make a rational decision of this sort. Here is where this kind of subversive, intrusive technology might be warranted. Teenagers, pregnant women and PTSD soldiers should certainly be given counseling, and perhaps legally prevented from suicide for a certain time period.

      A permit system could solve some of the confusion. Qualified adults could apply. They might be required to inform next of kin, etc ... to settle financial, insurance & legal matters ... to sign waivers releasing liability from others ... And then they get a packet of drugs and instructions/suggestions for an easy transition for all involved.

      --
      ...omphaloskepsis often...
    4. Re:I'm of two minds about this. by Anonymous Coward · · Score: 0

      You plan on turning suicide in to a taxable behavior with "permits"? You realize the only outcome from that will be the government looting the estate of the deceased with "penalties" don't you?

  9. You can trust it 'cause it works with Fffacebook by Demonoid-Penguin · · Score: 2

    Yeah - I looked for the paper that won him the Amdocs prize but couldn't find it. All reports seem to be, um, based on this story. Which is where I found he trained the system using two Fffacebook pages:

    posts on Hebrew-language Facebook pages that are almost pure opinion, called “superior and condescending people” and “ordinary and sensible people.” The pages are basically forums for people to let off steam about things and events that get them mad, a substitute for actually confronting the offending person. Between them, the two pages have about 150,000 “likes,” and active traffic full of snarky, sarcastic, and sometimes sincere comments on politics, food, drivers, and much more.

    “Now, the system can recognize patterns that are either condescending or caring sentiments and can even send a text message to the user if the system thinks the post may be arrogant,” explained Saig.

    System Alert - Possible Arrogance Detected - user message issued

    [ 328.0081004] Overtones Warning (bug): Optional FUBAR field Gpe1Block has zero address or length: 0x000000000000102C/0x0 (Sarcasm overflow)

    So it's a startup pitch - expect optimistic projections of outcomes. It's even possible (would it detect that) it's based on pure supposition - you know, like maybe the opinion of the machine learning program matched a readers take on those Fffacebook pages.

  10. Oblig Clippy by seven+of+five · · Score: 1

    Oldie but goodie... Clippy and the suicide note.

  11. This is only a test by ArcadeMan · · Score: 1

    ...a new machine learning technology [...] which can identify emotion in text messages and email, such as sarcasm...

    Of course it can detect sarcasm, the algorithms required are really simple.

  12. The best is actually called CRM114 by Anonymous Coward · · Score: 0

    Look it up. It's a Markovian, rather than Bayesian system, It's freeware and written in C, very portable, and *much* more effective than rule based filters.

    Unfortunately, the author is a bit of a dick and insists that the only way to publish it is as a tarball with a datestamp in the name. which he swears for honest and for true is the validated source, and has pretty much insisted on "edit your own Makefile as needed!" to compile it and keep it portable. So it takes a bit of actual knowledge to get it compiled the first time, but the Fedora SRPM's have done that work for you, so just grab it from Fedora.

    The only real deficit is good setup instructions to integrate it as a sitewide spam filter. It does need to be "seeded" with some "spam" traffic and "ham" or legitmate traffic, but it's so lightweight that this is actually quite fast. And since it can filter *any* kind of text content, on any axis you want, it' can also be used for "good code" versus "bad code", "private" versus "public safe" content, or even "legitmate compalint" versus "just whinging", which is how the Department of Transportation uses it for car complaints. So for "depressed" versus "just sad", it seems much more likely to work well than most filters. And it's multi-axis, so it can have a whole axis just to detect "4chan" or "basement dwellers who should get a job".

    Heck, it could even be applied to Slashdot for "Dice advertisements"....

  13. Here we go again... by mbeckman · · Score: 1, Interesting

    On the heels of Google's "AI" that the WSJ claims got "testy" comes this claim of a "machine learning" system that can identify suicidal tendencies. Once again, BOGUS! The claim that machines learn anything is bogus to begin with, as to date no machine has ever done anything other than record information, as in so-called maze-learning programs. Learning is a cognitive process, and until we ourselves know how it works in humans (which we don't), we can never program a machine to learn anything.

    But the real proof that this is bogus is that in order to "learn" to identify suicidal thoughts, even we humans would have to be given evidence that a given text actually came from someone as a result of their suicidal thinking. Which nobody can do, as this would require clairevoiance. Even the best psychiatric researchers can't know what someone was thinking when they composed a particular text.

    AI is being dramatically overstated once more. What AI researcher has the guts to call them out on this?

  14. Why do we need our e-mails read by the gov? by Anonymous Coward · · Score: 0

    This is more 'think of the children' bullshit. The JEWS have taken over your government and are running your country into the ground.

  15. 72 hour psychiatric hold by ChadSmith4920 · · Score: 1

    Damn Auto Correct.

  16. And the language space is? by no-body · · Score: 1

    English... how about other's, like Hebrew, for example?
    Or folks not writing in their native language on forums/social networks but in English which may be substantial.
    Sounding sarcastic, critical, suicidal or otherwise emotional may not be authentic.
    Not sure what the actual benefit would be using this and how many false positives this could create if some institution like DHS would use such a thing.

    1. Re:And the language space is? by PolygamousRanchKid+ · · Score: 1

      Sounding sarcastic, critical, suicidal or otherwise emotional may not be authentic.

      Greeks banks will run out of money next week. The positive side of this, is that there will be no more queues in front of banks, because if there is no more money in the bank, there is no point in queuing in front of it.

      How would the algorithm rate that comment . . . ?

      --
      Schroedinger's Brexit: The UK is both in and out of the EU at the same time!
    2. Re:And the language space is? by tehcyder · · Score: 1

      Greeks banks will run out of money next week. The positive side of this, is that there will be no more queues in front of banks, because if there is no more money in the bank, there is no point in queuing in front of it.

      How would the algorithm rate that comment . . . ?

      "I'm sorry Dave, but don't give up the dayjob."

      --
      To have a right to do a thing is not at all the same as to be right in doing it
  17. Great news! by Anonymous Coward · · Score: 0

    Now we can save countless lives by analyzing online conversations and putting on suicide watch those who match the parameters. Never again parents will have to ask themselves in anguish "if only I had known". It's time for the civil society to step in and take charge: individual in this day and age simply cannot cope with an increasingly complex and daunting reality. We must watch each other. Everybody needs to surrender some of their individuality for the privilege of being part of a community. No-one is an island. You lose nothing but loneliness and despair. Conform.

  18. Innovation by Anonymous Coward · · Score: 0

    Oh good, another text parser.

  19. Detect this. by maiden_taiwan · · Score: 1

    Yeah, that'll work.