Software Recognizes Sarcastic Tweets
An anonymous reader writes "Even humans sometimes fail to recognize sarcasm and irony; can machines do better? An algorithm that identifies sarcastic tweets (PDF) on Twitter and sarcastic sentences in product reviews on Amazon will be presented next week in the International Conference for Weblogs and Social Media in Washington, DC, and in the Computational Natural Language Learning in Sweden in July. A team from the Hebrew University, Israel, has developed an algorithm that identifies sarcastic sentences by using a machine learning technique in which a small number of sarcastic sentences act as seeds for the software to learn and generalize upon. The algorithm can then identify sarcastic sentences that are nothing like the examples. The variety of recognized sarcastic sentences is impressive, though the results are not perfect. But again, we don't do it so well ourselves, do we?"
Yeah, sure it does.
Want to improve your Karma? Instead of "Post Anonymously", try the "Post Humously" option.
Weight of various patterns and features. We present here a deeper look on some examples. A classic example of a sarcastic comment is: "Silly me, the Kindle and the Sony eBook can’t read these protected formats. Great!". Some of the patterns it contains are ...
You know DRM is pervasive as a very serious consumer problem when statistical research papers recognize user dissatisfaction with it as a classic example of sarcasm that floods reviews.
My work here is dung.
This may help people with autism and Asperger's Syndrome recognize satire.
A sarcasm detector, that's a real useful invention!
I guess it's for those who just don't get it!
"Yeah, we totally developed a program to detect sarcastic tweets... #fuckinggenius"
Just end your sarcasm tags before being sarcastic. This won't conform to W3C standards, however.
"Hegelians, who love a synthesis, will probably conclude that he wears a wig." - Bertrand Russell
Given that sometimes not even humans understand when I am being sarcastic, I expect this software will have an exceptionally high recognition rate with very low false positives. A truly remarkable achievement and the one algorithm the human race has been waiting for!
Most ACs are not even worth the keystrokes to insult them. Be generically insulted by this and ignored otherwise.
The algorithm can then identify sarcastic sentences that are nothing like the examples.
Good luck with that.
I can see the fnords!
wow
I'm god, but it's a bit of a drag really...
I forsee nothing but success for this algorithm.
"Any sufficiently optimistic statement is indistinguishable from sarcasm."
A sarcasm detector, that's a real useful invention!
It's only a matter of time before we can automatically generate sarcasm. Then websites can have snide comments auto-generated. When that happens, I'd like to see penalties for those attempting clever snark but failing to be smarter than a computer.
Wow. That was a great comment schon.
If libertarians are so opposed to effective government, why don't they all move to Somalia?
Yeah, like that would work!
-- Two men say they're Jesus. One of them must be wrong. - Dire Straits
The algorithm can then identify sarcastic sentences that are nothing like the examples.
Place it in my office. If it still responds at the end of the week, it's not working correctly. If it's overloaded and partially melted, we've got a winner.
They got about 80% accuracy. Looks like things in CAPS and other... types! of punctuation ;-) and metadata (star rating given for review) are used fairly heavily in addition to sentence structure. Would have be good to know what the breakdown of false positive vs. missed sarcasm is, but i didn't see it.
From TFA:
"We experimented with a large data set of 66000 reviews for various books and products. Evaluating pattern acquisition efciency, we achieved 81% in a 5-fold cross validation on the annotated seed, proving the consistency of the pattern acquisition phase. [...] each sentence was annotated by three human readers. We found some strong features that recognize sarcastic utterances, however, a combination of more subtle features served best in recognizing the various facets of sarcasm."
Recognizing sarcastic tweets... do twits even know what sarcasm is?
Slashdot social media options: AIM, ICQ, Yahoo, Jabber and Mobile Text. Why no MySpace?
I wonder what would happen if you applied their algorithm to any given slashdot post, particularly one on the Apple board.
-- Two men say they're Jesus. One of them must be wrong. - Dire Straits
This really *is* useful. (Something for the detector: I read TFA but it's just because I can't resist the elegant typesetting of PDFs.)
In reality though, automated systems that process a large amount of social comments (think Amazon reviews etc.) can be fooled by sarcastic comments. Such a system could result in poor recommendations.
This is not intended to be useful to humor impaired individuals.
When you hear hoofbeats, think horses, not zebras
When quoting the Simpsons, do it correctly.
Comic Book Guy: Oh, a sarcasm detector, that's a real useful invention.
I believe those trolls are called Poes, but I only hear that term used for Christian fundies, not those with other right wing views (e.g. return to a gold standard, something you'd probably only hear from a Ron Paul rally; there wouldn't be much "Christian nation" there).
SSC
They should just train it on Slashdot comments.
Many Slashdot users can benefit from such a technology. There are medical conditions whose sufferers cannot detect sarcasm. This leads to social ostracism and can cause reduced productivity and in very extreme cases, depression. People may scoff, but imagine if we could provide this technology on a portable device for those victims of the spectrum of diseases that cause anxieties? There are times when I have been the goat because I misunderstood "Yes, I'll have the work completed by Monday" to mean that the coming Monday, the work would be completed. My sarcasm detector did not fire to alert me that the cable installer was being sarcastic. I would like to see this sarcasm detector available for handheld devices. When a girl responded, "Yeah, I'll go out with you," I could then check my iPhone or Droid and know immediately she was making an attempt at humor.
Found the other stats after taking a second look at the PDF. was 11% false positive, 12% false negative.
Ye right!
__
Sigs are like arse-holes, everybody has one
What about someone whose intent is genuine, but whose ideas are considered absurd by the masses?
Wow, that sounds almost as bad as Global Warming!
(The above statement is dripping with sarcasm. Because Global Warming is bullshit, you see.)
It dates back into some of the great classic works of our time... upon reading Romeo and Juliet one critic was overheard saying:
"Nice play Shakespeare..."
or upon solving a great mystery, Watson was once overheard saying, "No shit Sherlock."
Was that sarcastic?
Alexander Peter Kristopeit bought his basement from his mommy for one dollar.
Thank you! It's Poe's Law.
Step into a huge movement. Don't Tread In Me.
Vercotti: Well, I had been running a successful escort agency - high class, no really, high class girls - we didn't have any of that. That was right out. And I decided. (phone rings on desk) Excuse me (he answers it) Hello......no, not now......shtoom...shtoom....right......yes, we'll have the watch ready for you at midnight.......the watch.....the Chinese watch....yes, right-oh, bye-bye mother (he replaces reciever) Anyway I decided then to open a high-class night club for the gentry at Biggleswade with International cuisine, cooking, top-line acts, and not a cheap clip joint for picking up tarts, that was right out, I deny that completely, and one night Dinsdale walked in with a couple of big lads, one of whom was carrying a tactical nuclear missile. They said I'd bought one of their fruit machines and would I pay for it.
Interviewer: How much did they want?
Vercotti: Three quarters of a million pounds. Then they went out.
Interviewer: Why didn't you call the police?
Vercotti: Well I had noticed that the lad with the thermo-nuclear device was the Chief Constable for the area. Anyway a week later they came back, said that the cheque had bounced and that I had to see Doug.
Interviewer: Doug?
Vercotti: Doug (takes a drink) I was terrified of him. Everyone was terrified of Doug. I've seen grown men pull their own heads off rather than see Doug. Even Dinsdale was frightened of Doug.
Interviewer: What did he do?
Vercotti: He used sarcasm. He knew all the tricks, dramatic irony, metaphor, bathos, puns, parody, litotes and satire.
....
No folly is more costly than the folly of intolerant idealism. - Winston Churchill
I bet it just looks for itallic text.
Are you sneering and munching on a chicken drumstick as crumbs of grease tumble down your t-shirt and lodge on top of your shelf-like belly?
Nerd rage is the funniest rage.
Why don't we ask the program?
Original.
A Good Troll is better than a Bad Human.
Guy 1: Oh Homer Simpson he's cool.
Guy 2: Are you being sarcastic?
Guy 1: I don't even know anymore.
God spoke to me.
No one would post a sarcastic remark
Would this help Paul Chambers, the man who was found guilty of sending a menacing messages for his sarcastic Twitter bomb threat? http://www.facebook.com/group.php?gid=265300406002
"I thought they were the dominant species..."
... why can't you?
[signature]
Use the word 'fuck' in your tweet/post. This way the profanity filter will block your message/post before it ever gets to the irony filter..
this scene
Sarcasm? On *Twitter*?! Never!!!
org.slashdot.post.SignatureNotFoundException: ewg
Their algorithm gets 77% accuracy. I think I can do better:
# Estimated accuracy: 92.1%
isSarcastic(tweet) { return true; }
Or does that only work for slashdot comments?
It will work perfectly.
The point of Sarcasm is that the words, the text itself, convey a literal meaning, while the actual intent (which must be deduced by the reader knowing certain things about the writer; sometimes just tone of voice is enough) is the polar opposite. Without anything except one line of text, there is absolutely no way of determining whether something is sarcasm or not. It will never work without more input. Now that you've read this paragraph, re-read the sentence above it.
. . . that the people who invented sarcasm (i.e.:"Moshe, were there not enough graves in Egypt that you brought us to the desert to die?" Shemos 14:11) would be the ones who find a way to automatically identify it.
In other news, there is still no software that can detect tweets without sarcasm.
Evil is as eval("does");
Its got a pretty web gui and everything.
http://www.twitter.com/
Yes, I'm trolling, but its still true!
Persistent Volume manager for Kubernetes - https://github.com/dwimsey/openshift-pvmanager
Please don't sue me twitter, it was a joke, I'm really not claiming I wrote your crappy software!
Persistent Volume manager for Kubernetes - https://github.com/dwimsey/openshift-pvmanager
If there is an algorithm for it, the Sheldon could use it to recognize (and produce?) sarcasm.
Bazynga!
She was like chocolate when she drank... semi-sweet at first and then increasingly bitter.
Hi Ix, long time no see.
Wonderful, can they apply it to irony as well, because I am fucking tired of people constantly proclaiming that someone's informative statement is 'ironic'?
But sure, like that is ever going to happen.
You can't handle the truth.
The problem with that is that in American sitcoms, verbal irony is accompanied by non-verbal cues like facial expression, tone of voice, or, ugh, laugh tracks. Take away the cues, and deliver the sarcasm in a deadpan manner, and tons of people in the USA are completely unable to catch it, neurotypical or not.
Are you adequate?
That'll be good.
"The greatest lesson in life is to know that even fools are right sometimes" - Winston Churchill
Was the computer being sarcastic that time?
Let q be a radix > 1. I am in ur base-q, killing 10 d00ds.
Don't we already have a tag?
There are only two types of tweets: retarded and sarcastic. If a tweet has the word "fuck" in it, it's easy to label it retarded. If a tweet has the word "retarded" in it, it's easy to label it sarcastic.
I scream. You scream. I assume that means we're both acquainted with the problem. We proceed.
"But again, we don't do it so well ourselves, do we?"
Hey, are you being sarcastic!?
Your brain is not a computer.
I suspect some SERIOUSLY fuzzy logic is involved here...