Next-Generation CAPTCHA Exploits the Semantic Gap

captcha_fun writes "Researchers at Penn State have developed a patent-pending image-based CAPTCHA technology for next-generation computer authentication. A user is asked to pass two tests: (1) click the geometric center of an image within a composite image, and (2) annotate an image using a word selected from a list. These images shown to the users have fake colors, textures, and edges, based on a sequence of randomly-generated parameters. Computer vision and recognition algorithms, such as alipr, rely on original colors, textures, and shapes in order to interpret the semantic content of an image. Because of the endowed power of imagination, even without the correct color, texture, and shape information, humans can still pass the tests with ease. Until computers can 'imagine' what is missing from an image, robotic programs will be unable to pass these tests. The system is called IMAGINATION and you can try it out." This sounds promising given how broken current CAPTCHA technology is.

Comments

Too hard.

[Whiney Mac Fanboy]

The general public will not know what "geometric" means*.

This Captcha suffers from the same old problem. As Captchas get harder more humans will fail them.

*or annotate... or centre

Re:Too hard.

[The Ancients]

The general public will not know what "geometric" means*.

This Captcha suffers from the same old problem. As Captchas get harder more humans will fail them.

*or annotate... or centre

If this is the case, do the captchas have the issue, or does humankind?

Re:Too hard.

[Smidge204]

Definitely the human's problem, although presumably if a human is smart enough to make it then a human is smart enough to figure it out...

To be optimistic, I actually like to think of it the other way around:

CAPTCHAs are providing a valuable evolutionary pressure on machine vision/artificial intelligence development!

=Smidge=

Re:Too hard.

[morgan_greywolf]

The general public will not know what "geometric" means*.

Oh, gimme a freaking break. I am sooooo sick of everyone worrying about pandering to the lowest common denominator. But I have a solution to this particular problem.

Here's my plan: cleanse the gene pool. We'll just eliminate warning labels from everything and when the stupid freaking idiots fry themselves blow-drying their hair in the bathtub because there was no warning label on the hair dryer saying "WARNING: RISK OF DEATH!!! DO NOT USE IN OR NEAR WATER!!!", Darwin's theory of survival of the fittest will kick in and we'll be rid of the bloody morons.

Re:Too hard.

[ronanbear]

Half the problem is the over-reliance on Captchas. Most of the cracks work by educated guessing and have large error rates. This fact could be exploited by the webmail companies. Additional Captchas for sending suspicious messages (lots of messages) and early activity.

That a Captcha is the only thing standing between a gmail account and the ability to send large numbers of spam messages is more of the problem. Run the spam filters on outgoing messages and delay some of them to give time for the new address to be blacklisted if it's sending spam and especially if there were large numbers of Captcha failures.

worthless

[tritonman]

who needs to write CAPTCHA exploits when you can just hire 50 chinese kids for 3 cents per day to create email accounts and send spam out for you?

Blind people?

[tepples]

As Captchas get harder more humans will fail them. And as the population of the Internet grows, more blind and hard-of-sight people will be using the Internet, and they will fail visual tests deployed by web site operators who don't bother to deploy a decent audio test.

Re:Blind people?

[Anonymous Coward]

Do we lament that the blind and h-o-s cannot drive? The difference is that the web consists mainly of textual information that blind people can use.

The cost of being all-inclusive can be too high for some budgets. The same could be said for supporting minor browsers, such as Safari.

Re:Blind people?

[csnydermvpsoft]

The blind are able to use braille displays and screen readers to access well-designed sites. The whole point of CAPTCHAs, however, is to have images that computers are unable to read. Accessible design and CAPTCHAs have exactly opposite goals.

The Internet is becoming much too important to leave a significant amount of the population (pardon the pun) in the dark. We have the technology to help the blind navigate web sites independently. Unfortunately, CAPTCHAs are hindering much of that progress.

Re:Blind people?

[Ngarrang]

csnydermvpsoft wrote, "The Internet is becoming much too important to leave a significant amount of the population (pardon the pun) in the dark. We have the technology to help the blind navigate web sites independently. Unfortunately, CAPTCHAs are hindering much of that progress."

No, spammers are. The root problem of this "solution" is the spammers, who do not care our personal feelings of privacy. They don't care that their messages cause everyone else's costs to rise.

Without CAPTHA technology, none of the web mailers would be usable, as they would all be blocked by every known blacklist.

For this reason, I think the penalties for convicted spammers should be far higher than what they are now. Their actions are subverting the ease of use for a very large group of people.

Re:Blind people?

[iangoldby]

I don't if it should be a concern. Do we lament that the blind and h-o-s cannot drive?

I think that's a pretty outrageous attitude.

Think about it. What is the cost of making a car that a blind person could drive? Prohibitive, I suspect. Given the current state of technology it may not be quite possible even (though we could pay for human chauffeurs if we were really determined).

What's the cost of making a printed newspaper accessible to a blind person? Quite high I suspect. The technology to read shapes on a page and convert them to something the blind person can read or listen to is not straighforward.

What's the cost of a system that allows a blind person to access text stored electronically on a computer? Pretty-much negligible.

The thing is, the web should be a superb medium for making its content accessible to practically everyone. The information is already in a form that computers can manipulate easily.

If you use HTML as it was designed to be used, there is no additional cost in making it accessible.

Come on people, this is not rocket science! Here we have a golden opportunity to make, for practically no additional cost, something that can be accessed by everyone. It's not like designing a driverless car, or backfitting access ramps and lifts to historic buildings. Why on earth wouldn't we do this?

</rant>

Re:Blind people?

[jackb_guppy]

CAPTHA are already dumping people with color issues, not blind but do not have the ability to perceive color differences.

Others are using letters / numbers that after distortion could be a,d,9,g for example.

Personal, I give a site two tries before I give up and dump them.

Re:Blind people?

[gnick]

The same could be said for supporting minor browsers, such as Safari. I believe that's why many web pages don't bother testing for compatibility with minor browsers, such as Safari.

Some sites (www.google.com, slashdot.org) can be adapted for use by the blind, so the admins need to consider them when incorporating a captcha. Others (images.google.com, www.hotmonkeylove.com) are inherently based for people with normal vision, so these image based captchas should be just fine.

Re:Blind people?

[iangoldby]

Here is where you fail to understand the problem.
        First, creating content is not negligible in cost.

But the cost is the same whether you are making it accessible or not.

Second, creating an interface to deliver the content is not Negligable in cost.

But the cost is the same whether you are making it accessible or not.

Third, Actually delivering the content to the masses isn't negligible in cost either.

But the cost is the same whether you are making it accessible or not.

In case you haven't picked up the theme yet, my original point was about the incremental cost of making content accessible - that it is very small compared to for example, driverless cars or retrofitting lifts and ramps to historic buildings.

if you are using HTML only, the whole captcha debate is meaningless for you. HTML is designed for PUBLISHING information, captcha applies to web based applications that HTML is only a SMALL part of.

That's a false distinction. HTML is an example of an inherently accessible medium (when used properly) but anything stored on a computer as text is inherently accessible. It is only the short-sightedness of some developers that makes it inaccessible.

Re:Blind people?

[ultranova]

The blind are able to use braille displays and screen readers to access well-designed sites. The whole point of CAPTCHAs, however, is to have images that computers are unable to read. Accessible design and CAPTCHAs have exactly opposite goals.

No, the point of a CAPTCHA is to have a test which a human can pass easily, but a computer can't. Most current CAPTCHAs are image-based, since that is simple to implement, but this is by no means a requirement.

Re:Blind people?

[Maestro4k]

1. Strip links from messages. The spammers are trying to game Google's (and other search engine's) page ranking, and they can't do this if you don't allow them to post links. The incentive to spam your site has now gone.

This is exceedingly wishful thinking on your part. We already see sites that strictly add the nofollow to all links in comments so that any URLs in said comments are completely useless for building page rank and yet the spambots still deluge the sites with spam on a constant basis. (Or at least attempt to.) I've seen the same thing happen on sites that do exactly what you suggest. You see spambots trying to use BBCode to link URLs in places that obviously don't use it, and so on. Spambots are automated, their owners don't give a damn if they spew lots of worthless stuff. All that matters is that some exceedingly small fraction of them DO work. And the way they achieve that is by spamming their crap everywhere and anywhere they can find a submit button.

Once a human spammer realises you've added captcha he'll come and have a look to see how easy it is to circumvent (very easy in my case). However after running a test personally he'll see there's no point and (hopefully) remove you from his list of sites to spam.

See above, they don't care and the vast majority of it's all automated. You may stop the bots that aren't prepared for your special CAPTCHA, but you'll still have to waste resources fighting them off.

Spammers are ruining the Internet I'm afraid.

It's still trivially crackable.

[Jason1729]

All they need to do is offer free porn to people who solve the captchas and embed the captcha in their site. It doesn't matter how sophisticated the test is or hard it is for a machine to do it, they all have that fatal flaw.

Then there's also the option of paying Warcraft gold farmers to solve captchas and take a break from the game.

Stupid Captcha

[Big Smirk]

Any captcha with multiple choice answers is not a good one. 20 choices? So the computer gets by 1/20 of the time. Hmmm, how many attempts does it take to get 1000 e-mail accounts? As for "geometric center" note that all the images are rectangular. I haven't tried it, but writing a program to pull out all possible rectanges and then sort them on size, and pick the center of the one of the larger rectangles should do it. Why not a captcha that works with google. "Describe in one or two words what is in this picture", then use a google like search to match up the actual description with what the person typed. Person types "Dog" picture is a "Labrador Retriever" match.

CAPTCHA = The terrorists have won.

[v(*_*)vvvv]

Like airport security, CAPTCHA puts a tremendous burden on the innocent people just because they cannot detect the terrorists.

How is CAPTCHA broken and how is it "technology"?

It is not broken because it works as it is suppose to. I would think the correct term would be "solved" or "been overcome".

Technology-wise, CAPTCHA is a workaround, not a solution. The real problem is automated bots manipulating forms where the webmaster only wants humans. Detecting whether or not the visitor is an automaton would be the solution, but because people have apparently given up on this, they have resorted to trying to detect whether or not the visitor is human.

Re:Illogical

[Matje]

If a computer could recognize the difference between human and computer generated speech, then it would know how to generate human sounding speech. Bullocks. Why is this modded informative? You don't provide any backup for your claim.

It is imaginable to create a model that describes speech characteristics in general and computer speech characteristics in particular. Any sound sample could compared with the two models. If it fits the wider speech model but not the computer speech model, then you would call it human speech. QED.

The ability to distinquish between two things does not imply that you'll be able to generate them effectively (unless the search space is very narrow). Imagine it this way: you can probably distinguish Chinese from Spanish. That does not imply you speak either language.

i think its too big

[PJ1216]

the image is huge. plus its two steps. also, the annotation part... i wasn't actually *sure* i was answering correctly. it looked like they were near water... boat was an option... didn't look like a boat... but nothing else really made sense... well, 'cept there was a guy in the picture and "man" was a choice as well... but i went with boat cause the guy didn't seem to be the focus. nonetheless, it required effort to reason it out. i don't want my captcha taking up more than 2 seconds, let alone like 30 seconds.

Sweatshops

[Anonymous Coward]

Spammers will still just pay sweatshop workers to solve these, won't they? What does this solve?

This is where it falls apart...

[Joce640k]

Pretty soon they'll just set up a "free porn" site - free access so long as you solve a captcha to get in.

It's been threatened and talked about before, all it needs is something "unbreakable" like this to actually make it happen.

At least a part is Ineffective

[Dracolytch]

Ok, so I was able to do the image analysis one, where they take an image, muck with the color, draw a bunch of black lines over it, and then ask you to annotate it with a word from a list.

This is no better, and may be worse, than what we have now, for two reasons.

1) If you fill in the gaps programmatically, and then make the image grayscale, you probably have something you can use for image matching.

2) Much more severely: The interface reduces the number of possible answers by multiple orders of magnitude. For the one I saw I think there were 10 or 15 answers. Even if you kick image recognition to the curb and randomly choose an answer, you'll be right 1/15 times. It'd be trivial to write a program to harvest hundreds of accounts in a day by just picking random answers. Hand that off to a botnet or similar, and this becomes a minor speedbump.

~D

Re:The real solution to captcha is OpenID.

[giafly]

How do you protect the sign-up page to get an OpenID? With a captcha?

I for one

[mapkinase]

I for one welcome this development. The more complex are CAPTCHA to solve, the less is the number of idiots in the tubes.

Solution: unproven users = limited access

[davidwr]

Wikipedia does this by restricting what new accounts and non-logged-in accounts can do.

If free mail servers put restrictions on what new accounts could do, with an override to anyone who is willing to go to a lot of trouble to prove they are human, it would short-circuit the spammer problem.

If Yahoo, Gmail, etc. all limited you to 10 outgoing mail recipients a day until you had both 1) had the service for 1 day and replied to 10 messages, AND limited you to 100 outgoing mail recipients a day until you signed up to be a "high volume sender," it would cut most spammers off at the knees. Depending on the service, being a "high volume sender" may involve turning over a credit card number and may not be free. Some services may give "loyalty awards" to long-term customers by removing this restriction for people who have had their accounts for 6 months and show a heavy non-spammy ad-revenue-generating usage pattern.

Re:Lyrical Response Mechanism

[naer_dinsul]

I know this was meant as a funny comment, but if you'll notice, of the replies to your comment there are as many different responses as there are posts!

The more we "exploit the semantic gap" the more problems like this are likely to arise.

Couldn't figure it out

[noidentity]

SERVICE DOWN TEMPORARILY

Because of the

The answer is "Slashdotting", but where do I type it? I can't figure this CAPTCHA out...

Re:Don't forget users of lynx

[mpeg4codec]

FWIW you don't need a dedicated HTTP proxy, as SSH has a built-in SOCKS proxy. Try it out some time: ssh -D 1080 remote.tld and configure your browser of choice to use SOCKS on localhost port 1080. For other apps that don't have native support for proxying, check out proxychains (on Unix). Not only great for browsing at work, but also a godsend for unsecured wireless nets.

I'd be PISSED if a page asked me to do this

[GanjaManja]

Did anyone else go "What the F***?!" when they read the instructions? That was the crappiest most pain-in-the-ass 'captcha' I've ever seen. Geometric Center of any image you can figure out? Annotate the image? not exactly simple or unobtrusive, is it? I got it right away, maybe it'd be ok if someone can write layman-legible instructions. I just guessed at when the heck they were asking for...but it wasn't immediately obvious. Anyone care to enlightned me as to what's so wrong with the current (10 or 20 different types) of Captchas? I don't see them being broken/spammed all over the place, so it's boviously not too bad...