Flickr Search Hack Powered by Mouse-Made Doodles

Carl Bialik from WSJ writes "Retrievr gives budding artists an impractical but addictive way to find photographs on Flickr: a search engine powered exclusively by mouse-made doodles. From the article: 'Retrievr, Mr. Langreiter says, "doesn't look at specific forms." Art history buffs might like to think of it as photo-search by way of Impressionism. The Retrievr engine dissects a photo like a gallery connoisseur who lost his bifocals: It focuses on regions of colors rather than specific shapes and lines. "It is, actually, a simple scheme," says Mr. Langreiter. Retrievr creates and stores a compact representation of each photo in its database. The system pulls only the most important features — broad shapes, blocks of color and spatial relationships between different colored areas — out of detailed images to create shorthand approximations of every photo. (The storage mechanism extracts the 120 "strongest" features from an image to create something called a "wavelet transform," which contains much less data than the photo itself and facilitates lightning-fast searches.)'"

Comments

Flickr Retrievr

[tonyr1988]

Direct Link

Requires Flash.

Re:Flickr Retrievr

[RuBLed]

It's powered by "mouse-made doodles" and apparently you're not doodling enough. :)

That was quick

[Centurix]

I think we just made the world record for the most number of boobies sketched out on the internet simultaneously.

That was quick

[5of0]

Already partly slashdotted. Very slow and sometimes you don't get in.
But this is an interesting idea, fun if nothing else.
I drew a tree and I got a pineapple with a guy's face in it, a chinese guy standing in front of a gate, and a dragonfly. Maybe I need to brush up on my drawing skills.

*groan*

It's been done before

[pyite]

I read about this a little while ago. Same principle. It uses a Haar transform (for those unfamiliar with multimedia signal processing and wavelets, specifically, the Haar transform is a specific wavelet transform based on the Haar wavelet and the associated orthogonal basis). The idea is that you compare the low frequency component of an image to the low frequency component of a rough drawing (which is pretty low frequency to begin with) and they should be pretty close of the images have anything in common.

Re:It's been done before

[pyite]

Haar wavelet though? While it's easier computationally (since the mother/father wavelets are peicewise linear in the 1D case) I always saw it as being a "lesser" wavelet in the sense of compression/reconstruction quality and ability to discern edges/other dramatic changes in data

I'm just saying what imgSeek uses. It's certainly a very easy wavelet to implement via lifting. I think it's probably used because more complex wavelets wouldn't be of any help since the rough drawing is so rough to begin with. In the end you could probably do the same thing with a DCT. Wish I had time to experiment.

Applied to museums?

[andphi]

To find Van Goghs, draw a whirlpool.
To find Pollocks, draw a can of paint.
To find Warhols, draw four cans of paint.
To find modern art sculptures, throw the tablet against a wall.

Other flickr Mashups

[vijaykiran]

This is very old .. I read about this first on webmonkey in Feb.

Ten Best Flickr Mashups
by Michael Calore 24 Feb 2006

Here's the link: Ten Best Flickr Mashups