Image Processing By Example
Aaron Hertzmann writes: "My collaborators and I will present a paper called
Image Analogies at
SIGGRAPH 2001 this summer, where we describe a machine learning method for 'learning' image filters for example.
For example, given a Van Gogh painting, the algorithm can process other images to look somewhat as if they were painted by Van Gogh."
"It can also 'texturize' images based on a sample textured image, e.g. to create landscape photos. It can do many other types of filters, as long as you give appropriate 'before' and 'after' examples to learn from." I especially like the idea of inferring a high-resolution image from a low-res one. The software is available for Windows and Unix, and "the source code is freely distributed for educational, research and non-profit purposes."
i just noticed that resizing link. Thats awesome - i cant think how many movies i've seen where they did the same thing and i was thinking "yeah right". I cant wait till someone makes filter that loads all the websites from coolhomepages.com and spits out composition to my empty canvas in photoshop ...
... a vehicle for people to toot their own horns and advertise their OWN papers, etc?
I just wonder what it would look like if you passed Monet's Water Lillies through the VanGogh filter. An approximation of an impression of an impressionist's painting. Figure out the logistics of that one.
something clever
Because "geek humor" in general isn't funny.
-- Brian
The most rabid believers in American Exceptionalism are the exact same people whose policies are destroying it.
Eh, you're probably right.
I'm also DEFINITELY able to spell, which really makes me an outcast around here.
-- Brian
The most rabid believers in American Exceptionalism are the exact same people whose policies are destroying it.
Could this one day be used to turn my dull crud into something Fitzgerald or Hemingway or even Asimov or Heinlein might have written?
Then you could take news from say CNN and process them to be Slashdot-ready. Imagine a Jon Katz or Taco filter.
__
__
Men with no respect for life must never be allowed to control the ultimate instruments of death.
GW Bu
Raaaahh!!!! Sometimes you read things and it just makes you angry. I read my comments filtered +3, but this really takes the cake. Troll anyone?
:) We'd literally work for weeks to come up with something like that. Just THINK about that. You've taught a computer "write programs" that a computer programmer would take weeks to write.
The point is NOT to make a picture that captures Van Gogh's brilliance. It is to create a _computer_program_ that identifies the _essential_ elements of a visual transformation. (ie. learns a photoshop filter)
And from a SINGLE picture mind you.
This technology is _really_ something. Think about how you'd write "a photoshop filter that makes a picture look like a Van Gogh". (I used to work at Corel, in Photo-paint, in the BitmapFX group, so I know something about this
--
#include <malloc.h>
--
#include <malloc.h>
free(your.mind);
Perhaps this software could be trained to learn from images of masonry, cliffs or pebbles. It could then apply the knowledge to create 'petrified' images of Star Wars actresses.
-- Ed Avis ed@membled.com
You'd still need a pretty good filter to get from the blurred Van Gogh to a Van Gogh imitation, a simple sharpen or brush-stroke filter won't do. The program can be downloaded from the page so go ahead and try another blurred image as source and see what it comes up with.
Oh, and check out the other examples as well. There's also an example where you draw by hand a very simple picture indicating where the river, city, etc. is located on a photo, then when you have the filter draw the same kind of simple image and create a whole new image of a similar city.
i wouldn't even call it "painting". pc does nothing but manipulate the existing image. doh.
--- d'oh
At first, I was going to say, "Well, I guess this is further proof that using computers doesn't count as fine art." (Only joking, I'm a BFA student and use computers plenty.)
Then I looked at the images this program produces. I guess I can't expect anything BETTER than what is stuck into it - Van Gogh would never have painted scenes like those. Hell, any beginning art student could "paint like Van Gogh" - just mix your paints a bit thick! Perhaps the program needs a content selection algorythm. (I'd like to see it do a self portrait.)
At any rate, the "holy grail" of this technology is to emulate air brushed velvet. Not a fan of elvis but love the look of painted velvet? Just use a pic of your favorite celeb! Finally, Natalie Portman recognised as she should be!
Know what I like about atheists? I've yet to meet one that believes God is on their side.
There's this cool plugin for GIMP which works on a similar concept as the patterns by numbers thing to remove objects from images by filling in the empty space left by removing them with a pattern copied from around the object. Sort of like using cloning to remove things, but automatic.
Have a look at http://www.csse.monash.edu.au/~pfh/resynthesizer/ oh and it's probably also in your installed plugins directory called Resynthesizer
When shit hits the fan get some of these https://youtu.be/pY-GncsZ-UE
So, you're going to find all the pr0n and remove the ears? Whatever floats your boat.
the real advantage both masters have is not in their actual prose but in the ideas they express - and no filter is going to be able to duplicate that.
:)
Au contraire - see sci-fi book a minute at rinkworks.com.
This was an (admittedly sad attempt at) humor, my friends, humor...
I think the point is that you train it in how to make up resolution in a certain situation with a certain type of picture. Could be useful in some situations, not that I can really think of any, but if I could well, then I'd have tons of karma and stuff.
The problem of finding "tanks" or whatever is actually an old one that goes back to the late sixties and seventies when the CIA was planning on sending up real reconaissance satellites with multispectral capabilities and NASA was sending up their interplanetary probes. The math used for this problem is older than that, but some new methods are being implemented by both government agencies and private corporations. It used to be much easier when we were just taking visible light photos. For instance, the wife of a friend of mine used to specialize in examining runway lengths. All she would do all day is look at photos of runways and compare their lengths to previous images to determine if they were being upgraded for bigger/more powerful planes. Now you can imagine that given the same image of a runway, but now you have twenty to one hundred and twenty separate images at different spectral wavelengths why there is a need for automation. Unfortunately all of the methods to analyze this type of data require fairly significant amounts of computational time and analyst time to extract the information you are looking for. There are many ways of going about looking for these "tanks" or whatever you want to look at in images (SCUD missiles, concrete desguised to look like granite, gold bearing strata, oil bearing strata, alpha ganglion cells in the retina, etc etc etc....) Using traditional multispectral classification techniques, one does not neccessarily have to implement neural networks. (There are times they can be problematic, but this is probably due in many ways to immature code) You can simply use supervised classification techniques where you specify the spectral fingerprint (you have to know what you are looking for) and have the algorhithm extract or highlight the pixels it finds. Alternatively, if you do not know exactly the spectral fingerprint of what you are looking for, you can perform an unsupervised classification such as a k-means or ISODATA classification. These techniques can be fairly time intensive from both a computational and an analysts perspective thus the push for more automated methods. It is the automation that has proven to be difficult. Many things like co-registration of hyperdimensional images is easily implemented using embedded fiducial points, but the actual analysis and taking apart of hyperspectral data often is more of an art than science (I hate to say that as thats what people say when they don't understand all of the aspects of the problem but....)and as such it currently requires lots of "biological" as opposed to silicon supervision.
Visit Jonesblog and say hello.
It's near the right-hand side of the keyboard.
cpeterso
It looks like the training data needs to be similar to the target data if the results are to be visually similar. In the watercolor example the training data of the apples produces the best results on the photo of the tulips. The filtered landscape photos don't look anywhere near as good. I wonder if you could use several sets of training data (still life, landscape, portrait, etc.) to create a more general purpose filter.
I would think that approximating the unfiltered source part of the training data from a painting (like the Van Gogh example) would produce kind of twisted results from photographic data. I wonder if they've tried getting a "real" painter to mimic Van Gogh's style from a photograph and using both the photo and the painting for training data. I expect the results would be better. (Although that wasn't really the case with the pastel examples so maybe not.)
Maybe I'll get a chance ask at the show.
It's not just using the filter; it is creating the filter.
--- witty signature
Take a look at some of the other images. And they didn't just "go into xv and sharpen the image" they got the computer to figure out how to do it on its own, given only two inputs!
I doubt you could program something similar if your life depended on it, looser.
ReadThe ReflectionEngine, a cyberpunk style n
That is what they did, although in the case of the paintings, they had the 'after' shot to start with and simply blured it to get the 'before' shot. In other words, there was no 'orgional' filter.
ReadThe ReflectionEngine, a cyberpunk style n
. In the case of Van Gogh, you just need to fuzz up the image a little. But there's a lot more to Van Gogh than fuzziness!
Wow, THEY DID Did you even read the site? or just look at the example? Here's one of some guy named Lucian Freud
And keep in mind they didn't 'just tell the computer to 'fuzz up' the image' they just gave the computer a copy of Starry night, and a blurry copy of Starry night and said 'figure out how to go from the blurry one to the original'. After that, the computer did all the work
ReadThe ReflectionEngine, a cyberpunk style n
You can use PPM compression for this.
Say you have samples of the works of N authors and a text T that has to be identified. Compress the text N times, each time the system is initialized with the samples from another author. T will usually compress best when the system was initialized with the samples from its own author.
See Bill Teahan's PhD thesis.
Well, while filters have existed in PhotoShop or the GIMP for ages, they tend to do a not altogether excellent job. Did you look at the one where they took an image and applied a watercolour filter? The result looked nothing like a watercolour, but had encoded in it what some folks might think a watercolour produced from an image might be. They then fed other photographs into the engine and produced what look to my untrained eye like real honest-to-goodness watercolours. I think that's pretty neat: they created good stuff by mimicing bad filters.
The point is, this is an ecellent first step on the way to making software which can paint. It may not be here today, but we are progressing twoards that end. What I find amusing is that this software has no concept of aesthetics or beauty; it is by no means a thinking machine. And yet it creates what we find to be aesthetically attractive pieces. Indicates to me that perh. artists are not more deeply connected to the soul or heart than the rest of us after all.
Van Gogh was not an expressionist. He was a post-impressionist.
I only took the trouble to correct your mistake because I disagree with your fairly backwards view of art...this idea of the artwork as a vessel for "the true meaning of the artist" is really trite.
Another pedantic slashdot reply. I am an ass.
What I've started to wonder is where else it's underlying principles could be used, or where this sort of technology could lead in the future.
Could it be used to analyze text from certain authors (hey, text and art are no different to a computer - treat words as "pixels" and sentences and structures flow like colors) and mimic their style? Could this one day be used to turn my dull crud into something Fitzgerald or Hemingway or even Asimov or Heinlein might have written?
I also have the following few questions:
I think that sums up my feelings. This stuff is really impressive guys, I hope the conference goes well.
---
---
"Of course, that's just my opinion. I could be wrong." --Dennis Miller
As soon as you get a computer to do the work and create the thoughts that Heinlein put out, I think its time for the human race to quietly disappear into the backround to be reused for carbon.
All Troll + "offtopic" mods are meta moderated as "Unfair", because you abused the system.
http://www.photools.com/
windows only though
If this was going on in an unclassified lab almost 10 years ago, I imagine that the best gov't computers today can easily Spot the Loony, or tank, or asian woman or nearly anything else desired.
See the following interview with Igor Aleksander. Search for "WISARD"
http://www.cix.co.uk/~hewitt/misc5.htm
-- Wodin
Simply amazing.
Ever see "the Sentinel"...
Computer nerd, my ass. What about the ubermensch whose senses were sharpened in the Brazilian rainforest to the point where he can clearly see the limited edition Willie Mays watch visible for a split second on the two-pixel wrist of a bank robber caught on grainy security camera?
--
keete
I seem to remember a PBS special (Nova?) that had a segment on experiments done with image recognition in pigeons. These pigeons were placed in a large, darkened box that displayed a projected image on one wall. They were then prompted to respond to the image in different ways and were given food feedback if they were "correct" (pecked when the right image was displayed). The pigeons were first introduced to one image and then shown related images as well as unrelated images to see if they could generalize... it emerged that pigeons can distinguish Monet paintings from Cezanne, though they have some trouble telling Cezanne from Picasso.
--
keete
well, not really, the brush strokes are too predictable and don't always work. take a look at some of Van Gogh art and you will see that he did more than side to side brush work.
they do look very intersting though...
Outside of a dog, a book is man's best friend. Inside of a dog, it's too dark to read. -- Groucho Marx
Except that the book-a-minutes are neither automated filters nor (IMHO) do in fact capture the essence of the book. From what I can see they are generally a poorly defended criticism of the book, or a synopsis of one or two points in the plot.
And my point is that the book-a-minutes leave the claims unsubstantiated.
Actually, text and art _are_ substantially different to a computer. The former has rules, the latter does not.
If a single pixel is off by a bit, you won't notice - your brain subconsciously blends the whole thing together anyway. If, on the other hand, the wrong word is chosen, it will stick out like a sore thumb - even if it's only a preposition.
Finally, I would posit that even if a filter could make your prose sound like Asimov or Hienlien, the real advantage both masters have is not in their actual prose but in the ideas they express - and no filter is going to be able to duplicate that.
OK so, maybe you're hopped up on smack and can't function normally, but if you'd read the linked article you'd see that this is very much related.
... guy.
There's a new wave of parameterless image filters rising up into a whole new field of study and you're sitting here bitching about Van Gogh's intent.
Van Gogh and his whore's stupid gift of a severed ear are not relevant
____________________
___
The ends are ape-chosen, only the means are man's. -- Aldous Huxley
There are a few companies (iterated.com, lizardtech.com, some others) that have been doing fractal and wavelet scaling for a while now. Pretty impressive stuff. I don't know all the theroretical details, just the practical uses. Scaling up to about 1600% is possible with no noticable artifacts (to the human eye). We've been using some of this stuff in the prepress/graphic arts industry for a while.
Jason
Wow! Does that mean that a certain staple of movies with spy-cameras crucial to the plot will finally have a basis in reality?
Every time I hear, "I can't see his face because the video's not clear enough - here, let me enhance the image," I just wanna scream...
--
Did van Gogh really paint tulips with ripples? It seems that the ripple effect used for the real ripples has a strong impact on the derived filter and dominates the result. In addition, the ripples do not follow the natural lines in the image.
I think manual filters are still much better, oops, I wanted to say: nothing can replace a real van Gogh.
So when's it going to show up in the Gimp? This is some cool stuff. People could make custom filters without programming anything, just train the filter to do what you want. Let the computer do the thinking in terms of imitating the effect you want. Very very impressive.
"I may not have morals, but I have standards."
"I may not have morals, but I have standards."
Or maybe a program that looks at pictures of people, and generates pictures of those people having sex.. (like Xena and Scully; Taco will like that one)
--
--
Stay tuned for some shock and awe coming right up after this messages!
Sometimes, when I look at a Van Gogh, it breaks my heart,it is so beautiful. When I look at these pictures, I get the same nausea-induced feeling that any cheap knock-off imitation gives to me. It's not even interesting technology.
---
Sorry dude, you're destined to remain on fugly.net
Make affiliate bucks
This is really cool, but I don't think it helps those who argue that computer graphics is an art. When you can't tell the difference between human art and computer generated art, is it really an art? or does it pass some Turing-esque test?
-jc
Hmm. I wander how good a job does it do with p0rn images. Can it make a non-sexy image look sexy again?!
---------------
Sig
abbr.
Karma stuck at 50? Add 2-5 inches.. err.. 2-5x Karmas Count to your pen1es.. err.. Karma all naturally and private
Maybe you could apply it to a well known computer system and give it the look and feel of another system. If this works call your filter a gate. You could bill for your gates...
I guess I'm just curious of how much this is limited to the "visual" world and whether it could be applied to create abstract digital filters.
"You can now flame me, I am full of love,"
As for my interpretation of "the true meaning of the artist" - whether or not I agree with the concept of all art needing some intangible, metaphysical, or even spiritual explanation that is derived from the ego of the artist (which I don't necessarily) - Van Gogh has become a cause celebre for the artist whose life was as important as their work. It's part of the reason for the ridiculous prices associated with his work. His letters to his brother established him as a figure after his death, and a cursory read would reveal that there were specific personal and deterministic notions in his endeavours. It may be trite to yourself, but it drives the ridiculous art market today, and many would say that it began with Van Gogh. Van Gogh's work is part and parcel with his life, interminably, for better or for worse - it is impossible to seperate him from his time and its technology and image processing capabilities.
And I do stand corrected on what's different about this work and what it's for (imagine using texture by numbers to generate landscapes for computer games rather than storing the textures). I will stand by the fact that when it comes to mimicking an artist's strokes the material will only ever be as good as a) what's fed into it and b) a pale imitation, good for only some FX gag I expect to see in some music video and then vanish.
** http://www.nkhumanrights.or.kr/ ** Human rights in North Korea. 1 million estimated dead from starvation.
This is interesting and all well and good, but ultimately where it fails is that the produced image is entirely dependent on the original photograph's perception of the world. A reproduction of an image through halide crystal activation, which is enough for human memory and recognizance, but it lacks the true meaning of the artist. Van Gogh never used contrast or flat lighting as exhibited in the source pictures, and he often burst highlights with striking colors that may not have been actually present to his eye. It's what seperates him from a Turner - not just his brush stroke or how thick he worked in paint but how he saw the world. It's pretty churlish to adopt the first real expressionist painter (who deliberately attempted to paint their perception of the world rather than reproduce it) as an example of this algorithim, as the resultant images show that without an interpretation or perception this is pretty useless stuff. All I see here is a souped up photoshop filter.
** http://www.nkhumanrights.or.kr/ ** Human rights in North Korea. 1 million estimated dead from starvation.
Van Gogh filters are cool and all, but in this geeky day & age, I would be more impressed with a code filter that could be trained to make my C programs look like they were written by Linus Torvalds... you know, change the indention styles, white space usage styles, identifier naming styles, and how bout going as far to use the same algorithmic patterns too?
The question is, what would happen if you fed your average Visual Basic program written by your average VB coder, through a Linus Torvalds filter? Wouldn't that be like "crossing the beams" in Ghost Busters?
There already is a Slashdot Story Generator
...how long will it be before somebody creates a VanGogh version of goatse?
For all intensive purposes, "whom" is no longer a word. That begs the question, "who cares"?
I kind of wish they would have added one more picture to compare which was an actual high res shot.
So you could compare low res, high res, and filtered high res.
They do look impressive though!
The man who trades freedom for security does not deserve nor will he ever receive either. - Benjamin Franklin
It would be even more interesting to take The Bedroom and produce a before picture for it that straightens the odd angles and de-fisheyes it. What sort of schizophrenic things might it produce then?
Fuck 'im up, Tim! His views are invalid! -Pirate Corp$
Corel painter 6 formaly Fractal painter has an auto Van Gogh filter. Fractal Painter 5 introduced the auto VanGogh filter.
To me, the most interesting part of the project is their patters-by-numbers. I can see this being useful immediately. Anyone know of Photoshop filters that do similiar tasks?
my mistake, texture by numbers
i.e.: They started with a painting by Van Gogh, then ran it through the "Smart Blur" filter of photoshop to remove the Van Gogh-esque-ness of the painting, leaving a textureless image. Then they ran the texture learning algorithm over that pair of images, and applied the learned texture to the target.
Training a computer to act like Van Gogh reminds me of the funniest piece of computer humor I have ever read.
Hey this is pretty cool. You take a good photograph, and make it into a bad painting. Paining is more than just mixing oil paints to be the average color for part of an image... Van Gogh paintings typically emphasize the edges, the cheekbones, the jaw, the eyebrows. I'm bitter that someone can take an image, use xv to sharpen the image and then shift the colors and get a PhD out of it. I wonder if he was funded by the department of defense?
If you'd even read the rest of the site, you'd realise that their software is *very* accomplished
Check out the Texture by Numbers sections for more examples of the flexibility of this software...
-Ciaran
Then you are DEFINATELY in the wrong place!
As I was going through the page I was fairly unimpressed, largely. Much of what was there has been in Photoshop (and probably the Gimp) for years now, i.e. filters to make photo's look like paintings or apply textures or whatever. ... the texture by numbers section was exceedingly cool and I could see a myriad of uses were someone to port it to Photoshop's plugin format. Being able to take an image, mask it with various different colors, and then have an entirely new image generated based on the textures you extracted ... yeh, thats nifty =) /. in a while.
However
By far the coolest thing I've seen on
I'd be more impressed if they had trained the software to imitate multiple artists, such as O'Keefe, Rembrandt, Klee, Gauguin, Monet, Picasso, etc., shown as a single image, as processed by all of the above, side by side.
__
They were working on this kind of image recognition in a JPL lab near my own in the early '90s. (I was an intern working on the flight computer for CRAF/Cassini at the time.) They were using some funktastic optical computer jive and I heard the thing was good... damn good. There was even a toy parking lot full of Hotwheels cars, and they would have the computer try to pick out a specific car, which might be in a group of other similar cars, or partly covered by a building, etc.
If this was going on in an unclassified lab almost 10 years ago, I imagine that the best gov't computers today can easily Spot the Loony, or tank, or asian woman or nearly anything else desired.
Comments by Anonymous Coward are automatically scored as zero unless they are modded up. OTOH, some posters with very good karma are automatically modded up.
Wow, maybe those parts in movies (that we all criticize) where the computer nerd enhances a still, low-res image to show the bad guy's face in a blurry crowd of people might become reality sooner than anticipated. Then we'd all feel bad for laughing at those scenes...
...nah
:)
*bsod*
Windows user: Fucking computer, it's on drugs.
computer: "I don't use drugs. I am drugs."
windows dali box:
"So little of what could happen does happen."
"Have no fear of perfection -- you'll never reach it."
"It is either easy or impossible."
"It is good taste, and good taste alone, that possesses the power to sterilize and is always the first handicap to any creative functioning."
"To gaze is to think."
"Those who do not want to imitate anything, produce nothing."
"Wars have never hurt anybody except the people who die."
Actually, what they haven't shown (that I saw) that would be most cool for this is to have a photo of a scene and a painting of that scene and have the filter learn that! Otherwise, what they have done that's still pretty neat is built a system that figures out what mathematically needs to be done to one set of numbers (i.e. the RGB bytes for each pixel) to get it to a second state. Not bad.
I do not have a signature
What I've started to wonder is where else it's underlying principles could be used, or where this sort of technology could lead in the future.
I was thinking along the same lines! (umm, well, brushstrokes?) Granted the amount of computation likely precludes real-time generation today. But, I could well imagine that within (pulls number out of the air) 2-5 years, it should be quite possible. Applications? Here are some ideas (some are admittedly off-beat, but why not?)
I have no illusions the results would be spectacular, but I'm quite sure they could be really interesting. Heck, even a commercial or a presidential speech could take on a whole new perspective.
Did anyone else notice for the "Van Gogh" images, it only did horizontal brush strokes. I'm not any kind of art buff, but I don't think artists would only use horizontal brush strokes. Although maybe it's a problem with the training data.
Also, the "image enhancing" stuff wasn't too impressive, yet. Maybe with more examples it might do better. Of course, the thing to remember is it's not programmed for any particular filter, but it still had a problem ignoring small details, like the black borders for the rugs.
Kurdt
Kurdt
I'm not anti-social. Just pro-technology.
to see Dali through cubist eyes....
Don't pick up the pho*(@)$*@&@!@ NO CARRIER
That is, why a "learning filter?"
It would be more useful if it could discover a technique by looking at one image.
Looks like these guys have much to improve. Yet it is an effort in the right direction and we can congratulate them, for at least their program can copy lesser styles, if not the masters.
And above all no matter how a good a copy it is, the copy can never measure up to the original.
There's always sufficient, but not always at the right place nor for the right folks.
Easy there, Jin. I think most of us are smart enough to understand the difference between art and the programmed output of a machine. Even if by some fluke you and a computer were to produce the exact same image in the exact same medium, only yours would be art--pretty much by definition, I would think.
To make a machine produce art would require the technology for a sentient computer. If the machine is really sentient, then it's probably as entitled to express itself as you or I.
BTW, I like your stuff (sorry, that's the limit of my knowledge of art--I like it or I don't).
http://bbspot.com/toys/slashtitle/index.html
----------
Technoli
If someone can use this to encode DeCSS, so it cans till be decoded, maybe THAT will convince people that its an artistic piece.
Seriously, though, this is an amazing project. I'm impressed.
____
Blood, guts, guns, cuts;
Knives, lives, wives, nuns, sluts.
___
The way to see by faith is to shut the eye of reason. --Ben Franklin
I agree that computer graphics *can* be an effective tool or medium for creating great art. But you can't seriously call those "Van Gogh-like" filtered photographs art. It's just a little trick of image processing. No one is likely to mistake those ugly images for a real Van Gogh painting or even a passably good non-Van Gogh painting.
Anyway, while it's interesting that they trained the tool to "increase" resolution, I doubt it's a generally useful technique. I mean, look at the training pairs compared to the test data. I'd like to see what the results woul dbe if they switched the sets of training data - hi-rez-ify the carpet with the forest data and vice-versa. That would probably look... very artistic.
It probably uses a neural net or something similar. The paper itself hasn't been published yet, so who knows.
This seems to me to have a great deal of potential. There have been some comments thus far that this isn't the first time such a thing has been done before. Error correcting algorithms help satellites to transmit correct images, and there are some programs with filters on the market.
/. people love that kind of thing. Source code too.
I see this as being a more sophisticated program. And its free...come on, you
The thing about this program is that it isn't a bunch of pre-collected filters, like any good imaging software, but that it can create new filters on the fly. So, if you want to recreate something to look like something else, you can. Not morphing, but in similar styles. That is very cool. Totally custom and unique filters, and that is new.
I really like the pictures where there is a painting that is converted to look like a river in a marsh. The computer makes it look real. So there is potential for artists. Scientists can use it to project data based on samples. I think there are some unique and useful uses to this program.
Lawrence Lessig is my personal hero.
In both Linux and Windows flavors. I (being lame and all) am running the Windows version now- very very kewl stuff. http://mrl.nyu.edu/projects/image-analogies/lf/
I guess I'll be obsolete soon. At least computers can't dress up and black and sit around in coffee shops, while making strange faces at the people that walk by. Yet. :(
Of course, on printers (which is what most people would have access to) the best this program can do is create the illusion of depth and paint texture. The printed surface would still be flat. Van Gogh's paintings are very thick and textured... he would sometimes even use his fingers to paint because the brush wouldn't hold enough to satisfy him. Or are they working on a solution for this problem too?
There is more to a painting than just the image. There's the warmth of the medium it was created on (wood, canvas, clay, etc.) and the media used to create it. Oil paints have a certain shine, texture, scent, and even behaviour as they crack and dry out over time.
Why don't we just build a robot to paint for us, so we don't have to waste our valuable brain power any more doing things like being creative or actually having ideas? Then we can build robots to appreciate the robotic art, because we'll all be sitting in front of the TV watching Friends every night. Why even bother being human to begin with? :(
My Webcomic: Asylum on 5th Street
We don't need computer's to produce Van Gogh paintings we had Van Gogh to do that, and the changes in the way we look at artwork are already made. This is at best a homage to Van Gogh, but I really don't see the point. If the algorithm has to learn the style of a painter then it is not producing anything new. Which is the whole point of art. Right?
... with OpenCyc and see what turns up.
-bch
Instead NPR is about an alternative way to present content efficiently. Technical sketches are easier to understand than photographs of the same part. We might want an impressionistic style to an animation to capture a dreamy mood. We might want cartoon physics to do Roadrunner/Coyote stuff. A person can understand and feel a grossly simple cartoon but feel disturbed by a photorealistic rendering with imperfect shadows. There are other good reasons for NPR, but I'm off to an ultimate game...
you know it's only a matter of time till someone Van Gogh's the goatsecx man.
ugh.
This learning algorithm looks similar to a neural net. My CS professor told us a story about the US government making a neural net that would be used to recognize tanks in satellite photographs.
They spent many hours loading photos for training data. Some photos had tanks and others did not. Once they thought it was working, they tried it on some non-training data --it didn't work.
Instead of recognizing tanks, it learned to distinguish cloudy days from ones with sunshine. All of the pictures with tanks were taken on a cloudy day & all other pictures were taken on days that had sunshine.
He didn't know if they ever actually got it working or not...
I think the important point of this article is not that they can make the painting look sort of like a Van Gogh painting.
I think the new important discovery is that they can take an image and process it so it looks sort of like a Van Gogh, or a painting I did, or a painting your pet chimp did. Or maybe not even necesarily a painting at all.
Instead of saying "here's a photo, make it look like a painting" they are saying "here's one image, now make this other image look sort of like the first one."
-J5K
The libertarian solution to the failures of capitalism is to apply more capitalism til the failures are fixed.
Terrific...a computer that behaves like Van Gogh.
Next thing you know I'll come home from work to find that my PC has severed its own mouse cord in a fit of psychosis.
But can you imagine all sorts of artists being able to "Van Gogh-ize" their paintings? You thought creativity was being diminished in society before...
How useful this particular application is remains to be seen; most people probably have a harder time giving an example of a van Gogh filter for the system to learn from than to use a canned filter.
...can it scan my pr0n images and find images similar to it?
"I don't know that atheists should be considered citizens, nor should they be considered patriots." - George Bush
if you seriously want to find out how good it is: TRAINING 1 -> TRAINING2 BEFORE-1 -> AFTER-1 and then TRAINING 2 -> TRAINING 1 and AFTER-1 -> after -2 and compare after 2 with before 1 :)
Does this mean I don't have too watch BOB anymore? It's just that those trees are just too hard to render on my own!!
Sex, Drugs, Rock & Roll
This is exactly what I ment when I said computer graphics could go the same way as photography. (look for my message in the ask slashdot: fine art?) Photographers trying to get the technique reconized as art blurred their pictures to make them look more like paintings.
Now it seems that computer graphics can take the same aproach. The intresting thing is photography did not become an artform as a a result of blurring the pictures. It became an artform by having people reconize being in the right place at the right time, and being able to see a message in the movements of the everyday takes as much work, skill and insight as painting.
(Apple thinks different, creates the iMac)
Yahoo Finance--
Company: Apple
(Apple thinks different, creates the iMac)
Yahoo Finance--
Company: Apple
Surprise: 100%