Slashdot Mirror


Computers With Opinions On Visual Aesthetics

photoenthusiast writes "Penn State researchers launched a new online photo-rating system, code named Acquine (Aesthetic Quality Inference Engine), for automatically determining the aesthetic value of a photo. Users can upload their own photographs for an instant Acquine rating, a score from zero to 100. The system learns to associate extracted visual characteristics with the way humans rate photos based on a lot of previously-rated photographs. It is designed for color natural photographic pictures. Technical publications reveal how Acquine works."

35 of 125 comments (clear)

  1. Computers with opinions?! by Seriousity · · Score: 5, Funny

    Oh great, now we'll turn our computer on in the morning, and it will say "I think this is far too early!" and switch itself back off.

    --
    This post was made in complete sincere seriousity; as such any attempts to derive humour are doomed to instant failure.
    1. Re:Computers with opinions?! by RogueyWon · · Score: 5, Funny

      Oh, this takes me back to something that happened when I was still at school, around about 1996 or so.

      At the time, despite being pretty much clueless by slashdot standards, I functioned (and still do function, when I can't avoid it) as the all purpose IT helpdesk for my family.

      Now, I have an aunt who was working as a manager in a medium sized UK based IT firm (I can't remember the name and I don't even think they're still around). However, do not take this as any indication that she knew anything at all about computers. She didn't. Nor did she have any inclination to learn. She could just about manage to use Microsoft Office and the web/e-mail clients that were around at the time (I think this was around the time of Netscape 2). Literally anything beyond that would baffle her. She'd call her monitor "the computer" and so on. She was employed, I gather, for her "management skills".

      Now, even at the time, I had a feeling that this was a crock. My aunt is a rather forceful personality. A less diplomatic person might use more bovine terminology and I always got the impression that she wouldn't be much fun to work for.

      She's also very, very, very large (over 25 stone) and ugly as sin to boot. That's not me being deliberately rude. There's just no nicer way to put it without doing a genuine dis-service to the truth.

      Anyway, one Saturday afternoon, I get a call from her. Her voice implies that she's perched in that dangerous territory between bursting into tears and throwing a screaming, PC-destroying fit. Apparently, her computer is "insulting" her. I need to go over there instantly. I got a lot of this kind of stuff until, a couple of years later, I finally told her where she could stick it after I moved off to university and got a call asking me to travel 200 miles to fix something. Anyway, I'm not best pleased about losing a Saturday afternoon, especially with exams coming up, but for the sake of a quiet life, I head over.

      Oh boy was it ever worth it.

      Sure enough, every two minutes on the dot, her PC is insulting her. Whatever she's doing in Windows, a little dialogue box will pop up with a splendidly vicious insult. I mean, some these were absolute gems and were clearly aimed right at her personally. A few of the more repeatable examples (and I still remember these more than a decade later) were:

      "Careful! Better fetch an extra chair. I think those two are about to give way."
      "Wow you must be constipated. Or does your face just look like that normally?"
      "Did you just fart, or do you always smell like that?"
      "Wipe your face. Half your lunch is stuck between your fifth and sixth chins."
      "Is that your face or your arse I can see? Your face? Hmm... the arse might be better."
      "I can access over 64,000,000 images via the Internet and none of them are as ugly as you."
      "Shall I compare thee to a summer's day? No? How about a half-digested turnip?"

      There was plenty of other stuff as well, including the old classics about ID10T and PEBCAK errors, but enough of it was specific enough to my aunt (making mention of particularly distinctive unflattering features) that this was clearly something bespoke.

      Anyway, my aunt's in an absolute state at this point. She's convinced that the computer is insulting her. She tells me she tried covering up the monitor for half an hour (so it couldn't see her), but when she came back, it had been queuing up the insults.

      Anyway, having confirmed that a virus scanner doesn't pick anything up, I ask to see any disks she's put in the PC lately, or any files she's downloaded. The downloaded files all look pretty safe, and it doesn't seem like anything dodgy's come in via e-mail either. However, she then shows me a couple of disks (3.5" floppies) she'd brought home with work on. These are a numbered series of progress reports. Most of the disks look absolutely fine - a few Word and Excel files. Nothing too scary (I don't think MS Office files were being used extensively for exploits at the time).

      However, on the fi

    2. Re:Computers with opinions?! by c0p0n · · Score: 3, Funny

      Dude, the algorithm is simple. B&W pictures automatically get 85 points.

      --

      Your head a splode
  2. Computer, play something by Billy Joel by Anonymous Coward · · Score: 2, Funny

    I'am afraid I cannot do that Dave.

  3. Matter of opinion? by Shrike82 · · Score: 4, Insightful

    Isn't aesthetic value a hugely personal thing? I mean I looked at some of the photos on the site and the ratings were arse-backwards as far as I was concerned. Generic, boring and frankly badly composed images were getting ~95%, whereas others that I thought were truely exceptional were being ranked in the 50's.

    I'm not saying "my opinion is better", just that it seems sort of pointless to assign a value to a picture like this.

    --
    You can advertise in this sig from as little as £99.99 a month!
    1. Re:Matter of opinion? by TapeCutter · · Score: 3, Funny

      "Generic, boring and frankly badly composed"

      My computer says you have no taste.

      --
      And did you exchange a walk on part in the war for a lead role in a cage? - Pink Floyd.
    2. Re:Matter of opinion? by Guano_Jim · · Score: 4, Informative

      Just in case anyone asks, here's the computer rating for goatse, emphasis mine:

      Machine Prediction of Aesthetic Value
      Score predicted by Acquine: 19.4/100 rated as below average

      Looking at that image a

    3. Re:Matter of opinion? by Guano_Jim · · Score: 3, Funny

      Tubgirl, on the other hand, rates a 58.8/100.

      Someone please stop me.

    4. Re:Matter of opinion? by Jurily · · Score: 2, Insightful

      I'm not saying "my opinion is better"

      I am. At least they tried something new.

    5. Re:Matter of opinion? by Guano_Jim · · Score: 2, Funny

      Acquine's rating of the first Google Image result for "Natalie Portman Hot Grits:"

      76.1/100

      Judging from my quick research, it's clear that Acquine is going to turn into Skynet someday.

    6. Re:Matter of opinion? by Guano_Jim · · Score: 4, Funny

      By the way, I uploaded a screenshot of the Google results for "Slashdot Karma Whore" (all text) and got a 42.4/100.

  4. Rubbish. by onion2k · · Score: 3, Funny

    It's terrible. Awful. A hopeless system. I wouldn't use ever it.

    And I'm not just saying that because it rated a couple of my photos as poor. :)

    1. Re:Rubbish. by Nursie · · Score: 3, Interesting

      It rated one of the best pictures I've ever taken as 13. Then it rated a fairly generic cityscape at around 60.

      I think it has some learning to do.

  5. This may be really tough.. by powerslave12r · · Score: 4, Insightful

    This seems a little far-fetched considering the vagueness of someone liking a photo that another person doesn't. I can't imagine this on something like flickr. I guess this could be some standalone rating that people could use on stock photography sites, where buying something needs to have commercial appeal. Websites such as alamy.com tend to do these things manually, they probably might find some use for this.

    --
    Real men read Slashdot articles at -1, bottom up.
  6. Acquine may assign funny scores... by marmusa · · Score: 5, Insightful

    From the Acquine website "A rule of thumb is that if the aesthetic quality of a photo is obvious to most people, it may not be worthwhile to seek Acquine's opinion on it because Acquine may assign funny scores in such cases." So in cases where the correct score is obvious, Acquine's score can't be trusted? That rather neatly avoids validation or refutation of Acquine's results. This is suspicious and seems to cast doubt on the trustworthiness of its score in less obvious cases.

    1. Re:Acquine may assign funny scores... by mangu · · Score: 3, Interesting

      "A rule of thumb is that if the aesthetic quality of a photo is obvious to most people, it may not be worthwhile to seek Acquine's opinion on it because Acquine may assign funny scores in such cases." So in cases where the correct score is obvious, Acquine's score can't be trusted?

      I noticed this with a picture I took in France that everybody praises. It got 6.9. I did the smallest possible change in color, darkening it imperceptibly. The new version got 35.7. Doing a selective gaussian blur also tends to raise the result a lot.

      My rating of their algorithm is 0.01 star, which can be summarized as "it sucks".

    2. Re:Acquine may assign funny scores... by onedotzero · · Score: 3, Funny

      I uploaded a 1x1 pixel black image. It scored 24.6. I then uploaded a 1x1 pixel white image, which scored 41.7.

      Looks your rating is accurate :)

    3. Re:Acquine may assign funny scores... by Twinbee · · Score: 2, Funny

      It looks like one would get more consistent results out of the checksum for a picture ;)

      Thanks for testing that - not many would have.

      --
      Why OpalCalc is the best Windows calc
  7. What exactly is a "color professional photograph"? by fake_name · · Score: 2, Insightful

    What exactly is a "color professional photograph"? Landscapes? Portraits? Group shots? Sports photography? Photo journalism? Abstracts? Artistic Nudes?

    This may be an interesting programming toy but it has little to no use in the real world, unless you have a desire to locate generically boring pictures built to formula. (or, generically boring pictures that have been run through the "ALIPR Picture Score Optimizer" Photoshop filter)

  8. terrible by Anonymous Coward · · Score: 5, Funny

    It prefers a nazi germany flag over some beautiful landscapes and portraits

    my name is godwin and I approve this message

  9. Our redundant brains by oneirophrenos · · Score: 3, Insightful

    This is great news, a system to tell us whether a photograph is beautiful or not. We are approaching the point where we can outsource all our thinking to computers. Soon we won't have to use our brains at all!

    (Not that many of us do presently, anyway.)

  10. Pulitzer versus Goatse.... by VinylRecords · · Score: 5, Funny

    Just google image search for any Pulitzer Prize winning photo and upload it to the Penn State ACQUINE system and see how some of them fare to the Goatse image...

    The Iwo Jima flag raising photo at this URL gets a 26.1 in the system.
    http://surreality.info/up/WW2_Iwo_Jima_flag_raising.jpg

    The fucking Goatse image with a construction crane photoshopped into it (don't ask) just got an 84.1 on the same ACQUINE system....and no I'm not going to provide a URL just test it yourself.

    So Goate is a better image than the Iwo Jima flag raising photo?

    Am I missing something?

    1. Re:Pulitzer versus Goatse.... by MichaelSmith · · Score: 5, Insightful

      So Goate is a better image than the Iwo Jima flag raising photo?

      Maybe all the people sending goatse to it has biased its aesthetic judgement.

    2. Re:Pulitzer versus Goatse.... by DerCed · · Score: 5, Insightful

      How on earth should an algorithm know how to infer the symbolic value of the flag rising image?! As far as I understand the Pulitzer Prize is not about artistic and aesthetic value, but rather about journalistic impact, isn't it?

    3. Re:Pulitzer versus Goatse.... by Saba · · Score: 4, Insightful

      Am I missing something?

      Yes.

      The system learns the quality of photo, not the abstractions we place upon it.

      The photograph, in strict terms of quality alone, is rather poor and achieves an appropriate rating. It cannot measure the value of the image.

    4. Re:Pulitzer versus Goatse.... by mdwh2 · · Score: 2, Interesting

      Well that's exactly the point, isn't it? We're a long way from AI being able to judge artistic merits, because doing so often isn't just a property of the image alone, but is related to what the things in the image represent.

      Now having said that, it might be interesting to have some judgement that is not biased by cultural perceptions - one that treats Pulitzer and Goatse on an equal playing field, judging what they look like rather than what they represent. But it's unclear what meaning such an algorithm has - it's not comparable to what humans would think, nor is it meaningful to say it's the computer's own opinion (I mean, anyone could write an algorithm that assigns some arbitrary value based on the image data, but what use or meaning that has is another matter.)

    5. Re:Pulitzer versus Goatse.... by hey! · · Score: 2, Insightful

      Symbolic appeal is very much different from aesthetic appeal.

      I think the problem with Iwo Jima is that it is in black and white and the system is designed to rank color images, according to TFA. However, I think we can see a certain ... similarity between the two pictures. One of the criteria for a composition is how the eye is drawn to a focal point in an image. In the Iwo Jima photo, the mound of the hill is sharpened by the triangular form of the squad and the flagpole, drawing the eye to the flag. I think we can conclude that it is an unusually strong composition.

      As for Mr. Goatse ... Well, I suppose if we judge it by the same criterion it'd have to be pretty good.

      --
      Post may contain irony: discontinue use if experiencing mood swings, nausea or elevated blood pressure.
  11. In other, unrelated news... by jamesh · · Score: 4, Funny

    In other, unrelated news, Penn State researchers have released an online image voting system called 'Aesthetic or not' where users are presented with a random image and have to give it a score of between 0 and 100.

    Initial user participation was good until for some completely unknown reason, 90% of images presented to users for rating were goatse, tubgirl, or other shock images.

  12. Great... by stms · · Score: 2, Funny

    Now I don't Have to look at so much porn to find the pics I want to look at.

  13. Re:Now we just need POQUINE by mangu · · Score: 2, Insightful

    presence of "M$" and "correlation is not causation" get flagged "insightful"

    That's not how Slashdot really works. Due to the number of astroturfers here, anything critical of Microsoft, no matter how true it is, is usually modded "Overrated", while "Vista works fine for me" gets "Informative".

  14. Interesting by jw3 · · Score: 2, Interesting

    One thing first. There *are* certain esthetic and technical rules / guidelines which are what we could call "objective" in the sense that they are very general. For example, a photograph usually looks better if the composition is balanced, if the 2/3rd (or golden mean) rule is used, the lines in the picture are coherent and lead the eye in the right direction (e.g. towards the subject), if the photograph is correctly exposed, colors matched etc. Of course, some of the greatest photographs break those rules; however, like in many things, you succeed in breaking the rules if you know what you are doing, and you cannot do it very often.

    I can imagine that you can come up with an engine that is able to detect how "rule conformant" a given picture is.

    However, pure formal esthetic judgement is what we rarely mean when talking about a "good photograph".
    There is one main issue that will make it very hard to match our "overall" esthetic sense. Firstly, we are unable to detach the image contents from the "pure form". That means, if we see a worried women holding a child, we cannot just look at that as a composition. Also, we are always considering what we know about the subject. E.g. if we have a photograph of a man standing in water, if the photograph ends just below the place that his legs go into the water, we will have the impression that his legs are cut off, and that there is something wrong about the photograph. Finally, facial expression is immensely important for the perceived esthetics of a photograph.

    I did some experimenting -- some of the truly great photographs of our times got rather lousy scores (e.g. Dorothea Lange's famous photograph, but also some color photographs as well), while at the same time rather random shots I did of my sons got even five out of five stars. Well. Maybe it will still be useful to someone to filter out the worse photographs.

    j.

  15. Re:My lone opinion by Morphine007 · · Score: 5, Insightful

    The field of AI is not comprised of a majority of researchers frantically trying to build an expert system that can pass a Turing Test. Visual data is complicated and building a system that can take that information and make use it in a very simplistic manner is non-trivial. Read some of scientific papers published by the authors of Acquine, and you'll see that their methodology (image processing, regression, Bayes' classification, decision trees, support vector machines, classification and regression trees, to name but a few) is anything but trivial.

    Not only did they build something novel, but they built a system that does a good job of approximating human response to good/bad photography.

    If you want to contest the true novelty of their work, through an academically-inspired claim that they combined existing technologies in a way that isn't terribly novel, rather than creating their own technology, then that's fine. However, the blanket statement that some researchers are trying to do "real work" and that Acquine isn't real work, is a giant red-flag indicating that you likely haven't got the slightest clue what actually goes on in the field of AI. Typically researchers like to tackle problems where the utility of their solutions isn't immediately obvious, the previous link to the RoboCup competition is a perfect example; who cares if you can build a robot that can play soccer? By your reasoning, that would be an incredible waste of time. Except, it's becoming the standard problem for multi-robotic systems research, and a large number of AI researchers are devoting significant time towards building RoboCup teams.

    Why?

    Simple, pick a real world task for a group of robots that "matters". Now decompose that task into all the subproblems that you would need to solve in order to have a robot complete the main task. Chances are, you're going to run into problems involving self-localization, team-work/cooperation, vision, data fusion, etc... All of those subproblems are being worked on and solved in different ways by researchers in the RoboCup challenge. And chances are, if you choose the methodologies used by the teams that win games you're likely to have chosen the most effective methodologies available in the field.

    The true value of research isn't the end-product of each individual research-project. It's the end-product of many "useless" research-projects combined.

  16. Re:My lone opinion by Anonymous Coward · · Score: 2, Informative

    Do you find that it "does a good job of approximating human response"? Because I don't. Photos that are absolute crap get 99.99% and interesting photos get 1%. It seems completely random, except for its apparent preference for high resolution and black borders.

  17. Re:My lone opinion by inode_buddha · · Score: 2, Funny

    I wonder how this AI will react to goatse? Will it have a human response?

    --
    C|N>K
  18. The dangers of trusting machines... by RingDev · · Score: 2, Insightful

    So I follow the link and think, hey this is pretty cool. I grab some screen shots of my apps and run them through. Unsurprisingly, some old VB6 crap I'm still maintaining was scoring in the 5-10% range. The newer Web and Silverlight apps I've been working on are all over from 30%-70%. I'm thinking this software is pretty cool and we could use it to get rapid feedback on different layouts and styles.

    So I send the link to one of my co-workers. He brings it up and posts a screen shot of his web site. We start talking about how we could use it and how it works. And we wind up with a little impromptu meeting at his cubicle. 5 people huddled around his desk checking out the rating system.

    And then we hit the home page, were recent highly rated photo thumbnails are shown. And what do we see?

    Some lady, buck naked, leaning on her shoulder blades, twisted up like a pretzel shooting an anal douche fountain a few feet into the air.

    And that is why you never trust a machine to rate user submitted images.

    -Rick

    --
    "Most people in the U.S. wouldn't know they live in a tyrannical state if it walked up and grabbed their junk." - MyFirs