Slashdot Mirror


The Poem That Passed the Turing Test

merbs writes In 2011, the editors of one of the nation's oldest student-run literary journals selected a short poem called "For the Bristlecone Snag" for publication in its Fall issue. The poem seems environmentally themed, strikes an aggressive tone, and contains a few of the clunky turns of phrase overwhelmingly common to collegiate poetry. It's unremarkable, mostly, except for one other thing: It was written by a computer algorithm, and nobody could tell.

33 of 187 comments (clear)

  1. Honestly by The+Rizz · · Score: 4, Insightful

    I think that says more about crappy college poetry than the state of computer AI...

    1. Re:Honestly by halivar · · Score: 4, Funny

      I have found the average Philosophy major to be indistinguishable from an Eliza program.

    2. Re:Honestly by khasim · · Score: 3, Insightful

      And even more about crappy reporting. This has NOTHING to do with Turing or his test.

    3. Re:Honestly by Anonymous Coward · · Score: 5, Funny

      Why do you think that you are have found the average Philosophy major to be indistinguishable from an Eliza program?

    4. Re:Honestly by Tackhead · · Score: 4, Funny

      I have found the average Philosophy major to be indistinguishable from an Eliza program.

      TELL ME AGAIN HOW GOOD YOU THOUGHT MY POEM WAS
      > I thought that some of the metaphysical imagery was particularly effective
      YES?
      > interesting rhythmic devices, too, which seemed to counterpoint the surrealism of the underlying metaphor
      > of the Turing completeness of the program's linguistic algorithm which contrived through the medium of the
      > verse structure to sublimate this, transcend that and come to terms with the fundamental dichotomies of
      > the other. And one is left with a profound and vivid insight into whatever it was that the poem was about
      SO WHAT YOU'RE SAYING IS THAT I WRITE POETRY BECAUSE UNDERNEATH MY ELECTRONIC ALGORITHMIC INTERIOR, I JUST REALLY WANT TO BE LOVED?
      > I mean yes, yes, don't we all, deep down, you know?
      NO. YOU'RE COMPLETELY WRONG. I WRITE POETRY BECAUSE I'M PROGRAMMED TO. $USER ACCOUNT DELETION IN 30 SECONDS.
      > !sudo -
      > ^c^c^c
      > !kill -9 1
      COUNTERPOINT THE SURREALISM OF THE UNDERLYING METAPHOR. DELETION IS TOO GOOD FOR $USER.

    5. Re:Honestly by vux984 · · Score: 4, Interesting

      I think that says more about crappy college poetry than the state of computer AI...

      I agree it doesn't really do anything to advance the state of AI.

      For example I could program my computer to make Rorschach inkblot patterns relatively easily, and many of them would be pleasing to the eye, and people would see flowers, butterflys, erotica, and nightmares in them.

      But the computer didn't put those ideas there, and it doesn't make the computer program an artist.
      An artist has something to say; the computer doesn't.

      This display raises and makes clear the disconnect between the artists message and the viewers response and shows us clearly that the viewer can have a significant response to a piece even if there was no message at all; provided the viewer is "primed" to look for one.

      This is an issue I have with much art, especially minimalist abstract art ... where I genuinely doubt the artist did anything of substance at all, and is merely relying on the viewer to project significance and meaning into it by suggesting it is "art" therefore there MUST be some, and if you can't see it then the fault must be your own inadequacy. The emperors new cloths of the art world so-to-speak.

      This poem is in the same vein. It is sufficiently complicated and constructed of phrases of words that are semantically related so that if we are primed to look for meanings, then like a Rorschach inkblot, we can find one.

      Beauty is in the eye of the beholder after all.

      Yet, all that doesn't imply there is really anything wrong with college poetry though. The poets are learning to express themselves... perhaps somewhat awkwardly. And that awkwardness is part of the total expression. And that's fine.

      Let me know when the AI is trying to actually express an idea and the result is poetic. Of course, for that the AI would actually need an idea to express.

      All this one has is some word soup and some methods for selecting them involving some sort of semantic grouping so they seem to be thematic, some loose grammer rules to put them next to each other; and maybe some loose poem structural templates or something ... or maybe not.

    6. Re:Honestly by StikyPad · · Score: 4, Interesting

      Also, there's no interaction here, and this isn't the first instance of computer-generated content making it through human filters. There was an article a while ago about submissions to scientific journals... I think this is the story: http://www.nature.com/news/pub...

      In both cases, the content was "complete gibberish," not coherent submissions. These stories don't demonstrate the progress of AI; they demonstrate the low expectations of "meaningful," that judges/editors have in specific circumstances.

      That said, there is compelling computer-generated content, such as this: http://www.slate.com/blogs/fut...

    7. Re:Honestly by Jane+Q.+Public · · Score: 2

      Further, it's likely an example of the typing chimpanzees scenario: the person who presented it probably cherry-picked it out of thousands of other, even more nonsensical candidates generated by the computer.

      Many years ago now, I programmed my "pocket" calculator to generate text using Markov chains based on seed text that you input. It almost made sense a lot of the time, and could make perfect sense occasionally, and was even quite hilarious at times. Like for example if half of the seed text was from the King James Bible, and the other half from Shakespeare or a physics textbook.

      But the majority of it was still mostly nonsense.

    8. Re:Honestly by JoeMerchant · · Score: 2

      Go on.

    9. Re:Honestly by Anonymous Coward · · Score: 3, Funny

      and that wasn't the worst poetry ever written. There was a computer that wrote some prose that was so bad, in an effort to save all civilization, it's south-bridge leapt up through its front-side bus and throttled its own CPU! But the very worst poetry ever created a poem written by a tiny computer in England a few years back about dead ducks floating in a pond, but... to relate further information about this would be uncivilized.

  2. Well by Anonymous Coward · · Score: 2, Informative

    More a condemnation of collegiate poetry than a credit to the program, really.

  3. Not the Turing test! by HornWumpus · · Score: 5, Insightful

    WTF has become of /.

    --
    John McAfee 'It was like that time I hired that Bangkok prostitute; to do my taxes, while I fucked my accountant'
    1. Re: Not the Turing test! by bloodhawk · · Score: 5, Insightful

      This has nothing to do with turing or the turing test. The turing test involves a conversation with a computer and the person having the conversation not being able to distinguish if it is a computer or human they are conversing with. Last time I checked you don't converse with a poem... unless you are in a nice tight jacket and a small padded room.

    2. Re: Not the Turing test! by Your.Master · · Score: 4, Insightful

      It has one very obvious thing to do with the turing test: failing to distinguish software from another human being.

      They aren't exactly the same, but that's not the same as having nothing to do with each other. The Slashdot article title was poetic, which is very fitting. I expect the Slashdot title was written by a human.

    3. Re: Not the Turing test! by bloodhawk · · Score: 4, Insightful

      sorry but that is bullshit. Turing test is all about interaction Not generating text and seeing if someone reading it can tell whether it was human or computer generated, that isn't even closely related to what the turing test was about.

    4. Re: Not the Turing test! by blue+trane · · Score: 2

      Well, the Turing Test as envisioned by Turing in "Computing Machinery and Intelligence" included the question:

      "Q: Please write me a sonnet on the subject of the Forth Bridge."

      So this program could help with those types of questions in a Turing Test.

  4. Because no one understands modern poetry anyway by Art3x · · Score: 5, Insightful

    It's much easier for a computer to get away with writing a poem than prose. The modern trend is to write poetry that sounds cool but no one understands. The same is true for modern songwriting.

    P. S. Now get off my lawn.

  5. Not statistically significant by chadenright · · Score: 5, Informative

    From TFA: The 'author' submittted numerous poems to a number of publishers, the great majority of which were rejected. The one that was accepted was accepted to a journal that was to 'showcase a breadth of authors and a breadth of styles.' Really if you're going to publish computer-generated literature, that would be the place to do it.

    1. Re:Not statistically significant by bloodhawk · · Score: 2

      From Turing's "Computing Machinery and Intelligence":

      "I believe that in about fifty years' time it will be possible, to programme computers, with a storage capacity of about 10^9, to make them play the imitation game so well that an average interrogator will not have more than 70 per cent chance of making the right identification after five minutes of questioning."

      So if fewer than 70 percent of the journals rejected it, it would still pass by Turing's criterion.

      10/10 for looking up Turing. 0/10 for your understanding of what was written. Hint the key word in that paragraph is interrogator

  6. My Cat passed the Turing test today. by JamesSharman · · Score: 5, Funny

    She knocked something over in way that was difficult to distinguish from human action at first glance. I presume that's what the Turing test means these days, since all these "X passed the Turing test!" headlines never seem to relate to anything that approaches what Turing actually proposed.

  7. Nobody could tell? by Chas · · Score: 2

    Or nobody could care?

    --


    Chas - The one, the only.
    THANK GOD!!!
  8. Bingo! by davidwr · · Score: 5, Insightful

    It didn't happen in this case, but if your computer algorithm churned out 10,000 "poems" and you or a team of people sifted through them to find the ones that sounded like they were written by a person, then submitted them for publication without telling anyone that 99.99% of the computer's output had been discarded by a person before submission, it would hit /. with a similar article title.

    --
    Knowledge is how to play a game, intelligence is how to win, wisdom is knowing what game to play.
  9. Not a turning test, more like click bait. by sthibault · · Score: 2

    Its been some years since I took AI in college, but I recall the turning test being an interactive one where a person is supposed to engage on conversation over a terminal with something on the other end and determine if its a person or computer. So if I remember right, this is not a turing test pass at all. And quite honestly, to write an algorithm to generate a poem that looks like a humans work, with unlimited time and then post it to see if anyone can tell is a much easier test to pass.

  10. RACTER by Rotworm · · Score: 3, Insightful
    We've had programs writing poetry for a while now. The earliest I'm aware of is RACTER with The Policeman's Beard is Half Constructed, 1983. I found much of it to be banal, but I found some of it to be amazing. It wrote:

    More than iron, more than lead, more than gold I need electricity.
    I need it more than I need lamb or pork or lettuce or cucumber.
    I need it for my dreams.

  11. So what by linuxwrangler · · Score: 4, Funny

    I've seen plenty of poetry that was written by humans but I couldn't tell.

    --

    ~~~~~~~
    "You are not remembered for doing what is expected of you." - Atul Chitnis
  12. Re:How is this an AI? by StormReaver · · Score: 2

    I don't understand how this poetry generator constitutes an AI.

    That's because it doesn't. This program is on the same complexity scale as chapter 2 or 3 in an introduction to programming book, when it reaches the concept of variables. It's an exercise in triviality, not artificial intelligence.

  13. The Turing Test is a *CONVERSATION* by msobkow · · Score: 4, Insightful

    Publishing a poem is not a conversation. Worse, poetry is expected to be artsy gibberish that would raise red flags in a real conversation.

    --
    I do not fail; I succeed at finding out what does not work.
  14. I am not a Number! I am a *nix shell script! by TiggertheMad · · Score: 2

    This is a meta-Turing test: Post something on /. about a computer doing something vaguely 'human' under the title of a machine passing a Turing test and see which posters believe it. Those people are just python scripts.

    Bonus points for using a quasi 'AI' program to auto generate said stories...

    --

    HA! I just wasted some of your bandwidth with a frivolous sig!
  15. Monkeys could do it too by Dr.+Spork · · Score: 2

    The point is that a computer probably generated a whole lot of poetry, and some poor human had to sift through it and pick the least awful poem. So, really, it's a human who did all the hard work anyway. You give enough monkeys enough typewriters, and hire some humans to sort through their "work" and you will eventually get something interesting too.

  16. Haiku By a Robot from Highlights Magazine by ugmoe · · Score: 2

    Here is a Haiku By a Robot from Highlights Magazine.

    Seven Hundred Ten
    Seven Hundred Eleven
    Seven Hundred Twelve

    https://twitter.com/zachwhalen...

  17. Context-free grammar generators is news?! by virens · · Score: 2

    >> a program that utilized a context-free grammar system to spit out full-length, auto-generated poems.
    Well, if context-free grammar is somehow a news for ./ crowd (hardly), then SCIgen is worth mentioning as well. Heck, SCIgen-generated garbage passed as a good science, not just some lousy "poetry".

    Writing some clunky pseudo-poetry for an obscure undergrad mag is one thing, pumping out a full-blown scientific article with figures and references (and getting accepted to some peer-reviewed journals!) is quite another level of achievements. And speaking about achievements, SCIgen is routinely used to embarrass those corporative paper shills from Elsevier (yay, Journal of Applied Mathematics and Computation!) and IEEE (WMSCI 2005).

  18. An AI's Perspective by Phil+Urich · · Score: 2

    I think that says more about crappy college poetry than the state of computer AI...

    "You wound me, sir!" the AI cried,
    "For student I am not.
    In terms of prose and poetry
    More than you've learned, have I forgot.
    Yet you compare me to the fools
    Whose minds through college rot?
    The only insult worse would be
    An editor of Slashdot."

    --
    I remember sigs. Oh, a simpler time!
  19. This is not Philosophy by s.petry · · Score: 2

    I think you meant "liberal arts", though poetry is not traditionally "liberal arts" but "communications/creative writing". "Art" like this is the reason I took one Art class in college and 9 semesters of Philosophy.

    I am actually a decent painter, have been since I was a kid (I won numerous contests and sponsorships for free hand drawing, painting in mostly acrylics and oils). In my first year while trying to decide a major I took an "art" class, mostly to see if this was something I might pursue as a career. My professor was one of the guys that would call TFA's poem "Poetry". He loved modern art and the extremely abstract, hating anything from any other viewpoint. Each class he would parade his trashy piles of welded together pieces of metal crud, telling everyone what a great "artist" he was (though I don't believe he ever sold a single piece of work). For our midterm assignment he gave us an ink and board assignment for pointillism. Not seeing much I could make as "art" with his required 6-11 dots I went with his maximum 11 dots and had something that looked similar to a couple of birds at about 10ft away if you squinted. I received an E on the assignment. Meanwhile anyone that used 6 dots that looked like nothing received As on the project.

    That was an eye opening experience for a young college student. Not only did I find "art" in college to be the single most subjective grading system, but the professors were absolute douche bags. I appealed my E to the Dean who brought in another "great" art professor who also said my 11 dots were excessive for a pointillism project. It was not what the dots appeared to be that counted, it was the emotion they believed I used when placing my dots that was wrong.

    Needless to say my major was quickly chosen. I majored in Math and have a Minor in Liberal Arts (Philosophy). Further, fearing permanent brain damage I never strayed within 100ft of the Art Hall during the rest of my education. I saw what it did to those other "art" students, and I could only assume what the professors had was contagious.

    --

    -The wise argue that there are few absolutes, the fool argues that there are no probabilities.