Slashdot Mirror


Turnitin's Different Messages To Students, Teachers

Economist David Harrington (spotted via Tyler Cowan's Marginal Revolution) charges anti-plagiarism service Turnitin with "playing both sides of the fence, helping instructors identify plagiarists while helping plagiarists avoid detection." Turnitin analyzes student papers for suspicious elements in order to spot the plagiarism, scanning for things like lifted quotations or clever rephrasing. However, the same company offers a counterpart — a scanning service called WriteCheck which essentially lets the writer of a submitted paper know whether that paper would pass muster at Turnitin, and thus provides a way to skirt it (by tweaking and resubmitting). Harrington gave these two systems an interesting test, involving several New York Times articles and a book he suspected of having lifted content from those articles.

37 of 306 comments (clear)

  1. Offensive by Anonymous Coward · · Score: 2, Funny

    From the article:

    "Its so simple my grandmother could do it"

    As a 49 yo grandmother, feminist and C programmer of 20+ years, i find this offensive.

    1. Re:Offensive by Surt · · Score: 2

      Yes, you're the typical grandmother if ever there was one.

      --
      "Who is the Journal of Quantum Physics going to believe?" --Stephen Hawking
    2. Re:Offensive by ColdWetDog · · Score: 4, Insightful

      Yes, you're the typical grandmother if ever there was one.

      She is now.

      Really, maybe not '20 years of C programming' (that puts her in crazy land), but everything else is fairly typical these days. Outside of Pakistan, that is.

      --
      Faster! Faster! Faster would be better!
    3. Re:Offensive by DarkTempes · · Score: 2

      It's still atypical for a 29-year-old woman to start programming in 2011.

      Take a peek in your local college/university computer science classroom...

    4. Re:Offensive by Runaway1956 · · Score: 2

      Well, AC, or Grandma - I say "Get over it".

      I'm six years older than you, and a Grandpa. We see and hear stuff all the time about old people and technology. And, it's so true that arguing is pointless. People our age are mostly clueless when it comes to modern tech. So, you and I can keep up with most of the younger generation, huh? So, put a feather in your cap for being ahead of the rest of our generation. We're still dinosaurs, albeit pretty smart dinosaurs.

      Oh - I missed the feminist part. You're probably a professional offense taker. Well, go ahead and be offended. Who am I to get in the way of your martyr complex?

      --
      "Windows is like the faint smell of piss in a subway: it's there, and there's nothing you can do about it." - Charlie Br
  2. Hmmm by Anonymous Coward · · Score: 3, Funny

    I don't see a problem here at all.

    A smart company found a way to exploit many stupid people and get their money. Isn't that the entire point of modern business?

    Everyone got what they wanted.

    1. Re:Hmmm by ynp7 · · Score: 2

      That's okay, in my career I've found most people who know anything didn't learn any of it in school anyway. The problem is relying upon degrees so heavily as a gauge of competency in hiring. Maybe if enough clowns cheat their way through university it will force hiring managers to re-evaluate the criteria they're using to make their decisions.

    2. Re:Hmmm by SanityInAnarchy · · Score: 2

      Most went to college because it was a way to have mommy and daddy pay their way for another 6 years.

      How's that relevant? Yes, I get that it's easier than the real world, but especially if you're this sort of person, you probably don't realize that yet. There are going to be plenty of times when dropping out seems like a good option. However much easier it may be, if you've got a degree that took 6 years, that means you actually stayed in school and didn't do terribly for 6 years.

      --
      Don't thank God, thank a doctor!
  3. Tweaking and submitting by dg41 · · Score: 2

    Tweaking and submitting would be removing the plagiarism, which would still be caught on the instructor side. I fail to see the conflict here.

    1. Re:Tweaking and submitting by PCM2 · · Score: 4, Interesting

      Tweaking and submitting would be removing the plagiarism, which would still be caught on the instructor side. I fail to see the conflict here.

      But it doesn't have to be verbatim to be plagiarism. Changing a few words here and there still isn't the same as doing the research and writing the paper yourself. A paper is supposed to be a demonstration of what you know and how well you can articulate it. A paper that you swiped and then tweaked to pass a plagiarism review proves only that you know how to be a crook.

      --
      Breakfast served all day!
    2. Re:Tweaking and submitting by alostpacket · · Score: 2, Funny

      Tweaking and submitting would be removing the plagiarism, which would still be caught on the instructor side. I fail to see the conflict here.

      It isn't required to be word for word to be plagiarism. Replacing a few words here and there still isn't the same as doing the work and writing something yourself. A paper is supposed to show what you know and how well you can communicate it. A paper that you stole and then modified to pass plagiarism software only proves that you know how to be a criminal.

      --
      PocketPermissions Android Permission Guide
    3. Re:Tweaking and submitting by Baloroth · · Score: 5, Insightful

      I think the point is, you can use WriteCheck to see if it would count as plagiarism, then modify it to the point where it won't.

      Of course, how much you need to modify each paper might mean that it would be simpler to just write the thing yourself... but never underestimate how much work a student will go through to avoid doing work.

      --
      "None can love freedom heartily, but good men; the rest love not freedom, but license." --John Milton
    4. Re:Tweaking and submitting by hedwards · · Score: 2

      Plagiarism is more than just lifting text word for word, only idiots do that these days, paraphrasing is acceptable to an extent, but lifting ideas isn't.

      The problem is that there's a fixed number of ideas and a fixed number of ways of expressing them. And unfortunately, there are going to be cases where unoriginal work really wasn't plagiarized from any other source. And determining whether or not a particular student really did lift something that could be a plagiarized idea that's been paraphrased isn't easy.

      And ultimately, I probably should cite Mozart for expressing the finite way in which we can create papers, but I'm sure he wasn't the first one.

      What's really bad is that plagiarism has only been a big deal for the last several hundred years, and a significant number of writers, politicians and similar have been guilty of it over the years.

    5. Re:Tweaking and submitting by Runaway1956 · · Score: 2

      There is still a problem, as I see it.

      There are, after all, only so many different ways to make a statement. If, over time, the statement has been re-stated 3 1/2 million times, then some of those re-statements are going to look suspiciously like plagiarism. In the final analysis, your answers to a test and/or your essays are merely tweaked rephrasing of whatever the teacher and the textbook already said.

      --
      "Windows is like the faint smell of piss in a subway: it's there, and there's nothing you can do about it." - Charlie Br
    6. Re:Tweaking and submitting by Anubis+IV · · Score: 3, Funny

      My first semester in college, I was taking an intro physics class that had a mandatory 10-question Calculus quiz online. We could take it as many times as we wanted, but we had to score a 100% on it in order to get a passing grade for the quiz (our data was anonymized, so our names were only tied to our final score). The questions were pulled from a pool of 25, and after I spent 20-30 minutes on it the first time, only to be foiled by a single mistake on one question, I got it into my head to just submit answers, note the question-answer pair for the ones I got correct, and repeat it until I got them all correct. It took me about 20 more minutes of note taking and quick submissions before I got 10 questions that I had the answers for. I figured it was a good tradeoff since I didn't have to worry about computation errors on my part eating up more of my time.

      The next day, the professor got up and sincerely praised all of us for our perseverance and tenacity in working through the difficult quiz. In particular, he wanted to praise one student who took the quiz 39 times before getting all 10 questions correct. He didn't know who it was, but he was clearly exuberant that he had a student so dedicated to excelling in the class. I didn't have the heart to tell him what I had actually done.

  4. How to double your profits selling arms: by Duradin · · Score: 4, Interesting

    How to double your profits selling arms: sell to both sides of the conflict.

    1. Re:How to double your profits selling arms: by gman003 · · Score: 2

      Only both sides? Don't forget that those caught in the crossfire are a nice market niche.

    2. Re:How to double your profits selling arms: by MBC1977 · · Score: 2

      Microsoft Security Essentials....works great!

      --
      Regards,

      MBC1977,
  5. dunno by spottedkangaroo · · Score: 4, Insightful

    I dunno about playing both sides of the fence... I used a service very much like this to detect that my partner in my last class had plagerized all 12 pages of our research paper. I was greatful to have spent the $5 and immediately wrote a new paper from scratch. What an asshole. Am I naive to think most students would use the service this way?

    --
    Imagine if you weren't allowed to use roads because a bus company complained about your driving 3 times. --skunkpussy
    1. Re:dunno by Anubis+IV · · Score: 5, Informative

      Your idea falls apart for the simple fact that Turnitin.com doesn't suggest false positives.

      For the last year and a half, I was a Teaching Assistant assigned to a senior-level engineering ethics course at a major university. We had about 650+ students every semester, and each of them would submit 3 essays via Turnitin.com. Out of the 14 TAs and 4 professors associated with the course, it fell to me to check for cheaters via Turnitin.com for all of those essays.

      To make a long story short, rather than the essays going into a black box with Turnitin.com spitting out a list of of cheaters on the other side, which is what you seem to think happens, Turnitin.com ranks the students by telling the instructor what percentage of the student's paper is a match with other sources. It doesn't label them as a cheater or automatically give them a 0. Instead, the instructor can click on the essay via Turnitin.com, and Turnitin.com will highlight each portion of the essay for which it found a match, showing the instructor the original text side-by-side with the essay. That allows the instructor to make an informed decision on whether or not the student is guilty of plagiarism.

      Had they not structured it that way, you'd be absolutely correct. In my time with the course, it wasn't uncommon to see average scores for matches in the 15-25% range (i.e. 15-25% of every student's paper could be identified as coming from another source). Most of that, however, was either a result of quotations, coincidental phrasing (there are only so many unique ways to discuss ideas on a narrow topic, so there's quite a bit of overlap between 650 students), or bibliographies (Turnitin.com can be told to ignore bibliographies, but if you don't have it do that, then they'll oftentimes show up as a match with the other students citing the same references).

      Anyway, because of the severity of academic dishonesty allegations (I saw one estimate that failing a class due to academic dishonesty costs a student about $100,000 over their career), a responsible instructor would never rely on a black box to tell them who was cheating. Every academic council, honor council, review board, or whatever else I've heard of demands to see evidence before punishing a student, and a responsible instructor should have had that prepared whenever they made the initial allegation anyway. Turnitin.com's job, rather than labeling cheaters, is merely to identify possible plagiarism and put the information in the hands of the instructor so that they can make an informed decision, and it does that job well.

    2. Re:dunno by izomiac · · Score: 2

      The hilarious thing would be if your lab partner did the same thing first, causing your later submission to be detected as plagiarism. (These services retain a copy so they can expand their database, and even non-plagiarists occasionally submit papers to ensure there aren't any false positives.)

  6. Re:They're Not Alone by PCM2 · · Score: 2

    Too bad Slashdot doesn't use something like this; plenty of submissions lately are lifted wholesale from somewhere else, without even a trivial rephrasing.

    I fail to see why a brief summary of someone else's article -- plus a link to it -- needs rephrasing. The original author's words are the whole point. The lame summaries are the ones when the submitter uses the summary as an opportunity to editorialize when they didn't even understand the article they submitted.

    --
    Breakfast served all day!
  7. Re:So what exactly is the crime here? by PCM2 · · Score: 2

    Not to mention that many of the types of papers that are being fed to these machines are of the variety where not so many original words could be said at all. Organic chemistry.

    Really? I never had to write any papers in organic chemistry class. I would have been thankful for one.

    --
    Breakfast served all day!
  8. Re:I came up with this post all on my own. by zill · · Score: 2

    Please see me after class, Mike.

  9. Re:So what exactly is the crime here? by fish+waffle · · Score: 2

    In my experience, professors have often suggested that students run their papers through these engines before turning them in, to ensure that the percentage of work done by students is adequate before they turn it in. There's nothing shady about that.

    Yes, yes there is. The purpose of an educational assignment is voided if you think of it as a game---the point is to do it and learn from that experience, not just "pass" it. If your professors are encouraging you to do that they are fools, and if you think learning is about achieving an "adequate percentage of work done" you do yourself (and your future employers) no service.

  10. But it doesn't work anyway... by Wasusa · · Score: 2

    Given that Turnitin doesn't work as advertised anyway, I'm not really sure what the issue is. While it can certainly check all the internet sources, it fails to compare it to other submitted works. I know I've lifted sections from my own, previously submitted to turnitin assignments only to have it spit out 0% plagiarism when in reality I've only done half the work the second time around. Hell, I know people who've lifted entire sections straight from Wikipedia, changed two words, and it detected nothing. The thing is broken, and I don't see why people still feel the need to bother with it.

  11. Re:That's not even in the articles! by hort_wort · · Score: 3, Funny

    Why the hell is that comment at 3, Insightful? That quotation isn't even in any of the linked pages.

    Did you use Turnitin to determine that?

  12. Re:configuration options exist by RobinEggs · · Score: 3, Insightful

    While I believe students do release their copyright to the work as part of this- I can't take seriously the idea anyone cares about the copyright on their intro biology lab report

    That's a foolish, misleading example on which to dismiss the concern out of hand. How many business models or product designs have come to someone during their undergraduate years, leading the inventor to drop out and create global corporations or life-changing social innovations? Where would we be if Mark Zuckerberg or Shawn Fanning or Bill Gates had written about their ideas in their "intro" computer science classes and had some bullshit like this take away their opportunity to copyright or patent their ideas? And what if it wasn't even the university that got to steal it, but Turnitin.com?

    Never, ever underestimate the seriousness of requiring someone to surrender intellectual ownership of things written or invented on their own time as a condition of getting an education or a job or anything else.

  13. I like your style! by definate · · Score: 2

    I like how you eliminated the part which makes her atypical, then said how it's fairly typical. You re-write the context, then say that it's not what the other commenter said, as if that somehow made sense. You do realize that the "20 years of C programming" was what made her atypical right? It wasn't that she was a grandmother, or that she's a feminist, or that she finds it offensive. All of those are perfectly normal things. Since you removed the absurd part, and still felt the need to comment on the normal stuff, my guess is you see these normal things as somewhat odd. It's really weird.

    So, following your lead... Why didn't you mention that this sort of thing would be atypical in Pakistan? Sure, it may be true everywhere else, but possibly not in Pakistan.

    --
    This is my footer. There are many like it, but this one is mine.
    1. Re:I like your style! by ColdWetDog · · Score: 2

      ## Humor failure detector missing in UID 876684 ###

      A)bort R)etry F)ail

      --
      Faster! Faster! Faster would be better!
  14. Turnitin as a teaching tool by Acheron · · Score: 3, Informative

    I was a technical advisor to a committee creating policy for Turnitin style service use on the university campus I work on. Turnitin isn't a plagiarism detection service: they're being disingenuous when they say that. It is a text matching service. The difference is significant: a first-year history paper might be 75% matched, but not plagiarized because the student correctly attributed all their quoted passages.

    The committee recommended against using it for detecting plagiarism, and for encouraging its use as a teaching tool to make students aware of proper citation techniques and the importance of avoiding plagiarism.

    Some service like this also happen to be quite good at the most common kind of plagiarism: someone on campus submitting someone elses paper from the previous year to a different prof... but that's a special clear-cut case of cheating, not what people commonly think of as plagiarism.

  15. Re:They're Not Alone by fahrbot-bot · · Score: 2

    Plagiarism is copying another work without citation and trying to pass it off as your own.

    Funny story. I wrote a paper (way) back in college for a creative writing class in which I included an original poem at the beginning. The teacher wrote "Source?" next to the poem. I chided her that I don't have to cite myself in my own paper. I still don't know if I should be flattered or insulted that she didn't think it my work. (sigh)

    --
    It must have been something you assimilated. . . .
  16. Re:I came up with this post all on my own. by tibit · · Score: 2

    I don't know if a class could do it for everyone. Socially inept geeks may need one-on-one tutoring, where they are to write papers, and the tutor is to grade them, discuss the mistakes, and provide guidance for improvement. This is not horribly expensive either, if you know where to look. A high school teacher should be plenty enough -- in most of Europe, at least. Ideally look for teachers that got geeks for significant others.

    --
    A successful API design takes a mixture of software design and pedagogy.
  17. Re:So what exactly is the crime here? by Anonymous Coward · · Score: 2, Insightful

    It has been way too long since you took an entry-level course.

    1. There are only so many things that can be said about entry level subjects, but still students must write the papers so they learn to write the kind of papers you think they should just know how to write.

    2. An accusation of plagiarism is to the current academic environment what accusations of witchcraft were in Salem in the seventeenth century.

    Combine those two and you have a lot of kids tossed out on their asses just because of a flawed algorithm. But yeah, those professors would be total fools to give their students a tool that can both help them avoid that fate and help educate them about plagiarism.

  18. Re:self plagiarism should not be flaged and you sh by ensignyu · · Score: 2

    Off-topic, but regarding self-plagiarism and "duplicate credit":

    In college I took an Intro to Philosophy 1 class for my humanities general ed requirement. The next year, I signed up for the second class in the series, on ethics, which had TBD listed for the instructor. On the first day of class, I found out it was taught by the same professor -- and the syllabus was exactly the same as Philosophy 1!

    The professor had basically plagiarized his own material for what was supposed to be a different course. For a class on ethics. Seriously. I confirmed with the TA (same TA) that the material was exactly the same and dropped the class (I took a different one later). In retrospect, I probably should have complained to the Dean.

  19. Re:That's not even in the articles! by TheRaven64 · · Score: 2

    I had to use TurnItIn for a course I taught last academic year (I also had to use Blackboard, which is the worst piece of software I've ever used - if one of my students had submitted code that bad, they'd have failed). To test it, I tried getting one of my students to upload a copy of the course notes. He uploaded a copy of the PDF that was on my web site. TurnItIn found the copy on my web site, and said that the uploaded version was 70% similar to it. Now, if it thinks that two bit-for-bit identical documents are only 70% similar, I don't have much faith in it finding real cheating...

    Oh, and it comes back with a lot of false positives because it doesn't know about quotes. If someone says: Poster hort_wort (in Slashdot post http://news.slashdot.org/comments.pl?sid=2422338&cid=37365024) posed the question "Did you use Turnitin to determine that?"

    Then it would flag that quote as plagiarised and add it to the plagiarism total. This meant that the essays I got that cited a lot of sources were all flagged.

    --
    I am TheRaven on Soylent News
  20. Re:What kind of professors are these?! by pehrs · · Score: 2

    Lets say that I hand you a pile with 240 10-page technical reports from students, and give you 2 weeks to grade them. About 5% of them looks "fishy" when you read them (not an unusual statistic at a major university by the way). There can be multiple reasons, like different style of writing, illustrations that doesn't quite fit the subject, sudden bursts of exceptional detail and so on.

    Without any text matching service you now have to basically go to the library and try to locate the sources, examine old papers and cross match between students. This is hours, if not days, of work per paper. Once you have located the exact sources you have to write up a report and send to the disciplinary board.

    The text matching service saves you a considerable amount of time. First of all you can put the high score reports in a separate pile, examine the matches more carefully and consider if they should be send to the disciplinary board. The hours or days in the library are more or less over. Secondly the "turnitin" logo acts as a "don't be stupid" warning to the student. In my experience it reduces the amount of badly plagiarized work significantly.