Slashdot Mirror


Yahoo Faces Questions After Discovery Of Comment Replication

An anonymous reader writes "Someone noticed that certain Associated Press stories on Yahoo seem to be appending old comments to new stories in a way that was highly misleading (suggesting new stories had a lot more interest than they really did). The initial theory was that this was some sort of nefarious scam, potentially by Yahoo and the AP. However, Mike Masnick at Techdirt dug into the details and found evidence that it's more about incompetence in the way Yahoo built its comment system, combined with the way that the AP pushes and rotates its articles to partner sites."

68 of 97 comments (clear)

  1. How does that saying go again? by Monkeedude1212 · · Score: 4, Insightful

    Never attribute to nefarious scams that which can be adequately explained by incompetence?

    Or something like that anyways

    1. Re:How does that saying go again? by SilverHatHacker · · Score: 3, Funny

      You pulled this exact post, word for word, out of my head, at the exact instant I thought of it. You've got to teach me how to do that!

      --
      Funny may not give karma, but +5 Informative never made anyone snort coffee out their nose.
    2. Re:How does that saying go again? by Michael+Kristopeit · · Score: 3, Funny

      Never attribute to nefarious scams that which can be adequately explained by incompetence

      if this sentiment was universal, all truly nefarious people would simply hide behind the protection of incompetence.

      i'm attributing this to orchestrated incompetence.

    3. Re:How does that saying go again? by Monkeedude1212 · · Score: 3, Funny

      You have to purchase my 10 DVD Box set on how to read minds through the internet. 11 small payments of 30 dollars + shipping and handling*

      *dvd's shipped seperately

    4. Re:How does that saying go again? by Anonymous Coward · · Score: 1, Informative
    5. Re:How does that saying go again? by SupremoMan · · Score: 1

      Hmmm I read the parent before. I think Slashdot is appending old comments to new stories. It's no doubt some sort of a nefarious plot to make the stories seem as though there is more interest in them.

    6. Re:How does that saying go again? by marcello_dl · · Score: 4, Insightful

      "Never ascribe to malice that which is adequately explained by incompetence."
      (attributed to Napoleon Bonaparte, born 1769 - likely competently poisoned to death in 1812)

      http://en.wikipedia.org/wiki/Napoleon_I#Cause_of_death

      --
      ---- MISSING MISCELLANEOUS DATA SEGMENT --- [sigdash] trolololol
    7. Re:How does that saying go again? by JesseMcDonald · · Score: 1

      How about "only a sith deals in absolutes"?

      That sounds like the sort of absolute statement a Sith would make.

      Or perhaps it's not just the Sith who deal in absolutes after all.

      --
      "The state is that great fiction by which everyone tries to live at the expense of everyone else." - Bastiat
    8. Re:How does that saying go again? by Gilmoure · · Score: 1

      I don't make enough money and my parents aren't rich enough for incompetence to be a plus for me.

      If I screw up, I end up paying.

      --
      I drank what? -- Socrates
    9. Re:How does that saying go again? by techoi · · Score: 5, Funny

      I am thinking of my address and credit card number right now. Please send me qty 2

    10. Re:How does that saying go again? by kronosopher · · Score: 1

      How else do you expect people to react when 99% of wealth is owned by less than 1% of the population?

    11. Re:How does that saying go again? by CaroKann · · Score: 1

      I've always thought this happened by design. Although, I've never been sure exactly what the design was.

      Perhaps it's an attempt to keep a conversation about a particular topic going through multiple headlines and stories. New stories are being written all of the time, usually with just a paragraph or two that are different from the old story.

      Perhaps it was an attempt to cut down on the number of stupid posts. After all, who reads the end of a comment thread that contains 99,601 comments. Surely people realize that few people are going to read their comment after so many have been posted.

      Perhaps it's an attempt to cut down on flame wars. It's not easy going through 100's of pages trying to find out if some moron picked up on your finely honed flame-bait.

      Perhaps it's a database design issue, and they are simply trying to save disk space.

    12. Re:How does that saying go again? by jeepien · · Score: 1

      "Napoleon Bonaparte, born 1769 - likely competently poisoned to death in 1812

      ...not to mention maliciously.

    13. Re:How does that saying go again? by JesseMcDonald · · Score: 1

      I'm not sure whether the paradox was deliberate or not in the original context. In the movie it seemed to be given as impromptu advice, which would imply that either the speaker didn't see the paradox, or the phrase, its paradox, and the resulting lesson were all well-known to both master and apprentice despite never being mentioned elsewhere.

      However, this is not the original context. I was responding to the quotation in Kingrames' comment, where it appeared to me to be taken literally. Perhaps I was wrong; subtle sarcasm is hard to reliably detect without the regular audible clues.

      --
      "The state is that great fiction by which everyone tries to live at the expense of everyone else." - Bastiat
    14. Re:How does that saying go again? by perryizgr8 · · Score: 1

      never attribute to weird mind powers that which can be adequately explained just by some bloody good luck.

      --
      Wealth is the gift that keeps on giving.
    15. Re:How does that saying go again? by perryizgr8 · · Score: 1

      dirty communist!!!!!!!!

      --
      Wealth is the gift that keeps on giving.
    16. Re:How does that saying go again? by kronosopher · · Score: 1

      "In an insane society, the sane man must appear insane." - Spock

    17. Re:How does that saying go again? by Dexter+Herbivore · · Score: 1

      Am I the only one here that finds "dissidentvoice" likely to be a batshit insane conspiracy theorist? I know he was right about the comments system being broken, but you know the saying about broken clocks...

    18. Re:How does that saying go again? by Kilrah_il · · Score: 1

      I think people around here give those companies too much credit. From all the theories that arise after such stories, you would think that each company is controlled by a criminal mastermind (AKA Doctor Evil) that sits all day and tries to create plans to f^%$-up everyone just to gain "One Million Dollar!".
      Now, I wouldn't be so naive as to suggest that those companies are the exact opposite (i.e. they want to spread little bits of happiness all around), but the truth is probably somewhere in the middle: These companies are trying to make money, usually in an honest way, but sometimes they screw-up, either through incompetence (which I think this is the case this time) or because of "nefarious" scams (e.g. Facebook's privacy issues*).
      Although problems such as the one described in TFA should be found, pointed out and fixed, we should be more selective in the "Evil Corporation" designation.

      * Some would say those privacy issues are just very bad business decision, but to the lay person it's the same. If you prefer the interest of your ad partners to the gross disadvantage of your customer, then you have a problem.

      --
      Whenever in an argument, remember this.
    19. Re:How does that saying go again? by Threni · · Score: 1
    20. Re:How does that saying go again? by moortak · · Score: 1

      Bah, everyone knows Slashdot appends old stories to new comments.

      --
      Xavier Rabourdin for president 2012
    21. Re:How does that saying go again? by lonecrow · · Score: 1

      "incompetence before conspiracy" is how I have naming the rule. It has applications all over the place from 9/11 some World Bank actions and others.

      However, I am not sure if I would apply it to the latest financial meltdown. It smelled a little to much like disgruntled employees pilfering as much as they can on the way out the door.

  2. Sloppy programming by dgatwood · · Score: 4, Insightful

    Well, in this case, they're treating the last path part as a unique identifier, which it obviously is not. I read the article half expecting it to be an integer overflow bug....

    --

    Check out my sci-fi/humor trilogy at PatriotsBooks.

    1. Re:Sloppy programming by Lazlo+Woodbine · · Score: 5, Informative

      It's pretty common in newspapers (and AP) to recycle slugs. A slug is the internal identifier that's used for a story since the title is often the last thing written. The slug is typically only unique for a specific day. Also, Yahoo is fairly incompetent when it comes to technology for a company its size.

    2. Re:Sloppy programming by Bakkster · · Score: 1

      Also, Yahoo is fairly incompetent when it comes to technology for a company its size.

      Thank you Captain Obvious ;)

      --
      Write your representatives! Repeal the 2nd Law of Thermodynamics!
    3. Re:Sloppy programming by Pollardito · · Score: 2, Insightful

      It's unique for a specific day, but it also isn't. As they add more detail to a story, a new story comes across with the same slug (or even slightly changed). They're matching comments to slugs instead of to some sort of a story ID, because they want the comments to stay on the story as it's revised. Imagine a story on the World Trade Center attacks coming through 10+ times as more and more detail filters in, and every time a new version comes through all the comments get wiped.

      Unfortunately it looks like their attempt to fix a weakness in the underlying delivery is overcorrecting. These things are pieced together by human editors on some sites, but I'm sure Yahoo isn't the only one to botch an attempt at automating it.

    4. Re:Sloppy programming by Velex · · Score: 1

      some sort of a story ID, because they want the comments to stay on the story as it's revised. Imagine a story on the World Trade Center attacks coming through 10+ times as more and more detail filters in

      The solution to that is to also store revisions, e.g. revision_id 2, 3, and 6 belong to story_id 4.

      --
      Join the Slashcott! Stay away entirely Feb 10 thru Feb 17! Close all tabs to prevent autorefresh!
  3. In other words... by Saeed+al-Sahaf · · Score: 1

    In other words, Nothing To See Here, Slow News Day, and so on... NEXT!

    --
    "Who are in control, they are not in control of anything - they don't even control themselves!" - Glen Beck
    1. Re:In other words... by Arthur+Grumbine · · Score: 1

      In other words, Nothing To See Here, Slow News Day, and so on... NEXT!

      Hmmm... apparently /. also suffers from this symptom of comment duplication... :-P

      --
      Now that I think about it, I'm pretty sure everything I just said is completely wrong.
    2. Re:In other words... by JustOK · · Score: 1

      In other words, Nothing To See Here, Slow News Day, and so on... NEXT!

      --
      rewriting history since 2109
  4. Yahoo Answers by Itninja · · Score: 5, Funny

    Kind of OT, but Yahoo Answers comment system is wonked out too. My favorite part is how I can edit my answer after it's been modded up (or down). I can say something like 'To fix your WAP you need to reset to factory defaults and reconfigure', and get modded very high. Questions come in very fast and most are off the main page withing a few minutes, so I can go back 10 minutes later and change my answer to something like 'Call the company at 202-456-1414 and complain. they will give you the runaround, but the secret word is 'potus'. Demand to talk to potus and you will be fine.'

    --
    I judt got a nre Kinesis keybiartf so please excusr ant egregiou typos.
    1. Re:Yahoo Answers by nurb432 · · Score: 4, Funny

      So you are the bastard that got the black vans to my house when i had that wireless problem !!!!! potus my ass!!!

      --
      ---- Booth was a patriot ----
    2. Re:Yahoo Answers by MrEricSir · · Score: 1

      They need to do WAP instain mother>

      --
      There's no -1 for "I don't get it."
    3. Re:Yahoo Answers by Itninja · · Score: 1

      Especially since we 'own our comments'. Not really sure how they define ownership. "Hey congrats on paying off your house and becoming an true homeowner! Oh, you accidentally painted your house numbers in the wrong order? Bummer, looks like your stuck with it now...forever."

      And the best part is there will always be some knob discrediting everything you said because of a misspelling.

      --
      I judt got a nre Kinesis keybiartf so please excusr ant egregiou typos.
    4. Re:Yahoo Answers by MichaelSmith · · Score: 1

      And I absolutely detest Slashdot's system.

      And yet here we are...

    5. Re:Yahoo Answers by martin-boundary · · Score: 1

      Yeah, it's kinda like talking, isn't it? I wish I could go back five minutes and change my side of a conversation IRL. Could be really useful for interviews, especially for the part about negotiating the salary...

    6. Re:Yahoo Answers by Itninja · · Score: 1

      But I don't have to wait 8 minutes when I misspeak to correct myself.

      --
      I judt got a nre Kinesis keybiartf so please excusr ant egregiou typos.
  5. Remmeber .... by Anomalyst · · Score: 1

    What you see is not information, it's not even data, it's "news" and rarely related to anything important in the real world.

    --
    There is no right to feel safe thru security vaudeville at the expense of everyone's freedom, privacy and tax money.
    1. Re:Remmeber .... by game+kid · · Score: 1

      But I saw it in the ticker thingy at the bottom! I swear Obama is having an affair with Katy Perry!

      --
      You can hold down the "B" button for continuous firing.
  6. Awww come on, maybe they got a visit from the by Phizzle · · Score: 1

    Department of Redundancy Department?

    --
    I will not be pushed, filed, stamped, indexed, briefed, debriefed or numbered. My life is my own.
  7. Bigger problem is editing by SomeJoel · · Score: 1

    I don't know who the drunks are that write and edit the Yahoo and CNN "news" stories, but they usually have more spelling and grammar errors than a 2nd grade book report.

    --
    <Complete your profile by adding a signature!>
    1. Re:Bigger problem is editing by CrashandDie · · Score: 1

      "I don't know who the drunks are who write and edit" (fixed that for you)

      Oh the irony of a grammar complaint coming from one who fails to live by his own rules.

  8. timeline of Yahoo quality by blair1q · · Score: 3, Informative

    Kinda lame, but useful
    Still lame, not as useful
    Somewhat better presented, less useful compared to competitors
    Kinda flashy and a little more useful than before
    Crufty and deliberately defeatured
    Kinda buggy and simplistic compared to competitors
    Definitely suffering bit-rot, not any more useful
    Total crap with pockets of new development of script-kiddie webdev showoff crap that makes it no more useful and often worse than useless

    1. Re:timeline of Yahoo quality by perryizgr8 · · Score: 1

      ever since i saw the headline, i been wondering who the fuck uses yahoo anymore?
      even hotmail is better than yahoo mail.
      google news is much much better than yahoo news.
      yahoo search??? what yahoo search?

      --
      Wealth is the gift that keeps on giving.
  9. Duh! by Just+Brew+It! · · Score: 1

    You'd think an Internet company that has been around as long as Yahoo! would understand how to code a proper CMS by now. IMO this is just further evidence that they will be joining the likes of Netscape and AOL in the dustbin of Internet has-beens sooner rather than later...

    1. Re:Duh! by toadlife · · Score: 1

      You would think...

      Up until a few months ago, the site ZDNet had a bug in their comments that allowed the first person who made a comment under a story or blog to change the headline displayed over the comments section by modifying the querystring.

      For example under a story called "Flaw found in Internet Explorer" the link to post a comment would look like this....

      http://zdnet.com/blogs?foo=4343?title=Flaw+Found+in+Internet+Explorer

      The first person to post a comment could change the querystring like so...

      http://zdnet.com/blogs?foo=4343?title=Microsft+gives+up+advises+edveryone+to+use+Firefox+instead

      And the "new" title would appear over the comments section for the world to see. I had fun with it a few times - never anything dirty or offensive and I even reported the bug to them multiple time, but they left it unfixed for years. Someone with ill intentions could have put something vulgar up for all of their readers to see.

      --
      I don't always use unix-like operating systems; but when I do, I prefer FreeBSD.
  10. It doesn't make any difference by SeaFox · · Score: 1

    Because the comments of new stories on Yahoo are all the same to start with!

    Half will directly hold the current sitting President responsible for the article's topic. Some will hold the political party with majority in Congress (yes, this includes articles about Acts of God -- see articles about Hurrican Katrina blaming the Right Wing). Then there will be all the responses to the first two groups that instead blame the other party or previous President. There will be a few that comment on terrorism. And there will be a few hardcore environmentalist-written ones.

    1. Re:It doesn't make any difference by gront · · Score: 1

      Don't forget all the cranks and crazies. Yahoo's news comment system is a complete waste of time and I have no idea why they have it. They got rid of it for a while, then brought it back. Without any sort of moderation or sanity checking, it's like listening to talk radio without call screening.

    2. Re:It doesn't make any difference by TimSSG · · Score: 1

      You are correct; it really explains why it took so long to notice the problem.

      Tim S.

    3. Re:It doesn't make any difference by SeaFox · · Score: 1

      Well, you can "thumbs up" and "thumbs down" comments now like on YouTube, and ones that score low enough (the threshold seems pretty damn low) will be hidden by default. So there is actually a possibility that the old crew of outright racist and vulgar comments will be actually suppressed a bit (that was why Yahoo pulled the comment plug to begin with, it was during that scare about lawsuits on sites that allowed hate speech to be published in reader comments). But the general quacks will still get the attention they want.

      A system more like Slashdot's where a comment starts with a low score and has to be modded up to a certain threshold to be seen by most people would be better.

  11. plausibly deniability by subanark · · Score: 2, Funny


    Getting a cue right from The underhanded C contest
    </tinfoilhat>

  12. I noticed the same on Amazon.com by rolfwind · · Score: 2, Interesting

    On some movies, like the DVD of a certain franchise, Amazon now includes reviews from all the other seasons or even completely different titles, going so far as to calculate the star ratings based on these seperate products.

    This doesn't seem to be across the board and may be up to the individual seller of the product, but it has turned movies that were rated 2 stars 2 years later into 5 star products -- without having an additional actual reviews pertinent to the title added, rather than reviews of better movies in the franchise lumped together into it.

    Really destroys their credibility.

  13. Re:Reality by thoughtsatthemoment · · Score: 1

    We know it's something like that already. The real interesting part is Yahoo hasn't been able to fix such an obvious bug for all these years.

  14. Advanced Comment Duping System? by ZERO1ZERO · · Score: 1
    Has Yahoo stumbled upon the Holy Grail of dupes? Have they unwittingly produced the mother of all duping systems? We must know, is there anything slashdot can learn from this to ensure more efficiently duped articles? Why stop at duped stories when we can have duped comments?! This would save so much time.

    Has Yahoo stumbled upon the Holy Grail of dupes? Have they unwittingly produced the mother of all duping systems? We must know, is there anything slashdot can learn from this to ensure more efficiently duped articles? Why stop at duped stories when we can have duped comments?! This would save so much time.

    1. Re:Advanced Comment Duping System? by BobisOnlyBob · · Score: 1

      Has Yahoo stumbled upon the Holy Grail of dupes? Have they unwittingly produced the mother of all duping systems? We must know, is there anything slashdot can learn from this to ensure more efficiently duped articles? Why stop at duped stories when we can have duped comments?! This would save so much time.

    2. Re:Advanced Comment Duping System? by thoughtsatthemoment · · Score: 1

      This is an easy call for a redundancy mod.

  15. Nefarious is overused. And usually incorrectly. by Darth+Sdlavrot · · Score: 1

    adjective
    (typically of an action or activity) wicked or criminal

    adjective
    flagrantly wicked or impious

    Ever since it was used in Raiders of the Lost Ark it seems.

    So, did Yahoo have a wicked or criminal scam, or was was it something less. Maybe just a scam?

  16. If you ever think that Slashdot's system is bad by CityZen · · Score: 2, Interesting

    You just need to take a look at Yahoo's comment system to see how much incredibly worse things can be.

    I'm not even talking about the quality of the comments themselves, which make your average Slashdot troll look like a PhD in comparison.

    Still, though, I think comment systems in general need lots of improvement. One idea I have is weighted tags: allow tags to be added to comments, along with +/- buttons to allow others to alter the weight of the tags. Then, design the display system to let you filter or arrange content based on tag weights that you care about.

    Of course, there's always lots of details to work out, such as how to keep the taggers/raters honest (or at least prevent too much abuse).

    Once such a system is made, it needs to become viral and replace all the lame comment systems out there.

    1. Re:If you ever think that Slashdot's system is bad by perryizgr8 · · Score: 1

      actually there is no room for discussion on a news website. if you want discussion, go to a blog or a forum.

      --
      Wealth is the gift that keeps on giving.
  17. Actually, it's not a new website... by Crazy+Taco · · Score: 1

    actually there is no room for discussion on a news website. if you want discussion, go to a blog or a forum.

    Well, to be technical, Yahoo! really isn't a news site. They are more of a web portal, and I'm sure if you pressed them, they would say the purpose of their existence is to entertain visitors with interesting content, not be a news organization. I mean, it's not like this is cnn.com... if comments keep people entertained (read some of them, they ARE entertaining) and coming back to the site then they are going to have comments and discussion.

    On a side note though, I do take issue with your statement that there is no room for discussion on a news website. Maybe if there was more discussion of the story we would start getting both sides more reliably, and that's always a good thing.

    --
    Beware of bugs in the above code; I have only proved it correct, not tried it.
    1. Re:Actually, it's not a new website... by perryizgr8 · · Score: 1

      a true news outlet would not have any inferences or opinions of the journalist. it would just state the facts. once i was watching bbc and one of their people was interviewing one of the wto protesters. he asked him what do the protesters want. the man was truly baffled. he gave some bullshit gibberish as answer and went away. now it was clear that atleast this man did not have any agenda and was just there to have some fun. but the bbc people did not make any comment on it. they allow the viewer to make their own judgments and inferences. in this case a second side does not exist. you are free to choose any side because bbc did not take any side. no comments are needed to "start getting both sides more reliably".

      --
      Wealth is the gift that keeps on giving.
  18. Re:Reality by JustOK · · Score: 1

    It's a FEATURE!!!!

    --
    rewriting history since 2109
  19. That's nothing by crossmr · · Score: 1

    I've found that yahoo routinely changes the links to their articles. After sharing on one facebook I clicked it to show it to someone else on MSN the next day and found that the story at the page was drastically different than the one that I had posted. in fact it was an entirely different article.

    1. Re:That's nothing by gront · · Score: 2, Informative

      Different content on the same subject or a completely different subject? Often the AP or whoever is doing the article will update and change it around a bit over time, especially on breaking news. Sometimes it is difficult to determine how and when it was changed, sometimes they tell you.

    2. Re:That's nothing by crossmr · · Score: 1

      This was an entirely different article. Several other sites still had the article, searching the text I had quoted on FB for it I found hundreds of copies. Yahoo just up and changed it though with no notice that I could find.

    3. Re:That's nothing by SeaFox · · Score: 1

      What I hate is they don't have permanent links to articles. Or they don't archive their news stories, one of the two. If I find an article I like I can't really bookmark it. If I try to come back to it months later I'm simply told the article doesn't exist.

      Meanwhile, I have bookmarks to articles on Wired's website from a decade ago that still load correctly.

  20. Re:whatever. by gront · · Score: 1

    In Yahoo news, old comments append you!

  21. So it's not on purpose? by NFNNMIDATA · · Score: 1

    I always figured it was on purpose, the better to keep conversations about the same topic together. Seemed a bit ham-handed but I figured they had a reason. I mean there's no way they could not have known about it is there? All you would have to do would be to glance at one of the major stories and it would be obvious that the comments do not pertain to it directly and are old with thousands of responses.