Slashdot Mirror


TV Networks Hide Bad Ratings With Typos, Report Says (cnet.com)

A report Thursday in The Wall Street Journal details how networks are taking advantage of that fact to disguise airings that underperform with viewers. From a report: It's described as a common practice in the world of TV ratings, where programs with higher ratings can charge advertisers more to run commercials. When an episode performs poorly with viewers, the networks often intentionally misspell the show title in their report to Nielsen, according to the Journal. This fools the system into separating that airing out as a different show and keeping it from affecting the correctly-spelled show's average overall rating. The report says the practice was initially used sparingly -- for instance, when a broadcast would go up against a major sporting event.

23 of 115 comments (clear)

  1. Nielsen hasn't figured this trick out by now? by dlleigh · · Score: 3, Interesting

    And they haven't employed technical solutions to correct for typos and collect the correct data?

    This doesn't sound right.

    1. Re:Nielsen hasn't figured this trick out by now? by Pascoea · · Score: 3

      Yeah doesn't sound like an incredibly hard problem to solve. 1) Don't key off the damn show name. An int(11) series_id combined with a "series not found, please check for spelling errors" return when the network tries to submit a rating seems like something even a CS grad could make happen. 2) Adjust their algorithm to account for competing shows.

      Isn't it a larger problem that the networks are submitting their own ratings? Who the hell thought this was a good idea? "No, trust us, that show did GREAT. It was HUGE." WTF.

      Last random thought... This whole thing smells like a phone book company in an Internet world...

    2. Re:Nielsen hasn't figured this trick out by now? by Tablizer · · Score: 5, Funny

      And they haven't employed technical solutions to correct for typos and collect the correct data?

      Imagine if Slashdot was like that, producing duplicate story entries. We'd think terribly of them and defect.

    3. Re:Nielsen hasn't figured this trick out by now? by stephanruby · · Score: 2

      Oh damn! Now, I am feeling bad for the ad companies. They're getting ripped off.

      Booo-hooooo

    4. Re: Nielsen hasn't figured this trick out by now? by Cryacin · · Score: 3, Funny

      Yeah, you're right. Big Bother performed quite poorly...

      --
      Science advances one funeral at a time- Max Planck
    5. Re:Nielsen hasn't figured this trick out by now? by bluefoxlucid · · Score: 2

      It's probably considered a feature.

      Absent better data tools which perform statistical analysis based on temporal locality, letting an episode of a TV show average its ratings out with ratings during major events like sports or 9/11 would distort the data with outliers. In statistics, we actually identify anything more than 1.5 times further away from the median than the first and third quartiles and discard it before performing any computations.

      Think about it. You air a 13-episode season of a show. All of these have a rating of 80/100, except the one that aired on Election Night--which had a 15/100 rating. Your rating is 75. Now you've got data telling you another popular program with an average 78 rating is more-popular, and it's not.

      Blunt statistics would have done exactly what they're doing: Remove the outliers. Today, we would use enormous data systems to identify if specific time slots had more viewers, if specific channels had more viewers, if airing after another show affected the show's popularity, if an event affected it, etc., and then forward-predict the rating of any given airing--even in any given market. That's part of what ATSC 3.0 aims to achieve: robust understanding of program viewership, based on everything that's happening during the airing of a show, and where.

    6. Re:Nielsen hasn't figured this trick out by now? by bluefoxlucid · · Score: 2

      Is it fraud if your less-popular series with ten half-hour episodes and a rating of 73 airs 2 hours before U.S. election footage, and your more-popular prime-time series with 5 one-hour episodes airs one during the U.S. election and gets a rating of 68??

      Hey, look, I can sell $LESS_VALUABLE show on fake higher ratings than $MORE_VALUABLE show because an outlier condition has damaged their ratings. They have one big dip on one episode out of four years, but their ratings this year tanked and so next year they won't be able to report it as so valuable and I can get people to pay me more money for my shit that nobody cares about!

      In medical literature, pharma companies have had their drug banned from the market and been fined billions of dollars for not doing the equivalent of removing the data of those patients who had another conflicting variable or even a major deviation from their computations. Including outliers is fraudulent.

    7. Re:Nielsen hasn't figured this trick out by now? by EvilSS · · Score: 4, Informative

      Let me explain how commercials generate revenue: Ad companies pay money to show ads during prime time. Bamph! Revenue. Commercial ad rates are based on the only rating that really counts: C3. This is the measure of live + 3 days of DVR viewing of the commercials (not the show). So media buyers have a pretty good idea of how many people are viewing the commercials. C3 ratings are rarely public but the live overnights are a pretty good substitute for how a show is doing, and the key factor sites like TVByTheNumbers and TheTVGrimReaper use to predict renewals/cancellations.

      That said, they are pushing back and this year ad buy revenue has been flat for most networks compared to last year (usually goes up a bit each year). They are aware that the market is shrinking.

      This is also why you are seeing more and more carriage disputes between cable/sat providers and the owners of the local affiliates (or the networks themselves if they are O&O stations). Carriage fees are a massive part of their revenue now, and they are using that as a bit of a buffer against falling viewership numbers. The affiliate owners keep pushing to increase the fees each contract.

      --
      I browse on +1 so AC's need not respond, I won't see it.
    8. Re:Nielsen hasn't figured this trick out by now? by rtb61 · · Score: 2

      They no longer have any idea what so ever about what people are viewing, right now a great big fat fucking lie is being pushed. Only a select audience of empathic TV viewers get to play the game and then the entire populations viewing habits are based on this group. Now that worked reasonable well prior to the internet but since the internet, there are growing numbers of people who do not watch free to air or cable and yet that same select sample is still meant to represent the entire population, a categorical lie, as now a large and growing percentage are no longer watching the commercials the ratings agency claim they are and that is especially prevalent in a younger audience. The ratings agencies are basically claiming that people who do not watch any free to air or cable and watching particular programs on free to air or cable. I have a TV that I have not bothered to attach to an TV antennae, no need and it has been that way for quite a few years. Old world main stream media, last millenniums version is just so done.

      --
      Chaos - everything, everywhere, everywhen
    9. Re:Nielsen hasn't figured this trick out by now? by apoc.famine · · Score: 2

      Only a select audience of empathic TV viewers get to play the game and then the entire populations viewing habits are based on this group.

      I was sent the Nielsen notebook and asked to record our household's viewing habits. I gave them two weeks of data, and they never contacted us again. Why? Because we don't watch a ton of TV. And what we do watch is not the profitable stuff.
       
      I sort-of figured that dumping us would happen, but at the same time, it really reinforced how much of a scam the entire TV market is. If you're going to base your decisions on carefully curated data, you might as well just not use data at all. Just make it all up, and stop pretending that you're doing any sort of research.
       
      Us not watching anything on the major networks during prime-time is really important data. It tells advertisers and the networks that for our demographics, what they're doing is not going to get our eyeballs. Looking at what did get our eyeballs might be informative, should they be interested in growing their market. But they didn't want to do that. Either we were invested in the prime-time networks, or we we weren't. And if we weren't, we weren't useful to them. It's that sort of head-in-the-sand thinking that is killing TV.

      --
      Velociraptor = Distiraptor / Timeraptor
  2. Why do we care? by ausekilis · · Score: 4, Insightful

    With the advent of streaming Nielson ratings are going to mean next to nothing anyway. Netflix, Hulu and Amazon will already know what shows/episodes/movies are popular just by hit counts.

    1. Re:Why do we care? by TheRealMindChild · · Score: 2

      Nielson rates streaming materials these days just the same. They also track a whole lot more than television and radio. Your shopping transactions for one

      --

      "When life gives you lemons, don't make lemonade. Make life take the lemons back!" -- Cave Johnson
    2. Re:Why do we care? by Baron_Yam · · Score: 2

      Nielson ratings were garbage in the early days because they were based on diaries filled out by hand by selected viewers. People who might be embarrassed to admit they watched trash television or blue movies, or fell asleep, or whatever. Chances are there was a lot of lying going on during the data collection phase.

      I believe later they moved to electronic collection, but that failed to account for people who left the TV on, or watched something on tape (or later DVD... I don't know if they fixed this by the time Blu-ray came along).

      It's always been mostly made up crap based on mostly made up crap, but advertisers wanted something to judge the reach of their ads and networks wanted something to judge the rate they should charge for ad space... so Nielson.

      Streaming is a Nielson nightmare - there's no need for middle-man analysis, it's all right there, to the frame. And in many cases, there's even less need because the media provider is on a subscription based revenue model and doesn't care about advertising.

    3. Re:Why do we care? by geekmux · · Score: 2

      Nielson rates are for calculating ad costs and determining if a show should be cancelled or not. Generations before millennials never directly cared about Nielson ratings either, they aren't meant for the consumers.

      Regarding show popularity and viewership, usage statistics should be able to be pulled from any cable box, and would likely be more accurate. Online streaming can really dial in the accuracy, since a lot of content is consumed on personal devices that also identify the specific end-user (age, gender, etc.). Since we're here discussing how something as simple as a spelling error can manipulate the shit out of ratings, perhaps manipulation is a key feature of Nielson that prevents us from trying to find a more accurate alternative.

      As far as calculating ad costs, no one wants to see or hear ads anymore. Consumers can't hit the fast-foward button fast enough in the time-shifted world we now live in. I struggle to even see how revenue is generated from ads to justify the obscene costs.

  3. easy idea to solve the fraud. by computerchimp · · Score: 5, Interesting

    Shows are broadcast on a predetermined schedule.
    A show gets a zero until something is submitted.
    that will get the spelling right.

    Anyways it is pretty dumb that Nelson has not been able to vet this out.

  4. Fraud by Sooner+Boomer · · Score: 4, Informative

    Many times, the network advertising rates are based upon rating shares. A deliberate deception, which raises the apparent share, and therefore ad rates, is fraud - plain and simple. The advertisers should be up in arms about this.

    --
    Chaos maximizes locally around me.
  5. I work with Nielsen data by langelgjm · · Score: 2

    While they don't actually use punch cards, a lot of the data seems like it's from that era - fixed width, all caps, space padded... feels very mainframe-y.

    That said, Nielsen also has networks report TV programs with unique numeric "program codes", so it's not like they (or other people using their data, like me) rely on the program strings to group by program.

    --
    "Anyone who [rips a CD] is probably engaging in copyright infringement." - David O. Carson
  6. PHB Response by Tablizer · · Score: 4, Interesting

    [TFA:]
    Nielsen issued the following statement to CNET:

    "With participation and input from clients, Nielsen maintains a rigorous set of policy guidelines for how network clients can and should receive program and commercial ratings credit for their programming. Nielsen takes these Policy Guidelines very seriously and if we find a network working in contrast to this agreed-upon policy, we address the issue in a direct fashion as a way to maintain fairness and balance over all of our clients and the industry as a whole. We have many touch points with clients throughout the season to ensure guidelines are being adhered to."

    That's a PHB non-response response if I've ever seen one. It says nothing concrete and doesn't explain the cause. It sounds like it's from a canned excuse template. "Microsoft Alibi for Azure"? And what is a "touch point"? That's either a new-fangled biz buzzword, or a way to get sued for harassment.

    How about a more honest statement: "We got cost-cutting-happy and slacked on data inspection. We apologize and will shape up and spend more on data validation like we should have from the start."

    You'll almost never hear that from a corporation. Would that kind of response really hit their stock harder than the first? I would think honesty would be more effective with stock-holders/purchasers. But egos get in the way and instead they produce flavorless fluff responses.

    To be fair, if they admit fault, lawsuits would be easier because the judge/jury has a direct written confession. Without it, they can confuse the court, for example, by claiming the Flux Capacitor, built by a far-off vendor, was at fault.

  7. TV Nets Hide Bad Ratings with Nielsen Myth by RobotRunAmok · · Score: 2

    It has been the Truth That Dare Not Speak Its Name for decades: The Nielsen ratings are just one or two ticks above throwing darts, blindfolded, when it comes to both accuracy or picking real winners. But too many people within the TV industry make their living based upon the "Dailies" for any one of them to want to upset the apple cart. Tip of the Iceberg, here. I suspect whoever wrote that will be SethRich'd shortly, if he hasn't already been...

  8. I worked at Nielsen by muninn · · Score: 5, Interesting

    After working a few years at Nielsen (in data-heavy development roles), this sort of issue is what prompted me to leave. Trying to convince them that ensuring data integrity is worthwhile was an uphill battle. Sure, they have lots of valuable data... but it's all dirty as heck. Now they think they can just throw some machine learning on top of it to fix everything right as rain. We can all guess how well that will go!

  9. Re:I can fix this with my cutting edge technology! by Pascoea · · Score: 2

    Hand the closest intern a pair of scissors and a hole punch, tell him to go sit on a bucket next to the fax machine. Then go have a coffee.

  10. Network programmer discovers this weird trick... by Anonymous Coward · · Score: 2, Funny

    Network programmer discovers this weird trick for hiding low rated shows. Advertisers hate him!

  11. Ratings mean shit by mark-t · · Score: 2

    The networks will air whatever the people that pay them air... I can't count how many times I have seen what looked like a promising show cancelled before a dozen episodes, or after just one intriguing season, on an alleged claim of "poor ratings" when a cursory look at the actual ratings shows that the show had actually performed quite well.