{"id":12552,"date":"2014-11-08T08:03:35","date_gmt":"2014-11-08T13:03:35","guid":{"rendered":"https:\/\/www.frankwbaker.com\/mlc\/?page_id=12552"},"modified":"2023-12-07T10:07:27","modified_gmt":"2023-12-07T15:07:27","slug":"math-media-accuracy-ratings","status":"publish","type":"post","link":"https:\/\/www.frankwbaker.com\/mlc\/math-media-accuracy-ratings\/","title":{"rendered":"Math in the Media: Accuracy and Ratings"},"content":{"rendered":"

\"wpe2.jpg<\/span>Math In The Media<\/span><\/b> \"wpe1.jpg<\/span><\/p>\n

\u00a0<\/small><\/small><\/strong><\/small><\/small><\/span>Accuracy<\/b>:
\nOne of the major complaints about the Nielsen ratings\u00a0is that they are outdated, ineffective and inaccurate. Have students consider this fact as they explore ratings and advertising during these lessons.
\n<\/span><\/p>\n\n\n\n
Even the most experienced industry users of TV ratings data are liable to forget one crucial point–the numbers aren’t real. Like any survey data, Nielsen ratings are subject to statistical errors of various kinds, as well as issues of cooperation rates, respondent compliance, and so on. They are merely estimates, after all. As such, it doesn’t make much sense to present them beyond one decimal point, because this implies a degree of accuracy that doesn’t exist. Also, small differences in ratings numbers often are not statistically significant. Claiming victory with a 10.4 share over a competitor’s 10.2 share may not be only trivial, it may be just plain wrong.<\/span>The Nielsen data are currently the only game in town. This has led to criticism by some users that the numbers could be better. The three major TV net works have set up a “ratings laboratory” demonstrate that it is possible to collect better viewing data. Whether or not Nielsen refines its methods or faces competition in the rating business in the future, the above disclaimers and cautions will remain in place because the data will remain complex and open to misinterpretation. Despite these caveats and pitfalls, TV ratings will remain a source of vital information for those within the media world. For those outside of it, they can provide a fascinating mirror of our society and time.\u00a0\u00a0\u00a0<\/span><\/p>\n

from How to Read TV Ratings<\/i> by James C. Roymondo, American Demographics magazine, March 1997<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n


\nResearchers Examine Holes in Nielsen Ratings Methods<\/a> (Dec.2003)
\n<\/span>
\nNetwork Execs Question Nielsen Accuracy<\/b><\/span><\/div>\n\n\n\n
\n
Sun November 16, 2003<\/span><\/div>\n<\/td>\n
<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

By DAVID BAUDER, AP Television Writer<\/i><\/span><\/p>\n

NEW YORK – Television’s biggest mystery this season has nothing to do with what’s on the air. Everyone in the industry is talking about it: Where have all the young viewers gone? Or have they gone anywhere at all?<\/span><\/p>\n

It’s just another chapter in the TV’s dysfunctional marriage to the Nielsen ratings, where breaking up would be more painful than staying together.<\/p>\n

Nielsen Media Research’s claim that prime-time viewing among men aged 18-to-34 has dropped by 7 percent this season is hotly disputed by TV networks, where overall viewership is down this season. The debate has renewed long-running tensions between broadcasters and the company they pay to measure their audience.<\/span><\/p>\n

Given Nielsen’s monopoly, the clash is inevitable. The research company’s numbers decide where billions of dollars worth of advertising is spent and whether TV shows \u2014 even entire networks \u2014 live or die.<\/span><\/p>\n

Several broadcast executives wonder whether Nielsen is unfit for a wired world with hundreds of networks, digital video recorders and impatient channel surfers.<\/span><\/p>\n

“I do worry about technology’s advances being ahead of Nielsen’s ability to measure it,” said Alan Wurtzel, research president at NBC, which has lost, on average, more than a million viewers a week from last year. “I do believe that has everything to do with being a monopoly.”<\/span><\/p>\n

The monopoly is as old as the medium, ever since Arthur Nielsen translated the measurement system that he devised for radio in 1942 to television. The company has been largely impervious to challenge; one notable attempt went under in 1999.<\/span><\/p>\n

Criticism from the networks grows loud whenever Nielsen detects an unexpectedly large drop in TV audience size.<\/span><\/p>\n

“A few years ago, (young male viewership) was at a record high, and there was no outrage expressed against that,” sniffed Jack Loftus, Nielsen spokesman.<\/span><\/p>\n

One of the industry’s top number-crunchers, CBS chief researcher David Poltrack, believes this autumn’s ratings drop can be tied to 105 men who aren’t pushing enough buttons.<\/span><\/p>\n

Nielsen gathers its ratings through a sample of 5,100 homes nationwide. Among men aged 18-to-24, where the bulk of the viewership decrease is concentrated, that’s just 600 people. Poltrack wants Nielsen to investigate whether a subset of these men \u2014 just 105 of them \u2014 are unreliable because they really don’t want to participate in Nielsen’s study.<\/span><\/p>\n

Wurtzel has suggested that Nielsen has worked hard to recruit new Hispanic viewers into its sample, and that they have proven less reliable than past participants in punching the buttons that record what they’re watching.<\/span><\/p>\n

Almost every time there’s a blip in the statistics, the sample is responsible, Wurtzel said.<\/span><\/p>\n

After a long investigation, a mysterious drop in TV watching in 1972 was traced to Nielsen using a new glue to attach its monitoring device to televisions. When the TV set warmed from use, some of the monitors loosened and dropped off.<\/span><\/p>\n

“We have billions of dollars riding on this,” Wurtzel said. “We can’t afford to have mistakes.”<\/span><\/p>\n

Loftus dismisses Wurtzel’s theory, saying the number of new Hispanic viewers is too small to make much difference. Nielsen is looking into Poltrack’s ideas, but said it has found no evidence of a large drop in participation.<\/span><\/p>\n

There’s always the obvious explanation: maybe men are actually watching less TV.<\/span><\/p>\n

Kate Lynch, global research director at the advertising firm Starcom USA, understands why Wurtzel and his network colleague don’t want to believe that.<\/span><\/p>\n

“All he can sell is his audience,” she said. “If they’re missing, he’s got to blame somebody.”<\/span><\/p>\n

The networks are concerned that Nielsen’s measurement system, which worked well in the days of three big broadcast networks, is archaic today. Viewership is so small for some of the tiny cable networks that Nielsen can barely offer a reliable picture of who’s watching.<\/span><\/p>\n

Nielsen admits that its sample does not include homes with digital video recorders \u2014 machines like TiVo (news<\/a> – web sites<\/a>) \u2014 because it can’t measure shows that are recorded and watched later. Networks say bypassing these tech-savvy homes means Nielsen is bypassing some of the most dedicated TV viewers, perhaps skewing their survey.<\/span><\/p>\n

It will be at least a year or two before DVR homes are included, Loftus said.<\/span><\/p>\n

Nielsen has committed to doubling its national sample of 5,100 homes within two years. Getting ready for the days of digital TV signals, Nielsen is experimenting with a device that reads codes embedded within the TV picture.<\/span><\/p>\n

The company has also tested systems that would make it easier for participating families, such as an electronic sensor of who is watching, but found them to be more expensive than clients were willing to pay, Loftus said.<\/span><\/p>\n

Nielsen has been very aggressive, Loftus said, but its ability to cope with a rapidly changing world is a legitimate question.<\/span><\/p>\n

“We all have a stake in this and we all have to work together, and that’s what we’re trying to do,” he said.<\/span><\/p>\n

Ultimately, there’s some question about how aggressive the networks want Nielsen to be.<\/span><\/p>\n

Networks and advertising agencies spent $60 million in the 1990s to bankroll a Nielsen competitor, Statistical Research, Inc., that experimented with technologies more advanced than anything Nielsen was using at the time.<\/span><\/p>\n

When SRI was operating, Nielsen “was never more responsive to their customer base,” Wurtzel said.<\/span><\/p>\n

Yet faced with the decision in 1999 of whether to fund SRI fully so it could put its experiments in operation, the networks balked.<\/span><\/p>\n

“In many ways the industry has what it bargained for,” said Gale Metzgar, SRI president. “They did let (SRI’s system) go down the drain.”<\/span><\/p>\n

Starcom’s Lynch, who believes Nielsen is doing “an OK to good job,” said networks are suspicious of innovation for fear of what new measurements will tell them.<\/span><\/p>\n

For instance, advertisers have unsuccessfully tried to get Nielsen to measure how many people are watching commercials. One recent non-Nielsen study of DVR users found three-quarters of them fast-forwarded through ads; networks have no interest in publicizing that, she said.<\/span><\/p>\n

“They want good numbers,” she said. “Not accurate numbers.”<\/span><\/p>\n

Poltrack, who believes Nielsen has improved its service but also worries about its ability to deal with new technology, conceded a certain fear of the unknown.<\/span><\/p>\n

“What we need, what we look for Nielsen to provide, is stability,” he said.<\/span><\/p>\n

The current flap over young viewers is familiar; networks took out magazine advertisements in 1996 to complain when Nielsen reported a dropoff in pro football viewership that year.<\/span><\/p>\n

“This problem is here today and will be gone tomorrow and then we’ll forget about it,” Metzgar said. “Then, five years from now, another problem will crop up.”<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

Math In The Media  Accuracy: One of the major complaints…<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_seopress_robots_primary_cat":"","_seopress_titles_title":"","_seopress_titles_desc":"","_seopress_robots_index":"","footnotes":""},"categories":[183],"tags":[],"class_list":{"0":"post-12552","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-math-in-the-media"},"_links":{"self":[{"href":"https:\/\/www.frankwbaker.com\/mlc\/wp-json\/wp\/v2\/posts\/12552","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.frankwbaker.com\/mlc\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.frankwbaker.com\/mlc\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.frankwbaker.com\/mlc\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.frankwbaker.com\/mlc\/wp-json\/wp\/v2\/comments?post=12552"}],"version-history":[{"count":1,"href":"https:\/\/www.frankwbaker.com\/mlc\/wp-json\/wp\/v2\/posts\/12552\/revisions"}],"predecessor-version":[{"id":36635,"href":"https:\/\/www.frankwbaker.com\/mlc\/wp-json\/wp\/v2\/posts\/12552\/revisions\/36635"}],"wp:attachment":[{"href":"https:\/\/www.frankwbaker.com\/mlc\/wp-json\/wp\/v2\/media?parent=12552"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.frankwbaker.com\/mlc\/wp-json\/wp\/v2\/categories?post=12552"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.frankwbaker.com\/mlc\/wp-json\/wp\/v2\/tags?post=12552"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}