Tag Archives: news bias

TV News Political Slant Report by Network: 1/16 – 1/20

Welcome to the Mediate Metrics inaugural TV news political slant measurement report, based on our version 1.0 text classifier.

To our knowledge, this is the first objective TV news slant rating service ever published. Slant, by our definition, is news containing an embedded statement of bias (opinion) OR an element of editorial influence (factual content that reflects positively or negatively on a particular U.S. political party). This initial report focuses specifically on evaluating  slant contained in the weekday transcripts of  the national nightly news programs on the 3 major broadcast networks (ABC, CBS, and NBC) , as well as programming aired from 5 PM until 11 PM eastern time on top 3 cable news channels (CNN, Fox, and MSNBC). At this stage, analytical coverage varies by network, program, and date, but our intention is to fill in the blanks over time.

CHART 1: Slant by Network - January 16 to January 20, 2012

In keeping with U.S. political tradition, content favoring the Republican party in Chart 1 is portrayed in red (positive numbers), while content that tilts towards the Democratic Party is shown in blue (negative numbers)

To grossly over-simplify, the numerical slant ratings supporting the Chart 1 emanate from a custom text analysis “classifier,” built to extract statements of political slant from TV news transcripts. (For more on the underlying technology, see our post on Text Analytics Basics at http://wp.me/p1MQsU-at.) We have trained our classifier to interpret slant quite conservatively, conforming to strict guidelines for the sake of consistency and objectivity. As such, the ratings we present may be perceived as under-reporting the absolute slant of the actual content under review, but the appropriate way to view our ratings is as relative to similar programming.

As mentioned, our analytical coverage varies by network, program, and date. Correspondingly, our rating confidence is directly proportional to the amount of transcript text available for classification.The exact amount of coverage per network is shown in the table to the right, but we have graphically indicated depth-of-coverage in Chart 1 by way of color shading. For example, the bars representing the slant ratings for both NBC and CBS were purposely made lighter to reflect the relatively small transcript coverage for those particular networks.

During development, we determined that the Republican presidential primaries are an enterprise for which scrutiny is a normal-and-valuable part of the vetting process.  Related news content, however, tends to be disproportionately negative, and often times does not contain a clear inter-party comparison — an element we view as a crucial condition for the evaluation of political slant. With those factors mind, we have partitioned statements about the Republican Presidential primaries, and have excluded them from most slant ratings at this juncture. Similarly, the Republican Presidential debates and other such dedicated program segments have been excluded in their entirety from classification since they do not reflect the political positions of the networks, programs, or contributors under a consideration.

We’ll publish slant ratings by program for the same January 16 – 20 time period tomorrow.

Tagged , , , , , , , , , , ,

Open Season on Journalists: Trump versus Todd

It seems like every time I turn around, some political figure is taking on a journalist. Here’s the latest installment, featuring a very edgy Donald Trump chastising Chuck Todd of MSNBC during his Daily Rundown Show this morning.


Wouldn’t you love to see focus group ratings during one of these exchanges?

My sense is that many political figures already have.

Tagged , , , , , , , , ,

White Paper Excerpt: “Bias and Objectivity in the News Media”

I remain convinced that one can measure media bias electronically, at least to some extent, by examining the text of news broadcasts and objectively identifying the speaker’s personal value judgments. With that said, it is far more difficult to extract bias based on that content that is chosen to be aired. The following excerpt, taken from a 2004 white paper published by The Foundation for Critical Thinking titled, “How to Detect Media Bias and Propaganda” by Dr. Richard Paul and Dr. Linda Elder, explains this far more eloquently than I ever could.



The logic of constructing news stories is parallel to the logic of writing history. In both cases, for events covered, there is both a massive background of facts and a highly restricted amount of space to devote to those facts. The result in both cases is the same: 99.99999% of the “facts” are never mentioned at all (see Figure 1).


If objectivity or fairness in the construction of news stories is thought of as equivalent to presenting all the facts and only the facts (“All the news that’s fit to print”), objectivity and fairness is an illusion. No human knows more than a small percentage of the facts and it is not possible to present all the facts (even if one did know them). It isn’t even possible to present all the important facts, for many criteria compete for determining what is “important.” We must therefore always ask, “What has been left out of this article?” “What would I think if different facts had been highlighted here?” “What if this article had been written by those who hold a point of view opposite to the one embedded in the story as told?”


Tagged , , , , , , , , , , , , , , , , , , , , , , , , , , ,

Who’s News? YOU Decide.

The more I study media bias, the more I realize that TV coverage flows (and often overflows) in certain directions because viewers vote with their eyeballs.

The blogosphere is crackling today with reports on the CBS internal memo which directed their debate moderators to devote fewer questions to Michelle Bachmann. The issue certainly has ignited the fanaterati. Don’t get me wrong; editorial selection bias is a very real phenomenon. Still, a thinking person should consider other possibilities.

So here is one: Perhaps we get a disproportionate amount of coverage on certain issues and people because they drive viewership. Combined with the extensive amount of news capacity that needs to be filled, media outlets are motivated to keep popular stories alive because lots of people are following them. As an unfortunate by-product, reporters and commentators fan the  flames over time by digging up all kinds of corner-cases, then sensationalizing them as “New Developments!” And that’s when we enter the realm of the absurd.

Circling back to the issue du jour, giving Michelle Bachmann more debate time does not make sense for the network in that context. It’s an inexact science, but it is a network executive’s job is to promote viewership … which drives ad revenue …which increases company profits, equity value, and personal paychecks.

It’s tempting to see a conspiracy here, and maybe there is one, but I think it is equally possible that this is just capitalism in action.

Tagged , , , , , , , , , , , , , , , , , , , , , ,

Politics and TV News: Commonly Used Bias Techniques

As I have dutifully trudged through TV news transcripts as part of creating my surveys, I have noticed certain bias techniques — some intuitive, and others subtle — that are employed with regularity by popular TV news channels.  My focus has been on political analysis segments wherein a news anchor/moderator is joined by one-or-more contributors, positioned as subject matter experts.

The most prevalent techniques are as follows:

  • False Balancing –TV viewers have been conditioned to expect news anchors to conduct interviews with contributing experts who present contrasting points of view. Interestingly, these expert contributors are occasionally unbalanced, and actually are on the same side the “debated” issue.

A variant on this theme occurs when complementary views are presented by experts from opposite camps. A Democratic congressman may be critical of aspects of “Obama-care” when interviewed side-by-side with a Republican senator whose disapproval applies to other areas. Both are critical, just in different ways.

On the surface, these experts represent groups who are traditionally in opposition, but their opinions are surprisingly aligned in this example. The notion that positions on a particular subject are not known in advance strains credibility. Still, that fact may be lost on passive TV viewers, who believe they have ingested a short-but- complete review of an issue when presented in this format, especially when the contributors are otherwise natural enemies.

Credit should go where credit is due, so I must recognize The Pessimistic Viewer’s September 12 blog (http://comm2302.wordpress.com/) for identifying and labeling this particular bias mechanism.

  • Time Management – This is an intuitively obvious slanting technique; the more time devoted to a particular perspective, the more weight it is given by the audience. Timing was initially my primary target for evaluating media bias, thinking it to be objective and readily quantifiable. In practice, however, it turned out to be much more difficult to do, primarily because of technique #3.
  • Flakking – In real-time, recording the specific speaking time of any particular contributor is inordinately difficult because of “flakking” — aggressive interruptions of contributors’ statements that are in conflict with those being favored on the program.
  •  Framing  & Finishing  – Even in the pseudo-debate construct of the popular anchor-plus-expert news format, the moderator has control of how an issue is initially framed (“Is the Gang of 6 Deficit Reduction Plan Bad for America?”) along with the manner in which the segment is closed. Even if the anchor does not personally deliver a closing statement, the last word generally has more impact than others, and the moderator can readily determine who gets it.
  • Anchor Affirmations – Television viewers have been conditioned to expect the news anchor/moderator, while possessing their own informed opinions, to exercise a certain amount of journalistic detachment and fairness. Implicitly, they are the ultimate arbiter.

Regardless of the historical role of the anchor/moderator, in this era of advocate journalism, strong opinions are easily discernible, and readily recognized as such by even the most passive viewer. Still, I often encountered more subtle endorsements which may slip passed a viewer’s internal bias filter. Simply have the moderator inject a, “Right,” or “Yes,” as a follow-on comment gives the preceding statement additional weight.

  • Pronoun Putdowns – Similar to moderator affirmations, news anchor can send a subtle-but-unmistakable message by the way they refer to involved parties. Groups holding conflicting views with the discussion leader are often referred to as “they” or “them.” Similarly, if a title-bearing politician, such as a Senator, is referred to as “he” or “him,” it comes across as a refusal to recognize rank-and-status, and conveys an implicit lack of respect.

In closing, some may see these slanting techniques as a normal part of Op-Ed programming.  While that is fair criticism to some degree, passive TV viewers may not make a conscious distinction between objective news and editorials.  The concept of framing applies here, but in a different context — Are these programs framed as Op-Ed segments, or overshadowed by pervasive, embedded marketing messages — “Cable News Network”  …  Fox News, Fair and Balanced” … “MSNBC, the Place for Politics” … “The No-Spin Zone?”

I welcome your comments on the matter.

Tagged , , , , , , , , , , , ,

Quantifying the Impact of TV News Bias – Example #1

The following example represents my core method of quantifying the impact of media bias, using only program segments from the top 3 cable news networks in this particular example. The underlying “Raw Bias Index” data I am using is in fact quite coarse, so consider this an alpha trial put forth for review and discussion.

Much debate has been devoted to assessing whether there is a liberal or conservative media bias. Qualitatively, a case can be made for both, but quantifying the effective bias is a more complex endeavor.

In my recent studies of television news programming, it occurred to me that the quantity of liberal TV outlets seemed greater than conservative channels, but their “share-of-voice” may still be lesser. The true impact of a particular TV news program can only be determined by considering both bias and reach.

In order to add a viewership variable, I used the Nielsen Cable News Ratings from September 8, first calculating the average rating of the 6 largest cable news networks for the entire day. (Source: TV by the Numbers – Zap2It website. http://tvbythenumbers.zap2it.com/2011/09/09/fox-news-leads-presidential-address-viewing-among-cable-news-ratings-for-thursday-september-8-2011/103155/ )

 NOTE: “P2+”= Viewers over the age of 2.

I then calculated a “Viewership Weighting” factor for each of the post-Presidential address programs from CNN, Fox, and MSNBC that I had previously created a Raw Bias Index for (see Sept. 11 post below), and com combined them to create a “Raw Impact Index.”

Needless to say, prime time news is viewed much more extensively than its daytime cousins, hence the large viewership weighting factors. Still, one can readily see in this crude example that viewership, not the number of TV outlets, is key to determining the overall impact of news bias.


PLEASE NOTE that this is but an example, and is not meant in any way to be an accurate-or-comprehensive measure of TV news bias today.


Is this methodology simplistic? You bet. I fully expect critiques from those more experienced in media measurement and proficient with survey science. Regardless, simpler is often times better.

As always, I remain open to feedback, and encourage you to leave yours in the comments section.

Tagged , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

Media Bias Measurement – Prelude

Have you noticed that political news is more about spin and emotional-triggering than facts and fairness?

Me too.

For years, I’ve been troubled by political news bias. Having worked briefly at a media measurement company, I began to wonder whether bias could be measured. I scoured the internet, looking for a method-or-model for quantitatively dimensioning bias. I could find none, so I developed my own.

While I believe that the core system is sound, further development is dependent on the input and guidance of others. If nothing else, I hope to learn from the process, and share that learning as broadly as possible.

Please visit this site again soon. It is obviously under construction, but I will be posting surveys in the coming days and weeks, based on transcripts of popular news programs, that will desperately need respondents. All data will be aggregated and anonymized. Your privacy will be diligently protected.

If nothing else, this will be an interesting experiment. But if this works, we might change the media landscape.

Go big or go home, right?

Tagged , , , , , , , , ,