Statisticians Investigate Political Bias On Wikipedia
Hugh Pickens writes "The Global Economic Intersection reports on a project to statistically measure political bias on Wikipedia. The team first identified 1,000 political phrases based on the number of times these phrases appeared in the text of the 2005 Congressional Record and applied statistical methods to identify the phrases that separated Democratic representatives from Republican representatives, under the model that each group speaks to its respective constituents with a distinct set of coded language. Then the team identified 111,000 Wikipedia articles that include 'republican' or 'democrat' as keywords, and analyzed them to determine whether a given Wikipedia article used phrases favored more by Republican members or by Democratic members of Congress. The results may surprise you. 'The average old political article in Wikipedia leans Democratic' but gradually, Wikipedia's articles have lost the disproportionate use of Democratic phrases and moved to nearly equivalent use of words from both parties (PDF), akin to an NPOV [neutral point of view] on average. Interestingly, some articles have the expected political slant (civil rights tends Democrat; trade tends Republican), but at the same time many seemingly controversial topics, such as foreign policy, war and peace, and abortion have no net slant. 'Most articles arrive with a slant, and most articles change only mildly from their initial slant. The overall slant changes due to the entry of articles with opposite slants, leading toward neutrality for many topics, not necessarily within specific articles.'"
What can be done to avoid political bias and how do we do it consistently?
Or shall we remind them that the English Wikipedia is not only about U.S., and the word 'republican' and 'democrat' have other meanings too?
One guy may say that the sun is green, the other guy may say it's purple. Having both of them in the same article does not make it neutral.
[Citation Needed]
Surely they need to investigate libertarian bias (especially seeing as Wales himself is, how should I put this, a raving Objectivist nutjob). The fact that libertarian beliefs overlap with democrat and republican beliefs can explain the two separate slants with one single hypothesis.
(civil rights tends Democrat; trade tends Republican)
Could that be simply because Democrats invent/introduce/overuse new phrases and talking points for civil rights and Republicans invent/introduce/overuse new phrases and talking points for trade? For example, you'd probably hear Democrats say "Equal Opportunity Employment" or "Affirmative Action" a lot and you'd probably hear Republicans say "Laissez-faire" or "Free Market" a lot. What would be the antithesis of these phrases for the other side? I would posit that it's entirely possible that these articles are not on average biased and instead are merely explaining and using the phrases that each party has employed to tackle their number one priorities.
On top of that, I didn't see anything that seemed to indicate that they used windowing to determine when a phrase was opposed to the phrase they were using. For example if you found that the acronym ACORN indicates a Democratic slant but there's a whole section on its Wikipedia page full of negative criticism despite them using 'ACORN' frequently in that section. Would this section be identified as a Democratic slant?
Where is this G&S word bank? Where is the list of results so I can look up the ACORN article's scores?
My work here is dung.
I would have assumed a fairly even distribution with Wikipedia so the results weren't that surprising. I'd be more interested in using it to find bias in the media. There are obvious cases of bias such as Fox but I've noticed a gradual move towards the right in groups like CNN who seemed in the past Democratic in it's leaning. I've found more open reporting from comedians these days. Some subjects only the comedians take on that the media avoids or barely mentions. One interesting trend I noticed early on is all media sources including supposed left wing groups call the President Mr Obama while Bush was generally called President Bush and I can't remember him being referred to as Mr Bush. Traditionally the media always calls a sitting President by the title President and expresidents are generally referred to as Former President. Pay attention when you listen to the news and see if I'm right. Both Bushs and Clinton are referred to as former Presidents far more often than Obama is called President Obama.
How on earth can 2 scientists be so naive as to think there are only 2 political points of view... and then to measure for those 2 points of view? They basically took talking points from our 2 main parties and then measured how often each showed up in an article. I'd argue that the Republican and Democrat points of view are one and the same. They disagree on very minor, but very polarizing points of view that give them something to argue about in an election. Most of the subjects they were surprised to see no slant on, both parties agree on... foreign policy, war, peace... How has our current president acted any different than the last one? Or the last 10 for that matter? Abortion? Does anyone really care other than extreme feminists and extreme Christians?
We have one ruling political party in this country that masquerades as two. They measured bias in those articles... far more than they realize. Bias towards the statuesque and our 1 party system.
The frequency of using individual words is far from an actual political bias.
Europe has a clear political bias too (we're left wing socialist surrender monkeys), and we're quite happy about that. So, please America, leave our wikipedia alone. Thanks.
If I think that wikipedia is politically neutral, then this investigation will show it has a bias for the Democrats.
If wikipedia is neutral between Democrat and Republican views, then I will think it has a strong right wing bias.
The problem with this kind of reserach is that it might either undermine Wikipedia as a source in general (when finally the world seems to agree that the qualiy of wikipedia is just as good as any encyclopedia), or worse: it leads to changes in the contents to neutralize the supposed bias. This investigation has no benefits for wikipedia, or for free information.
The first accountant shoots and misses a meter high.
The second accountant shoots and misses a meter low.
The third accountant says "Got it"!
------------------
It looks like another paid for study that proves what they were asked to prove.
They only had to determine which data points would produce the required end point.
No brain, no pain.
I'm glad it didn't turn out to be a liberal bias. I would tire quickly of the phrase "Liberal Pedia" constantly from Conservatives.
Though, it still might not stop Fox.
Bias is rhetoric. Apodixis: A rhetorical device that stealthily inserts a false pretense of general knowledge. For example "As everyone knows..."
Or, as this article does: "expected political slant - civil rights tends Democrat"
Republicans broke the Democrats filibuster of the Civil Rights Laws of the 60's. The Republican Party was formed for the sole purpose of overturning Democratic Legislation that allowed slavery to expand into the Western Territories. The first Republican President freed the slaves. Every Governor of every state that let loose the fire hoses on and dogs on minority students was a Democrat.
Study rhetoric, and don't fall for it. We are most vulnerable to the rhetoric we cheer for. That's where we should put most of our scrutiny.
Being tricked by adversary is bad enough, being tricked by someone you support is truly insulting.
There's also choice of topic, slant of the article and what is included or excluded.
I see, for example, they excluded the chart with the average IQs of all nations.
Slant of article is tough to define, but it's your approach to the topic. "Self-Appointed 'Neighborhood Watch' guy shoots innocent teen" or "Angry Teen with marijuana possession offense attacks neighborhood watch official."
As long as there are people, there will be political bias, and Wikipedia still leans left because the people behind it are mostly students.
Futurist Traditionalism
Apodixis: A rhetorical device that stealthily inserts a false pretense of general knowledge. For example "As everyone knows..." Or, as this article does: "expected political slant - civil rights tends Democrat" The Republican Party was formed for the sole purpose of overturning Democratic Legislation that allowed slavery to expand into the Western Territories. The first Republican President freed the slaves. Every Governor of every state that let loose the police, the fire hoses and the dogs on minority students was a Democrat. Republicans broke the Democrat's filibuster of the Civil Rights Laws of the 60's Study rhetoric; don't fall for it. We are most vulnerable to the rhetoric we agree with. So, that's where we should put most of our scrutiny. Being tricked by an adversary is bad enough, being tricked by someone you support is truly insulting.
Bias can sneak in because of changes in terminology, presumably in both directions, although I've noticed it more on the right these days. As Robert Anton Wilson famously observed, you can go from liberal to conservative without changing a single idea if you wait long enough -- the reverse is also true, depending on the domain in which you have your ideas.
For instance, an article about taxation written in the 1990s might be considered neutral in its time, and talk about the "inheritance tax" a lot. Fast forward ten years, during which the term "death tax" has come into prominence, and the old term "inheritance tax" is only used by fogies and liberals. The textual analysis of the unchanged article will now score it as "liberal", because the terms of the debate have shifted.
This can happen with policies, too -- I remember when a carbon tax was considered a compromise position between liberals, who wanted to directly regulate carbon dioxide emissions, and conservatives, who felt that some kind of market mechanism would provide useful flexibility. Carbon taxes were a technocratic, ideologically neutral solution when they were proposed, but now they're seen as liberal social engineering.
It doesn't always go rightward, of course, some debates have been successfully re-framed by the left, as well, I think -- "global warming" used to be a neutral descriptive term, but the warming isn't uniform, so "climate change" is the preferred term, and I think it's mostly conservatives who use the term "global warming".
That ought to blow up my karma for a solid year...
2*3*3*3*3*11*251
Republicans broke the Democrats filibuster of the Civil Rights Laws of the 60's.
Everett Dirksen was a republican congressman that grew up in the extremely racially charged town of Pekin, Illinois. I grew up nearby, and Pekin is still regarded as one of the most racially divided towns today, but they have made a lot of progress. At least they got rid of the previous high school mascot (changed from the "Pekin Chinks" to the "Pekin Dragons").
Dirksen is the one who brought forward the Civil Rights Act of 1964.
You can't go through the Illinois school system without hearing about what Dirksen did to bring about equality, and Springfield has even tried to make him a local hero, by naming roads after him, etc. But, I don't know how many times I've seen him listed as a democrat, when the truth was the complete opposite. Now, this article is calling civil rights a democrat issue, and it just makes me cringe. Is history education really this bad in this country?
Free unix account: freeshell.org
Your "history" stops at the 1960s. You are aware, aren't you, that huge numbers of conservative Democrats moved to the Republican party in the '60s? Look up "Solid South."
So you are basically claiming that a significant part of today's Republican party is racist.
Brilliant.
I think the major flaw is that this seems to be assuming that bias on Wikipedia is done in the same way as bias elsewhere. Someone who wants to bias a Wikipedia article has to do so within the confines of rules which help prevent some kinds of bias more than others.
For instance, one of the most common ways to bias a Wikipedia article is undue weight--you include negative information and exclude positive information, or vice versa. This sort of bias doesn't use coded language (thus making it invisible to this study) and while it is still against Wikipedia rules, Wikipedia does relatively poorly at stopping it.
The Republican Party was formed for the sole purpose of overturning Democratic Legislation that allowed slavery to expand into the Western Territories.
The first Republican President freed the slaves.
Every Governor of every state that let loose the police, the fire hoses and the dogs on minority students was a Democrat.
Republicans broke the Democrat's filibuster of the Civil Rights Laws of the 60's.
True, but missing the point. LBJ managed to get the Civil Rights Act passed, largely using the political capital of JFK's death (by describing it as an enduring legacy) and nearly all Republicans and Democrats in the North (but more Democrats) voted for it, while nearly all in the South of either party voted against it. This correlation reverses when you combine the figures (Simpson's paradox) which is what you are talking about. The divide was so intense that it changed the base of the parties - the Democrats "lost the South", and they went to the Republicans - which changed the GOP more than the GOP changed them. Starting with the next election after this shift (Nixon's), the GOP started winning elections by playing to racist fears
While saying that the Democrats in aggregate opposed the CRA is technically true, it's not really relevant. The South opposed the CRA, and that was so important to them that party lines not only didn't matter, but they changed what the party lines were.
I have developed a truly marvelous proof of this comment, which this signature is too narrow to contain.
ntil the Republican party adopted the Southern Strategy in the 70's to win over the racists
It's absurd that the Wiki page you link to labels the "southern strategy" as racist - when the main thing that entailed was Republicans advocating for states rights! The article tries to paint that as pandering to "scared white people" but if you even thought for a second about what it actually meant, you'd realize that stronger states rights means more control for blacks than whites in the south where the black population is a majority, since after all they could vote at that point... That is how Nixon managed to get a high percentage of the black vote. Think again, WHY would black people vote for Nixon in large numbers were he pandering to racist whites?
That whole article is a prime example of how Wikipedia tilts so far towards Democrats it's horizontal.
The Republican party used to be basically like the Democratic party was today.
Not at all, things are still as they were. Democrats still seek to keep "lower classes" like the black minority groups down, by keeping them addicted to government handouts and assistance.
Affirmative action is another example. It is basically a declaration that the specified minorities are inferior and cannot help themselves. When you expect less from people you get less, which serves no-one well.
As far as I can tell, Republicans are still the only major party offering true equality and freedom from racial discrimination.
It is rather funny that the black population continues to vote in large numbers for Democrats, at this point it's a combination of Stockholm Syndrome and very advanced propaganda from Democrats parroted and amplified by much of the media. Looks like the racists won after all.
"There is more worth loving than we have strength to love." - Brian Jay Stanley