Why this Site?

  • Our Mission:
  • We exist to shine the light of scrutiny into the dark crevices of Wikipedia and its related projects; to examine the corruption there, along with its structural flaws; and to inoculate the unsuspecting public against the torrent of misinformation, defamation, and general nonsense that issues forth from one of the world’s most frequently visited websites, the “encyclopedia that anyone can edit.”
  • How you can participate:
  •  Visit the Wikipediocracy Forum, a candid exchange of views between Wikipedia editors, administrators, critics, proponents, and the general public.
  • 'Like' our Wikipediocracy page on Facebook.
  •  Follow Wikipediocracy on Twitter!

Press Releases

  • Please click here for recent Wikipediocracy press releases.

What can fact checkers learn from Wikipedia — How not to do things, perhaps?

By Kingsindian

[First in a two-part series.]

“Fake News” became one of the big issues during and after the 2016 US Presidential election. The concept itself is vigorously contested, with arguments about how new it is and how important it is. After the shocking election result, there were many solemn articles written on how fake news undermines democracy. There has been soul-searching among the media (both “traditional media” and “social media”) about the issue.

One of the voices that have popped up in this discussion is that of Wikipedia, “the free encyclopedia that anyone can edit.” In recent months, Katherine Maher, the executive director of the Wikimedia Foundation (WMF), the non-profit in charge of Wikipedia, has been giving talks and interviews about how Wikipedia works — talks and interviews with titles like “What can fact checkers learn from Wikipedia?“, “Wikipedia to fight fake news” and “Wikipedia aims for consensus and trust as fake news spreads”.

So what can the news media learn from Wikipedia? Let’s find out.

Media Strategy
First, an obvious question: why is Wikipedia popping up in the news on this issue? Let our guide be the dictum: “news doesn’t just happen; it’s made to happen”. Therefore, it’s instructive to look at the communications audit commissioned by the Wikimedia Foundation, conducted by Minassian Media. Incidentally, the head of Minassian Media, Craig Minassian, is the Chief Communications Officer of the Clinton Foundation. The audit recommends:

Talk neutrality post-election

Given the record levels of partisanship/polarization and POV/opinion media (embodied perhaps most of all in the U.S. election), we have an opportunity to build on the neutrality message. The post-election space gives us an opportunity to do this, but does anyone think this is likely to change anytime soon?

Recommendations:

  • Think about a post-election gag about getting “back to facts now.”
  • Bring Wikipedia’s “Citation needed” to the media (both mainstream and fringe) by pushing out our balanced coverage of the most controversial subjects.
  • Think about introducing a breaking news Twitter feed that pushes out neutral content when controversy breaks.

The same theme pops up in the WMF’s fundraising pitches at the end of the last year. Here is an example from Jimmy Wales:

You may have heard people say that in today’s online media environment, facts have become subjective. At Wikipedia, we reject that idea. When you find yourself in despair about the state of the world, remember: Wikipedia is one of the most popular websites on the planet. And that’s because, at the end of the day, people share a common thirst for high-quality, neutral information. We are proud to offer a place where people of all backgrounds and ideologies can come to think, learn, and find neutral ground together.

Wales has parlayed this sentiment, which undoubtedly strikes a chord with many people, into a new business venture, WikiTribune.

Katherine Maher

Katherine Maher
Image: Wikimedia Commons
License: CC BY-SA 4.0

 

Wikipedia’s self-image
Maher painted an interesting picture of Wikipedia in her interviews:

Maher says that Wikipedia is “open to everyone to edit”, “participatory”, “transparent” in the edits made to any article, the reasons given for those edits, and the citations used to support the material. She likens the “Talk” page for every Wikipedia article, where Wikipedia contributors can discuss their edits, to a “newsroom” where the discussions are open and transparent. This transparency makes people “accountable” for their edits, and builds trust. Maher says: “Even when you have contested facts or contested information, Wikipedia tries to provide you some sort of consensus amidst all that complexity”.

Maher also acknowledges Wikipedia’s limitations: “Wikipedia is a tertiary source. But it is a great place to get a general understanding, and its citations are a perfect jumping off point for further research.” Maher says that she “encouraged a healthy level of skepticism among the website’s readers.” Maher also acknowledged that Wikipedia contributors are typically from relatively rich countries and predominantly male.

Putting claims under scrutiny
Talk is cheap, but is Wikipedia faithful to the principles it espouses?

Openness to edit: Wikipedia may have once been “the encyclopedia anyone can edit” but those days are long past. Every day, a large number of IP addresses are blocked by the admins on Wikipedia, and one can observe people being blocked and banned at administrator notice boards for one offense or another. Others are banned or blocked for “sockpuppeting”, which is when two or more accounts are controlled by the same person. Since Wikipedia does not ask for any identifying information when creating an account, the “sockpuppet investigations” are often little more than informed guesses, based on behavioral clues and rudimentary technical tools.

Leaving aside direct prohibitions, there are many other factors which militate against a truly open editing platform. For instance, Wikipedia’s dated interface and convoluted markup can often deter users from contributing. The WMF has invested a lot of resources into developing a “Visual Editor“, which turned out to be a boondoggle which barely anyone uses. As Maher says, most of Wikipedia contributors are from relatively rich countries, and most are male. While the WMF has been talking about the “gender gap” for many years now, it has also failed to make any sort of headway on the issue.

Transparency and accountability: Let’s consider a thought experiment, based on Maher’s own analogy. Would anyone accept a “newsroom” where anonymous contributors with undisclosed conflicts of interest argue about things, where expertise is irrelevant, where contributors’ work is not paid, there is no editor or copy-editor, and then nobody takes responsibility for the final product? But this is an exact analogue of the Wikipedia system. Many on Wikipedia try to finesse this objection by saying that “facts are cited to reliable sources”. But citation to a “reliable source” (even according to Wikipedia’s own policy) by itself is not a sufficient reason for inclusion. Here, the following quote, by E. H. Carr from his book “What is History”, is apt:

Study the historian before you begin to study the facts. This is, after all, not very abstruse. It is what is already done by the intelligent undergraduate who, when recommended to read a work by that great scholar Jones of St. Jude’s, goes round to a friend at St. Jude’s to ask what sort of chap Jones is, and what bees he has in his bonnet. When you read a work of history, always listen out for the buzzing. If you can detect none, either you are tone deaf or your historian is a dull dog. The facts are really not at all like fish on the fishmonger’s slab. They are like fish swimming about in a vast and sometimes inaccessible ocean; and what the historian catches will depend, partly on chance, but mainly on what part of the ocean he chooses to fish in and what tackle he chooses to use – these two factors being, of course, determined by the kind of fish he wants to catch. By and large, the historian will get the kind of facts he wants. History means interpretation.

To translate to Wikipedia: how does one figure out what’s buzzing in the bonnet of some contributor named CounterStrikeKilla or Randy In Boise (or for that matter, Kingsindian)?

A final point about accountability. According to Wikipedia policy, nobody “owns” any page or group of pages. This is supposed to foster an open environment to edit. It also means nobody is responsible for the content. There exist certain Wikiprojects that perform quality assessments of various articles and they sometimes do a decent job, but there is no accountability or transparency for them either. What does it mean for a certain article to be a “Good Article” or “Featured Article”? Often, not much. The DYKs (Did You Know) on the front page, which often get thousands of views when they are listed, are routinely shot through with errors and misrepresentations.

sausage grinder

Image: Pixabay (CC0)

Neutrality and Consensus: Wikipedia does have norms around maintaining a “neutral point of view“. But what exactly is a neutral point of view? Which sources are cited, how is their content phrased, and in what proportion? In practice, it comes down to “consensus”. However, this consensus is not a consensus among experts or a consensus among “the people” (however defined) — instead, it is a consensus among an unrepresentative sample of the world’s people from which a few anonymous people show up in a discussion on a Wikipedia page. These people are often armed with nothing more than Google and their own biases. They then engage in “wikilawyering” for their positions, citing countless policies and guidelines running to tens of thousands of words, whose interpretations in Wikipedia are often idiosyncratic to Wikipedia and unmoored from the real-world meaning of the terms. From this sausage-making process, neutral content is expected to emerge.

[In the second part, we will look at the actual content which emerges from the process described above.]

10 comments to What can fact checkers learn from Wikipedia — How not to do things, perhaps?

  • FactChecker

    That size-changing picture is extremely annoying.

    • Zoloft

      Please send a more detailed description of your problem to support @ wikipediocracy.com, and we’ll see if it’s resolvable. Details like which image, when does it resize, why is it irritating? Thanks!

  • First off, +1 for the highly appropriate E.H. Carr quote.

    The reason that IP editing should not be allowed (and is seemingly being crushed away over time) and why sockpuppetry is not allowed is explained by Carr very nicely — history (or biography) is all about interpretation, and it is vitally important to know the historian, biographer, or Wikipedia contributor in assessing their contributions to the finished work. The same contributor is apt to have many, many IP addresses, which frequently reset; these are de facto multiple accounts. There is precious little way to track back to an individual’s contribution history to learn about what particular “bees” are in the bonnet of an editor who has a multiplicity of contribution histories.

    Carr is exactly right about this, and WMF and WP community consensus regarding IP editing is exactly wrong.

    Wikipedia, at this late date, emphatically [b]should not be[/b} “The Encyclopedia Anyone Can Edit.”™ Things are way the hell past that point now.

    Obviously, a serious system of one-person/one-account, mandatory registration with teeth, and sign-in-to-edit would make the replenishment of the volunteer corps more challenging, but it would go miles towards improving the quality and reliability of the product, enormously reducing the amount of vandalism and making the permanent banning of POV warriors and commercial spammers technically possible.

    We’ll get there someday, maybe.

    Tim Davenport / “Carrite” on WP / “Randy from Boise” on WPO
    Corvallis, OR USA

  • This is sort of the idea of Infogalactic. IP editing is not allowed, although that’s hardly Wikipedia’s biggest problem.

    I think the bigger problem is that Wikipedia tries to portray itself as neutral, which has failed in any real controversial issue. One solution is to accept that we are biased and allow POV forking so that the readers can choose which version of the page to read.

    • Kingsindian

      There is something to that solution; POV forking can be useful in certain circumstances (more on this in part 2).

      But, one has to recognize the limits of this approach. We are all biased, but we live in the same physical universe. We can’t have “views differ on the shape of the Earth” type articles.

  • Good posting Kingsindian! And thanks for a interesting pickture you draw of Katherine Maher……

  • thekohser2

    I’ve usually found that practically any manner of nonsense can be accepted into Wikipedia, just as long as you properly format it and cite it to something official-sounding.

  • Captain Custard

    As hard hitting as this piece is, there are some more fundamental truths about the broken nature of Wikipedia with regard to the main points, that the author fails to mention. Citogenisis, for example. Or the basic resource gap which underlies much of their current closed nature. Or the fundamental issues with consensus building that stem from things much darker than mere inherent bias and gamesmanship.

    Dare I speculate that this level of underlying oversight in the critique is because they are still an active participant at Wikipedia, yet to fully unplug from the machine? For my own mind, it cannot be possible for anyone who truly understands what Wikipedia is, who has properly figured out how it all really works, to still then want to be a willing participant.

    Dude needs a red pill, stat.

  • Kingsindian

    Some discussion on Minassian media and the communications audit can be found at the following links:

    http://wikipediareview.proboards.com/thread/421/donors-money-funds-outgoing-managers – thread on another forum where I first learnt of it

    http://wikipediocracy.com/forum/viewtopic.php?f=23&t=8381 – thread on the associated Wikipediocracy forum

    https://www.facebook.com/groups/wikipediaweekly/permalink/1366566440057850/ – discussion on Wikipedia Weekly Facebook group.

    https://meta.wikimedia.org/wiki/Talk:Communications/Wikimedia_Foundation_messaging_strategy?fref=gc#Comments_on_the_2014.E2.80.9316_communications_audit – comments on the Meta talk page.

  • Rogol Domedonfors

    The relationship between Minassian and the WMF Communications team was reported in 2015 and mentioned on Wikipediocracy in October of that year: http://wikipediocracy.com/forum/viewtopic.php?f=6&t=6944&p=155678&hilit=minassian#p155678