Information Forensics: Five Case Studies on How to Verify Crowdsourced Information from Social Media

My 20+ page study on verifying crowdsourced information is now publicly available here as a PDF and here as an open Google Doc for comments. I very much welcome constructive feedback from iRevolution readers so I can improve the piece before it gets published in an edited book next year.


False information can cost lives. But no information can also cost lives, especially in a crisis zone. Indeed, information is perishable so the potential value of information must be weighed against the urgency of the situation. Correct information that arrives too late is useless. Crowdsourced information can provide rapid situational awareness, especially when added to a live crisis map. But information in the social media space may not be reliable or immediately verifiable. This may explain why humanitarian (and news) organizations are often reluctant to leverage crowdsourced crisis maps. Many believe that verifying crowdsourced information is either too challenging or impossible. The purpose of this paper is to demonstrate that concrete strategies do exist for the verification of geo-referenced crowdsourced social media information. The study first provides a brief introduction to crisis mapping and argues that crowdsourcing is simply non-probability sampling. Next, five case studies comprising various efforts to verify social media are analyzed to demonstrate how different verification strategies work. The five case studies are: Andy Carvin and Twitter; Kyrgyzstan and Skype; BBC’s User-Generated Content Hub; the Standby Volunteer Task Force (SBTF); and U-Shahid in Egypt. The final section concludes the study with specific recommendations.

Update: See also this link and my other posts on Information Forensics.

24 responses to “Information Forensics: Five Case Studies on How to Verify Crowdsourced Information from Social Media

  1. Pingback: How to Verify Social Media Content: Some Tips and Tricks on Information Forensics | iRevolution

  2. This is a terrific idea – crowdsourcing a study on crowdsourcing!

  3. Great stuff Patrick, thanks for this.

  4. Hello may be of interest for the topic of this article to remember this webinar by George Chamales; it is iteresting how he “sees” the issue.

  5. Pingback: Stranger than Fiction: A Few Words About An Ethical Compass for Crisis Mapping « GEODATA POLICY

  6. Pingback: Trails of Trustworthiness in Real-Time Streams | iRevolution

  7. Pingback: Truthiness as Probability: Moving Beyond the True or False Dichotomy when Verifying Social Media | iRevolution

  8. Pingback: Social Web for Broadcast Media

  9. Pingback: The Best of iRevolution: Four Years of Blogging | iRevolution

  10. Pingback: Mit Crowdsourcing zu mehr Barrierefreiheit | Blind-Text

  11. Pingback: Big Data for Development: Challenges and Opportunities | iRevolution

  12. Pingback: Crowdsourcing for Human Rights Monitoring: Challenges and Opportunities for Information Collection & Verification | iRevolution

  13. Pingback: Truth in the Age of Social Media: A Social Computing and Big Data Challenge | iRevolution

  14. Pingback: Accelerating the Verification of Social Media Content | iRevolution

  15. Pingback: Predicting the Credibility of Disaster Tweets Automatically | iRevolution

  16. Pingback: Analyzing the Veracity of Tweets during a Major Crisis | iRevolution

  17. Pingback: Twitter: The Internet’s Lie Detector?

  18. Pingback: Verifying Social Media Content: The Best Links, Case Studies and Discussion | Groundswell

  19. Pingback: Using Crowdsourcing to Counter the Spread of False Rumors on Social Media During Crises | iRevolution

  20. Pingback: Crowdsourcing Critical Thinking to Verify Social Media During Crises | iRevolution

  21. Pingback: Analyzing Fake Content on Twitter During Boston Marathon Bombings | iRevolution

  22. Pingback: New Insights on How To Verify Social Media | iRevolution

  23. Pingback: Automatically Ranking the Credibility of Tweets During Major Events | iRevolution

  24. Pingback: Got TweetCred? Use it To Automatically Identify Credible Tweets | iRevolution

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s