Using Big Data to Inform Poverty Reduction Strategies

My colleagues and I at QCRI are spearheading a new experimental Research and Development (R&D) project with the United Nations Development Program (UNDP) team in Cairo, Egypt. Colleagues at Harvard University, MIT and UC Berkeley have also joined the R&D efforts as full-fledged partners. The research question: can an analysis of Twitter traffic in Egypt tell us anything about changes in unemployment and poverty levels? This question was formulated with UNDP’s Cairo-based Team during several conversations I had with them in early 2013.

Egyptian Tweets

As is well known, a major challenge in the development space is the lack of access to timely socio-economic data. So the question here is whether alternative, non-traditional sources of information (such as social media) can provide a timely and “good enough” indication of changing trends. Thanks to our academic partners, we have access to hundreds of millions of Egyptian tweets (both historical and current) along with census and demographic data for ground-truth purposes. If the research yields robust results, then our UNDP colleagues could draw on more real-time data to complement their existing datasets, which may better inform some of their local poverty reduction and development strategies. This more rapid feedback loop could lead to faster economic empowerment for local communities in Egypt. Of course, there are many challenges to working with social data vis-a-vis representation and sample bias. But that is precisely why this kind of experimental research is important—to determine whether any of our results are robust to biases in phone ownership, twitter-use, etc.


6 responses to “Using Big Data to Inform Poverty Reduction Strategies

  1. Pingback: Using Big Data to Inform Poverty Reduction Strategies | Society for Media Psychology and Technology (APA Division 46)

  2. A fascinating project – I’d love to hear how you get on and would be very grateful if you’d share any results, lessons-learned, techniques etc. good luck with it!

  3. Poverty Alleviation is a welcome project but Why can you approach poverty reduction from community base rather than large or governmental bases? Anything involving a large group of people, especially the politicians in Africa don’t usually succeed due to financial misplacement and corruption.

  4. Pingback: Egypt Twitter Map of iPhone, Android and Blackberry Users | iRevolution

  5. Pingback: All Aboard the Big Data Express! | Voices from Eurasia - We help build better lives.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s