Tag Archives: Representative

Social Media, Disaster Response and the Streetlight Effect

A police officer sees a man searching for his coin under a streetlight. After helping for several minutes, the exasperated officer asks if the man is sure that he lost his coin there. The man says “No, I lost them in the park a few blocks down the street.” The incredulous officer asks why he’s searching under the streetlight. The man replies, “Well this is where the light is.”[1] This parable describes the “streetlight effect,” the observational bias that results from using the easiest way to collect information. The streetlight effect is an important criticisms leveled against the use of social media for emergency management. This certainly is a valid concern but one that needs to be placed into context.

muttjeff01
I had the honor of speaking on a UN panel with Hans Rosling in New York last year. During the Q&A, Hans showed Member States a map of cell phone coverage in the Democratic Republic of the Congo (DRC). The map was striking. Barely 10% of the country seemed to have coverage. This one map shut down the entire conversation about the value of mobile technology for data collection during disasters. Now, what Hans didn’t show was a map of the DRC’s population distribution, which reveals that the majority of the country’s population lives in urban areas; areas that have cell phone coverage. Hans’s map was also static and thus did not convey the fact that the number cell phone subscribers increased by roughly 50% in the year leading up to the panel and ~50% again the year after.

Of course, the number of social media users in the DRC is far, far lower than the country’s 12.4 million unique cell phone subscribers. The map below, for example, shows the location of Twitter users over a 10 day period in October 2013. Now keep in mind that only 2% of users actually geo-tag their tweets. Also, as my colleague Kalev Leetaru recently discovered, the correlation between the location of Twitter users and access to electricity is very high, which means that every place on Earth that is electrified has a high probability of having some level of Twitter activity. Furthermore, Twitter was only launched 7 years ago compared to the first cell phone, which was built 30 years ago. So these are still early days for Twitter. But that doesn’t change the fact that there is clearly very little Twitter traffic in the DRC today. And just like the man in the parable above, we only have access to answers where an “electrified tweet” exists (if we restrict ourselves to the Twitter streetlight).

DRC twitter map 2

But this begs the following question, which is almost always overlooked: too little traffic for what? This study by Harvard colleagues, for example, found that Twitter was faster (and as accurate) as official sources at detecting the start and early progress of Cholera after the 2010 earthquake. And yet, the corresponding Twitter map of Haiti does not show significantly more activity than the DRC map over the same 10-day period. Keep in mind there were far fewer Twitter users in Haiti four years ago (i.e., before the earthquake). Other researchers have recently shown that “micro-crises” can also be detected via Twitter even though said crises elicit very few tweets by definition. More on that here.

Haiti twitter map

But why limit ourselves to the Twitter streetlight? Only a handful of “puzzle pieces” in our Haiti jigsaw may be tweets, but that doesn’t mean they can’t complement other pieces taken from traditional datasets and even other social media channels. Remember that there are five times more Facebook users than Twitter users. In certain contexts, however, social media may be of zero added value. I’ve reiterated this point again in recent talks at the Council on Foreign Relation and the UN. Social media is forming a new “nervous system” for our planet, but one that is still very young, even premature in places and certainly imperfect in representation. Then again, so was 911 in the 1970’s and 1980’s as explained here. In any event, focusing on more developed parts of the system (like Indonesia’s Twitter footprint below) makes more sense for some questions, as does complementing this new nervous system with other more mature data sources such mainstream media via as GDELT as advocated here.

Indonesia twitter map2

The Twitter map of the Manila area below is also the result of 10-day traffic. While “only” ~12 million Filipinos (13% of the country) lives in Manila, it behoves us to remember that urban populations across the world are booming. In just over 2,000 days, more than half of the population in the world’s developing regions will be living in urban areas according to the UN. Meanwhile, the rural population of developing countries will decline by half-a-billion in coming decades. At the same time, these rural populations will also grow a larger social media footprint since mobile phone penetration rates already stand at 89% in developing countries according to the latest ITU study (PDF). With Google and Facebook making it their (for-profit) mission to connect those off the digital grid, it is only a matter of time until very rural communities get online and click on ads.

Manila twitter map

The radical increase in population density means that urban areas will become even more vulnerable to major disasters (hence the Rockefeller Foundation’s program on 100 Resilience Cities). To be sure, as Rousseau noted in a letter to Voltaire after the massive 1756 Portugal Earthquake, “an earthquake occurring in wilderness would not be important to society.” In other words, disaster risk is a function of population density. At the same time, however, a denser population also means more proverbial streetlights. But just as we don’t need a high density of streetlights to find our way at night, we hardly need everyone to be on social media for tweets and Instagram pictures to shed some light during disasters and facilitate self-organized disaster response at the grassroots level.

Credit: Heidi RYDER Photography

My good friend Jaroslav Valůch recounted a recent conversation he had with an old fireman in a very small town in Eastern Europe who had never heard of Twitter, Facebook or crowdsourcing. The old man said: “During crisis, for us, the firemen, it is like having a dark house where only some rooms are lit (i.e., information from mayors and other official local sources in villages and cities affected). What you do [with social media and crowdsourcing], is that you are lighting up more rooms for us. So don’t worry, it is enough.”

No doubt Hans Rosling will show another dramatic map if I happen to sit on another panel with him. But this time I’ll offer context so that instead of ending the discussion, his map will hopefully catalyze a more informed debate. In any event, I suspect (and hope that) Hans won’t be the only one objecting to my optimism in this blog post. So as always, I welcome feedback from iRevolution readers. And as my colleague Andrew Zolli is fond of reminding folks at PopTech:

“Be tough on ideas, gentle on people.”

bio

Big Data for Disaster Response: A List of Wrong Assumptions

Screen Shot 2013-06-09 at 1.24.56 PM

Derrick Herris puts it best:

“It might be provocative to call into question one of the hottest tech movements in generations, but it’s not really fair. That’s because how companies and people benefit from Big Data, Data Science or whatever else they choose to call the movement toward a data-centric world is directly related to what they expect going in. Arguing that big data isn’t all it’s cracked up to be is a strawman, pure and simple—because no one should think it’s magic to begin with.”

So here is a list of misplaced assumptions about the relevance of Big Data for disaster response and emergency management:

•  “Big Data will improve decision-making for disaster response”

This recent groundbreaking study by the UN confirms that many decisions made by humanitarian professionals during disasters are not based on any kind of empirical data—regardless of how large or small a dataset may be and even when the data is fully trustworthy. In fact, humanitarians often use anecdotal information or mainstream news to inform their decision-making. So no, Big Data will not magically fix these decision-making deficiencies in humanitarian organizations, all of which pre-date the era of Big (Crisis) Data.

•  Big Data suffers from extreme sample bias.”

This is often true of any dataset collected using non-random sampling methods. The statement also seems to suggest that representative sampling methods can actually be carried out just as easily, quickly and cheaply. This is very rarely the case, hence the use of non-random sampling. In other words, sample bias is not some strange disease that only affects Big Data or social media. And even though Big Data is biased and not necessarily objective, Big Data such as social media still represents a “new, large, and arguably unfiltered insights into attitudes and behaviors that were previously difficult to track in the wild.”

digital prints

Statistical correlations in Big Data do not imply causation; they simply suggest that there may be something worth exploring further. Moreover, data that is collected via non-random, non-representative sampling does not invalidate or devalue the data collected. Much of the data used for medical research, digital disease detection and police work is the product of convenience sampling. Should they dismiss or ignore the resulting data because it is not representative? Of course not.

While the 911 system was set up in 1968, the service and number were not widely known until the 1970s and some municipalities did not have the crowdsourcing service until the 1980s. So it was hardly a representative way to collect emergency calls. Does this mean that the millions of 911 calls made before the more widespread adoption of the service in the 1990s were all invalid or useless? Of course not, even despite the tens of millions of false 911 calls and hoaxes that are made ever year. Point is, there has never been a moment in history in which everyone has had access to the same communication technology at the same time. This is unlikely to change for a while even though mobile phones are by far the most rapidly distributed and widespread communication technology in the history of our species.

There were over 20 million tweets posted during Hurricane Sandy last year. While “only” 16% of Americans are on Twitter and while this demographic is younger, more urban and affluent than the norm, as Kate Crawford rightly notes, this does not render the informative and actionable tweets shared during the Hurricane useless to emergency managers. After Typhoon Pablo devastated the Philippines last year, the UN used images and videos shared on social media as a preliminary way to assess the disaster damage. According to one Senior UN Official I recently spoke with, their relief efforts would have overlooked certain disaster-affected areas had it not been for this map.

PHILIPPINES-TYPHOON

Was the data representative? No. Were the underlying images and videos objective? No, they captured the perspective of those taking the pictures. Note that “only” 3% of the world’s population are active Twitter users and fewer still post images and videos online. But the damage captured by this data was not virtual, it was  real damage. And it only takes one person to take a picture of a washed-out bridge to reveal the infrastructure damage caused by a Typhoon, even if all other onlookers have never heard of social media. Moreover, this recent statistical study reveals that tweets are evenly geographically distributed according to the availability of electricity. This is striking given that Twitter has only been around for 7 years compared to the light bulb, which was invented 134 years ago.

•  Big Data enthusiasts suggest doing away with traditional sources of information for disaster response.”

I have yet to meet anyone who earnestly believes this. As Derrick writes, “social media shouldn’t usurp traditional customer service or market research data that’s still useful, nor should the Centers for Disease Control start relying on Google Flu Trends at the expense of traditional flu-tracking methodologies. Web and social data are just one more source of data to factor into decisions, albeit a potentially voluminous and high-velocity one.” In other words, the situation is not either/or, but rather a both/and. Big (Crisis) Data from social media can complement rather than replace traditional information sources and methods.

•  Big Data will make us forget the human faces behind the data.”

Big (Crisis) Data typically refers to user-generated content shared on social media, such as Twitter, Instagram, Youtube, etc. Anyone who follows social media during a disaster would be hard-pressed to forget where this data is coming from, in my opinion. Social media, after all, is social and increasingly visually social as witnessed by the tremendous popularity of Instagram and Youtube during disasters. These help us capture, connect and feel real emotions.

OkeTorn

 

bio

See also: 

  • “No Data is Better than Bad Data…” Really? [Link]
  • Crowdsourcing and the Veil of Ignorance [Link]