Category Archives: Drones/UAVs

Counter-Mapping the State with UAVs

Want a piece of Indonesia? The country’s government is busy implementing an “accelerated development program” in which “different provinces are assigned different development foci,” like “food and energy for Papua, palm oil processing for North Sumatra, mining for Central Kalimantan etc.” Critics describe this program as “a national, state-coordinated program of land grabs.” An important component of “this development plan is the commoditization of space by spatial planning,” which is “supposed to be open, transparent and participatory.” The reality is very different. “Maps are made by consultants and government offices favoring the interests of capital and local elites.” As a result, “concessions are given mostly without the consent (and often without the knowledge) of local communities.” These quotes are taken from a brilliant new study (PDF) written by Irendra Radjawali and Oliver Pye. The study describes the use of Unmanned Aerial Vehicles (UAVs) to “generate high-quality community controlled maps to challenge spatial planning from above,” which is “revolutionizing the counter-mapping movement in Indonesia.”

Screen Shot 2015-07-31 at 2.46.00 PM

“Challenging state power over maps and its categorization of land uses by counter-mapping indigenous and local claims to territory has developed into an important movement in Indonesia.” As the authors of the new study rightly note, “Mapping needs to be understood as a political process rather than a merely technical tool. Mapping is not only an act of how to produce maps, it is important to always ask who produces the maps, how people can access the maps and how the maps can be used for emancipatory purposes.” Counter-mapping is thus a political process as well. And this counter-mapping movement is now experimenting with “grassroots UAVs” (or community drones) to bolster their political actions.

Activists in Indonesia initially used their UAV to capture “high quality and high-resolution spatial data in areas where access was restricted by company security and police.” Where exactly did they get their UAV from? They built one from scratch: “Irendra Radjawali built the first drone without any former training, by using the Internet and the online forum. He also sourced much of the material second hand via ebay.” The advantage of this DIY approach is the relatively low costs involved. This UAV, coupled with a mapping camera, came to just over USD 500.

Screen Shot 2015-07-31 at 3.35.58 PM

Irendra and team subsequently few their UAVs over oil palm plantations where a company had taken lands from local communities who had no idea that their lands had been parceled off to said company. The team managed to fly their UAVs “at several places, capturing several community’s areas which have been grabbed by the company, including the customary area.” It is worth emphasizing that “community members very rarely have access to the spatial plan documents, and so could hardly ever actively participate in the spatial planning process. The opportunity to produce high-quality and precise maps is seen by community members as the chance to claim and to re-claim their lands.”

The team also flew over an area that was directly “affected by the expansion of large scale open mining for bauxite.” The water from the river became unsafe to drink; fishing grounds vanished; the nearby lake dried up. Local communities repeatedly protested the irreversible destruction of their ecosystem but this hasn’t stopped mining companies from expanding their activities. Irendra and team were able to take aerial photographs of the affected areas. One of the “high-quality and precise maps” that they were able to generate with these photos has since “been used as an evidence to disclose illegal mining company exploiting bauxites operating outside of their concession area.” These aerial counter-maps are thus “being used to provide evidence against the mining company,” and they also support local community’s efforts to protect their existing lands and forest.”

Screen Shot 2015-07-31 at 3.45.19 PM

Irendra and his colleagues took a direct, community-driven approach to these counter-mapping projects: “Community members are involved in establishing the community drone and in deciding who will be responsible to perform drone mapping activities. […] Village meetings also discussed the plans and strategies to perform mapping activities at various different villages with different challenges and contexts. One part of village meetings was training on mapping and drones where participants were informed about participatory counter-mapping techniques as well as the use and the operation of drones to support rapid participatory counter-mapping for high-quality spatial data. A meeting in Subah village agreed to fund the mapping themselves by a monthly contribution of [50 USD] from each [sub-village].”

In sum, co-authors Irendra and Oliver write that UAVs are “very empowering.” “The sense of power and achievement when community members themselves fly the drone is substantial. The empowerment impact that comes with the knowledge that these images are of greater quality than the concession maps and that they have been acknowledged by the Constitutional Court is even greater.”

It is worth noting that the land-use planning maps controlled by the government and companies were made on “the basis of satellite imagery,” which means that “small hamlets [are] not visible. In the process of map-making by the State, the hamlets literally disappeared, losing any rights to their land in the process. With high-resolution drone maps, however, residential areas, farming, fruit tree forests and other long-term uses of the land are rendered visible. Furthermore, local communities require high-quality maps to re-claim those residential areas which now are ‘officially’ part of company’s concessions. These maps are used to support their arguments to halt new concessions for mining and for oil palm.”

Screen Shot 2015-07-31 at 4.39.47 PM

Not surprisingly, perhaps, “the counter-mapping process also uncovered simmering territorial conflicts.” In one of these conflicts, “it emerged that the unsettled village border is one the problems.” Irendra and fellow co-author Oliver write that “One of the aims of community drones is to map the area of several villages […] and to confirm village borders.”

The team’s use of UAVs for counter-mapping resulted in a number of political victories that went beyond the local level. In one case, for example, a counter-map was “used as legal evidence at the Constitutional Court trial on the 1st September 2014, providing the chance for drone counter maps to be recognized by the Indonesian legal system in the future.” In another case, counter maps were combined with other evidence to “challenge the provincial government to accept what the civil society organizations demand. Some of their demands were achieved and accepted, including: (1) Recognition of community-managed lands, (2) Recognition of customary community rights, and (3) active community engagement in the spatial planning process. These demands had not been addressed before.” In yet a third case, “Maps made by drones were used to support […] arguments that often mining activities are causing detrimental social and ecological effects. The Constitutional Court ruled against the mining corporations [as a result], upholding the obligation of mining companies to install smelters and to process raw minerals and coal before exporting them.”

Screen Shot 2015-07-31 at 4.37.53 PM

These projects have generated a growing interest in UAVs, which is why the local Swandiri Institute recently established a “drones school” where “civil society organizations and community activists who are interested in learning and using drones for mapping and for advocacy work could join and participate.” A second drones school was also launched by other partners to “focus on using drones at village levels to map village areas and to confirm village borders.”

The authors conclude that “the appropriation of drone technology by community activists has the potential to improve the situation with regard to inclusion, transparency, and empowerment. […] Nowadays, younger members of local communities are computer literate. After a mapping flight, images and videos can be directly downloaded on to a laptop, giving instant transparency to village meetings during the mapping project. The resolution is so high that individual houses, trees, etc. can be clearly identified, also increasing transparency and the potential to include just about everybody in territorial discussions.”

But of course, to state the obvious: UAVs are not a silver bullet or “magic wand that can conjure away hierarchies and power structures at the local level or in wider society.” Irendra and team were “unable to use drones in those areas where local elites were in cahoots with plantation and mining companies and controlled traditional institutions such as customary councils and where opposition was marginalized.” In other areas, “hierarchical gender relations […], power dynamics, and territorial disputes between different villages were replicated in the mapping process.” At the same time, the UAV revolution does have “the potential—together with campaigning and political pressure—to force through the recognition of community counter-maps in the spatial planning process […].” To this end, “if embedded within political action, drone technology can revolutionize counter-mapping and become an effective weapon in the struggle against land grabs.” And in this context, “community drones for counter-mapping could well become a technology of the masses, by the masses, and for the masses.”

A Practical Introduction to UAVs for NGOs

The New America Foundation and Omidyar Network recently published an important primer on how NGOs across multiple sectors can begin to leverage UAVs (or drones). Entitled, “Drones and Aerial Observation: New Technologies for Property Rights, Human Rights & Global Development,” this new publication (PDF) is highly recommended to NGOs seeking to better understand the in’s and out’s of this new technology. UAVs represent the first wave of robotics to be used in the NGOs space. It is incumbent on us to both anticipate and channel the transformative impact that these aerial robots will inevitably have in order to lead by example and thereby inform the safe, responsible and effective use of this new technology. As per AmeriCare’s recent tweet about UAVs: “Technology can disrupt, destroy or transform. Our choice.”

Screen Shot 2015-07-30 at 2.06.27 PM

The UAV industry is expected to grow to $11.5 billion annually within 10 years. In the meantime, “governments worldwide are wrestling in real time with exactly how to react to this democratization of technology and information, particularly in the areas of surveillance and privacy. This is where smart, informed public policy is especially critical. It is imperative that we balance the rights of citizens with legitimate privacy and security concerns. The only way this will happen is if we set up an open, fair and transparent exchange of ideas—something we hope that this Primer will enable.”

Screen Shot 2015-07-30 at 2.32.22 PM

Perhaps what I value the most about this primer is the simple language it uses to explain what UAVs are, what they can do, and how. See in particular Chapter 1 on what UAVs can do, and Chapter 4 on how to make maps with UAVs. If you only have time to read one chapter, then definitely read Chapter 4. Chapter 2 focuses on community participation, consent and data sharing; worth reading Kate Chapman’s comments on that chapter. Chapter 3 addresses the thorny issue of regulations. The primer also features important case-studies on how UAVs are used across different sectors. For example, Chapter 5, “Mapping in Practice,” highlights multiple real-world uses of mapping UAVs, ranging from community and cadastral mapping to archaeological and conservation mapping. 

Screen Shot 2015-07-30 at 3.46.50 PM

Chapter 6 is the one I wrote, documenting recent uses of UAVs in humanitarian disasters along with key use-cases and lessons learned. In closing, I briefly introduce the Humanitarian UAV Network (UAViators), which is the only global initiative that actively promotes the safe, coordinated and effective use of UAVs in humanitarian settings. The Network champions a dedicated Code of Conduct to raise awareness about best practices and humanitarian principles. This is especially important given that an increasing number of  the  “disaster tourists” and “citizen journalists” are already experimenting with UAVs in disaster zones. UAViators is thus taking pro-active steps to educate amateur pilots rather than waiting for mistakes to be made.

Chapters 7 and 8 focus on the use of UAVs for conservation & human rights respectively. While the chapter on human rights is more hypothetical and speculative than others, it contains insightful interviews with several experts from the United Nations, Human Rights Watch and Amnesty International. One such interviewee, Daniel Gilman, is rather skeptical about the use of UAVs to deter armed groups from committing human rights abuses: “I’m not convinced so much about the deterrent effect of drones. Just because I think people are assholes.” The final chapters, 8 and 9, address uses of UAVs in archaeology and in peacekeeping operations. Like the use of UAVs for human rights, the use of UAVs in peacekeeping is an area I have also explored.

Screen Shot 2015-07-30 at 2.17.07 PM

Taken together, the real-world focus and accessible language of the 9 chapters really sets this short book apart and certainly fills a void. So if you’re new to UAVs, this primer will definitely help answer your most frequent questions and will go a long way to demystifying this new technology for you. If you’re keen to learn more about humanitarian applications, then I recommend this write-up on “Humanitarian UAV Missions: Towards Best Practices” along with this overview on streamlined workflows. You may also want to visit the resources available at the Humanitarian UAV Network (UAViators).

3D Digital Humanitarians: The Irony

In 2009 I wrote this blog post entitled “The Biggest Problem with Crisis Maps.” The gist of the post: crises are dynamic over time and space but our crisis maps are 2D and static. More than half-a-decade later, Digital Humanitarians have still not escaped from Plato’s Cave. Instead, they continue tracing 2D shadows cast by crisis data projected on their 2D crisis maps. Is there value in breaking free from our 2D data chains? Yes. And the time will soon come when Digital Humanitarians will have to make a 3D run for it.

Screen Shot 2015-07-21 at 3.31.27 PM

Aerial imagery captured by UAVs (Unmanned Aerial Vehicles) can be used to create very high-resolution 3D point clouds like the one below. It only took a 4-minute UAV flight to capture the imagery for this point cloud. Of course, the processing time to convert the 2D imagery to 3D took longer. But solutions already exist to create 3D point clouds on the fly, and these solutions will only get more sophisticated over time.

Stitching 2D aerial imagery into larger “mosaics” is already standard practice in the UAV space. But that’s so 2014. What we need is the ability to stitch together 3D point clouds. In other words, I should be able to mesh my 3D point cloud of a given area with other point clouds that overlap spatially with mine. This would enable us to generate high-resolution 3D point clouds for larger areas. Lets call these accumulated point clouds Cumulus Clouds. We could then create baseline data in the form of Cumulus Clouds. And when a disaster happens, we could create updated Cumulus Clouds for the affected area and compare them with our baseline Cumulus Cloud for changes. In other words, instead of solely generating 2D mapping data for the Missing Maps Project, we could add Cumulus Clouds.

Meanwhile, breakthroughs in Virtual Reality will enable Digital Humanitarians to swarm through these Cumulus Clouds. Innovations such as Oculus Rift, the first consumer-targeted virtual reality headsets, may become the pièce de résistance of future Digital Humanitarians. This shift to 3D doesn’t mean that our methods for analyzing 2D crisis maps are obsolete when we leave Plato’s Cave. We simply need to extend our microtasking and crowdsourcing solutions to the 3D space. As such, a 3D “tasking manager” would just assign specific areas of a Cumulus Cloud to individual Digital Jedis. This is no different to how field-based disaster assessment surveys get carried out in the “Solid World” (Real Word). Our Oculus headsets would “simply” need to allow Digital Jedis to “annotate” or “trace various” sections of the Cumulus Clouds just like they already do with 2D maps; otherwise we’ll be nothing more than disaster tourists.

wp oculus

The shift to 3D is not without challenges. This shift necessarily increases visual complexity. Indeed, 2D images are a radical (and often welcome) simplification of the Solid World. This simplification comes with a number of advantages like reducing the signal to noise ratio. But 2D imagery, like satellite imagery, “hides” information, which is one reason why imagery-interpretation and analysis is difficult, often requiring expert training. But 3D is more intuitive; 3D is the world we live in. Interpreting signs of damage in 3D may thus be easier than doing so with a lot less information in 2D. Of course, this also depends on the level of detail required for the 3D damage assessments. Regardless, appropriate tutorials will need to be developed to guide the analysis of 3D point clouds and Cumulus Clouds. Wait a minute—shouldn’t existing assessment methodologies used for field-based surveys in the Solid World do the trick? After all, the “Real World” is in 3D last time I checked.

Ah, there’s the rub. Some of the existing methodologies developed by the UN and World Bank to assess disaster damage are largely dysfunctional. Take for example the formal definition of “partial damage” used by the Bank to carry out their post-disaster damage and needs assessments: “the classification used is to say that if a building is 40% damaged, it needs to be repaired. In my view this is too vague a description and not much help. When we say 40%, is it the volume of the building we are talking about or the structural components?” The question is posed by a World Bank colleague with 15+ years of experience. Since high-resolution 3D data enables more of us to more easily see more details, our assessment methodologies will necessarily need to become more detailed both for manual and automated analysis solutions. This does add more complexity but such is the price if we actually want reliable damage assessments regardless.

Isn’t it ironic that our shift to Virtual Reality may ultimately improve the methodologies (and thus data quality) of field-based surveys carried out in the Solid World? In any event, I can already “hear” the usual critics complaining; the usual theatrics of cave-bound humanitarians who eagerly dismiss any technology that appears after the radio (and maybe SMS). Such is life. Moving along. I’m exploring practical ways to annotate 3D point clouds here but if anyone has additional ideas, do please get in touch. I’m also looking for any solutions out there (imperfect ones are fine too) that can can help us build Cumulus Clouds—i.e., stitch overlapping 3D point clouds. Lastly, I’d love to know what it would take to annotate Cumulus Clouds via Virtual Reality. Thanks!

Acknowledgements: Thanks to colleagues from OpenAerialMap, Cadasta and MapBox for helping me think through some of the ideas above.

Developing Guidelines for Humanitarian UAV Missions

New: The revised Code of Conduct and Guidelines are now publicly available as part of an open consultative process that will conclude on October 10th. We thus invite comments on the draft guidelines here (Google Doc). Please note that only feedback provided via this Google Form will be reviewed. We’ll be running an open Webinar on September 16th to discuss the guidelines in more detail.


The Humanitarian UAV Network (UAViators) recently organized a 3-day Policy Forum on Humanitarian UAVs. The mission of UAViators is to promote the safe, coordinated and effective use of UAVs in a wide range of humanitarian settings. The Forum, the first of it’s kind, was generously sponsored and hosted by the Rockefeller Foundation at their conference center in Bellagio, Italy. The aerial panoramic photograph below was captured by UAV during the Forum.

EricChengBellagio

UAViators brought together a cross-section of experts from the UN Office for the Coordination of Humanitarian Affairs (OCHA), UN Refugee Agency (UNHCR), UN Department for Peacekeeping Operations (DPKO), World Food Program (WFP), International Committee of the Red Cross (ICRC), American Red Cross, European Commission’s Humanitarian Aid Organization (ECHO), Medair, Humanitarian OpenStreetMap, ICT for Peace Foundation (ICT4Peace), DJI, BuildPeace, Peace Research Institute, Oslo (PRIO), Trilateral Research, Harvard University, Texas A&M, University of Central Lancashire, École Polytechnique Fédérale de Lausanne (EPFL), Pepperdine University School of Law and other independent experts. The purpose of the Forum, which I had the distinct pleasure of running: to draft guidelines for the safe, coordinated and effective use of UAVs in humanitarian settings.

Five key sets of guidelines were drafted, each focusing on priority areas where policy has been notably absent: 1) Code of Conduct; 2) Data Ethics; 3) Community Engagement; 4) Principled Partnerships; and 5) Conflict Sensitivity. These five policy areas were identified as priorities during the full-day Humanitarian UAV Experts Meeting co-organized at the UN Secretariat in New York by UAViators and OCHA (see summary here). After 3 very long days of deliberation in Bellagio, we converged towards an initial draft set of guidelines for each of the key areas. There was certainly no guarantee that this convergence would happen, so I’m particularly pleased and very grateful to all participants for their hard work. Indeed, I’m reminded of Alexander Aleinikoff (Deputy High Commissioner in the Office of UNHCR) who defines innovation as “dynamic problem solving among friends.” The camaraderie throughout the long hours had a lot to do with the positive outcome. Conferences typically take a group photo of participants; we chose to take an aerial video instead:

Of course, this doesn’t mean we’re done. The most immediate next step is to harmonize each of the guideline documents so that they “speak” to each other. We’ll then solicit internal institutional feedback from the organizations that were represented in Bellagio. Once this feedback has been considered and integrated where appropriate, we will organize a soft public launch of the guidelines in August 2015. The purpose of this soft launch is to actively solicit feedback from the broader humanitarian community. We plan to hold Webinars in August and September to invite this additional feedback. The draft guidelines will be further reviewed in October at the 2015 Humanitarian UAV Experts Meeting, which is being hosted at MIT and co-organized by UAViators, OCHA and the World Humanitarian Summit (WHS).

We’ll then review all the feedback received since Bellagio to produce the “final” version of the guidelines, which will be presented to donors and humanitarian organizations for public endorsement. The guidelines will be officially launched at the World Humanitarian Summit in 2016. In the meantime, these documents will serve as best practices to inform both humanitarian UAV trainings and missions. In other words, they will already serve to guide the safe, coordinated and effective use of UAVs in humanitarian settings. We will also use these draft guidelines to hold ourselves accountable. To be sure, humanitarian innovation is not simply about the technology; humanitarian innovation is also about the processes that enable the innovative use of emerging technologies.

While the first text message (SMS) was sent in 1992, it took 20 years (!) until a set of guidelines were developed to inform the use of SMS in disaster response. I’m relieved that we won’t have to wait until 2035 to produce UAV guidelines. Yes, the evidence base for the added value of UAVs in humanitarian missions is still thin, which is why it is all the more remarkable that forward-thinking guidelines are already being drafted. As several participants noted during the Forum, “The humanitarian community completely missed the boat on the mobile phone revolution. It is vital that we not make this same mistake again with newer, emerging technologies.” As such, the question for everyone at the Forum was not whether UAVs will have a significant impact, but rather what guidelines are needed now to guide the impact that this new technology will inevitably have on future humanitarian efforts.

The evidence base is necessarily thin since UAVs are only now emerging as a potential humanitarian technology. There is still a lot of learning and documenting to be done. The Humanitarian UAV Network has already taken on this task and will continue to enable learning and catalyze information sharing by convening expert meetings and documenting lessons learned in collaboration with key partners. The Network will also seek to partner with select groups on strategic projects with the aim of expanding the evidence base. In sum, I think we’re on the right track, and staying on the right track will require a joint and sustained effort with a cross-section of partners and stakeholders. To be sure, UAViators cannot accomplish the above alone. It took 22 dedicated experts and 3 long days to produce the draft guidelines. So consider this post an open invitation to join these efforts as we press on to make the use of UAVs in humanitarian crises safer, more coordinated and more effective.

In the meantime, a big thanks once again to all the experts who joined us for the Forum, and equally big thanks to the team at the Rockefeller Foundation for graciously hosting us in Bellagio.

Review: The First Ever Course on Humanitarian UAVs

UAViatorsLogo

The Humanitarian UAV Network (UAViators) promotes the safe, coordinated and effective use of UAVs in a wide range of humanitarian settings. To this end, the Network’s mission includes training the first generation of Humanitarian UAV experts. This explains why I teamed up with VIVES Aeronautics College last year to create and launch the first ever UAV training specifically geared towards established humanitarian organizations. The 3-day, intensive and hands-on training took place this month in Belgium and went superbly well, which is why we’ll be offering it again next year and possibly a second time this year as well.

Participants included representatives from the United Nations Office for the Coordination of Humanitarian Affairs (OCHA), World Food Program (WFP), International Organization for Migration (IOM), European Union Humanitarian Aid Organization (ECHO), Medair, Direct Relief, and Germany’s Development Organization GIZ. We powered through the most important subjects, ranging from airspace regulations to the physics of flight, the in’s and out’s of civil aviation, aeronautics, weather forecasts, programming flight routes, operational safety, standard operating procedures, best practices, etc. I gave trainings on both Humanitarian UAV Applications and Humanitarian UAV Operations, which totaled well over 4 hours of instruction and discussion. The Ops training included a detailed review of best practices—summary available here. Knowing how to operate this new technology is definitely the easy part; knowing how to use UAVs effectively and responsibly in real-world humanitarian contexts is a far bigger challenge; hence the need for this training.

The purpose of the course was to provide the kind of training that humanitarian professionals need in order to 1) Fully understand the opportunities and limitations of this new technology; 2) Partner effectively with professional UAV teams during disasters; and 3) Operate safely, legally, responsibly and ethically. The accelerated training ended with a 2-hour simulation exercise in which participants were tasked with carrying out a UAV mission in Nepal for which they had to use all the standard operating procedures and best practices they had learned over the course of the training. Each team then had to present in detail how they would carry out the required mission.

Below are pictures from the 3-day event. Each day included some 12 hours of instructions and discussions—so these pictures certainly don’t cover all of the flights, materials and seminars. For more on this unique UAV training course, check out this excellent blog post by Andrew Schroeder from Direct Relief. In the meantime, please feel free to get in touch with me if you’re interested taking this course in the future or would like a customized one for your organization.

thumb_IMG_3744_1024

The VIVES Aeronautics campus in Belgium has a dedicated group focused on UAV courses, training and research in addition to traditional aviation training.

thumb_IMG_3748_1024

Facilities at VIVES include flight simulators, computer labs and labs dedicated to building UAVs.

thumb_IMG_3750_1024

We went through hundreds of pages and at least 400 slides of dedicated training material over the course of the 3 days.

thumb_IMG_3679_1024

We took a direct, hands-on approach from day one of the training. Naturally, we go all the necessary legal permissions to operate UAVs in this area.

thumb_IMG_3688_1024

Introducing participants to fixed-wing and multi-rotor UAVs.

thumb_IMG_3678_1024

Participants learned how the basics on how to operate this fixed-wing UAV.

thumb_IMG_3693_1024

Some fixed-wing UAVs are hand-launched, this one uses a dedicated launcher. We flew this one for about 20 minutes.

thumb_IMG_3700_1024

Multi-rotor UAVs were then introduced and participants were instructed on how to operate this model themselves during the training.

thumb_IMG_3709_1024

So each participant took to the controls under the supervision of certified UAV pilots and got a feel for manual flights.

thumb_IMG_3721_1024

Other multi-rotor UAVs were also introduced along with standard operating procedures related to safety, take-off, flight and landing.

thumb_IMG_3737_1024

Multi-rotors were compared with fixed-wing UAVs and participants asked about which type of asset to use for different humanitarian UAV missions.

thumb_IMG_3732_1024

We then visited a factory dedicated towards the manufacturing of long-range fixed-wing UAVs so participants could learn about airframes and hardware.

thumb_IMG_3743_1024

After half-a-day of outdoor, hands-on training on UAVs, the real-work began.

thumb_IMG_3786_1024

Intensive, back-to-back seminars to provide humanitarian participants with everything they need to know about UAVs, humanitarian applications and also humanitarian UAV missions.

thumb_IMG_3802_1024

From the laws of the skies and reading official air-route maps to understanding airspace classes and regulations.

UAV-Training-600x335

Safety was an overriding theme throughout the 3-day training.

thumb_IMG_3804_1024

Safety training included standard operating procedures for hardware & batteries

thumb_IMG_3792_1024

Participants were also introduced to the principles of flight and aviation.

thumb_IMG_3788_1024

All seminars were highly interactive and also allowed for long question & answer sessions; some of these lasted up to an hour and continued during the breaks.

thumb_IMG_3794_1024

All aspects of UAV technology was introduced and discussed at length, such as First Person View (FPV).

thumb_IMG_3798_1024

Regulations were an important component of the 3-day training.

thumb_IMG_3752_1024

Participants learned how to program UAV flights; they were introduced to the software and provided with an overview of best practices on flight planning.

thumb_IMG_3662_1024

A hands-on introduction to imagery processing and analysis was also provided. Participants were taught how to use dedicated software to process and analyze the aerial imagery captured during the morning outdoor sessions.

thumb_IMG_3760_1024

Participants thus spent time in the dedicated computer lab working with this imagery and creating 3D point clouds, for example.

thumb_IMG_3778_1024

Humanitarian OpenStreetMap, MapBoxMicroMappers were also introduced.

thumb_IMG_3770_1024

The first UAViators & VIVES Class of 2015!

UVAVIATOR-600x400

Humanitarian UAV Missions: Towards Best Practices

UAViatorsLogo

The purpose of the handbook below is to promote the safe, coordinated and effective use of UAVs in a wide range of humanitarian settings. The handbook draws on lessons learned during recent humanitarian UAV missions in Vanuatu (March-April 2015) and Nepal (April-May 2015) as well as earlier UAV missions in both Haiti and the Philippines. The handbook takes the form of an operational checklist divided into Pre-flight, In-flight and Post-flight sections. The best practices documented in each section are meant to serve as a minimum set of guidelines only. As such, this document is not the final word on best practices, which explains why the handbook is available here as an open, editable Google Doc. We invite humanitarian, UAV and research communities to improve this handbook and to keep our collective best practices current by inserting key comments and suggestions directly to the Google Doc. Both hardcopies and digital copies of this handbook are available for free and may not in part or in whole be used for commercial purposes. Click here for more information on the Humanitarian UAV Network.

Assessing Disaster Damage from 3D Point Clouds

Humanitarian and development organizations like the United Nations and the World Bank typically carry out disaster damage and needs assessments following major disasters. The ultimate goal of these assessments is to measure the impact of disasters on the society, economy and environment of the affected country or region. This includes assessing the damage caused to building infrastructure, for example. These assessment surveys are generally carried out in person—that is, on foot and/or by driving around an affected area. This is a very time-consuming process with very variable results in terms of data quality. Can 3D (Point Clouds) derived from very high resolution aerial imagery captured by UAVs accelerate and improve the post-disaster damage assessment process? Yes, but a number of challenges related to methods, data & software need to be overcome first. Solving these challenges will require pro-active cross-disciplinary collaboration.

The following three-tiered scale is often used to classify infrastructure damage: “1) Completely destroyed buildings or those beyond repair; 2) Partially destroyed buildings with a possibility of repair; and 3) Unaffected buildings or those with only minor damage . By locating on a map all dwellings and buildings affected in accordance with the categories noted above, it is easy to visualize the areas hardest hit and thus requiring priority attention from authorities in producing more detailed studies and defining demolition and debris removal requirements” (UN Handbook). As one World Bank colleague confirmed in a recent email, “From the engineering standpoint, there are many definitions of the damage scales, but from years of working with structural engineers, I think the consensus is now to use a three-tier scale – destroyed, heavily damaged, and others (non-visible damage).”

That said, field-based surveys of disaster damage typically overlook damage caused to roofs since on-the-ground surveyors are bound by the laws of gravity. Hence the importance of satellite imagery. At the same time, however, “The primary problem is the vertical perspective of [satellite imagery, which] largely limits the building information to the roofs. This roof information is well suited for the identification of extreme damage states, that is completely destroyed structures or, to a lesser extent, undamaged buildings. However, damage is a complex 3-dimensional phenomenon,” which means that “important damage indicators expressed on building façades, such as cracks or inclined walls, are largely missed, preventing an effective assessment of intermediate damage states” (Fernandez Galaretta et al. 2014).

Screen Shot 2015-04-06 at 10.58.31 AM

This explains why “Oblique imagery [captured from UAVs] has been identified as more useful, though the multi-angle imagery also adds a new dimension of complexity” as we experienced first-hand during the World Bank’s UAV response to Cyclone Pam in Vanuatu (Ibid, 2014). Obtaining photogrammetric data for oblique images is particularly challenging. That is, identifying GPS coordinates for a given house pictured in an oblique photograph is virtually impossible to do automatically with the vast majority of UAV cameras. (Only specialist cameras using gimbal mounted systems can reportedly infer photogrammetric data in oblique aerial imagery, but even then it is unclear how accurate this inferred GPS data is). In any event, oblique data also “lead to challenges resulting from the multi-perspective nature of the data, such as how to create single damage scores when multiple façades are imaged” (Ibid, 2014).

To this end, my colleague Jorge Fernandez Galarreta and I are exploring the use of 3D (point clouds) to assess disaster damage. Multiple software solutions like Pix4D and PhotoScan can already be used to construct detailed point clouds from high-resolution 2D aerial imagery (nadir and oblique). “These exceed standard LiDAR point clouds in terms of detail, especially at façades, and provide a rich geometric environment that favors the identification of more subtle damage features, such as inclined walls, that otherwise would not be visible, and that in combination with detailed façade and roof imagery have not been studied yet” (Ibid, 2014).

Unlike oblique images, point clouds give surveyors a full 3D view of an urban area, allowing them to “fly through” and inspect each building up close and from all angles. One need no longer be physically onsite, nor limited to simply one façade or a strictly field-based view to determine whether a given building is partially damaged. But what does partially damaged even mean when this kind of high resolution 3D data becomes available? Take this recent note from a Bank colleague with 15+ years of experience in disaster damage assessments: “In the [Bank’s] official Post-Disaster Needs Assessment, the classification used is to say that if a building is 40% damaged, it needs to be repaired. In my view this is too vague a description and not much help. When we say 40%, is it the volume of the building we are talking about or the structural components?”

Screen Shot 2015-05-17 at 1.45.50 PM

In their recent study, Fernandez Galaretta et al. used point clouds to generate per-building damage scores based on a 5-tiered classification scale (D1-D5). They chose to compute these damage scores based on the following features: “cracks, holes, intersection of cracks with load-carrying elements and dislocated tiles.” They also selected non-damage related features: “façade, window, column and intact roof.” Their results suggest that the visual assessment of point clouds is very useful to identify the following disaster damage features: total collapse, collapsed roof, rubble piles, inclined façades and more subtle damage signatures that are difficult to recognize in more traditional BDA [Building Damage Assessment] approaches. The authors were thus able to compute a per building damage score, taking into account both “the overall structure of the building,” and the “aggregated information collected from each of the façades and roofs of the building to provide an individual per-building damage score.”

Fernandez Galaretta et al. also explore the possibility of automating this damage assessment process based on point clouds. Their conclusion: “More research is needed to extract automatically damage features from point clouds, combine those with spectral and pattern indicators of damage, and to couple this with engineering understanding of the significance of connected or occluded damage indictors for the overall structural integrity of a building.” That said, the authors note that this approach would “still suffer from the subjectivity that characterizes expert-based image analysis.”

Hence my interest in using crowdsourcing to analyze point clouds for disaster damage. Naturally, crowdsourcing alone will not eliminate subjectivity. In fact, having more people analyze point clouds may yield all kinds of disparate results. This is explains why a detailed and customized imagery interpretation guide is necessary; like this one, which was just released by my colleagues at the Harvard Humanitarian Initiative (HHI). This also explains why crowdsourcing platforms require quality-control mechanisms. One easy technique is triangulation: have ten different volunteers look at each point cloud and tag features in said cloud that show cracks, holes, intersection of cracks with load-carrying elements and dislocated tiles. Surely more eyes are better than two for tasks that require a good eye for detail.

Screen Shot 2015-05-17 at 1.49.59 PM

Next, identify which features have the most tags—this is the triangulation process. For example, if one area of a point cloud is tagged as a “crack” by 8 or more volunteers, chances are there really is a crack there. One can then count the total number of distinct areas tagged as cracks by 8 or more volunteers across the point cloud to calculate the total number of cracks per façade. Do the same with the other metrics (holes, dislocated titles, etc.), and you can compute a per building damage score based on overall consensus derived from hundreds of crowdsourced tags. Note that “tags’ can also be lines or polygons; meaning that individual cracks could be traced by volunteers, thus providing information on the approximate lengths/size of a crack. This variable could also be factored in the overall per-building damage score.

In sum, crowdsourcing could potentially overcome some of the data quality issues that have already marked field-based damage assessment surveys. In addition, crowdsourcing could potentially speed up the data analysis since professional imagery and GIS analysts tend to already be hugely busy in the aftermath of major disasters. Adding more data to their plate won’t help anyone. Crowdsourcing the analysis of 3D point clouds may thus be our best bet.

So why hasn’t this all been done yet? For several reasons. For one, creating very high-resolution point clouds requires more pictures and thus more UAV flights, which can be time consuming. Second, processing aerial imagery to construct point clouds can also take some time. Third, handling, sharing and hosting point clouds can be challenging given how large those files quickly get. Fourth, no software platform currently exists to crowdsource the annotation of point clouds as described above (particularly when it comes to the automated quality control mechanisms that are necessary to ensure data quality). Fifth, we need more robust imagery interpretation guides. Sixth, groups like the UN and the World Bank are still largely thinking in 2D rather than 3D. And those few who are considering 3D tend to approach this from a data visualization angle rather than using human and machine computing to analyze 3D data. Seventh, this area, point cloud analysis for 3D feature detection, is still a very new area of research. Many of the methodology questions that need answers have yet to be answered, which is why my team and I at QCRI are starting to explore this area from the perspective of computer vision and machine learning.

The holy grail? Combining crowdsourcing with machine learning for real-time feature detection of disaster damage in 3D point clouds rendered in real-time via airborne UAVs surveying a disaster site. So what is it going to take to get there? Well, first of all, UAVs are becoming more sophisticated; they’re flying faster and for longer and will increasingly be working in swarms. (In addition, many of the new micro-UAVs come with a “follow me” function, which could enable the easy and rapid collection of aerial imagery during field assessments). So the first challenge described above is temporary as are the second and third challenges since computer processing power is increasing, not decreasing, over time.

This leaves us with the software challenge and imagery guides. I’m already collaborate with HHI on the latter. As for the former, I’ve spoken with a number of colleagues to explore possible software solutions to crowdsource the tagging of point clouds. One idea is simply to extend MicroMappers. Another is to add simple annotation features to PLAS.io and PointCloudViz since these platforms are already designed to visualize and interact with point clouds. A third option is to use a 3D model platform like SketchFab, which already enables annotations. (Many thanks to colleague Matthew Schroyer for pointing me to SketchFab last week). I’ve since had a long call with SketchFab and am excited by the prospects of using this platform for simple point cloud annotation.

In fact, Matthew already used SketcFab to annotate a 3D model of Durbar Square neighborhood in downtown Kathmandu post-earthquake. He found an aerial video of the area, took multiple screenshots of this video, created a point cloud from these and then generated a 3D model which he annotated within SketchFab. This model, pictured below, would have been much higher resolution if he had the original footage or 2D images. Click pictures to enlarge.

3D Model 1 Nepal

3D Model 2 Nepal

3D Model 3 Nepal

3D Model 4 Nepal

Here’s a short video with all the annotations in the 3D model:

And here’s the link to the “live” 3D model. And to drive home the point that this 3D model could be far higher resolution if the underlying imagery had been directly accessible to Matthew, check out this other SketchFab model below, which you can also access in full here.

Screen Shot 2015-05-16 at 9.35.20 AM

Screen Shot 2015-05-16 at 9.35.41 AM

Screen Shot 2015-05-16 at 9.37.33 AM

The SketchFab team has kindly given me a SketchFab account that allows up to 50 annotations per 3D model. So I’ll be uploading a number of point clouds from Vanuatu (post Cyclone Pam) and Nepal (post earthquakes) to explore the usability of SketchFab for crowdsourced disaster damage assessments. In the meantime, one could simply tag-and-number all major features in a point cloud, create a Google Form, and ask digital volunteers to rate the level of damage near each numbered tag. Not a perfect solution, but one that works. Ultimately, we’d need users to annotate point clouds by tracing 3D polygons if we wanted a more easy way to use the resulting data for automated machine learning purposes.

In any event, if readers do have any suggestions on other software platforms, methodologies, studies worth reading, etc., feel free to get in touch via the comments section below or by email, thank you. In the meantime, many thanks to colleagues Jorge, Matthew, Ferda & Ji (QCRI), Salvador (PointCloudViz), Howard (PLAS.io) and Corentin (SketchFab) for the time they’ve kindly spent brainstorming the above issues with me.

Humanitarian UAV Missions in Nepal: Early Observations (Updated)

Public request from the United Nations (UN) Office for the Coordination of Humanitarian Affairs (OCHA) posted on April 28, 2015:

“OCHA would prefer that all the UAV operators coordinate their efforts. With UAViators (Humanitarian UAV Network) in place, OCHA suggest that they all connect to UAViators and share their activities so everyone knows what is being worked on. Please make sure all UAV teams register at the RDC (Reception and Departure Center) at the airport.” 

Note: UAViators does not self-deploy but rather responds to requests from established humanitarian organizations.


There are at the very least 15 humanitarian UAV teams operating in Nepal. We know this since these teams voluntarily chose to liaise with the Humanitarian UAV Network (UAViators). In this respect, the current humanitarian UAV response is far better coordinated than the one I witnessed in the Philippines right after Typhoon Haiyan in 2013. In fact, there was little to no coordination at the time amongst the multiple civilian UAV teams; let alone between these teams and humanitarian organizations, or the Filipino government for that matter. This lack of coordination coupled with the fact that I could not find any existing “Code of Conduct” for the use of UAVs in humanitarian settings is actually what prompted me to launch UAViators just months after leaving the Philippines.

DCIM100MEDIA

The past few days have made it clear that we still have a long way to go in the humanitarian UAV space. Below are some early observations (not to be taken as criticisms but early reflections only). UAV technology is highly disruptive and is only now starting to have visible impact (both good and bad) in humanitarian contexts. We don’t have all the answers; the institutions are not keeping up with the rapid pace of innovation, nor are the regulators. The challenges below cut across technical, organizational, regulatory challenges that are only growing more complex. So I welcome your constructive input on how to improve these efforts moving forward.

  • Yes, we now have a Code of Conduct which was drafted by several humanitarian professionals, UAV pilots & experts and academics. However, this doesn’t mean that every civilian UAV pilot in Nepal has taken the time to read this document let alone knows that this document exists. As such, most UAV pilots may not even realize that they require legal permission from the government in order to operate or that they should carry some form of insurance. Even professional pilots may not think to inform the local police that they have formal authorization to operate; or know how to communicate with Air Traffic Control or with the military for flight permissions. UAViators can’t force anyone in Nepal to comply with national regulations or the Code. The Network can only encourage UAV pilots to follow best practices. The majority of the problems vis-a-vis the use of UAVs in Nepal would have been avoided had the majority of UAV users followed the Humanitarian UAV Code of Conduct.
  • Yes, more countries have instituted UAV regulations. Some of these tend to be highly restrictive, equating 700-gram micro-UAVs with 50-kilo UAVs. Some apply the same sets of laws for the use of UAVs for amateur movie productions as for the professional use of UAVs for Search & Rescue. In any event, there are no (clear) regulations in Nepal as per research and phone calls made by the Humanitarian UAV Network (see also the UAViators Laws/Travel Wiki). To this end, UAViators has provided contact info to Nepal’s Civil Aviation Authority and Chief of Police. Update: All humanitarian UAV Teams are now required to obtain permission from the Ministry of Home Affairs to operate UAVs in Nepal. Once permission is granted, individual flight plants must be approved by the Nepal Army (via UNDAC). More info here (see May 8 Update). It has taken almost two weeks to get the above process in place. Clearly, without a strong backing or leadership from an established humanitarian group that is able and willing to mediate with appropriate Ministries and Civil Aviation authorities, there is only so much that UAViators can do to support the above process.
  • Yes, we now have all 15 UAV teams on one single dedicated email thread. And yes, UAViators has been able to vet many teams while keeping amateur UAV pilots on standby if the latter have less than 50 hours of flight experience. Incidentally, requests for imagery can be made here. That said, what about all the other civilian UAV pilots operating independently? These other pilots, some of them reporters and disaster junkies, have already undermined the use of UAVs for humanitarian efforts. Indeed, it was reported that “The Nepali Government became very irritated with reporters collecting disaster adventure footage using drones.” This has prompted the government to ban UAV flights with the exception of flights carried out for humanitarian purposes. The latter still require permission from the Ministry of Home Affairs. The problem with so-called “drone journalists” is not simply a safety issue, which is obviously the number one priority of a humanitarian UAV mission. Fact is, there are far more requests for aerial imagery than can be met with just 10 UAV teams on site. So coordination and data sharing is key—even with drone journalists if the latter are prepared to be a part of the solution by liaising with UAViators and following the Code of Conduct. Furthermore, local communities have already expressed anger at the fact that drone & humanitarian journalists have “have visited the same sites with no plans to share data, make the imagery publicly available, or to make an effort to communicate to villages why the flights are important and how the information will be used to assist in relief efforts.”
  • Yes, we have workflows in place for the UAV teams to share their imagery, and some already have. Alas, limited Internet bandwidth is significantly slowing down the pace of data sharing. Some UAV teams have not (yet) expressed an interest in sharing their imagery. Some have not provided information about where they’re flying. Of course, they are incredibly busy. And besides, they are not required to share any data or information. The best UAViators can do is simply to outline the added value of sharing this imagery & their flight plans. And without strong public backing from established humanitarian groups, there is little else the Network can do. Update: several UAV teams are now only sharing imagery with local and national authorities. If the UN and others want this imagery, they need to go through Nepali authorities.
  • Yes, UAViators is indeed in touch with a number of humanitarian organizations who would like aerial imagery for specific areas, however these groups are unable (or not yet willing) to make these requests public or formal until they better understand the risks (legal, political and operational), the extent of the value-added (they want to see the imagery first), the experience and reliability of the UAV teams, etc. They are also weary of having UAV teams take requests for imagery as carte blanche to say they are operating on their behalf. At the same time, these humanitarian organizations do not have the resources (or time) to provide any coordination support between the Humanitarian UAV Network, appropriate government ministries and Nepal’s Civil Aviation Authority.
  • Yes, we have a dedicated UAViators site for Nepal updated multiple times a day. Unfortunately, most UAV Teams are having difficulty accessing this site from Nepal due to continuing Internet connectivity issues. This is also true of the dedicated UAViators Google Spreadsheet being used to facilitate the coordination of UAV operations. This online resource includes each team’s contact info, UAV assets, requests for aerial imagery, data needs, etc. We’re now sharing this information via basic text within the body of emails; but this also contributes to email overload. Incidentally, the UAVs being used by the 7 Teams in Nepal are small UAVs such as DJI’s Phantom and Inspire and Aeryon SkyRangers and eBees for example.
  • Yes, we have set up a UAV-Flights-Twitter map for Nepal (big thanks to colleagues at LinkedIn) to increase the transparency of where and when UAVs are being flown across the country. Alas, none of the UAV teams have made use of this solution yet even though most are tweeting from the field. This service allows UAV teams to send a simple tweet about their next UAV flight which then gets mapped automatically. If not used in Nepal, perhaps this service will be used in the future & combined with SMS/WhatsApp.
  • Yes, UAViators is connected with the Digital Humanitarian Network (DHN); specifically Humanitarian OpenStreetMap (HOT) and the Standby Task Force (SBTF), with the latter ready to deploy QCRI’s MicroMappers platform for the analysis of oblique imagery. Yet we’re still not sure how best to combine the results of nadir imagery and oblique imagery analysis to add value. Every point on a nadir (vertical) image has a GPS coordinate; but this is not true of obliques (photos taken at an angle). The GPS data for oblique photographs is simply the GPS coordinates for the position of the camera at the time the oblique image was taken. (Specialist gimbal mounted cameras can provide GPS info for objects in oblique photographs, but these are not in use in Nepal).
  • Yes, UAViators has access to a local physical office in Kathmandu. Thanks to the kind offer from Kathmandu Living Labs (KLL), UAV pilots can meet and co-work at KLL. However, even finding a time for all the UAV teams to meet at this office has proven impossible. And yet this is so crucial; there are good reasons why humanitarians have Cluster meetings.
  • Yes, 3D models (Point Clouds) of disaster areas can add insights to disaster damage assessments. That said, these are often huge files and thus particularly challenging to upload. And when these do get posted on-line, what is the best way to have them analyzed? GIS experts and other professionals tend to be completely swamped during disasters. But even if a team were available, what methods & software should they be using to assess and indeed quantify the level of damage in each 3D model? Can this assessment be crowdsourced? And how can the results of 3D analysis be added to other datasets and official humanitarian information products?
  • Yes, the majority of UAV teams that have chosen to liaise with the Humanitarian UAV Network are now in Nepal, yet it took a while for some teams to get on site and there were delays with their UAV assets getting into the country. This points to the need for building local capacity within Nepal and other disaster-prone countries so that local organizations can rapidly deploy UAVs and analyze the resulting imagery themselves after major disasters. This explains why my colleague Nama Budhathoki (at KLL) and I have been looking to set up Kathmandu Flying Labs (basically a Humanitarian UAV Innovation Lab) for literally a year now. In any event, thanks to LinkedIn for Good, we were able to identify some local UAV pilots and students right after the earthquake; some of whom have since been paired with the international UAV teams. Building the capacity of local teams is also important because of the local knowledge and local contacts (and potentially the legal permissions) that these teams will already have.

https://vimeo.com/126676918

So where do we go from here? Despite the above challenges, there is a lot more coordination and structure to the UAV response in Nepal than there was following Typhoon Haiyan in 2013. Then again, the challenges that come with UAV operations in disaster situations are only going to increase as more UAV teams deploy in future crises alongside members of the public, drone journalists, military UAVs, etc. At some point, hopefully sooner (before accidents and major mistakes happen) rather than later, an established humanitarian organization will take on the responsibility of mediating between UAV teams, UAViators, the government, civil aviation officials, military and other aid groups.

What we may need is something along the lines of what GSMA’s Disaster Response Program has done for Mobile Network Operators (MNOs) and the humanitarian community. GSMA has done a lot since the 2010 Haiti Earthquake to bridge MNOs and humanitarians, acting as convener, developing standard operating procedures, ethical guidelines, a global model agreement, etc. Another suggestion floated by a humanitarian colleague is the INSARAG Secretariat, which classifies and also categorizes Search and Rescue teams. Each teams has to “sign onto agreed guidelines (behavior, coordination, markings, etc). So, when the first one arrives, they know to setup a reception space; they all know that there will be coordination meetings, etc.” Perhaps INSARAG could serve as a model for UAViators 2.0. Update: UNDAC is now serving as liaison for UAV flights, which will likely set a precedence for future humanitarian UAV missions.

Coordination is never easy. And leveraging a new, disruptive technology for disaster response is also a major challenge. I, for one, am ready and want to take on these new challenges, but do I need a willing and able partner in the humanitarian community to take on these challenges with me and others. The added value of timely, very high-resolution aerial data during disaster is significant for disaster response, not to mention the use of UAVs for payload transportation and the provision of communication services via UAV. The World Humanitarian Summit (WHS) is coming up next year. Will we unveil a solution to the above challenges at this pivotal Summit or will we continue dragging our feet and forgo the humanitarian innovation opportunities that are right on front of our eyes in Nepal?

In the meantime, I want to thank and acknowledge the following UAV Teams for liaising with the Humanitarian UAV Network: Team RubiconSkyCatch, Halo Drop, GlobalMedic, Medair, Deploy Media and Paul Borrud. Almost all teams have already been able to share aerial imagery. If other responders on the ground are able to support these efforts in any way, e.g., CISCO providing better Internet connectivity, or if you know of other UAV groups that are moving faster and able to provide guidance, for example, then please do get in touch.

A Force for Good: How Digital Jedis are Responding to the Nepal Earthquake (Updated)

Digital Humanitarians are responding in full force to the devastating earthquake that struck Nepal. Information sharing and coordination is taking place online via CrisisMappers and on multiple dedicated Skype chats. The Standby Task Force (SBTF), Humanitarian OpenStreetMap (HOT) and others from the Digital Humanitarian Network (DHN) have also deployed in response to the tragedy. This blog post provides a quick summary of some of these digital humanitarian efforts along with what’s coming in terms of new deployments.

Update: A list of Crisis Maps for Nepal is available below.

Credit: http://www.thestar.com/content/dam/thestar/uploads/2015/4/26/nepal2.jpg

At the request of the UN Office for the Coordination of Humanitarian Affairs (OCHA), the SBTF is using QCRI’s MicroMappers platform to crowdsource the analysis of tweets and mainstream media (the latter via GDELT) to rapidly 1) assess disaster damage & needs; and 2) Identify where humanitarian groups are deploying (3W’s). The MicroMappers CrisisMaps are already live and publicly available below (simply click on the maps to open live version). Both Crisis Maps are being updated hourly (at times every 15 minutes). Note that MicroMappers also uses both crowdsourcing and Artificial Intelligence (AIDR).

Update: More than 1,200 Digital Jedis have used MicroMappers to sift through a staggering 35,000 images and 7,000 tweets! This has so far resulted in 300+ relevant pictures of disaster damage displayed on the Image Crisis Map and over 100 relevant disaster tweets on the Tweet Crisis Map.

Live CrisisMap of pictures from both Twitter and Mainstream Media showing disaster damage:

MM Nepal Earthquake ImageMap

Live CrisisMap of Urgent Needs, Damage and Response Efforts posted on Twitter:

MM Nepal Earthquake TweetMap

Note: the outstanding Kathmandu Living Labs (KLL) team have also launched an Ushahidi Crisis Map in collaboration with the Nepal Red Cross. We’ve already invited invited KLL to take all of the MicroMappers data and add it to their crisis map. Supporting local efforts is absolutely key.

WP_aerial_image_nepal

The Humanitarian UAV Network (UAViators) has also been activated to identify, mobilize and coordinate UAV assets & teams. Several professional UAV teams are already on their way to Kathmandu. The UAV pilots will be producing high resolution nadir imagery, oblique imagery and 3D point clouds. UAViators will be pushing this imagery to both HOT and MicroMappers for rapid crowdsourced analysis (just like was done with the aerial imagery from Vanuatu post Cyclone Pam, more on that here). A leading UAV manufacturer is also donating several UAVs to UAViators for use in Nepal. These UAVs will be sent to KLL to support their efforts. In the meantime, DigitalGlobePlanet Labs and SkyBox are each sharing their satellite imagery with CrisisMappers, HOT and others in the Digital Humanitarian Network.

There are several other efforts going on, so the above is certainly not a complete list but simply reflect those digital humanitarian efforts that I am involved in or most familiar with. If you know of other major efforts, then please feel free to post them in the comments section. Thank you. More on the state of the art in digital humanitarian action in my new book, Digital Humanitarians.


List of Nepal Crisis Maps

Please add to the list below by posting new links in this Google Spreadsheet. Also, someone should really create 1 map that pulls from each of the listed maps.

Code for Nepal Casualty Crisis Map:
http://bit.ly/1IpUi1f 

DigitalGlobe Crowdsourced Damage Assessment Map:
http://goo.gl/bGyHTC

Disaster OpenRouteService Map for Nepal:
http://www.openrouteservice.org/disaster-nepal

ESRI Damage Assessment Map:
http://arcg.is/1HVNNEm

Harvard WorldMap Tweets of Nepal:
http://worldmap.harvard.edu/maps/nepalquake 

Humanitarian OpenStreetMap Nepal:
http://www.openstreetmap.org/relation/184633

Kathmandu Living Labs Crowdsourced Crisis Map: http://www.kathmandulivinglabs.org/earthquake

MicroMappers Disaster Image Map of Damage:
http://maps.micromappers.org/2015/nepal/images/#close

MicroMappers Disaster Damage Tweet Map of Needs:
http://maps.micromappers.org/2015/nepal/tweets

NepalQuake Status Map:
http://www.nepalquake.org/status-map

UAViators Crisis Map of Damage from Aerial Pics/Vids:
http://uaviators.org/map (takes a while to load)

Visions SDSU Tweet Crisis Map of Nepal:
http://vision.sdsu.edu/ec2/geoviewer/nepal-kathmandu#

How Digital Jedis Are Springing to Action In Response To Cyclone Pam

Digital Humanitarians sprung to action just hours after the Category 5 Cyclone collided with Vanuatu’s many islands. This first deployment focused on rapidly assessing the damage by analyzing multimedia content posted on social media and in the mainstream news. This request came directly from the United Nations (OCHA), which activated the Digital Humanitarian Network (DHN) to carry out the rapid damage assessment. So the Standby Task Force (SBTF), a founding member of the DHN, used QCRI′s MicroMappers platform to produce a digital, interactive Crisis Map of some 1,000+ geo-tagged pictures of disaster damage (screenshot below).

MM_ImageMap_Vanuatu

Within days of Cyclone Pam making landfall, the World Bank (WB) activated the Humanitarian UAV Network (UAViators) to quickly deploy UAV pilots to the affected islands. UAViators has access to a global network of 700+ professional UAV pilots is some 70+ countries worldwide. The WB identified two UAV teams from the Humanitarian UAV Network and deployed them to capture very high-resolution aerial photographs of the damage to support the Government’s post-disaster damage assessment efforts. Pictures from these early UAV missions are available here. Aerial images & videos of the disaster damage were also posted to the UAViators Crowdsourced Crisis Map.

Last week, the World Bank activated the DHN (for the first time ever) to help analyze the many, many GigaBytes of aerial imagery from Vanuatu. So Digital Jedis from the DHN are now using Humanitarian OpenStreetMap (HOT) and MicroMappers (MM) to crowdsource the search for partially damaged and fully destroyed houses in the aerial imagery. The OSM team is specifically looking at the “nadir imagery” captured by the UAVs while MM is exclusively reviewing the “oblique imagery“. More specifically, digital volunteers are using MM to trace destroyed houses red, partially damaged houses orange, and using blue to denote houses that appear to have little to no damage. Below is an early screenshot of the Aerial Crisis Map for the island of Efate. The live Crisis Map is available here.

Screen Shot 2015-04-06 at 10.56.09 AM

Clicking on one of these markers will open up the high resolution aerial pictures taken at that location. Here, two houses are traced in blue (little to no damage) and two on the upper left are traced in orange (partial damage expected).

Screen Shot 2015-04-06 at 10.57.17 AM

The cameras on the UAVs captured the aerial imagery in very high resolution, as you can see from the close up below. You’ll note two traces for the house. These two traces were done by two independent volunteers (for the purposes of quality control). In fact, each aerial image is shown to at least 3 different Digital Jedis.

Screen Shot 2015-04-06 at 10.58.31 AM

Once this MicroMappers deployment is over, we’ll be using the resulting traces to create automated featured detection algorithms; just like we did here for the MicroMappers Namibia deployment. This approach, combining crowdsourcing with Artificial Intelligence (AI), is explored in more detail here vis-a-vis disaster response. The purpose of taking this hybrid human-machine computing solution is to accelerate (semi-automate) future damage assessment efforts.

Meanwhile, back in Vanuatu, the HOT team has already carried out some tentative, preliminary analysis of the damage based on the aerial imagery provided. They are also up-dating their OSM maps of the affected islands thanks this imagery. Below is an initial damage assessment carried out by HOT for demonstration purposes only. Please visit their deployment page on the Vanuatu response for more information.

2015-04-04_18h04_00

So what’s next? Combining both the nadir and oblique imagery to interpret disaster damage is ultimately what is needed, so we’re actually hoping to make this happen (today) by displaying the nadir imagery directly within the Aerial Crisis Map produced by MicroMappers. (Many thanks to the MapBox team for their assistance on this). We hope this integration will help HOT and our World Bank partners better assess the disaster damage. This is the first time that we as a group are doing anything like this, so obviously lots of learning going on, which should improve future deployments. Ultimately, we’ll need to create 3D models (point clouds) of disaster affected areas (already easy to do with high-resolution aerial imagery) and then simply use MicroMappers to crowdsource the analysis of these 3D models.

And here’s a 3D model of a village in Vanuatu constructed using 2D aerial photos taken by UAV:

For now, though, Digital Jedis will continue working very closely with the World Bank to ensure that the latter have the results they need in the right format to deliver a comprehensive damage assessment to the Government of Vanuatu by the end of the week. In the meantime, if you’re interested in learning more about digital humanitarian action, then please check out my new book, which features UAViators, HOT, MM and lots more.