My colleague Dr. Imes Chiu recently co-authored this report (PDF) on his team’s use of expendable UAVs following Typhoon Haiyan (known as Typhoon Yolanda in the Philippines). Imes is Chief of Applied Research at the Center for Excellence in Disaster Management and Humanitarian Assistance (COE-DMHA) based in Honolulu, Hawaii.
Highlights of the report:
“The interdisciplinary […] team concluded that during the rapid response phase of disaster management, aerial imagery of damaged areas proved more useful than a detailed needs-assessment.”
“Imagery provided by civil drones enabled local government units to immediately and accurately assess the extent of the damage in their jurisdictions, even when operating with a significantly reduced staff.”
“What they [relief workers] actually need at this point is to get an accurate understanding and a very detailed picture at the village level, at the camp level, as to what exactly is going on.”
“During Haiyan recovery operations, civil drones were quickly adopted as routine operating procedures for many humanitarian groups. Overcoming the logistical challenges posed by massive debris in Tacloban, civil drones provided many NGOs much needed situational awareness at a time when needs-assessment teams did not have access to the disaster area.”
“Initially used to pinpoint potential base camp locations for aid workers, many NGOs began adapted the use of civil drones to inform their relief, rescue and recovery operations from aerial views of infrastructure devastation, road and power line damages, emergency areas and relief distribution networks. Civil drones also helped ensure the safety of aid workers through regular information feeds of their movements in the affected areas.”
“The biggest challenge […] was determining a launch & recovery site sufficient for a fixed-wing xUAV, so the team used a multi-rotor helicopter drone that is vertically launched and recovered. Imagery from both video and still photography informed the acquisition team where to launch and recover the larger fixed-wing unit.”
“Even though this UAV subclass is termed ‘expendable,’ it does not mean the team intentionally or willingly ‘expends’ them, rather it means that the cost is so low and accessibility so high that the drones can be readily replace in case of loss—therefore users are not inhibited by the cost & loss factors.”
“A significant benefit of the xUAV is as an asset that could be locally employed and managed. They do not require a centralized command system; they are ‘locally modifiable’ so changes to the system can easily be done to meet community needs. These expendable systems by nature are small, inexpensive and not transportation limited. Unlike larger systems, xUAV could easily be hand carried to remote locations. The components are derived from everyday consumer technology backed by a large network of web-based support systems, often set-up by the academic community.”
“The team’s first effort started from a fixed-wing xUAV that covered an area of approximately 1.5 square kilometers at an altitude of 150 meters. The total flight time was approximately 30 minutes. The imagery acquired rendered a final mosaic at eight centimeter per pixel. The current xUAV configuration can fly and capture imagery for approximately an hour.”
“The xUAV platform used to generate the Tacloban mosaic imagery consisted of widely available parts that can be purchased for approximately $1,000. This is significantly cheaper than the more expensive commercial ‘turnkey’ systems.”
My colleague Martino Pesaresi from the European Community’s Joint Research Center (JRC) recently shared one of his co-authored studies with me on the use of advanced computing to analyze UAV (aerial) imagery. Given the rather technical nature of the title, “Rubble Detection from VHR Aerial Imagery Data Using Differential Morphological Profiles,” it is unlikely that many of my humanitarian colleagues have read the study. But the results have important implications for the development of next generation humanitarian technologies that focus on very high resolution (VHR) aerial imagery captured by UAVs.
As Martino and his co-authors note, “The presence of rubble in urban areas can be used as an indicator of building quality, poverty level, commercial activity, and others. In the case of armed conflict or natural disasters, rubble is seen as the trace of the event on the affected area. The amount of rubble and its density are two important attributes for measuring the severity of the event, in contribution to the overall crisis assessment. In the post-disaster time scale, accurate mapping of rubble in relation to the building type and location is of critical importance in allocating response teams and relief resources immediately after event. In the longer run, this information is used for post-disaster needs assessment, recovery planning and other relief activities on the affected region.”
Martino and team therefore developed an “automated method for the rapid detection and quantification of rubble from very high resolution aerial imagery of urban regions.” The first step in this model is to transfer the information depicted in images to “some hierarchical representation structure for indexing and fast component retrieval.” This simply means that aerial images need to be converted into a format that will make them “readable” by a computer. One way to do this is by converting said images into Max-Trees like the one below (which I find rather poetic).
The conversion of aerial images into Max Trees enables Martino and company to analyze and compare as many images as they’d like to identify which combination of nodes and branches represent rubble. This pattern enables the team to subsequently use advanced statistical techniques to identify the rest of the rubble in the remaining aerial images, as shown below. The heat maps on the right depict the result of the analysis, with the red shapes denoting areas that have a high probability of being rubble.
The detection success rate of Martino et al.’s automated rubble detector was about 92%, “suggesting that the method in its simplest form is sufficiently reliable for rapid damage assessment.” The full study is available here and also appears in my forthcoming book “Digital Humanitarians: How Big Data Changes the Face of Disaster Response.”
I recently joined my fellow National Geographic Emergency Explorer colleague Shah Selbe on his first expedition of SoarOcean, which seeks to leverage low-cost UAVs for Ocean protection. Why did I participate in an expedition that seemingly had nothing to do with humanitarian response? Because the conservation space is well ahead of the humanitarian sector when it comes to using UAVs. To this end, we have a lot to learn from colleagues like Shah and others outside our field. The video below explains this further & provides a great overview of SoarOcean.
And here’s my short amateur aerial video from the expedition:
My goal, by the end of the year, is to join two more expeditions led by members of the Humanitarian UAV Network Advisory Board. Hopefully one of these will be with Drone Adventures (especially now that I’ve been invited to volunteer as “Drone Adventures Ambassador”, possibly the coolest title I will ever have). I’m also hoping to join my colleague Steve from the ShadowView Foundation in one of his team’s future expeditions. His Foundation has extensive experience in the use of UAVs for anti-poaching and wildlife conservation.
In sum, I learned heaps during Shah’s SoarOcean expedition; there’s just no substitute for hands-on learning and onsite tinkering. So I really hope I can join Drone Adventures and ShadowView later this year. In the meantime, big thanks to Shah and his awesome team for a great weekend of flying and learning.
Note: The Planetary Response Network was formerly called Zoomanitarians
The Planetary Response Network (PRN) has been in the works for well over a year, so we’re excited to be going fully public for the first time. PRN a joint initiative between Zooniverse (Brook Simmons), Planet Labs (Alex Bakir) and myself at QCRI. The purpose of Zoomanitarians is to accelerate disaster damage assessments by leveraging Planet Labs’ unique constellation of 28 satellites and Zooniverse’s highly scalable microtasking platform. As I noted in this earlier post, digital volunteers from Zooniverse tagged well over 2 million satellite images (of Mars, below) in just 48 hours. So why not invite Zooniverse volunteers to tag millions of images taken by Planet Labs following major disasters (on Earth) to help humanitarians accelerate their damage assessments?
That was the question I posed to Brooke and Alex in early 2013. “Why not indeed?” was our collective answer. So we reached out to several knowledgeable colleagues of mine including Kate Chapman from Humanitarian OpenStreetMap and Lars Bromley from UNOSAT for their feedback and guidance on the idea.
We’ll be able to launch our first pilot project later this year thanks to Kate who kindly provided us with very high-resolution UAV/aerial imagery of downtown Tacloban in the Philippines. Why do we want said imagery when the plan is to use Planet Labs imagery? Because Planet Labs imagery is currently available at 3-5 meter resolution so we’ll be “degrading” the resolution of the aerial imagery to determine just what level and type of damage can be captured at various resolutions as compared to the imagery from Planet Labs. The pilot project will therefore serve to (1) customize and test The Planetary Response Network’s microtasking platform and (2) determine what level of detail can be captured at various resolutions.
We’ll then spend the remainder of the year improving the platform based on the results of the pilot project during which time I will continue to seek input from humanitarian colleagues. Zooniverse’s microtasking platform has already been stress-tested extensively over the years, which is one reason why I approached Zooniverse last year. The other reason is that they have over 1 million digital volunteers on their list-serve. Couple this with Planet Labs’ unique constellation of 28 satellites, and you’ve got the potential for near real-time satellite imagery analysis for disaster response. Our plan is to produce “heat maps” based on the results and to share shape files as well for overlay on other maps.
It took imagery analysts well over 48 hours to acquire and analyze satellite imagery following Typhoon Yolanda. While Planet Labs imagery is not (yet) available at high-resolutions, our hope is that PRN will be able to acquire and analyze relevant imagery within 12-24 hours of a request. Several colleagues have confirmed to me that the results of this rapid analysis will also prove invaluable for subsequent, higher-resolution satellite imagery acquisition and analysis. On a related note, I hope that our rapid satellite-based damage assessments will also serve as a triangulation mechanism (ground-truthing) for the rapid social-media-driven damage assessments carried out using the Artificial Intelligence for Disaster Response (AIDR) platform & MicroMappers.
While much work certainly remains, and while The Planetary Response Network is still in the early phases of research and development, I’m nevertheless excited and optimistic about the potential impact—as are my colleagues Brooke and Alex. We’ll be announcing the date of the pilot later this summer, so stay tuned for updates!
The purpose of the Humanitarian UAV Network (UAViators) is to guide the responsible and safe use of small UAVs in humanitarian settings while promoting information sharing and enlightened policymaking. As I’ve noted in the past, UAVs are already being used to support a range of humanitarian efforts. So the question is not if, but rather how to facilitate the inevitable expanded use of UAVs in a responsible and safe manner. This is just one of many challenging questions that UAViators was created to manage.
UAViators has already drafted a number of documents, including a Code of Conduct and an Operational Check-List for the use of UAVs in humanitarian settings. These documents will continue to be improved throughout the year, so don’t expect a final and perfect version tomorrow. This space is still too new to have all the answers in a first draft. So our community will aim to improve these documents over time. By the end of 2014, we hope to have a solid version of the of Code of Conduct for organizations and companies to publicly endorse.
In the meantime, my three Research Assistants (RA’s) and I are working on (the first ever?) comprehensive evaluation of 1) Small UAVs; 2) Cameras; 3) Payload Units; and 4) Imagery Software specifically for humanitarian field-workers. The purpose of this evaluation is to rate which technologies are best suited to the needs of humanitarians in the field. We will carry out this research through interviews with seasoned UAV experts coupled with secondary, online research. Our aim is to recommend 2-3 small UAVs, cameras, payload units and software solutions for imagery processing and analysis that make the most sense for humanitarians as end users. These suggestions will then be “peer reviewed” by members of the Humanitarian UAV Network.
Following this evaluation, my three RA’s and I will create a detailed end-to-end operational model for the use of UAVs in humanitarian settings. The model will include pre-flight guidance on several key issues including legislation, insurance, safety and coordination. The pre-flight section will also include guidance on how to program the flight-path of the UAVs recommended in the evaluation. But the model does not end with the safe landing of a UAV. The operational model will include post-flight guidance on imagery processing and analysis for decision support as well as guidelines on information sharing with local communities. Once completed, this operational model will also be “peer reviewed” by members of the UAViators.
Both deliverables—the evaluation and model—will be further reviewed by the Advisory Board of UAViators and by field-based humanitarians. We hope to have this review completed during the Humanitarian UAV Experts Meeting, which I am co-organizing with OCHA in New York this November. Feedback from this session will be integrated into both deliverables.
Our plan is to subsequently convert these documents into training materials for both online and onsite training. We have thus far identified two sites for this training, one in Southeast Asia and the other in southern Africa. We’re considering a potential third site in South America depending on the availability of funding. These trainings will enable us to further improve our materials and to provide minimum level certification to humanitarians participating in said trainings. To this end, our long-term strategy for the Humanitarian UAV Network is not only to facilitate the coordination of small UAVs in humanitarian settings but also to provide both training and certification in collaboration with multiple humanitarian organizations.
I recognize that the above is highly ambitious. But all the signals I’m getting from humanitarian organizations clearly demonstrate that the above is needed. So if you have some expertise in this space and wish to join my Research Assistants and I in this applied and policy-focused research, then please do get in touch. In addition, if your organization or company is interested in funding any of the above, then do get in touch as well. We have the initial funding for the first phase of the 2014-2015 strategy and are in the process of applying for funding to complete the second phase.
One final but important point: while the use of many small and large UAVs in complex airspaces in which piloted (manned) aircraft are also flying poses a major challenge in terms of safety, collision avoidance and coordination, this obviously doesn’t mean that small UAVs should be grounded in humanitarian contexts with far simpler airspaces. Indeed, to argue that small UAVs cannot be responsibly and safely operated in simpler airspaces ignores the obvious fact that they already have—and continue to be responsibly & safely used. Moreover, I for one don’t see the point of flying small UAVs in areas already covered by larger UAVs and piloted aircraft. I’m far more interested in the rapid and local deployment of small UAVs to cover areas that are overlooked or have not yet been reached by mainstream response efforts. In sum, while it will take years to develop effective solutions for large UAV-use in dense and complex airspaces, small UAVs are already being used responsibly and safely by a number of humanitarian organizations and their partners.
Aerial imagery will soon become a Big Data problem for humanitarian response—particularly oblique imagery. This was confirmed to me by a number of imagery experts in both the US (FEMA) and Europe (JRC). Aerial imagery taken at an angle is referred to as oblique imagery; compared to vertical imagery, which is taken by cameras pointing straight down (like satellite imagery). The team from Humanitarian OpenStreetMap (HOT) is already well equipped to make sense of vertical aerial imagery. They do this by microtasking the tracing of said imagery, as depicted below. So how do we rapidly analyze oblique images, which often provide more detail vis-a-vis infrastructure damage than vertical pictures?
One approach is to microtask the tagging of oblique images. This was carried out very successfully after Hurricane Sandy (screenshot below).
This solution did not include any tracing and was not designed to inform the development of machine learning classifiers to automatically identify features of interest, like damaged buildings, for example. Making sense of Big (Aerial) Data will ultimately require the combined use of human computing (microtasking) and machine learning. As volunteers use microtasking to trace features of interest such as damaged buildings pictured in oblique aerial imagery, perhaps machine learning algorithms can learn to detect these features automatically if enough examples of damaged buildings are provided. There is obviously value in doing automated feature detection with vertical imagery as well. So my team and I at QCRI have been collaborating with a local Filipino UAV start-up (SkyEye) to develop a new “Clicker” for our MicroMappers collection. We’ll be testing the “Aerial Clicker” below with our Filipino partners this summer. Incidentally, SkyEye is on the Advisory Board of the Humanitarian UAV Network (UAViators).
SkyEye is interested in developing a machine learning classifier to automatically identify coconut trees, for example. Why? Because coconut trees are an important source of livelihood for many Filipinos. Being able to rapidly identify trees that are still standing versus uprooted would enable SkyEye to quickly assess the impact of a Typhoon on local agriculture, which is important for food security & long-term recovery. So we hope to use the Aerial Clicker to microtask the tracing of coconut trees in order to significantly improve the accuracy of the machine learning classifier that SkyEye has already developed.
Will this be successful? One way to find out is by experimenting. I realize that developing a “visual version” of AIDR is anything but trivial. While AIDR was developed to automatically identify tweets (i.e., text) of interest during disasters by using microtasking and machine learning, what if we also had a free and open source platform to microtask and then automatically identify visual features of interest in both vertical and oblique imagery captured by UAVs? To be honest, I’m not sure how feasible this is vis-a-vis oblique imagery. As an imagery analyst at FEMA recently told me, this is still a research question for now. So I’m hoping to take this research on at QCRI but I do not want to duplicate any existing efforts in this space. So I would be grateful for feedback on this idea and any related research that iRevolution readers may recommend.
In the meantime, here’s another idea I’m toying with for the Aerial Clicker:
I often see this in the aftermath of major disasters; affected communities turning to “analog social medial” to communicate when cell phone towers are down. The aerial imagery above was taken following Typhoon Yolanda in the Philippines. And this is just one of several dozen images with analog media messages that I came across. So what if our Aerial Clicker were to ask digital volunteers to transcribe or categorize these messages? This would enable us to quickly create a crisis map of needs based on said content since every image is already geo-referenced. Thoughts?
I had the pleasure of helping co-organize the first UAV/Drone Search and Rescue Challenge in the DC Area last Saturday. This was the first time that members of the DC Area Drone User Group participated in an event like this, so it was an ideal opportunity for everyone involved to better understand how UAVs might be used in a real world emergency to support of professional first responders. The challenge was held at the 65-acre MadCap Farm in The Plains, Virginia. For perspective, 65 acres is equal to about 30 full-size football (soccer) fields.
Satellite view of MadCap Farm above versus aerial view below during the UAV Search and Rescue Challenge.
Big thanks to our host and to Timothy Reuter who organized and ran the challenge; and of course many thanks indeed to all five teams who participated in the challenge. One colleague even flew in from Texas to compete in the event, which was sponsored by UAViators, the Humanitarian UAV Network. I described the rules of the challenge in this post but let me briefly summarize these here. Teams were notified of the following “alert” the night before the challenge:
“We have received reports of three lost campers in the vicinity of MadCap Farms. Local Search & Rescue professionals have requested our help to find them. Please report to the front field of MadCap no later than 9:15am for additional details on the campers and efforts to locate them. You will receive a laminated map of the area upon your arrival as well as a wax pen. We ask that you use your drones to identify objects that may help local responders determine where the campers are and ideally find the campers themselves. You will mark on the maps you receive what items you find, their color, and any people you identify. If any of the campers are trapped, you may need to deliver some form of medicine or other relief to them in advance of first responders being able to aid them in person.”
Upon reporting to the farm the following morning, the teams (pictured above) were notified that the campers were teenagers who were carrying sleeping bags and tents. In reality, our three lost campers were the cardboard stand-ups below, but Timothy had already hidden these and scattered their belongings by the time participants arrived at the farm. By the way, notice all the clouds in the picture above? This would have hampered efforts to use satellite imagery in the search and rescue efforts. UAVs, in contrast, fly below the cloud canopy and can provide far cheaper and more up-to-date imagery at far higher spatial resolutions and available even using the best commercial satellites.
As a side note, I was really pleased to see the Civilian Air Patrol (CAP) at the Search and Rescue Challenge. The Air Patrol is a federally supported non-profit volunteer-based organization that serves as the official civilian auxiliary of the US Air Force. CAP members share a passion for aviation and come from all backgrounds and walks of life.
Back to the Challenge. Each team had an hour to fly their UAVs and another hour to search through their aerial videos and/or images post-flight. Two of the five teams used fixed-wing UAVs, like the group below, which kicked off our Search & Rescue Challenge.
They decided to program their UAV for autonomous flight. You can see the flight path below with specified altitude and the different way points (numbers) in the top-right screen (click to enlarge).
Here’s a short 20-second video of the hand-held launch of the fixed-wing UAV. Once airborne, the team simply switches to auto-pilot and the UAV does the rest, accurately following the pre-programmed flight path.
The team decided to analyze their streaming aerial video in real-time, as you can observe in the second video below. While this certainly expedites the analysis and the search for the missing campers, it is also challenging since the team has to pivot back and forth between the live video and the flight path of the UAV in order to pin-point the location of a potential camper or their tent. Unlike rotary-wing UAVs, fixed-wing UAVs obviously cannot hover over one area but need to circle back to fly over the same area.
My colleague Michael and his co-pilot programmed a quadcopter to fly to designated waypoints at a specified altitude. They too used live-streaming to look for clues that could reveal the location of the three missing campers. But they also recorded the video-feed for later analysis, which proved far more effective at identifying said clues. In any event, they used First Person View (FPV) goggles to see exactly what the quadcopter’s camera was seeing, as depicted below.
In addition to searching for the whereabouts of the missing campers, Timothy and I decided to add a bit more focus on the “rescue” part of Search & Rescue. My colleague Euan kindly gave us a number of his new payload units, which are basically a pair of magnets that can be demagnetized by passing a small electric current through said magnets, thus acting as a release mechanism. Euan posted this short video of his prototype payload units in action during a first test earlier this year. Competing teams could earn additional points if they were able to carry a small payload (of their choice) and release this near any of the cardboard stand-ups they could find.
Some teams used Euan’s units while other used their own, like the device pictured above. Here’s a short video of payload release (with parachute) during the competition.
At the end of the competition, we all came together for a full debrief and of course to count up points. Timothy asked each team to share what they felt went well and what some of the major challenges were. The picture below shows some of the items (sleeping bags, clothing, etc.) that were scattered around the farm.
Perhaps the single biggest challenge was altitude. Given that we were in a valley surrounded by rolling hills, it was difficult for competing teams to judge at what altitude their UAVs should be programmed to fly since we couldn’t see over the next hill to determine whether there were taller trees in the distance.
Flying too high would make it more difficult to identify the potential campers on the ground while flying too low would mean running into trees. Unfortunately, two teams encountered the latter problem but both UAVs were eventually recovered. This highlights the importance of developing automatic collision avoidance systems (ACAS) specifically for UAVs. In addition, if UAVs are to be used for Search and Rescue efforts in forested areas, it would pay to have a back-up quadcopter to rescue any UAVs caught in taller trees. One could attach a hanger to said quadcopter to unhook UAVs out of trees. The picture below is taken by a camera fixed to a quadcopter that hit the top of a tree. Yes, we all had a good laugh about the irony of sending UAVs to rescue other UAVs.
The debrief also revealed that most teams were able to find more items post-flight after going through their recorded video footage. My colleague Michael noted that finding signs of the campers was “like looking for a needle in a haystack.” One team noted that live video feeds have a limited range, which hampered their efforts. Another team remarked that one can never have enough batteries on hand. Indeed, wind conditions can very easily affect the endurance of UAV batteries, for example. The importance of pre-flight check-lists was reiterated as well as clearly spelling out safety protocols before a challenge.
I’ll be sharing this debrief and lessons learned with my humanitarian colleagues at the United Nations and the Red Cross; as well as with members of the Advisory Board of the Humanitarian UAV Network (UAViators). Keep in mind that groups like UNICEF, UNHCR and the UN Office for the Coordination for Humanitarian Affairs (OCHA) have not yet begun to experiment hands-on with UAVs to support their relief efforts, so all of the above will be very new to them, just as it was to most teams who participated in the challenge. So this kind of hands-on learning will be of interest to humanitarians groups looking to explore this space.
We counted up the points from each team’s map (like the one above) after the debrief and congratulated the winning team pictured below. They were the only team that found all three missing campers along with some of their belongings.
Big thanks again to our hosts at MadCap Farm, to Timothy Reuter and all participants for spending a fun Saturday outdoors trying something new. We certainly learned some valuable lessons and in the process made new friends.
The short video above was produced by CCTV America, a news television channel that reported on the Search & Rescue Challenge.
Acknowledgements: Many thanks to Timothy Reuter and Michael Ender for their feedback on an earlier draft of this blog post.
See also:
How UAVs are Making a Difference in Disaster Response [link]
Humanitarians Using UAVs for Post Disaster Recovery [link]
I’ve long been interested in disaster resilience particularly when considered through the lens of self-organization. To be sure, the capacity to self-organize is an important feature of resilient societies. So what facilitates self-organization? There are several factors, of course, but the two I’m most interested in are social capital and communication technologies. My interest in disaster resilience also explains why one of our Social Innovation Tracks at QCRI is specifically focused on resilience. So I’m always on the lookout for new research on resilience. The purpose of this blog post is to summarize the latest insights.
This new report (PDF) on Burma assesses the influence of social capital on disaster resilience. More specifically, the report focuses on the influence of bonding, bridging and linking social capital on disaster resilience in remote rural communities in the Ayerwaddy Region of Myanmar. Bonding capital refers to ties that are shared between individuals with common characteristics characteristics such as religion or ethnicity. Bridging capital relates to ties that connect individuals with those outside their immediate communities. These ties could be the result of shared geographical space, for example. Linking capital refers to vertical links between a community and individuals or groups outside said community. The relationship between a village and the government or a donor and recipients, for example.
As the report notes, “a balance of bonding, bridging and linking capitals is important of social and economic stability as well as resilience. It will also play a large role in a community’s ability to reduce their risk of disaster and cope with external shocks as they play a role in resource management, sustainable livelihoods and coping strategies.” In fact, “social capital can be a substitute for a lack of government intervention in disaster planning, early warning and recovery.” The study also notes that “rural communities tend to have stronger social capital due to their geographical distance from government and decision-making structures necessitating them being more self-sufficient.”
Results of the study reveal that villages in the region are “mutually supportive, have strong bonding capital and reasonably strong bridging capital […].” This mutual support “plays a part in reducing vulnerability to disasters in these communities.” Indeed, “the strong bonding capital found in the villages not only mobilizes communities to assist each other in recovering from disasters and building community coping mechanisms, but is also vital for disaster risk reduction and knowledge and information sharing. However, the linking capital of villages is “limited and this is an issue when it comes to coping with larger scale problems such as disasters.”
Meanwhile, in San Francisco, a low-income neighborhood is building a culture of disaster preparedness founded on social capital. “No one had to die [during Hurricane Katrina]. No one had to even lose their home. It was all a cascading series of really bad decisions, bad planning, and corrupted social capital,” says Homsey, San Francisco’s director of neighborhood resiliency who spearheads the city’s Neighborhood Empowerment Network (NEN). The Network takes a different approach to disaster preparedness—it is reflective, not prescriptive. The group also works to “strengthen the relationships between governments and the community, nonprofits and other agencies [linking capital]. They make sure those relationships are full of trust and reciprocity between those that want to help and those that need help.” In short, they act as a local Match.com for disaster preparedness and response.
Providence Baptist Church of San Francisco is unusual because unlike most other American churches, this one has a line item for disaster preparedness. Hodge, who administrates the church, takes issue with the government’s disaster plan for San Francisco. “That plan is to evacuate the city. Our plan is to stay in the city. We aren’t going anywhere. We know that if we work together before a major catastrophe, we will be able to work together during a major catastrophe.” This explains why he’s teaming up with the Neighborhood Network (NEN) which will “activate immediately after an event. It will be entirely staffed and managed by the community, for the community. It will be a hyper-local, problem-solving platform where people can come with immediate issues they need collective support for,” such as “evacuations, medical care or water delivery.”
Their early work has focused on “making plans to protect the neighborhood’s most vulnerable residents: its seniors and the disabled.” Many of these residents have thus received “kits that include a sealable plastic bag to stock with prescription medication, cash, phone numbers for family and friends. They also have door-hangers to help speed up search-and-rescue efforts (above pics).
Lastly, colleagues at the Rockefeller Foundation have just released their long-awaited City Resilience Framework after several months of extensive fieldwork, research and workshops in six cities: Cali, Columbia; Concepción, Chile; New Orleans, USA; Cape Town, South Africa; Surat, India; and Semarang, Indonesia. “The primary purpose of the fieldwork was to understandwhat contributes to resilience in cities, and how resilience is understood from the perspective of different city stakeholder groups in different contexts. The results are depicted in the graphic below, which figures the 12 categories identified by Rockefeller and team (in yellow).
These 12 categories are important because “one must be able to relate resilience to other properties that one has some means of ascertaining, through observation.” The four categories that I’m most interested in observing are:
Collective identity and mutual support: this is observed as active community engagement, strong social networks and social integration. Sub-indicators include community and civic participation, social relationships and networks, local identity and culture and integrated communities.
Empowered stakeholders: this is underpinned by education for all, and relies on access to up-to-date information and knowledge to enable people and organizations to take appropriate action. Sub-indicators include risk monitoring & alerts and communication between government & citizens.
Reliable communications and mobility: this is enabled by diverse and affordable multi-modal transport systems and information and communication technology (ICT) networks, and contingency planning. Sub-indicators include emergency communication services.
Effective leadership and management: this relates to government, business and civil society and is recognizable in trusted individuals, multi-stakeholder consultation, and evidence-based decision-making. Sub-indicators include emergency capacity and coordination.
How am I interested in observing these drivers of resilience? Via social media. Why? Because that source of information is 1) available in real-time; 2) enables two-way communication; and 3) remains largely unexplored vis-a-vis disaster resilience. Whether or not social media can be used as a reliable proxy to measure resilience is still very much a research question at this point—meaning more research is required to determine whether social media can indeed serve as a proxy for city resilience.
As noted above, one of our Social Innovation research tracks at QCRI is on resilience. So we’re currently reviewing the list of 32 cities that the Rockefeller Foundation’s 100 Resilient Cities project is partnering with to identify which have a relatively large social media footprint. We’ll then select three cities and begin to explore whether collective identity and mutual support can be captured via the social media activity in each city. In other words, we’ll be applying data science & advanced computing—specifically computational social science—to explore whether digital data can shed light on city resilience. Ultimately, we hope our research will support the Rockefeller Foundation’s next phase in their 100 Resilient Cities project: the development of a Resilient City Index.
Satellite images have been used to support humanitarian efforts for decades. Why? A bird’s eye view of a disaster-affected area simply captures far more information than most Earth-based data-collection technologies can. In short, birds have more situational awareness than we do. In contrast to satellites, UAVs offer significantly higher-resolution imagery, are unobstructed by clouds, can be captured more quickly, by more groups and more often at a fraction of the cost with far fewer licensing and data-sharing restrictions than satellite imagery.
Introduction to UAVs
There are basically three types of UAVs: 1) the balloon/kite variety; 2) fixed-wing UAVs; 3) rotary-wing UAVs. While my forthcoming book looks at humanitarian applications of each type, I’ll focus on fixed-wing and rotary-wing UAVs here since these are of greatest interest to humanitarian organizations. These types of UAVs differ from traditional remote control planes and helicopters because they are programmable and intelligent. UAVs can be programmed to take-off, fly and land completely autonomously, for example. They often include intelligent flight stabilization features that adapt for changing wind speeds and other weather-related conditions. They also have a number of built-in fail-safe mechanisms; some of the newer UAVs even include automated collision avoidance systems.
Fixed-wing UAVs like senseFly’s eBees (above) are launched by hand and can land on a wide variety of surfaces, requiring only a few meters of landing space. They fly autonomously along pre-programmed routes and also land themselves auto-matically. My colleague Adam from senseFly recently flew eBees to support recovery efforts in the Philippines following Typhoon Yolanda. Adam is also on the Advisory Board of the Humanitarian UAV Network (UAViators). Other fixed-wing UAVs are flown manually and require an airstrip for both manual take-off and landing. Rotary-wing UAVs, in contrast, are “helicopters” with three or more propellors. Quadcopters, for example, have four propellors, like the Huginn X1 below, which my colleague Liam Dawson, another Advisory Board member, flew following Typhoon Yolanda in the Philippines. One advantage of rotary-UAVs is that they take-off and land vertically. They can also hover in one fixed place and can also be programmed to fly over designated points.
Rotary-UAVs cannot glide like their fixed-wing counterparts, which means their batteries get used up fairly quickly. So they can’t stay airborne for very long (~25 minutes, 2 kilometer range, depending on the model) compared to fixed-wing UAVs like the eBee (~45 minutes, 3 kilometers). Advisory Board member Shane Coughlan is designing fixed-wing humanitarian UAVs that will have a range of several hundred kilometers. Fixed-wing UAVs, however, cannot hover in one place over time. So both types of UAVs come with their advantages and disadvantages. Most UAV experts agree that fixed-wing and rotary-wing UAVs can serve complementary purposes, however. You can quickly use a quadcopter to do an initial aerial recon and then send a fixed-wing UAV for more detailed, high-resolution imagery capture.
Humanitarian Uses of UAVs
So what are some specific examples of humanitarian UAVs in action? Lets take the response to Typhoon Yolanda, which saw an unprecedented number of UAVs in operation. Rotary-wing UAVs were used to support search and rescue efforts, looking for survivors amongst massive fields of debris left behind by the unprecedented storm surge (see below). More specifically, Liam captured very high-resolution imagery of large debris-riddled areas that could not be reached by car and then analyzed this imagery for any signs of trapped survivors. Most of this imagery was taken with an oblique, high-resolution camera; oblique simply means that the camera was not pointing straight down but an angle.
These cameras can be set to capture continuous very high-resolution (VHR) video footage or to take VHR photographs multiple times a second or minute. Some cameras like GoPros can do both. (In the US, the majority of search and rescue operations supported by UAVs use the fixed-wing kind like the Spectra which use down-facing vertical cameras. Advisory Board member Gene Robinson is one of the leading experts in UAV search & rescue missions in North America). Rotary-wing UAVs were also used in the wake of Yolanda to help clear roads. Again, very high-resolution (oblique) aerial imagery was used to determine which roads to prioritize for clearance and what equipment would be needed to clear said-roads given the widely varying levels of debris. In the same way, aerial imagery was also used to identify sites for humanitarian organizations to set up their base-camps.
Fixed-wing UAVs like the eBee were used to survey disaster damage in Tacloban, with the resulting imagery uploaded to Humanitarian OpenStreetMap’s (HOT’s) Task Manager to trace up-to-date digital maps of the area. This is not the first time that HOT has used aerial imagery—the team used aerial imagery back in 2010 following the devastating Haiti earthquake. Beyond building damage, VHR aerial imagery can also be used to assess the impact of a disasters on powerlines, cell phone towers, agriculture and farmland.
In addition, VHR images can also be used to estimate populations and the number of displaced persons. In Haiti, the International Organization for Migration (IOM) used UAVs used to map over 40 square kilometers of dense urban territory, which included several shantytowns. The imagery was used to count the number of tents and to organize a “door-to-door” census of the population–an important step to identify needs and organize more permanent infrastructure.
A few months after Yolanda, the Swiss humanitarian organization Medair used fixed-wing UAVs to support their post-disaster recovery operations. They took hundreds of VHR aerial photographs to create very detailed 2D and 3D digital maps of Tacloban and Leyte. This required flying the UAV at the same altitude along a pre-programmed route. The UAV team that captured the images used the Pix4D software to stitch these together and create the 3D maps, which capture elevation—an important piece of information for disaster-risk analysis like floods and storm surges. The VHR maps enabled Medair to identify and thus advocate for those residential areas that were falling behind vis-a-vis reconstruction and recovery. The imagery was also used by the local mayor’s office in Tacloban to identify appropriate, safe and dignified areas to resettle Filipinos had been forced to live in informal shelters right after the Typhoon.
To learn more about past and ongoing humanitarian UAV projects, please see the “Directory of Projects” on the Humanitarian UAV Network. If you know of other projects that are not listed in this directory, then please do add these directly to the document, thank you.
Other Potential Use Cases
There’s been increasing talk of using UAVs for transportation (small payloads of 1-5 Kilos). Perhaps these payloads could carry flyers with important information for disaster-affected communities who are without electricity, radio access or cell phone coverage. Along those lines, some entrepreneurial groups in the US are starting to use UAVs for advertising purposes by flying banners. This may be another way to “communicate” with disaster affected communities, although it would be limited to one-way communication. Obviously, payloads could also include satellite phones or first-aid kits, like the one below, which we were testing earlier this week for our upcoming UAV Search & Rescue Challenge.
In addition, Google and Facebook are betting hundreds of millions of dollars that UAVs will provide remote areas with Internet connectivity (as is DARPA). This may come in handy when traditional communication infrastructure is affected after major disasters. Some telecommunications companies may follow in these footsteps; sending out a fleet of UAVs to serve as temporary “aerial cell phone towers” when their Earth-based towers go down. A related idea is to extend the concept of meshed mobile communication technologies (like those developed by The Serval Project) to aerial meshed communication networks.
UAVs can also carry a host of sensors other than a regular camera. In Haiti, UAV sensors were used to assess water quality and identify areas of standing water where mosquitos and epidemics could thrive. Highly sensitive audio sensors can be used to listen for signs of trapped survivors. Other sensors can also be used to identify whether radio transmitters and other ground-based communication facilities (like cell phone towers) still work. This use-case was brought to my attention earlier this year by a member of the UAViators Advisory Board.
Conclusion
UAVs can add value in a number of areas but are obviously not the solution to every problem. In many cases, the use of UAVs won’t be appropriate; and when all you have is a hammer, then everything looks like a nail. So my advocacy around the use of humanitarian UAVs should obviouslynot be taken to suggest that UAVs are the answer to every and all humanitarian problems; UAVs, like other technologies used in humanitarian settings, obviously come with a host of advantages and disadvantages. As always, the key is to accurately identify and describe the challenge first; and then to assess potential technology solutions that are most appropriate—if any. Finally, and again obviously, flying UAVs is just part of the challenge. Coordination, safety, privacy, information sharing, imagery analysis, legislation and operational response are just a some of the other challenges that the Humanitarian UAV Network is set up to address.
The Humanitarian UAV Network (UAViators) has taken off much faster than I expected. More than 240 members in 32 countries have joined the network since it’s launch just a few weeks ago.
I was also pleasantly surprised by the number of humanitarian organizations that got in touch with me right after the launch. Many of them are just starting to explore this space. And I found it refreshing that every single one of them considers the case for humanitarian UAVs to be perfectly obvious. Almost all of the groups also mentioned how they would have made use of UAVs in recent disasters. Some are even taking steps now to set up rapid-response UAV teams.
My number one priority after launching the network was to start working on a Code of Conduct to guide the use of UAVs in humanitarian settings—the only one of it’s kind as far as I know. While I had initially sought to turn this Code of Conduct into a check-list, it became clear from the excellent feedback provided by members and the Advisory Board that we needed two separate documents. So my RA’s and I have created a more general Code of Conduct along with a more detailed operational check-list for flying UAVs in humanitarian settings. You’ll find the check-list here. Big thanks to Advisory Board member Gene Robinson for letting me draw on his excellent book for this check-list. Both the Code of Conduct and Check-List will continue to be updated on a monthly basis, so please do chime in and help us improve them.
One of my main goals for 2014 is to have the Code of Conduct officially and publicly endorsed by both UAV companies and humanitarian organizations alike. This may end up being a time-consuming process, but this endorsement is a must if the Code of Conduct is to become an established policy document. Another one of my goals is to organize a Humanitarian UAV Strategy Meeting in November that will bring together a select number of experts in Humanitarian UAVs with seasoned humanitarian professionals from the UN and Red Cross. The purpose of this meeting is to establish closer relationships between the humanitarian and UAV communities in order to facilitate coordination and information sharing during major disasters.
Also in the works for this year is a disaster response simulation with partners in the Philippines (including local government). The purpose of this simulation will be to rapidly deploy UAVs over a made-believe disaster area; then to upload the thousands of aerial images to MicroMappers to rapidly crowdsource the tagging of features-of-interest. Our (ambitious) hope is that the entire process can be done within a matter of hours. The simulation will help us identify the weak-links in our workflows. Our Filipino partners will also be using the resulting tagged images to create more accurate machine learning classifiers for automated feature detection. This will help them accelerate the analysis of aerial imagery during real disasters.
So stay tuned for updates, which will be posted on iRevolution and UAViators.
See also:
How UAVs are Making a Difference in Disaster Response [link]
Humanitarians Using UAVs for Post Disaster Recovery [link]
I thrive when working across disciplines, building diverse cross-cutting coalitions to create, translate and apply innovative strategies driven by shared values. This has enabled the 20+ organizations I’ve worked with, and those I’ve led, to accelerate meaningful and inclusive social impact.
Which is why I've been called a social entrepreneur and a translational leader by successful innovators. President Clinton once called me a digital pioneer, while recent colleagues describe me as kind, dedicated, values-driven, authentic, creative, ethical, and impactful.