Improving Emergency Response during Hurricane Season using Computer Vision

08/17/2020
by   Marc Bosch, et al.
18

We have developed a framework for crisis response and management that incorporates the latest technologies in computer vision (CV), inland flood prediction, damage assessment and data visualization. The framework uses data collected before, during, and after the crisis to enable rapid and informed decision making during all phases of disaster response. Our computer-vision model analyzes spaceborne and airborne imagery to detect relevant features during and after a natural disaster and creates metadata that is transformed into actionable information through web-accessible mapping tools. In particular, we have designed an ensemble of models to identify features including water, roads, buildings, and vegetation from the imagery. We have investigated techniques to bootstrap and reduce dependency on large data annotation efforts by adding use of open source labels including OpenStreetMaps and adding complementary data sources including Height Above Nearest Drainage (HAND) as a side channel to the network's input to encourage it to learn other features orthogonal to visual characteristics. Modeling efforts include modification of connected U-Nets for (1) semantic segmentation, (2) flood line detection, and (3) for damage assessment. In particular for the case of damage assessment, we added a second encoder to U-Net so that it could learn pre-event and post-event image features simultaneously. Through this method, the network is able to learn the difference between the pre- and post-disaster images, and therefore more effectively classify the level of damage. We have validated our approaches using publicly available data from the National Oceanic and Atmospheric Administration (NOAA)'s Remote Sensing Division, which displays the city and street-level details as mosaic tile images as well as data released as part of the Xview2 challenge.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 6

page 7

research
02/19/2018

Satellite imagery analysis for operational damage assessment in Emergency situations

When major disaster occurs the questions are raised how to estimate the ...
research
12/13/2018

Benchmark Dataset for Automatic Damaged Building Detection from Post-Hurricane Remotely Sensed Imagery

Rapid damage assessment is of crucial importance to emergency responders...
research
12/15/2020

Post-Hurricane Damage Assessment Using Satellite Imagery and Geolocation Features

Gaining timely and reliable situation awareness after hazard events such...
research
12/05/2020

FloodNet: A High Resolution Aerial Imagery Dataset for Post Flood Scene Understanding

Visual scene understanding is the core task in making any crucial decisi...
research
04/14/2020

Rapid Damage Assessment Using Social Media Images by Combining Human and Machine Intelligence

Rapid damage assessment is one of the core tasks that response organizat...
research
06/18/2022

GaLeNet: Multimodal Learning for Disaster Prediction, Management and Relief

After a natural disaster, such as a hurricane, millions are left in need...
research
10/09/2022

Transformer-based Flood Scene Segmentation for Developing Countries

Floods are large-scale natural disasters that often induce a massive num...

Please sign up or login with your details

Forgot password? Click here to reset