Beyond RGB: Very High Resolution Urban Remote Sensing With Multimodal Deep Networks

11/23/2017
by   Nicolas Audebert, et al.
0

In this work, we investigate various methods to deal with semantic labeling of very high resolution multi-modal remote sensing data. Especially, we study how deep fully convolutional networks can be adapted to deal with multi-modal and multi-scale remote sensing data for semantic labeling. Our contributions are threefold: a) we present an efficient multi-scale approach to leverage both a large spatial context and the high resolution data, b) we investigate early and late fusion of Lidar and multispectral data, c) we validate our methods on two public datasets with state-of-the-art results. Our results indicate that late fusion make it possible to recover errors steaming from ambiguous data, while early fusion allows for better joint-feature learning but at the cost of higher sensitivity to missing data.

READ FULL TEXT

page 6

page 8

page 10

page 12

page 18

page 19

page 20

page 22

research
09/22/2016

Semantic Segmentation of Earth Observation Data Using Multimodal and Multi-scale Deep Networks

This work investigates the use of deep fully convolutional neural networ...
research
07/24/2018

Feature Fusion through Multitask CNN for Large-scale Remote Sensing Image Segmentation

In recent years, Fully Convolutional Networks (FCN) has been widely used...
research
05/17/2017

Joint Learning from Earth Observation and OpenStreetMap Data to Get Faster Better Semantic Maps

In this work, we investigate the use of OpenStreetMap data for semantic ...
research
07/30/2018

Semantic Labeling in Very High Resolution Images via a Self-Cascaded Convolutional Neural Network

Semantic labeling for very high resolution (VHR) images in urban areas, ...
research
01/20/2017

Fusion of Heterogeneous Data in Convolutional Networks for Urban Semantic Labeling (Invited Paper)

In this work, we present a novel module to perform fusion of heterogeneo...
research
06/08/2016

Fully Convolutional Networks for Dense Semantic Labelling of High-Resolution Aerial Imagery

The trend towards higher resolution remote sensing imagery facilitates a...
research
01/09/2023

High-Resolution Cloud Removal with Multi-Modal and Multi-Resolution Data Fusion: A New Baseline and Benchmark

In this paper, we introduce Planet-CR, a benchmark dataset for high-reso...

Please sign up or login with your details

Forgot password? Click here to reset