DeepAI AI Chat
Log In Sign Up

Multi-Resolution Multi-Modal Sensor Fusion For Remote Sensing Data With Label Uncertainty

05/02/2018
by   Xiaoxiao Du, et al.
University of Florida
0

In remote sensing, each sensor can provide complementary or reinforcing information. It is valuable to fuse outputs from multiple sensors to boost overall performance. Previous supervised fusion methods often require accurate labels for each pixel in the training data. However, in many remote sensing applications, pixel-level labels are difficult or infeasible to obtain. In addition, outputs from multiple sensors may have different levels of resolution or modalities (such as rasterized hyperspectral imagery versus LiDAR 3D point clouds). This paper presents a Multiple Instance Multi-Resolution Fusion (MIMRF) framework that can fuse multi-resolution and multi-modal sensor outputs while learning from ambiguously and imprecisely labeled training data. Experiments were conducted on the MUUFL Gulfport hyperspectral and LiDAR data set and a remotely-sensed soybean and weed data set. Results show improved, consistent performance on scene understanding and agricultural applications when compared to traditional fusion methods.

READ FULL TEXT

page 3

page 14

page 17

page 19

page 21

page 24

page 28

page 29

03/11/2018

Multiple Instance Choquet Integral Classifier Fusion and Regression for Remote Sensing Applications

In classifier (or regression) fusion the aim is to combine the outputs o...
07/24/2021

Two Headed Dragons: Multimodal Fusion and Cross Modal Transactions

As the field of remote sensing is evolving, we witness the accumulation ...
05/05/2019

GETNET: A General End-to-end Two-dimensional CNN Framework for Hyperspectral Image Change Detection

Change detection (CD) is an important application of remote sensing, whi...
08/28/2019

Online Sensor Hallucination via Knowledge Distillation for Multimodal Image Classification

We deal with the problem of information fusion driven satellite image/sc...
01/17/2023

Training Methods of Multi-label Prediction Classifiers for Hyperspectral Remote Sensing Images

With their combined spectral depth and geometric resolution, hyperspectr...
11/04/2020

Robust building footprint extraction from big multi-sensor data using deep competition network

Building footprint extraction (BFE) from multi-sensor data such as optic...

Code Repositories

MIMRF

Multi-Resolution Multi-Modal Sensor Fusion For Remote Sensing Data With Label Uncertainty


view repo