DeepAI AI Chat
Log In Sign Up

Multi-Resolution Multi-Modal Sensor Fusion For Remote Sensing Data With Label Uncertainty

by   Xiaoxiao Du, et al.
University of Florida

In remote sensing, each sensor can provide complementary or reinforcing information. It is valuable to fuse outputs from multiple sensors to boost overall performance. Previous supervised fusion methods often require accurate labels for each pixel in the training data. However, in many remote sensing applications, pixel-level labels are difficult or infeasible to obtain. In addition, outputs from multiple sensors may have different levels of resolution or modalities (such as rasterized hyperspectral imagery versus LiDAR 3D point clouds). This paper presents a Multiple Instance Multi-Resolution Fusion (MIMRF) framework that can fuse multi-resolution and multi-modal sensor outputs while learning from ambiguously and imprecisely labeled training data. Experiments were conducted on the MUUFL Gulfport hyperspectral and LiDAR data set and a remotely-sensed soybean and weed data set. Results show improved, consistent performance on scene understanding and agricultural applications when compared to traditional fusion methods.


page 3

page 14

page 17

page 19

page 21

page 24

page 28

page 29


Multiple Instance Choquet Integral Classifier Fusion and Regression for Remote Sensing Applications

In classifier (or regression) fusion the aim is to combine the outputs o...

Two Headed Dragons: Multimodal Fusion and Cross Modal Transactions

As the field of remote sensing is evolving, we witness the accumulation ...

GETNET: A General End-to-end Two-dimensional CNN Framework for Hyperspectral Image Change Detection

Change detection (CD) is an important application of remote sensing, whi...

Online Sensor Hallucination via Knowledge Distillation for Multimodal Image Classification

We deal with the problem of information fusion driven satellite image/sc...

Training Methods of Multi-label Prediction Classifiers for Hyperspectral Remote Sensing Images

With their combined spectral depth and geometric resolution, hyperspectr...

Robust building footprint extraction from big multi-sensor data using deep competition network

Building footprint extraction (BFE) from multi-sensor data such as optic...

Code Repositories


Multi-Resolution Multi-Modal Sensor Fusion For Remote Sensing Data With Label Uncertainty

view repo