Semi-Supervised Semantic Segmentation in Earth Observation: The MiniFrance Suite, Dataset Analysis and Multi-task Network Study

10/15/2020
by   Javiera Castillo-Navarro, et al.
0

The development of semi-supervised learning techniques is essential to enhance the generalization capacities of machine learning algorithms. Indeed, raw image data are abundant while labels are scarce, therefore it is crucial to leverage unlabeled inputs to build better models. The availability of large databases have been key for the development of learning algorithms with high level performance. Despite the major role of machine learning in Earth Observation to derive products such as land cover maps, datasets in the field are still limited, either because of modest surface coverage, lack of variety of scenes or restricted classes to identify. We introduce a novel large-scale dataset for semi-supervised semantic segmentation in Earth Observation, the MiniFrance suite. MiniFrance has several unprecedented properties: it is large-scale, containing over 2000 very high resolution aerial images, accounting for more than 200 billions samples (pixels); it is varied, covering 16 conurbations in France, with various climates, different landscapes, and urban as well as countryside scenes; and it is challenging, considering land use classes with high-level semantics. Nevertheless, the most distinctive quality of MiniFrance is being the only dataset in the field especially designed for semi-supervised learning: it contains labeled and unlabeled images in its training partition, which reproduces a life-like scenario. Along with this dataset, we present tools for data representativeness analysis in terms of appearance similarity and a thorough study of MiniFrance data, demonstrating that it is suitable for learning and generalizes well in a semi-supervised setting. Finally, we present semi-supervised deep architectures based on multi-task learning and the first experiments on MiniFrance.

READ FULL TEXT

page 8

page 26

page 28

page 29

page 30

page 31

page 32

page 33

research
03/21/2023

CAFS: Class Adaptive Framework for Semi-Supervised Semantic Segmentation

Semi-supervised semantic segmentation learns a model for classifying pix...
research
01/31/2022

Semi-supervised Identification and Mapping of Surface Water Extent using Street-level Monitoring Videos

Urban flooding is becoming a common and devastating hazard to cause life...
research
12/05/2022

Minimum Class Confusion based Transfer for Land Cover Segmentation in Rural and Urban Regions

Transfer Learning methods are widely used in satellite image segmentatio...
research
05/16/2021

Semi-Supervised Classification and Segmentation on High Resolution Aerial Images

FloodNet is a high-resolution image dataset acquired by a small UAV plat...
research
06/28/2021

Rail-5k: a Real-World Dataset for Rail Surface Defects Detection

This paper presents the Rail-5k dataset for benchmarking the performance...
research
12/18/2020

Hyperspectral Image Semantic Segmentation in Cityscapes

High-resolution hyperspectral images (HSIs) contain the response of each...
research
11/22/2022

Big Earth Data and Machine Learning for Sustainable and Resilient Agriculture

Big streams of Earth images from satellites or other platforms (e.g., dr...

Please sign up or login with your details

Forgot password? Click here to reset