Incremental Learning for Semantic Segmentation of Large-Scale Remote Sensing Data

10/29/2018
by   Onur Tasar, et al.
0

In spite of remarkable success of the convolutional neural networks on semantic segmentation, they suffer from catastrophic forgetting: a significant performance drop for the already learned classes when new classes are added on the data, having no annotations for the old classes. We propose an incremental learning methodology, enabling to learn segmenting new classes without hindering dense labeling abilities for the previous classes, although the entire previous data are not accessible. The key points of the proposed approach are adapting the network to learn new as well as old classes on the new training data, and allowing it to remember the previously learned information for the old classes. For adaptation, we keep a frozen copy of the previously trained network, which is used as a memory for the updated network in absence of annotations for the former classes. The updated network minimizes a loss function, which balances the discrepancy between outputs for the previous classes from the memory and updated networks, and the mis-classification rate between outputs for the new classes from the updated network and the new ground-truth. For remembering, we either regularly feed samples from the stored, little fraction of the previous data or use the memory network, depending on whether the new data are collected from completely different geographic areas or from the same city. Our experimental results prove that it is possible to add new classes to the network, while maintaining its performance for the previous classes, despite the whole previous training data are not available.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 6

page 8

page 10

page 13

research
08/23/2017

Incremental Learning of Object Detectors without Catastrophic Forgetting

Despite their success for object detection, convolutional neural network...
research
04/01/2020

Memory-Efficient Incremental Learning Through Feature Adaptation

In this work we introduce an approach for incremental learning, which pr...
research
12/07/2017

Incremental Learning in Deep Convolutional Neural Networks Using Partial Network Sharing

Deep convolutional neural network (DCNN) based supervised learning is a ...
research
12/06/2020

Self-Training for Class-Incremental Semantic Segmentation

We study incremental learning for semantic segmentation where when learn...
research
02/28/2023

Foundation Model Drives Weakly Incremental Learning for Semantic Segmentation

Modern incremental learning for semantic segmentation methods usually le...
research
07/31/2019

Incremental Learning Techniques for Semantic Segmentation

Deep learning architectures exhibit a critical drop of performance due t...
research
07/23/2019

Adaptive Compression-based Lifelong Learning

The problem of a deep learning model losing performance on a previously ...

Please sign up or login with your details

Forgot password? Click here to reset