ColorMapGAN: Unsupervised Domain Adaptation for Semantic Segmentation Using Color Mapping Generative Adversarial Networks

07/30/2019
by   Onur Tasar, et al.
5

Due to the various reasons such as atmospheric effects and differences in acquisition, it is often the case that there exists a large difference between spectral bands of satellite images collected from different geographic locations. The large shift between spectral distributions of training and test data causes the current state of the art supervised learning approaches to output poor maps. We present a novel end to end semantic segmentation framework that is robust to such shift. The key component of the proposed framework is Color Mapping Generative Adversarial Networks (ColorMapGAN), which can generate fake training images that are semantically exactly the same as training images, but whose spectral distribution is similar to the distribution of the test images. We then use the fake images and the ground-truth for the training images to fine-tune the already trained classifier. Contrary to the existing Generative Adversarial Networks (GAN), the generator in ColorMapGAN does not have any convolutional or pooling layers. It learns to transform the colors of the training data to the colors of the test data by performing only one element-wise matrix multiplication and one matrix addition operations. Thanks to the architecturally simple but powerful design of ColorMapGAN, the proposed framework outperforms the existing approaches with a large margin in terms of both accuracy and computational complexity.

READ FULL TEXT

page 1

page 4

page 6

page 8

page 9

page 11

research
02/14/2020

SemI2I: Semantically Consistent Image-to-Image Translation for Domain Adaptation of Remote Sensing Data

Although convolutional neural networks have been proven to be an effecti...
research
04/20/2021

Semantic Segmentation by Improved Generative Adversarial Networks

While most existing segmentation methods usually combined the powerful f...
research
05/08/2019

Unsupervised Domain Adaptation using Generative Adversarial Networks for Semantic Segmentation of Aerial Images

Segmenting aerial images is being of great potential in surveillance and...
research
08/02/2022

Explicit Use of Fourier Spectrum in Generative Adversarial Networks

Generative Adversarial Networks have got the researchers' attention due ...
research
02/07/2018

Spectral Image Visualization Using Generative Adversarial Networks

Spectral images captured by satellites and radio-telescopes are analyzed...
research
06/24/2016

Coupled Generative Adversarial Networks

We propose coupled generative adversarial network (CoGAN) for learning a...
research
02/22/2017

Unsupervised Diverse Colorization via Generative Adversarial Networks

Colorization of grayscale images has been a hot topic in computer vision...

Please sign up or login with your details

Forgot password? Click here to reset