Spectral Image Visualization Using Generative Adversarial Networks

02/07/2018
by   Siyu Chen, et al.
0

Spectral images captured by satellites and radio-telescopes are analyzed to obtain information about geological compositions distributions, distant asters as well as undersea terrain. Spectral images usually contain tens to hundreds of continuous narrow spectral bands and are widely used in various fields. But the vast majority of those image signals are beyond the visible range, which calls for special visualization technique. The visualizations of spectral images shall convey as much information as possible from the original signal and facilitate image interpretation. However, most of the existing visualizatio methods display spectral images in false colors, which contradict with human's experience and expectation. In this paper, we present a novel visualization generative adversarial network (GAN) to display spectral images in natural colors. To achieve our goal, we propose a loss function which consists of an adversarial loss and a structure loss. The adversarial loss pushes our solution to the natural image distribution using a discriminator network that is trained to differentiate between false-color images and natural-color images. We also use a cycle loss as the structure constraint to guarantee structure consistency. Experimental results show that our method is able to generate structure-preserved and natural-looking visualizations.

READ FULL TEXT

page 4

page 5

research
11/24/2017

Constrained Manifold Learning for Hyperspectral Imagery Visualization

Displaying the large number of bands in a hyper- spectral image (HSI) on...
research
01/20/2018

Visualization of Hyperspectral Images Using Moving Least Squares

Displaying the large number of bands in a hyper spectral image on a tric...
research
07/26/2018

AlphaGAN: Generative adversarial networks for natural image matting

We present the first generative adversarial network (GAN) for natural im...
research
07/24/2019

Spectral Visualization Sharpening

In this paper, we propose a perceptually-guided visualization sharpening...
research
07/30/2019

ColorMapGAN: Unsupervised Domain Adaptation for Semantic Segmentation Using Color Mapping Generative Adversarial Networks

Due to the various reasons such as atmospheric effects and differences i...
research
07/01/2020

Inferring Human Observer Spectral Sensitivities from Video Game Data

With the use of primaries which have increasingly narrow bandwidths in m...
research
12/11/2018

Generative Adversarial Networks for Recovering Missing Spectral Information

Ultra-wideband (UWB) radar systems nowadays typical operate in the low f...

Please sign up or login with your details

Forgot password? Click here to reset