Data Augmentation via Mixed Class Interpolation using Cycle-Consistent Generative Adversarial Networks Applied to Cross-Domain Imagery

05/07/2020
by   Hiroshi Sasaki, et al.
1

Machine learning driven object detection and classification within non-visible imagery has an important role in many fields such as night vision, all-weather surveillance and aviation security. However, such applications often suffer due to the limited quantity and variety of non-visible spectral domain imagery, in contrast to the high data availability of visible-band imagery that readily enables contemporary deep learning driven detection and classification approaches. To address this problem, this paper proposes and evaluates a novel data augmentation approach that leverages the more readily available visible-band imagery via a generative domain transfer model. The model can synthesise large volumes of non-visible domain imagery by image-to-image (I2I) translation from the visible image domain. Furthermore, we show that the generation of interpolated mixed class (non-visible domain) image examples via our novel Conditional CycleGAN Mixup Augmentation (C2GMA) methodology can lead to a significant improvement in the quality of non-visible domain classification tasks that otherwise suffer due to limited data availability. Focusing on classification within the Synthetic Aperture Radar (SAR) domain, our approach is evaluated on a variation of the Statoil/C-CORE Iceberg Classifier Challenge dataset and achieves 75.4% accuracy, demonstrating a significant improvement when compared against traditional data augmentation strategies (Rotation, Mixup, and MixCycleGAN).

READ FULL TEXT

page 1

page 4

page 5

page 6

page 8

research
08/26/2017

Deep Learning for Target Classification from SAR Imagery: Data Augmentation and Translation Invariance

This report deals with translation invariance of convolutional neural ne...
research
06/05/2022

Computer Vision-based Characterization of Large-scale Jet Flames using a Synthetic Infrared Image Generation Approach

Among the different kinds of fire accidents that can occur during indust...
research
03/27/2021

Improving prostate whole gland segmentation in t2-weighted MRI with synthetically generated data

Whole gland (WG) segmentation of the prostate plays a crucial role in de...
research
12/16/2020

Sparse Signal Models for Data Augmentation in Deep Learning ATR

Automatic Target Recognition (ATR) algorithms classify a given Synthetic...
research
04/19/2022

Augmentation of Atmospheric Turbulence Effects on Thermal Adapted Object Detection Models

Atmospheric turbulence has a degrading effect on the image quality of lo...
research
08/03/2022

Unsupervised Discovery of Semantic Concepts in Satellite Imagery with Style-based Wavelet-driven Generative Models

In recent years, considerable advancements have been made in the area of...
research
08/19/2018

Eliminating the Blind Spot: Adapting 3D Object Detection and Monocular Depth Estimation to 360° Panoramic Imagery

Recent automotive vision work has focused almost exclusively on processi...

Please sign up or login with your details

Forgot password? Click here to reset