Subsampled Turbulence Removal Network

07/12/2018
by   Wai Ho Chak, et al.
0

We present a deep-learning approach to restore a sequence of turbulence-distorted video frames from turbulent deformations and space-time varying blurs. Instead of requiring a massive training sample size in deep networks, we purpose a training strategy that is based on a new data augmentation method to model turbulence from a relatively small dataset. Then we introduce a subsampled method to enhance the restoration performance of the presented GAN model. The contributions of the paper is threefold: first, we introduce a simple but effective data augmentation algorithm to model the turbulence in real life for training in the deep network; Second, we firstly purpose the Wasserstein GAN combined with ℓ_1 cost for successful restoration of turbulence-corrupted video sequence; Third, we combine the subsampling algorithm to filter out strongly corrupted frames to generate a video sequence with better quality.

READ FULL TEXT
research
06/30/2022

Exploring Temporally Dynamic Data Augmentation for Video Recognition

Data augmentation has recently emerged as an essential component of mode...
research
03/13/2019

Hyperspectral Data Augmentation

Data augmentation is a popular technique which helps improve generalizat...
research
07/08/2022

On Improving the Performance of Glitch Classification for Gravitational Wave Detection by using Generative Adversarial Networks

Spectrogram classification plays an important role in analyzing gravitat...
research
10/31/2019

Multi-defect microscopy image restoration under limited data conditions

Deep learning methods are becoming widely used for restoration of defect...
research
04/11/2017

Restoration of Atmospheric Turbulence-distorted Images via RPCA and Quasiconformal Maps

We address the problem of restoring a high-quality image from an observe...
research
09/04/2023

Cross-Consistent Deep Unfolding Network for Adaptive All-In-One Video Restoration

Existing Video Restoration (VR) methods always necessitate the individua...
research
06/11/2018

Understanding Patch-Based Learning by Explaining Predictions

Deep networks are able to learn highly predictive models of video data. ...

Please sign up or login with your details

Forgot password? Click here to reset