Training Image Estimators without Image Ground-Truth

06/13/2019
by   Zhihao Xia, et al.
7

Deep neural networks have been very successful in image estimation applications such as compressive-sensing and image restoration, as a means to estimate images from partial, blurry, or otherwise degraded measurements. These networks are trained on a large number of corresponding pairs of measurements and ground-truth images, and thus implicitly learn to exploit domain-specific image statistics. But unlike measurement data, it is often expensive or impractical to collect a large training set of ground-truth images in many application settings. In this paper, we introduce an unsupervised framework for training image estimation networks, from a training set that contains only measurements---with two varied measurements per image---but no ground-truth for the full images desired as output. We demonstrate that our framework can be applied for both regular and blind image estimation tasks, where in the latter case parameters of the measurement model (e.g., the blur kernel) are unknown: during inference, and potentially, also during training. We evaluate our method for training networks for compressive-sensing and blind deconvolution, considering both non-blind and blind training for the latter. Our unsupervised framework yields models that are nearly as accurate as those from fully supervised training, despite not having access to any ground-truth images.

READ FULL TEXT

page 6

page 8

page 12

page 13

page 14

research
08/14/2020

Unsupervised Image Restoration Using Partially Linear Denoisers

Deep neural network based methods are the state of the art in various im...
research
06/09/2019

Deep Unsupervised Drum Transcription

We introduce DrummerNet, a drum transcription system that is trained in ...
research
11/21/2016

Estimation of respiratory pattern from video using selective ensemble aggregation

Non-contact estimation of respiratory pattern (RP) and respiration rate ...
research
06/04/2018

Simultaneous compressive image recovery and deep denoiser learning from undersampled measurements

Compressive image recovery utilizes sparse image priors such as wavelet ...
research
08/05/2019

Mass Estimation from Images using Deep Neural Network and Sparse Ground Truth

Supervised learning is the workhorse for regression and classification t...
research
11/05/2019

Closing the Training/Inference Gap for Deep Attractor Networks

This paper improves the deep attractor network (DANet) approach by closi...

Please sign up or login with your details

Forgot password? Click here to reset