DeepAI AI Chat
Log In Sign Up

DivNoising: Diversity Denoising with Fully Convolutional Variational Autoencoders

by   Mangal Prakash, et al.

Deep Learning based methods have emerged as the indisputable leaders for virtually all image restoration tasks. Especially in the domain of microscopy images, various content-aware image restoration (CARE) approaches are now used to improve the interpretability of acquired data. But there are limitations to what can be restored in corrupted images, and any given method needs to make a sensible compromise between many possible clean signals when predicting a restored image. Here, we propose DivNoising – a denoising approach based on fully-convolutional variational autoencoders, overcoming this problem by predicting a whole distribution of denoised images. Our method is unsupervised, requiring only noisy images and a description of the imaging noise, which can be measured or bootstrapped from noisy data. If desired, consensus predictions can be inferred from a set of DivNoising predictions, leading to competitive results with other unsupervised methods and, on occasion, even with the supervised state-of-the-art. DivNoising samples from the posterior enable a plethora of useful applications. We are (i) discussing how optical character recognition (OCR) applications could benefit from diverse predictions on ambiguous data, and (ii) show in detail how instance cell segmentation gains performance when using diverse DivNoising predictions.


page 18

page 19

page 23

page 25

page 26

page 28

page 31

page 34


Cryo-CARE: Content-Aware Image Restoration for Cryo-Transmission Electron Microscopy Data

Multiple approaches to use deep learning for image restoration have rece...

Removing Noise from Extracellular Neural Recordings Using Fully Convolutional Denoising Autoencoders

Extracellular recordings are severely contaminated by a considerable amo...

Can fully convolutional networks perform well for general image restoration problems?

We present a fully convolutional network(FCN) based approach for color i...

Leveraging Self-supervised Denoising for Image Segmentation

Deep learning (DL) has arguably emerged as the method of choice for the ...

Fully Unsupervised Probabilistic Noise2Void

Image denoising is the first step in many biomedical image analysis pipe...

Fully Convolutional Pixel Adaptive Image Denoiser

We propose a new denoising algorithm, dubbed as Fully Convolutional Adap...

Tutorial on Variational Autoencoders

In just three years, Variational Autoencoders (VAEs) have emerged as one...