Deep Denoising For Scientific Discovery: A Case Study In Electron Microscopy

10/24/2020
by   Sreyas Mohan, et al.
11

Denoising is a fundamental challenge in scientific imaging. Deep convolutional neural networks (CNNs) provide the current state of the art in denoising natural images, where they produce impressive results. However, their potential has barely been explored in the context of scientific imaging. Denoising CNNs are typically trained on real natural images artificially corrupted with simulated noise. In contrast, in scientific applications, noiseless ground-truth images are usually not available. To address this issue, we propose a simulation-based denoising (SBD) framework, in which CNNs are trained on simulated images. We test the framework on data obtained from transmission electron microscopy (TEM), an imaging technique with widespread applications in material science, biology, and medicine. SBD outperforms existing techniques by a wide margin on a simulated benchmark dataset, as well as on real data. Apart from the denoised images, SBD generates likelihood maps to visualize the agreement between the structure of the denoised image and the observed data. Our results reveal shortcomings of state-of-the-art denoising architectures, such as their small field-of-view: substantially increasing the field-of-view of the CNNs allows them to exploit non-local periodic patterns in the data, which is crucial at high noise levels. In addition, we analyze the generalization capability of SBD, demonstrating that the trained networks are robust to variations of imaging parameters and of the underlying signal structure. Finally, we release the first publicly available benchmark dataset of TEM images, containing 18,000 examples.

READ FULL TEXT

page 2

page 14

page 16

page 20

page 21

page 22

page 23

page 24

research
11/30/2020

Unsupervised Deep Video Denoising

Deep convolutional neural networks (CNNs) currently achieve state-of-the...
research
05/08/2022

Differentiable Electron Microscopy Simulation: Methods and Applications for Visualization

We propose a new microscopy simulation system that can depict atomistic ...
research
07/27/2021

Adaptive Denoising via GainTuning

Deep convolutional neural networks (CNNs) for image denoising are usuall...
research
11/21/2017

Universal Denoising Networks : A Novel CNN-based Network Architecture for Image Denoising

We design a novel network architecture for learning discriminative image...
research
01/21/2020

Scientific Image Tampering Detection Based On Noise Inconsistencies: A Method And Datasets

Scientific image tampering is a problem that affects not only authors bu...
research
10/11/2022

Evaluating Unsupervised Denoising Requires Unsupervised Metrics

Unsupervised denoising is a crucial challenge in real-world imaging appl...
research
01/11/2022

Image quality measurements and denoising using Fourier Ring Correlations

Image quality is a nebulous concept with different meanings to different...

Please sign up or login with your details

Forgot password? Click here to reset