Learning to Synthesize: Robust Phase Retrieval at Low Photon counts

07/26/2019
by   Mo Deng, et al.
0

The quality of inverse problem solutions obtained through deep learning [Barbastathis et al, 2019] is limited by the nature of the priors learned from examples presented during the training phase. In the case of quantitative phase retrieval [Sinha et al, 2017, Goy et al, 2019], in particular, spatial frequencies that are underrepresented in the training database, most often at the high band, tend to be suppressed in the reconstruction. Ad hoc solutions have been proposed, such as pre-amplifying the high spatial frequencies in the examples [Li et al, 2018]; however, while that strategy improves resolution, it also leads to high-frequency artifacts as well as low-frequency distortions in the reconstructions. Here, we present a new approach that learns separately how to handle the two frequency bands, low and high; and also learns how to synthesize these two bands into the full-band reconstructions. We show that this "learning to synthesize" (LS) method yields phase reconstructions of high spatial resolution and artifact-free; and it is also resilient to high-noise conditions, e.g. in the case of very low photon flux. In addition to the problem of quantitative phase retrieval, the LS method is applicable, in principle, to any inverse problem where the forward operator treats different frequency bands unevenly, i.e. is ill-posed.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 7

page 11

page 13

page 14

research
11/19/2018

Learning to synthesize: splitting and recombining low and high spatial frequencies for image recovery

Deep Neural Network (DNN)-based image reconstruction, despite many succe...
research
10/21/2019

Multi-Band Multi-Resolution Fully Convolutional Neural Networks for Singing Voice Separation

Deep neural networks with convolutional layers usually process the entir...
research
03/18/2021

A geometrically adapted reduced set of frequencies for a FFT-based microstructure simulation

We present a modified model order reduction (MOR) technique for the FFT-...
research
02/09/2022

PINs: Progressive Implicit Networks for Multi-Scale Neural Representations

Multi-layer perceptrons (MLP) have proven to be effective scene encoders...
research
12/14/2020

Phase Retrieval with Holography and Untrained Priors: Tackling the Challenges of Low-Photon Nanoscale Imaging

Phase retrieval is the inverse problem of recovering a signal from magni...
research
01/19/2019

Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks

We study the training process of Deep Neural Networks (DNNs) from the Fo...
research
12/18/2019

Frequency-Aware Reconstruction of Fluid Simulations with Generative Networks

Convolutional neural networks were recently employed to fully reconstruc...

Please sign up or login with your details

Forgot password? Click here to reset