Real-time sparse-sampled Ptychographic imaging through deep neural networks

04/15/2020
by   Mathew J. Cherukara, et al.
0

Ptychography has rapidly grown in the fields of X-ray and electron imaging for its unprecedented ability to achieve nano or atomic scale resolution while simultaneously retrieving chemical or magnetic information from a sample. A ptychographic reconstruction is achieved by means of solving a complex inverse problem that imposes constraints both on the acquisition and on the analysis of the data, which typically precludes real-time imaging due to computational cost involved in solving this inverse problem. In this work we propose PtychoNN, a novel approach to solve the ptychography reconstruction problem based on deep convolutional neural networks. We demonstrate how the proposed method can be used to predict real-space structure and phase at each scan point solely from the corresponding far-field diffraction data. The presented results demonstrate how PtychoNN can effectively be used on experimental data, being able to generate high quality reconstructions of a sample up to hundreds of times faster than state-of-the-art ptychography reconstruction solutions once trained. By surpassing the typical constraints of iterative model-based methods, we can significantly relax the data acquisition sampling conditions and produce equally satisfactory reconstructions. Besides drastically accelerating acquisition and analysis, this capability can enable new imaging scenarios that were not possible before, in cases of dose sensitive, dynamic and extremely voluminous samples.

READ FULL TEXT

page 2

page 3

page 4

research
10/27/2019

GrappaNet: Combining Parallel Imaging with Deep Learning for Multi-Coil MRI Reconstruction

Magnetic Resonance Image (MRI) acquisition is an inherently slow process...
research
06/16/2020

Real-time 3D Nanoscale Coherent Imaging via Physics-aware Deep Learning

Phase retrieval, the problem of recovering lost phase information from m...
research
06/02/2022

Machine Learning for Detection of 3D Features using sparse X-ray data

In many inertial confinement fusion experiments, the neutron yield and o...
research
02/25/2022

Predicting 4D Liver MRI for MR-guided Interventions

Organ motion poses an unresolved challenge in image-guided interventions...
research
12/12/2017

Online radio interferometric imaging: assimilating and discarding visibilities on arrival

The emerging generation of radio interferometric (RI) telescopes, such a...
research
02/10/2023

CEN-HDR: Computationally Efficient neural Network for real-time High Dynamic Range imaging

High dynamic range (HDR) imaging is still a challenging task in modern d...
research
10/09/2019

Deep Learning Accelerated Light Source Experiments

Experimental protocols at synchrotron light sources typically process an...

Please sign up or login with your details

Forgot password? Click here to reset