Physical model simulator-trained neural network for computational 3D phase imaging of multiple-scattering samples

03/29/2021
by   Alex Matlock, et al.
13

Recovering 3D phase features of complex, multiple-scattering biological samples traditionally sacrifices computational efficiency and processing time for physical model accuracy and reconstruction quality. This trade-off hinders the rapid analysis of living, dynamic biological samples that are often of greatest interest to biological research. Here, we overcome this bottleneck by combining annular intensity diffraction tomography (aIDT) with an approximant-guided deep learning framework. Using a novel physics model simulator-based learning strategy trained entirely on natural image datasets, we show our network can robustly reconstruct complex 3D biological samples of arbitrary size and structure. This approach highlights that large-scale multiple-scattering models can be leveraged in place of acquiring experimental datasets for achieving highly generalizable deep learning models. We devise a new model-based data normalization pre-processing procedure for homogenizing the sample contrast and achieving uniform prediction quality regardless of scattering strength. To achieve highly efficient training and prediction, we implement a lightweight 2D network structure that utilizes a multi-channel input for encoding the axial information. We demonstrate this framework's capabilities on experimental measurements of epithelial buccal cells and Caenorhabditis elegans worms. We highlight the robustness of this approach by evaluating dynamic samples on a living worm video, and we emphasize our approach's generalizability by recovering algae samples evaluated with different experimental setups. To assess the prediction quality, we develop a novel quantitative evaluation metric and show that our predictions are consistent with our experimental measurements and multiple-scattering physics.

READ FULL TEXT

page 2

page 4

page 5

page 6

page 7

page 9

research
07/28/2022

Physics-informed neural networks for diffraction tomography

We propose a physics-informed neural network as the forward model for to...
research
07/12/2023

Local Conditional Neural Fields for Versatile and Generalizable Large-Scale Reconstructions in Computational Imaging

Deep learning has transformed computational imaging, but traditional pix...
research
12/10/2020

3D Scattering Tomography by Deep Learning with Architecture Tailored to Cloud Fields

We present 3DeepCT, a deep neural network for computed tomography, which...
research
09/24/2020

Robust Phase Unwrapping via Deep Image Prior for Quantitative Phase Imaging

Quantitative phase imaging (QPI) is an emerging label-free technique tha...
research
02/01/2022

Disentangling multiple scattering with deep learning: application to strain mapping from electron diffraction patterns

Implementation of a fast, robust, and fully-automated pipeline for cryst...
research
04/17/2023

Physics-inspired Neuroacoustic Computing Based on Tunable Nonlinear Multiple-scattering

Waves, such as light and sound, inherently bounce and mix due to multipl...
research
04/08/2023

Capturing dynamical correlations using implicit neural representations

The observation and description of collective excitations in solids is a...

Please sign up or login with your details

Forgot password? Click here to reset