Untrained, physics-informed neural networks for structured illumination microscopy

07/15/2022
by   Zachary Burns, et al.
0

In recent years there has been great interest in using deep neural networks (DNN) for super-resolution image reconstruction including for structured illumination microscopy (SIM). While these methods have shown very promising results, they all rely on data-driven, supervised training strategies that need a large number of ground truth images, which is experimentally difficult to realize. For SIM imaging, there exists a need for a flexible, general, and open-source reconstruction method that can be readily adapted to different forms of structured illumination. We demonstrate that we can combine a deep neural network with the forward model of the structured illumination process to reconstruct sub-diffraction images without training data. The resulting physics-informed neural network (PINN) can be optimized on a single set of diffraction limited sub-images and thus doesn't require any training set. We show with simulated and experimental data that this PINN can be applied to a wide variety of SIM methods by simply changing the known illumination patterns used in the loss function and can achieve resolution improvements that match well with theoretical expectations.

READ FULL TEXT

page 3

page 6

page 7

page 8

page 9

page 18

page 21

research
03/24/2020

ML-SIM: A deep neural network for reconstruction of structured illumination microscopy images

Structured illumination microscopy (SIM) has become an important techniq...
research
02/19/2016

Structured illumination microscopy image reconstruction algorithm

Structured illumination microscopy (SIM) is a very important super-resol...
research
06/03/2022

Dynamic Structured Illumination Microscopy with a Neural Space-time Model

Structured illumination microscopy (SIM) reconstructs a super-resolved i...
research
10/26/2016

Structured illumination microscopy with unknown patterns and a statistical prior

Structured illumination microscopy (SIM) improves resolution by down-mod...
research
09/19/2019

PgNN: Physics-guided Neural Network for Fourier Ptychographic Microscopy

Fourier ptychography (FP) is a newly developed computational imaging app...
research
09/04/2020

Improving axial resolution in SIM using deep learning

Structured Illumination Microscopy is a widespread methodology to image ...
research
03/09/2018

Solving Fourier ptychographic imaging problems via neural network modeling and TensorFlow

Fourier ptychography is a recently developed imaging approach for large ...

Please sign up or login with your details

Forgot password? Click here to reset