Dynamic Structured Illumination Microscopy with a Neural Space-time Model

06/03/2022
by   Ruiming Cao, et al.
0

Structured illumination microscopy (SIM) reconstructs a super-resolved image from multiple raw images captured with different illumination patterns; hence, acquisition speed is limited, making it unsuitable for dynamic scenes. We propose a new method, Speckle Flow SIM, that uses static patterned illumination with moving samples and models the sample motion during data capture in order to reconstruct the dynamic scene with super-resolution. Speckle Flow SIM relies on sample motion to capture a sequence of raw images. The spatio-temporal relationship of the dynamic scene is modeled using a neural space-time model with coordinate-based multi-layer perceptrons (MLPs), and the motion dynamics and the super-resolved scene are jointly recovered. We validate Speckle Flow SIM for coherent imaging in simulation and build a simple, inexpensive experimental setup with off-the-shelf components. We demonstrate that Speckle Flow SIM can reconstruct a dynamic scene with deformable motion and 1.88x the diffraction-limited resolution in experiment.

READ FULL TEXT

page 2

page 4

page 5

page 7

page 8

page 9

page 10

research
02/28/2022

Spatio-temporal Vision Transformer for Super-resolution Microscopy

Structured illumination microscopy (SIM) is an optical super-resolution ...
research
07/15/2022

Untrained, physics-informed neural networks for structured illumination microscopy

In recent years there has been great interest in using deep neural netwo...
research
11/17/2021

Fast and Light-Weight Network for Single Frame Structured Illumination Microscopy Super-Resolution

Structured illumination microscopy (SIM) is an important super-resolutio...
research
03/24/2020

ML-SIM: A deep neural network for reconstruction of structured illumination microscopy images

Structured illumination microscopy (SIM) has become an important techniq...
research
09/02/2021

Dynamic Scene Novel View Synthesis via Deferred Spatio-temporal Consistency

Structure from motion (SfM) enables us to reconstruct a scene via casual...
research
10/22/2019

Towards an Intelligent Microscope: adaptively learned illumination for optimal sample classification

Recent machine learning techniques have dramatically changed how we proc...
research
02/19/2016

Structured illumination microscopy image reconstruction algorithm

Structured illumination microscopy (SIM) is a very important super-resol...

Please sign up or login with your details

Forgot password? Click here to reset