Recurrent neural network-based volumetric fluorescence microscopy

10/21/2020
by   Luzhe Huang, et al.
0

Volumetric imaging of samples using fluorescence microscopy plays an important role in various fields including physical, medical and life sciences. Here we report a deep learning-based volumetric image inference framework that uses 2D images that are sparsely captured by a standard wide-field fluorescence microscope at arbitrary axial positions within the sample volume. Through a recurrent convolutional neural network, which we term as Recurrent-MZ, 2D fluorescence information from a few axial planes within the sample is explicitly incorporated to digitally reconstruct the sample volume over an extended depth-of-field. Using experiments on C. Elegans and nanobead samples, Recurrent-MZ is demonstrated to increase the depth-of-field of a 63x/1.4NA objective lens by approximately 50-fold, also providing a 30-fold reduction in the number of axial scans required to image the same sample volume. We further illustrated the generalization of this recurrent network for 3D imaging by showing its resilience to varying imaging conditions, including e.g., different sequences of input images, covering various axial permutations and unknown axial positioning errors. Recurrent-MZ demonstrates the first application of recurrent neural networks in microscopic image reconstruction and provides a flexible and rapid volumetric imaging framework, overcoming the limitations of current 3D scanning microscopy tools.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 3

page 4

page 5

page 6

page 7

page 9

page 10

11/17/2018

Cross-modality deep learning brings bright-field microscopy contrast to holography

Deep learning brings bright-field microscopy contrast to holographic ima...
01/31/2019

Three-dimensional propagation and time-reversal of fluorescence images

Unlike holography, fluorescence microscopy lacks an image propagation an...
03/24/2020

Learning to Reconstruct Confocal Microscopy Stacks from Single Light Field Images

We present a novel deep learning approach to reconstruct confocal micros...
04/21/2021

Programmable 3D snapshot microscopy with Fourier convolutional networks

3D snapshot microscopy enables volumetric imaging as fast as a camera al...
12/22/2020

Deep learning-based virtual refocusing of images using an engineered point-spread function

We present a virtual image refocusing method over an extended depth of f...
05/01/2022

Analysis of Diffractive Neural Networks for Seeing Through Random Diffusers

Imaging through diffusive media is a challenging problem, where the exis...
10/12/2020

Miniscope3D: optimized single-shot miniature 3D fluorescence microscopy

Miniature fluorescence microscopes are a standard tool in systems biolog...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.