Recurrent neural network-based volumetric fluorescence microscopy

by   Luzhe Huang, et al.

Volumetric imaging of samples using fluorescence microscopy plays an important role in various fields including physical, medical and life sciences. Here we report a deep learning-based volumetric image inference framework that uses 2D images that are sparsely captured by a standard wide-field fluorescence microscope at arbitrary axial positions within the sample volume. Through a recurrent convolutional neural network, which we term as Recurrent-MZ, 2D fluorescence information from a few axial planes within the sample is explicitly incorporated to digitally reconstruct the sample volume over an extended depth-of-field. Using experiments on C. Elegans and nanobead samples, Recurrent-MZ is demonstrated to increase the depth-of-field of a 63x/1.4NA objective lens by approximately 50-fold, also providing a 30-fold reduction in the number of axial scans required to image the same sample volume. We further illustrated the generalization of this recurrent network for 3D imaging by showing its resilience to varying imaging conditions, including e.g., different sequences of input images, covering various axial permutations and unknown axial positioning errors. Recurrent-MZ demonstrates the first application of recurrent neural networks in microscopic image reconstruction and provides a flexible and rapid volumetric imaging framework, overcoming the limitations of current 3D scanning microscopy tools.



There are no comments yet.


page 3

page 4

page 5

page 6

page 7

page 9

page 10


Cross-modality deep learning brings bright-field microscopy contrast to holography

Deep learning brings bright-field microscopy contrast to holographic ima...

Three-dimensional propagation and time-reversal of fluorescence images

Unlike holography, fluorescence microscopy lacks an image propagation an...

Learning to Reconstruct Confocal Microscopy Stacks from Single Light Field Images

We present a novel deep learning approach to reconstruct confocal micros...

Programmable 3D snapshot microscopy with Fourier convolutional networks

3D snapshot microscopy enables volumetric imaging as fast as a camera al...

Deep learning-based virtual refocusing of images using an engineered point-spread function

We present a virtual image refocusing method over an extended depth of f...

Analysis of Diffractive Neural Networks for Seeing Through Random Diffusers

Imaging through diffusive media is a challenging problem, where the exis...

Miniscope3D: optimized single-shot miniature 3D fluorescence microscopy

Miniature fluorescence microscopes are a standard tool in systems biolog...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.