ML-SIM: A deep neural network for reconstruction of structured illumination microscopy images

03/24/2020
by   Charles N. Christensen, et al.
7

Structured illumination microscopy (SIM) has become an important technique for optical super-resolution imaging because it allows a doubling of image resolution at speeds compatible for live-cell imaging. However, the reconstruction of SIM images is often slow and prone to artefacts. Here we propose a versatile reconstruction method, ML-SIM, which makes use of machine learning. The model is an end-to-end deep residual neural network that is trained on a simulated data set to be free of common SIM artefacts. ML-SIM is thus robust to noise and irregularities in the illumination patterns of the raw SIM input frames. The reconstruction method is widely applicable and does not require the acquisition of experimental training data. Since the training data are generated from simulations of the SIM process on images from generic libraries the method can be efficiently adapted to specific experimental SIM implementations. The reconstruction quality enabled by our method is compared with traditional SIM reconstruction methods, and we demonstrate advantages in terms of noise, reconstruction fidelity and contrast for both simulated and experimental inputs. In addition, reconstruction of one SIM frame typically only takes  100ms to perform on PCs with modern Nvidia graphics cards, making the technique compatible with real-time imaging. The full implementation and the trained networks are available at http://ML-SIM.com.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8

research
11/17/2021

Fast and Light-Weight Network for Single Frame Structured Illumination Microscopy Super-Resolution

Structured illumination microscopy (SIM) is an important super-resolutio...
research
07/15/2022

Untrained, physics-informed neural networks for structured illumination microscopy

In recent years there has been great interest in using deep neural netwo...
research
10/26/2016

Structured illumination microscopy with unknown patterns and a statistical prior

Structured illumination microscopy (SIM) improves resolution by down-mod...
research
02/28/2022

Spatio-temporal Vision Transformer for Super-resolution Microscopy

Structured illumination microscopy (SIM) is an optical super-resolution ...
research
03/03/2020

Single-exposure absorption imaging of ultracold atoms using deep learning

Absorption imaging is the most common probing technique in experiments w...
research
06/03/2022

Dynamic Structured Illumination Microscopy with a Neural Space-time Model

Structured illumination microscopy (SIM) reconstructs a super-resolved i...
research
12/08/2022

NRTR: Neuron Reconstruction with Transformer from 3D Optical Microscopy Images

The neuron reconstruction from raw Optical Microscopy (OM) image stacks ...

Please sign up or login with your details

Forgot password? Click here to reset