Axial-to-lateral super-resolution for 3D fluorescence microscopy using unsupervised deep learning

04/19/2021
by   Hyoungjun Park, et al.
0

Volumetric imaging by fluorescence microscopy is often limited by anisotropic spatial resolution from inferior axial resolution compared to the lateral resolution. To address this problem, here we present a deep-learning-enabled unsupervised super-resolution technique that enhances anisotropic images in volumetric fluorescence microscopy. In contrast to the existing deep learning approaches that require matched high-resolution target volume images, our method greatly reduces the effort to put into practice as the training of a network requires as little as a single 3D image stack, without a priori knowledge of the image formation process, registration of training data, or separate acquisition of target data. This is achieved based on the optimal transport driven cycle-consistent generative adversarial network that learns from an unpaired matching between high-resolution 2D images in lateral image plane and low-resolution 2D images in the other planes. Using fluorescence confocal microscopy and light-sheet microscopy, we demonstrate that the trained network not only enhances axial resolution beyond the diffraction limit, but also enhances suppressed visual details between the imaging planes and removes imaging artifacts.

READ FULL TEXT

page 2

page 3

page 4

page 11

page 12

page 14

page 16

page 18

research
01/07/2018

High-throughput, high-resolution Generated Adversarial Network Microscopy

We for the first time combine generated adversarial network (GAN) with w...
research
01/30/2019

Resolution enhancement in scanning electron microscopy using deep learning

We report resolution enhancement in scanning electron microscopy (SEM) i...
research
03/07/2021

Deep learning-based super-resolution fluorescence microscopy on small datasets

Fluorescence microscopy has enabled a dramatic development in modern bio...
research
11/17/2021

Fast and Light-Weight Network for Single Frame Structured Illumination Microscopy Super-Resolution

Structured illumination microscopy (SIM) is an important super-resolutio...
research
12/22/2020

Deep learning-based virtual refocusing of images using an engineered point-spread function

We present a virtual image refocusing method over an extended depth of f...
research
11/28/2016

Multi-resolution Data Fusion for Super-Resolution Electron Microscopy

Perhaps surprisingly, the total electron microscopy (EM) data collected ...
research
12/30/2019

Self-Supervised Fine-tuning for Image Enhancement of Super-Resolution Deep Neural Networks

While Deep Neural Networks (DNNs) trained for image and video super-reso...

Please sign up or login with your details

Forgot password? Click here to reset