Isotropic reconstruction of 3D fluorescence microscopy images using convolutional neural networks

04/05/2017
by   Martin Weigert, et al.
0

Fluorescence microscopy images usually show severe anisotropy in axial versus lateral resolution. This hampers downstream processing, i.e. the automatic extraction of quantitative biological data. While deconvolution methods and other techniques to address this problem exist, they are either time consuming to apply or limited in their ability to remove anisotropy. We propose a method to recover isotropic resolution from readily acquired anisotropic data. We achieve this using a convolutional neural network that is trained end-to-end from the same anisotropic body of data we later apply the network to. The network effectively learns to restore the full isotropic resolution by restoring the image under a trained, sample specific image prior. We apply our method to 3 synthetic and 3 real datasets and show that our results improve on results from deconvolution and state-of-the-art super-resolution techniques. Finally, we demonstrate that a standard 3D segmentation pipeline performs on the output of our network with comparable accuracy as on the full isotropic data.

READ FULL TEXT

page 5

page 6

page 7

research
05/26/2017

Extracting 3D Vascular Structures from Microscopy Images using Convolutional Recurrent Networks

Vasculature is known to be of key biological significance, especially in...
research
03/20/2023

Fluctuation-based deconvolution in fluorescence microscopy using plug-and-play denoisers

The spatial resolution of images of living samples obtained by fluoresce...
research
06/02/2020

Fast and accurate aberration estimation from 3D bead images using convolutional neural networks

Estimating optical aberrations from volumetric intensity images is a key...
research
08/05/2016

Blind Deconvolution of PET Images using Anatomical Priors

Images from positron emission tomography (PET) provide metabolic informa...
research
07/07/2019

Adaptive Weighting Depth-variant Deconvolution of Fluorescence Microscopy Images with Convolutional Neural Network

Fluorescence microscopy plays an important role in biomedical research. ...
research
03/27/2015

Real-time multi-view deconvolution

In light-sheet microscopy, overall image content and resolution are impr...
research
10/29/2018

Burst ranking for blind multi-image deblurring

We propose a new incremental aggregation algorithm for multi-image deblu...

Please sign up or login with your details

Forgot password? Click here to reset