CycleGAN with a Blur Kernel for Deconvolution Microscopy: Optimal Transport Geometry

08/26/2019
by   Sungjun Lim, et al.
20

Deconvolution microscopy has been extensively used to improve the resolution of the widefield fluorescent microscopy. However, classical deconvolution approaches require the measurement or estimation of the point spread function (PSF), and are usually computationally expensive. Recently, convolutional neural network (CNN) approaches have been extensively studied as fast and high performance alternatives. Unfortunately, the CNN approaches usually require matched high resolution images for supervised training. In this paper, we present a novel unsupervised cycle-consistent generative adversarial network (cycleGAN) with a linear blur kernel, which can be used for both blind- and non-blind image deconvolution. In contrast to the conventional cycleGAN approaches that require two generators, the proposed cycleGAN approach needs only a single generator, which significantly improves the robustness of network training. We show that the proposed architecture is indeed a dual formulation of an optimal transport problem that uses a special form of penalized least squares as transport cost. Experimental results using simulated and real experimental data confirm the efficacy of the algorithm.

READ FULL TEXT

page 4

page 8

page 9

page 10

research
04/05/2019

Blind Deconvolution Microscopy Using Cycle Consistent CNN with Explicit PSF Layer

Deconvolution microscopy has been extensively used to improve the resolu...
research
09/25/2019

Optimal Transport, CycleGAN, and Penalized LS for Unsupervised Learning in Inverse Problems

The penalized least squares (PLS) is a classic approach to inverse probl...
research
08/29/2020

Unpaired Deep Learning for Accelerated MRI using Optimal Transport Driven CycleGAN

Recently, deep learning approaches for accelerated MRI have been extensi...
research
04/19/2019

Three dimensional blind image deconvolution for fluorescence microscopy using generative adversarial networks

Due to image blurring image deconvolution is often used for studying bio...
research
08/18/2023

Self-Supervised Single-Image Deconvolution with Siamese Neural Networks

Inverse problems in image reconstruction are fundamentally complicated b...
research
10/08/2020

Spatially-Variant CNN-based Point Spread Function Estimation for Blind Deconvolution and Depth Estimation in Optical Microscopy

Optical microscopy is an essential tool in biology and medicine. Imaging...
research
08/05/2021

Semi- and Self-Supervised Multi-View Fusion of 3D Microscopy Images using Generative Adversarial Networks

Recent developments in fluorescence microscopy allow capturing high-reso...

Please sign up or login with your details

Forgot password? Click here to reset