Generalizable Denoising of Microscopy Images using Generative Adversarial Networks and Contrastive Learning

03/27/2023
by   Felix Fuentes-Hurtado, et al.
0

Microscopy images often suffer from high levels of noise, which can hinder further analysis and interpretation. Content-aware image restoration (CARE) methods have been proposed to address this issue, but they often require large amounts of training data and suffer from over-fitting. To overcome these challenges, we propose a novel framework for few-shot microscopy image denoising. Our approach combines a generative adversarial network (GAN) trained via contrastive learning (CL) with two structure preserving loss terms (Structural Similarity Index and Total Variation loss) to further improve the quality of the denoised images using little data. We demonstrate the effectiveness of our method on three well-known microscopy imaging datasets, and show that we can drastically reduce the amount of training data while retaining the quality of the denoising, thus alleviating the burden of acquiring paired data and enabling few-shot learning. The proposed framework can be easily extended to other image restoration tasks and has the potential to significantly advance the field of microscopy image analysis.

READ FULL TEXT

page 1

page 5

page 6

page 7

research
10/31/2019

Multi-defect microscopy image restoration under limited data conditions

Deep learning methods are becoming widely used for restoration of defect...
research
10/12/2018

Cryo-CARE: Content-Aware Image Restoration for Cryo-Transmission Electron Microscopy Data

Multiple approaches to use deep learning for image restoration have rece...
research
04/19/2019

Three dimensional blind image deconvolution for fluorescence microscopy using generative adversarial networks

Due to image blurring image deconvolution is often used for studying bio...
research
07/26/2023

Phenotype-preserving metric design for high-content image reconstruction by generative inpainting

In the past decades, automated high-content microscopy demonstrated its ...
research
05/06/2020

DenoiSeg: Joint Denoising and Segmentation

Microscopy image analysis often requires the segmentation of objects, bu...
research
11/25/2019

Microscopy Image Restoration with Deep Wiener-Kolmogorov filters

Microscopy is a powerful visualization tool in biology, enabling the stu...
research
04/02/2017

Restoration of Images with Wavefront Aberrations

This contribution deals with image restoration in optical systems with c...

Please sign up or login with your details

Forgot password? Click here to reset