DeepAI AI Chat
Log In Sign Up

DenoiSeg: Joint Denoising and Segmentation

by   Tim-Oliver Buchholz, et al.

Microscopy image analysis often requires the segmentation of objects, but training data for this task is typically scarce and hard to obtain. Here we propose DenoiSeg, a new method that can be trained end-to-end on only a few annotated ground truth segmentations. We achieve this by extending Noise2Void, a self-supervised denoising scheme that can be trained on noisy images alone, to also predict dense 3-class segmentations. The reason for the success of our method is that segmentation can profit from denoising, especially when performed jointly within the same network. The network becomes a denoising expert by seeing all available raw data, while co-learning to segment, even if only a few segmentation labels are available. This hypothesis is additionally fueled by our observation that the best segmentation results on high quality (very low noise) raw data are obtained when moderate amounts of synthetic noise are added. This renders the denoising-task non-trivial and unleashes the desired co-learning effect. We believe that DenoiSeg offers a viable way to circumvent the tremendous hunger for high quality training data and effectively enables few-shot learning of dense segmentations.


Leveraging Self-supervised Denoising for Image Segmentation

Deep learning (DL) has arguably emerged as the method of choice for the ...

Joint Optical Neuroimaging Denoising with Semantic Tasks

Optical neuroimaging is a vital tool for understanding the brain structu...

Joint demosaicing and denoising by overfitting of bursts of raw images

Demosaicking and denoising are the first steps of any camera image proce...

Deep Denoising Method for Side Scan Sonar Images without High-quality Reference Data

Subsea images measured by the side scan sonars (SSSs) are necessary visu...

Patch-Craft Self-Supervised Training for Correlated Image Denoising

Supervised neural networks are known to achieve excellent results in var...

Unsupervised Deep Video Denoising

Deep convolutional neural networks (CNNs) currently achieve state-of-the...

Model-Based Image Signal Processors via Learnable Dictionaries

Digital cameras transform sensor RAW readings into RGB images by means o...