Log In Sign Up

Noise2Sim – Similarity-based Self-Learning for Image Denoising

by   Chuang Niu, et al.

The key idea behind denoising methods is to perform a mean/averaging operation, either locally or non-locally. An observation on classic denoising methods is that non-local mean (NLM) outcomes are typically superior to locally denoised results. Despite achieving the best performance in image denoising, the supervised deep denoising methods require paired noise-clean data which are often unavailable. To address this challenge, Noise2Noise methods are based on the fact that paired noise-clean images can be replaced by paired noise-noise images which are easier to collect. However, in many scenarios the collection of paired noise-noise images are still impractical. To bypass labeled images, Noise2Void methods predict masked pixels from their surroundings in a single noisy image only. It is pitiful that neither Noise2Noise nor Noise2Void methods utilize self-similarities in an image as NLM methods do, while self-similarities/symmetries play a critical role in modern sciences. Here we propose Noise2Sim, an NLM-inspired self-learning method for image denoising. Specifically, Noise2Sim leverages self-similarities of image patches and learns to map between the center pixels of similar patches for self-consistent image denoising. Our statistical analysis shows that Noise2Sim tends to be equivalent to Noise2Noise under mild conditions. To accelerate the process of finding similar image patches, we design an efficient two-step procedure to provide data for Noise2Sim training, which can be iteratively conducted if needed. Extensive experiments demonstrate the superiority of Noise2Sim over Noise2Noise and Noise2Void on common benchmark datasets.


page 1

page 5

page 7

page 8


NLH: A Blind Pixel-level Non-local Method for Real-world Image Denoising

Non-local self similarity (NSS) is a powerful prior of natural images fo...

Unpaired Learning of Deep Image Denoising

We investigate the task of learning blind image denoising networks from ...

ISCL: Interdependent Self-Cooperative Learning for Unpaired Image Denoising

With the advent of advances in self-supervised learning, paired clean-no...

Adaptive noise imitation for image denoising

The effectiveness of existing denoising algorithms typically relies on a...

Unsupervised Image Noise Modeling with Self-Consistent GAN

Noise modeling lies in the heart of many image processing tasks. However...

Unsupervised Linear and Iterative Combinations of Patches for Image Denoising

We introduce a parametric view of non-local two-step denoisers, for whic...

Identifying Recurring Patterns with Deep Neural Networks for Natural Image Denoising

While there is a vast diversity in the patterns and textures that occur ...

Code Repositories