Estimating Fine-Grained Noise Model via Contrastive Learning

04/03/2022
by   Yunhao Zou, et al.
0

Image denoising has achieved unprecedented progress as great efforts have been made to exploit effective deep denoisers. To improve the denoising performance in realworld, two typical solutions are used in recent trends: devising better noise models for the synthesis of more realistic training data, and estimating noise level function to guide non-blind denoisers. In this work, we combine both noise modeling and estimation, and propose an innovative noise model estimation and noise synthesis pipeline for realistic noisy image generation. Specifically, our model learns a noise estimation model with fine-grained statistical noise model in a contrastive manner. Then, we use the estimated noise parameters to model camera-specific noise distribution, and synthesize realistic noisy training data. The most striking thing for our work is that by calibrating noise models of several sensors, our model can be extended to predict other cameras. In other words, we can estimate cameraspecific noise models for unknown sensors with only testing images, without laborious calibration frames or paired noisy/clean data. The proposed pipeline endows deep denoisers with competitive performances with state-of-the-art real noise modeling methods.

READ FULL TEXT

page 3

page 7

page 8

research
11/30/2020

Adaptive noise imitation for image denoising

The effectiveness of existing denoising algorithms typically relies on a...
research
01/31/2023

NoiseTransfer: Image Noise Generation with Contrastive Embeddings

Deep image denoising networks have achieved impressive success with the ...
research
07/12/2018

Toward Convolutional Blind Denoising of Real Photographs

Despite their success in Gaussian denoising, deep convolutional neural n...
research
06/02/2022

Noise2NoiseFlow: Realistic Camera Noise Modeling without Clean Images

Image noise modeling is a long-standing problem with many applications i...
research
04/18/2019

Generating Training Data for Denoising Real RGB Images via Camera Pipeline Simulation

Image reconstruction techniques such as denoising often need to be appli...
research
03/18/2021

Pseudo-ISP: Learning Pseudo In-camera Signal Processing Pipeline from A Color Image Denoiser

The success of deep denoisers on real-world color photographs usually re...
research
06/13/2019

Unsupervised Image Noise Modeling with Self-Consistent GAN

Noise modeling lies in the heart of many image processing tasks. However...

Please sign up or login with your details

Forgot password? Click here to reset