Controllable Confidence-Based Image Denoising

06/17/2021
by   Haley Owsianko, et al.
2

Image denoising is a classic restoration problem. Yet, current deep learning methods are subject to the problems of generalization and interpretability. To mitigate these problems, in this project, we present a framework that is capable of controllable, confidence-based noise removal. The framework is based on the fusion between two different denoised images, both derived from the same noisy input. One of the two is denoised using generic algorithms (e.g. Gaussian), which make few assumptions on the input images, therefore, generalize in all scenarios. The other is denoised using deep learning, performing well on seen datasets. We introduce a set of techniques to fuse the two components smoothly in the frequency domain. Beyond that, we estimate the confidence of a deep learning denoiser to allow users to interpret the output, and provide a fusion strategy that safeguards them against out-of-distribution inputs. Through experiments, we demonstrate the effectiveness of the proposed framework in different use cases.

READ FULL TEXT

page 2

page 7

page 8

page 9

page 10

page 11

page 12

page 13

research
01/02/2022

Image Denoising with Control over Deep Network Hallucination

Deep image denoisers achieve state-of-the-art results but with a hidden ...
research
12/31/2019

Deep Learning on Image Denoising: An overview

Deep learning techniques have obtained much attention in image denoising...
research
08/29/2019

Variational Denoising Network: Toward Blind Noise Modeling and Removal

Blind image denoising is an important yet very challenging problem in co...
research
05/22/2023

Restore Anything Pipeline: Segment Anything Meets Image Restoration

Recent image restoration methods have produced significant advancements ...
research
03/23/2023

Masked Image Training for Generalizable Deep Image Denoising

When capturing and storing images, devices inevitably introduce noise. R...
research
05/12/2021

Operation-wise Attention Network for Tampering Localization Fusion

In this work, we present a deep learning-based approach for image tamper...
research
07/16/2022

CharFormer: A Glyph Fusion based Attentive Framework for High-precision Character Image Denoising

Degraded images commonly exist in the general sources of character image...

Please sign up or login with your details

Forgot password? Click here to reset