Legacy Photo Editing with Learned Noise Prior

11/23/2020
by   Zhao Yuzhi, et al.
8

There are quite a number of photographs captured under undesirable conditions in the last century. Thus, they are often noisy, regionally incomplete, and grayscale formatted. Conventional approaches mainly focus on one point so that those restoration results are not perceptually sharp or clean enough. To solve these problems, we propose a noise prior learner NEGAN to simulate the noise distribution of real legacy photos using unpaired images. It mainly focuses on matching high-frequency parts of noisy images through discrete wavelet transform (DWT) since they include most of noise statistics. We also create a large legacy photo dataset for learning noise prior. Using learned noise prior, we can easily build valid training pairs by degrading clean images. Then, we propose an IEGAN framework performing image editing including joint denoising, inpainting and colorization based on the estimated noise prior. We evaluate the proposed system and compare it with state-of-the-art image enhancement methods. The experimental results demonstrate that it achieves the best perceptual quality. https://github.com/zhaoyuzhi/Legacy-Photo-Editing-with-Learned-Noise-Prior for the codes and the proposed LP dataset.

READ FULL TEXT

page 2

page 4

page 5

page 6

page 7

page 8

research
08/01/2021

CERL: A Unified Optimization Framework for Light Enhancement with Realistic Noise

Low-light images captured in the real world are inevitably corrupted by ...
research
07/12/2020

Dual Adversarial Network: Toward Real-world Noise Removal and Noise Generation

Real-world image noise removal is a long-standing yet very challenging t...
research
03/16/2020

A CNN-Based Blind Denoising Method for Endoscopic Images

The quality of images captured by wireless capsule endoscopy (WCE) is ke...
research
11/11/2021

FINO: Flow-based Joint Image and Noise Model

One of the fundamental challenges in image restoration is denoising, whe...
research
07/07/2022

D2HNet: Joint Denoising and Deblurring with Hierarchical Network for Robust Night Image Restoration

Night imaging with modern smartphone cameras is troublesome due to low p...
research
06/13/2019

Unsupervised Image Noise Modeling with Self-Consistent GAN

Noise modeling lies in the heart of many image processing tasks. However...
research
12/11/2014

High-level numerical simulations of noise in CCD and CMOS photosensors: review and tutorial

In many applications, such as development and testing of image processin...

Please sign up or login with your details

Forgot password? Click here to reset