Pik-Fix: Restoring and Colorizing Old Photos

05/04/2022
by   Runsheng Xu, et al.
93

Restoring and inpainting the visual memories that are present, but often impaired, in old photos remains an intriguing but unsolved research topic. Decades-old photos often suffer from severe and commingled degradation such as cracks, defocus, and color-fading, which are difficult to treat individually and harder to repair when they interact. Deep learning presents a plausible avenue, but the lack of large-scale datasets of old photos makes addressing this restoration task very challenging. Here we present a novel reference-based end-to-end learning framework that is able to both repair and colorize old and degraded pictures. Our proposed framework consists of three modules: a restoration sub-network that conducts restoration from degradations, a similarity sub-network that performs color histogram matching and color transfer, and a colorization subnet that learns to predict the chroma elements of images that have been conditioned on chromatic reference signals. The overall system makes use of color histogram priors from reference images, which greatly reduces the need for large-scale training data. We have also created a first-of-a-kind public dataset of real old photos that are paired with ground truth "pristine" photos that have been that have been manually restored by PhotoShop experts. We conducted extensive experiments on this dataset and synthetic datasets, and found that our method significantly outperforms previous state-of-the-art models using both qualitative comparisons and quantitative measurements.

READ FULL TEXT

page 1

page 3

page 6

page 7

research
02/05/2022

ROMNet: Renovate the Old Memories

Renovating the memories in old photos is an intriguing research topic in...
research
04/20/2020

Bringing Old Photos Back to Life

We propose to restore old photos that suffer from severe degradation thr...
research
09/14/2020

Old Photo Restoration via Deep Latent Space Translation

We propose to restore old photos that suffer from severe degradation thr...
research
12/22/2020

Time-Travel Rephotography

Many historical people are captured only in old, faded, black and white ...
research
03/31/2022

Bringing Old Films Back to Life

We present a learning-based framework, recurrent transformer network (RT...
research
08/14/2021

Focusing on Persons: Colorizing Old Images Learning from Modern Historical Movies

In industry, there exist plenty of scenarios where old gray photos need ...
research
10/28/2019

Reply to: Large-scale quantitative profiling of the Old English verse tradition

In Nature Human Behaviour 3/2019, an article was published entitled "Lar...

Please sign up or login with your details

Forgot password? Click here to reset