DeepAI AI Chat
Log In Sign Up

Blind Face Restoration via Deep Multi-scale Component Dictionaries

08/02/2020
by   Xiaoming Li, et al.
5

Recent reference-based face restoration methods have received considerable attention due to their great capability in recovering high-frequency details on real low-quality images. However, most of these methods require a high-quality reference image of the same identity, making them only applicable in limited scenes. To address this issue, this paper suggests a deep face dictionary network (termed as DFDNet) to guide the restoration process of degraded observations. To begin with, we use K-means to generate deep dictionaries for perceptually significant face components (, left/right eyes, nose and mouth) from high-quality images. Next, with the degraded input, we match and select the most similar component features from their corresponding dictionaries and transfer the high-quality details to the input via the proposed dictionary feature transfer (DFT) block. In particular, component AdaIN is leveraged to eliminate the style diversity between the input and dictionary features (, illumination), and a confidence score is proposed to adaptively fuse the dictionary feature to the input. Finally, multi-scale dictionaries are adopted in a progressive manner to enable the coarse-to-fine restoration. Experiments show that our proposed method can achieve plausible performance in both quantitative and qualitative evaluation, and more importantly, can generate realistic and promising results on real degraded images without requiring an identity-belonging reference. The source code and models are available at <https://github.com/csxmli2016/DFDNet>.

READ FULL TEXT

page 5

page 11

page 12

page 13

10/15/2022

Learning Dual Memory Dictionaries for Blind Face Restoration

To improve the performance of blind face restoration, recent works mainl...
09/18/2020

Progressive Semantic-Aware Style Transformation for Blind Face Restoration

Face restoration is important in face image processing, and has been wid...
05/13/2022

VQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decoder

Although generative facial prior and geometric prior have recently demon...
04/13/2018

Learning Warped Guidance for Blind Face Restoration

This paper studies the problem of blind face restoration from an unconst...
01/17/2022

RestoreFormer: High-Quality Blind Face Restoration From Undegraded Key-Value Pairs

Blind face restoration is to recover a high-quality face image from unkn...
05/06/2018

Multi-Scale Face Restoration with Sequential Gating Ensemble Network

Restoring face images from distortions is important in face recognition ...

Code Repositories

DFDNet

Blind Face Restoration via Deep Multi-scale Component Dictionaries (ECCV 2020)


view repo