Multi-level Encoder-Decoder Architectures for Image Restoration

05/01/2019
by   Indra Deep Mastan, et al.
22

Many real-world solutions for image restoration are learning-free and based on handcrafted image priors such as self-similarity. Recently, deep-learning methods that use training data have achieved state-of-the-art results in various image restoration tasks (e.g., super-resolution and inpainting). Ulyanov et al. bridge the gap between these two families of methods (CVPR 18). They have shown that learning-free methods perform close to the state-of-the-art learning-based methods (approximately 1 PSNR). Their approach benefits from the encoder-decoder network. In this paper, we propose a framework based on the multi-level extensions of the encoder-decoder network, to investigate interesting aspects of the relationship between image restoration and network construction independent of learning. Our framework allows various network structures by modifying the following network components: skip links, cascading of the network input into intermediate layers, a composition of the encoder-decoder subnetworks, and network depth. These handcrafted network structures illustrate how the construction of untrained networks influence the following image restoration tasks: denoising, super-resolution, and inpainting. We also demonstrate image reconstruction using flash and no-flash image pairs. We provide performance comparisons with the state-of-the-art methods for all the restoration tasks above.

READ FULL TEXT

page 5

page 6

page 7

page 8

research
11/14/2022

CurvPnP: Plug-and-play Blind Image Restoration with Deep Curvature Denoiser

Due to the development of deep learning-based denoisers, the plug-and-pl...
research
12/09/2019

DCIL: Deep Contextual Internal Learning for Image Restoration and Image Retargeting

Recently, there is a vast interest in developing methods which are indep...
research
02/28/2023

TextIR: A Simple Framework for Text-based Editable Image Restoration

Most existing image restoration methods use neural networks to learn str...
research
11/29/2017

Deep Image Prior

Deep convolutional networks have become a popular tool for image generat...
research
06/10/2023

Learning Image-Adaptive Codebooks for Class-Agnostic Image Restoration

Recent work on discrete generative priors, in the form of codebooks, has...
research
01/14/2021

DeFlow: Learning Complex Image Degradations from Unpaired Data with Conditional Flows

The difficulty of obtaining paired data remains a major bottleneck for l...
research
06/02/2023

HD-DEMUCS: General Speech Restoration with Heterogeneous Decoders

This paper introduces an end-to-end neural speech restoration model, HD-...

Please sign up or login with your details

Forgot password? Click here to reset