Deep Networks for Image Super-Resolution with Sparse Prior

07/31/2015
by   Zhaowen Wang, et al.
0

Deep learning techniques have been successfully applied in many areas of computer vision, including low-level image restoration problems. For image super-resolution, several models based on deep neural networks have been recently proposed and attained superior performance that overshadows all previous handcrafted models. The question then arises whether large-capacity and data-driven models have become the dominant solution to the ill-posed super-resolution problem. In this paper, we argue that domain expertise represented by the conventional sparse coding model is still valuable, and it can be combined with the key ingredients of deep learning to achieve further improved results. We show that a sparse coding model particularly designed for super-resolution can be incarnated as a neural network, and trained in a cascaded structure from end to end. The interpretation of the network based on sparse coding leads to much more efficient and effective training, as well as a reduced model size. Our model is evaluated on a wide range of images, and shows clear advantage over existing state-of-the-art methods in terms of both restoration accuracy and human subjective quality.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 4

page 7

page 8

08/24/2020

Cascade Convolutional Neural Network for Image Super-Resolution

With the development of the super-resolution convolutional neural networ...
07/18/2018

Learning Hybrid Sparsity Prior for Image Restoration: Where Deep Learning Meets Sparse Coding

State-of-the-art approaches toward image restoration can be classified i...
04/05/2019

Controlling Neural Networks via Energy Dissipation

The last decade has shown a tremendous success in solving various comput...
04/16/2018

Densely Connected High Order Residual Network for Single Frame Image Super Resolution

Deep convolutional neural networks (DCNN) have been widely adopted for r...
04/15/2019

Human-Guided Learning of Column Networks: Augmenting Deep Learning with Advice

Recently, deep models have been successfully applied in several applicat...
06/08/2020

Neural Sparse Representation for Image Restoration

Inspired by the robustness and efficiency of sparse representation in sp...
04/16/2021

Multitask Learning for VVC Quality Enhancement and Super-Resolution

The latest video coding standard, called versatile video coding (VVC), i...

Code Repositories

SCN_Matlab

Matlab reimplementation of SCNSR


view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.