Deep Networks for Image Super-Resolution with Sparse Prior

by   Zhaowen Wang, et al.

Deep learning techniques have been successfully applied in many areas of computer vision, including low-level image restoration problems. For image super-resolution, several models based on deep neural networks have been recently proposed and attained superior performance that overshadows all previous handcrafted models. The question then arises whether large-capacity and data-driven models have become the dominant solution to the ill-posed super-resolution problem. In this paper, we argue that domain expertise represented by the conventional sparse coding model is still valuable, and it can be combined with the key ingredients of deep learning to achieve further improved results. We show that a sparse coding model particularly designed for super-resolution can be incarnated as a neural network, and trained in a cascaded structure from end to end. The interpretation of the network based on sparse coding leads to much more efficient and effective training, as well as a reduced model size. Our model is evaluated on a wide range of images, and shows clear advantage over existing state-of-the-art methods in terms of both restoration accuracy and human subjective quality.



There are no comments yet.


page 4

page 7

page 8


Cascade Convolutional Neural Network for Image Super-Resolution

With the development of the super-resolution convolutional neural networ...

Learning Hybrid Sparsity Prior for Image Restoration: Where Deep Learning Meets Sparse Coding

State-of-the-art approaches toward image restoration can be classified i...

Controlling Neural Networks via Energy Dissipation

The last decade has shown a tremendous success in solving various comput...

Densely Connected High Order Residual Network for Single Frame Image Super Resolution

Deep convolutional neural networks (DCNN) have been widely adopted for r...

Human-Guided Learning of Column Networks: Augmenting Deep Learning with Advice

Recently, deep models have been successfully applied in several applicat...

Neural Sparse Representation for Image Restoration

Inspired by the robustness and efficiency of sparse representation in sp...

Multitask Learning for VVC Quality Enhancement and Super-Resolution

The latest video coding standard, called versatile video coding (VVC), i...

Code Repositories


Matlab reimplementation of SCNSR

view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.