Super-resolving Compressed Images via Parallel and Series Integration of Artifact Reduction and Resolution Enhancement

03/02/2021
by   Hongming Luo, et al.
0

In this paper, we propose a novel compressed image super resolution (CISR) framework based on parallel and series integration of artifact removal and resolution enhancement. Based on maximum a posterior inference for estimating a clean low-resolution (LR) input image and a clean high resolution (HR) output image from down-sampled and compressed observations, we have designed a CISR architecture consisting of two deep neural network modules: the artifact reduction module (ARM) and resolution enhancement module (REM). ARM and REM work in parallel with both taking the compressed LR image as their inputs, while they also work in series with REM taking the output of ARM as one of its inputs and ARM taking the output of REM as its other input. A unique property of our CSIR system is that a single trained model is able to super-resolve LR images compressed by different methods to various qualities. This is achieved by exploiting deep neural net-works capacity for handling image degradations, and the parallel and series connections between ARM and REM to reduce the dependency on specific degradations. ARM and REM are trained simultaneously by the deep unfolding technique. Experiments are conducted on a mixture of JPEG and WebP compressed images without a priori knowledge of the compression type and com-pression factor. Visual and quantitative comparisons demonstrate the superiority of our method over state-of-the-art super resolu-tion methods.Code link: https://github.com/luohongming/CISR_PSI

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 19

page 20

page 22

page 23

page 24

page 25

page 26

page 29

04/06/2020

Lossless Image Compression through Super-Resolution

We introduce a simple and efficient lossless image compression algorithm...
01/16/2022

CISRNet: Compressed Image Super-Resolution Network

In recent years, tons of research has been conducted on Single Image Sup...
09/26/2019

Lightweight Image Super-Resolution with Information Multi-distillation Network

In recent years, single image super-resolution (SISR) methods using deep...
09/19/2017

CISRDCNN: Super-resolution of compressed images using deep convolutional neural networks

In recent years, much research has been conducted on image super-resolut...
10/18/2019

Multimodal Image Super-resolution via Deep Unfolding with Side Information

Deep learning methods have been successfully applied to various computer...
07/08/2019

Fully Convolutional Network for Removing DCT Artefacts From Images

Deep learning methods achieve excellent results in image transformations...
06/16/2020

Explorable Decoding of Compressed Images

The ever-growing amounts of visual contents captured on a daily basis ne...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.