End-to-End JPEG Decoding and Artifacts Suppression Using Heterogeneous Residual Convolutional Neural Network

07/01/2020
by   Jun Niu, et al.
0

Existing deep learning models separate JPEG artifacts suppression from the decoding protocol as independent task. In this work, we take one step forward to design a true end-to-end heterogeneous residual convolutional neural network (HR-CNN) with spectrum decomposition and heterogeneous reconstruction mechanism. Benefitting from the full CNN architecture and GPU acceleration, the proposed model considerably improves the reconstruction efficiency. Numerical experiments show that the overall reconstruction speed reaches to the same magnitude of the standard CPU JPEG decoding protocol, while both decoding and artifacts suppression are completed together. We formulate the JPEG artifacts suppression task as an interactive process of decoding and image detail reconstructions. A heterogeneous, fully convolutional, mechanism is proposed to particularly address the uncorrelated nature of different spectral channels. Directly starting from the JPEG code in k-space, the network first extracts the spectral samples channel by channel, and restores the spectral snapshots with expanded throughput. These intermediate snapshots are then heterogeneously decoded and merged into the pixel space image. A cascaded residual learning segment is designed to further enhance the image details. Experiments verify that the model achieves outstanding performance in JPEG artifacts suppression, while its full convolutional operations and elegant network structure offers higher computational efficiency for practical online usage compared with other deep learning models on this topic.

READ FULL TEXT

page 1

page 5

page 8

research
03/27/2021

Scalable and Efficient Neural Speech Coding

This work presents a scalable and efficient neural waveform codec (NWC) ...
research
10/09/2019

A cascaded dual-domain deep learning reconstruction method for sparsely spaced multidetector helical CT

Helical CT has been widely used in clinical diagnosis. Sparsely spaced m...
research
10/26/2020

Generative Tomography Reconstruction

We propose an end-to-end differentiable architecture for tomography reco...
research
06/01/2018

Hyperspectral Image Denoising Employing a Spatial-Spectral Deep Residual Convolutional Neural Network

Hyperspectral image (HSI) denoising is a crucial preprocessing procedure...
research
07/18/2017

An Iterative BP-CNN Architecture for Channel Decoding

Inspired by recent advances in deep learning, we propose a novel iterati...
research
05/22/2017

Boosting the accuracy of multi-spectral image pan-sharpening by learning a deep residual network

In the field of fusing multi-spectral and panchromatic images (Pan-sharp...

Please sign up or login with your details

Forgot password? Click here to reset