MFRNet: A New CNN Architecture for Post-Processing and In-loop Filtering

07/14/2020
by   Di Ma, et al.
4

In this paper, we propose a novel convolutional neural network (CNN) architecture, MFRNet, for post-processing (PP) and in-loop filtering (ILF) in the context of video compression. This network consists of four Multi-level Feature review Residual dense Blocks (MFRBs), which are connected using a cascading structure. Each MFRB extracts features from multiple convolutional layers using dense connections and a multi-level residual learning structure. In order to further improve information flow between these blocks, each of them also reuses high dimensional features from the previous MFRB. This network has been integrated into PP and ILF coding modules for both HEVC (HM 16.20) and VVC (VTM 7.0), and fully evaluated under the JVET Common Test Conditions using the Random Access configuration. The experimental results show significant and consistent coding gains over both anchor codecs (HEVC HM and VVC VTM) and also over other existing CNN-based PP/ILF approaches based on Bjontegaard Delta measurements using both PSNR and VMAF for quality assessment. When MFRNet is integrated into HM 16.20, gains up to 16.0 ILF, and up to 21.0 are up to 5.1

READ FULL TEXT

page 1

page 3

page 4

page 10

research
09/16/2020

Video Compression with CNN-based Post Processing

In recent years, video compression techniques have been significantly ch...
research
11/18/2020

CVEGAN: A Perceptually-inspired GAN for Compressed Video Enhancement

We propose a new Generative Adversarial Network for Compressed Video qua...
research
04/02/2019

Effective Aesthetics Prediction with Multi-level Spatially Pooled Features

We propose an effective deep learning approach to aesthetics quality ass...
research
01/01/2023

GoogLe2Net: Going Transverse with Convolutions

Capturing feature information effectively is of great importance in visi...
research
04/10/2020

CNN-BASED DETECTION OF GENERIC CONTRAST ADJUSTMENT WITH JPEG POST-PROCESSING

processing is known to be a challenging task. JPEG post processing is of...
research
05/24/2018

Environmental Sound Classification Based on Multi-temporal Resolution Convolutional Neural Network Combining with Multi-level Features

Motivated by the fact that characteristics of different sound classes ar...
research
04/29/2019

Deep Learning-Based Video Coding: A Review and A Case Study

The past decade has witnessed great success of deep learning technology ...

Please sign up or login with your details

Forgot password? Click here to reset