Distortion-Aware Loop Filtering of Intra 360^o Video Coding with Equirectangular Projection

02/20/2022
by   Pingping Zhang, et al.
0

In this paper, we propose a distortion-aware loop filtering model to improve the performance of intra coding for 360^o videos projected via equirectangular projection (ERP) format. To enable the awareness of distortion, our proposed module analyzes content characteristics based on a coding unit (CU) partition mask and processes them through partial convolution to activate the specified area. The feature recalibration module, which leverages cascaded residual channel-wise attention blocks (RCABs) to adjust the inter-channel and intra-channel features automatically, is capable of adapting with different quality levels. The perceptual geometry optimization combining with weighted mean squared error (WMSE) and the perceptual loss guarantees both the local field of view (FoV) and global image reconstruction with high quality. Extensive experimental results show that our proposed scheme achieves significant bitrate savings compared with the anchor (HM + 360Lib), leading to 8.9 WPSNR, and PSNR of two viewports for luminance component of 360^o videos, respectively.

READ FULL TEXT

page 1

page 2

page 6

page 7

page 8

page 10

page 11

page 12

research
06/24/2021

A Global Appearance and Local Coding Distortion based Fusion Framework for CNN based Filtering in Video Coding

In-loop filtering is used in video coding to process the reconstructed f...
research
04/21/2021

Visual Analysis Motivated Rate-Distortion Model for Image Coding

Optimized for pixel fidelity metrics, images compressed by existing imag...
research
09/25/2017

Spatial-Temporal Residue Network Based In-Loop Filter for Video Coding

Deep learning has demonstrated tremendous break through in the area of i...
research
04/08/2022

Deep Learning-Based Intra Mode Derivation for Versatile Video Coding

In intra coding, Rate Distortion Optimization (RDO) is performed to achi...
research
12/30/2020

An Efficient QP Variable Convolutional Neural Network Based In-loop Filter for Intra Coding

In this paper, a novel QP variable convolutional neural network based in...
research
11/07/2018

High-quality speech coding with SampleRNN

We provide a speech coding scheme employing a generative model based on ...
research
04/08/2021

Multi-Density Attention Network for Loop Filtering in Video Compression

Video compression is a basic requirement for consumer and professional v...

Please sign up or login with your details

Forgot password? Click here to reset