Efficient VVC Intra Prediction Based on Deep Feature Fusion and Probability Estimation

05/07/2022
by   Tiesong Zhao, et al.
0

The ever-growing multimedia traffic has underscored the importance of effective multimedia codecs. Among them, the up-to-date lossy video coding standard, Versatile Video Coding (VVC), has been attracting attentions of video coding community. However, the gain of VVC is achieved at the cost of significant encoding complexity, which brings the need to realize fast encoder with comparable Rate Distortion (RD) performance. In this paper, we propose to optimize the VVC complexity at intra-frame prediction, with a two-stage framework of deep feature fusion and probability estimation. At the first stage, we employ the deep convolutional network to extract the spatialtemporal neighboring coding features. Then we fuse all reference features obtained by different convolutional kernels to determine an optimal intra coding depth. At the second stage, we employ a probability-based model and the spatial-temporal coherence to select the candidate partition modes within the optimal coding depth. Finally, these selected depths and partitions are executed whilst unnecessary computations are excluded. Experimental results on standard database demonstrate the superiority of proposed method, especially for High Definition (HD) and Ultra-HD (UHD) video sequences.

READ FULL TEXT

page 1

page 8

research
04/06/2023

Fast QTMT Partition for VVC Intra Coding Using U-Net Framework

Versatile Video Coding (VVC) has significantly increased encoding effici...
research
06/23/2020

DeepQTMT: A Deep Learning Approach for Fast QTMT-based CU Partition of Intra-mode VVC

The latest standard Versatile Video Coding (VVC) significantly improves ...
research
02/22/2017

Convolutional Neural Network-Based Block Up-sampling for Intra Frame Coding

Inspired by the recent advances of image super-resolution using convolut...
research
04/08/2022

Deep Learning-Based Intra Mode Derivation for Versatile Video Coding

In intra coding, Rate Distortion Optimization (RDO) is performed to achi...
research
04/10/2021

A Flexible Lossy Depth Video Coding Scheme Based on Low-rank Tensor Modelling and HEVC Intra Prediction for Free Viewpoint Video

The compression quality losses of depth sequences determine quality of v...
research
01/14/2022

Cross-Block Difference Guided Fast CU Partition for VVC Intra Coding

In this paper, we propose a new fast CU partition algorithm for VVC intr...
research
01/19/2022

BLINC: Lightweight Bimodal Learning for Low-Complexity VVC Intra Coding

The latest video coding standard, Versatile Video Coding (VVC), achieves...

Please sign up or login with your details

Forgot password? Click here to reset