DeepAI AI Chat
Log In Sign Up

Progressive Spatial Recurrent Neural Network for Intra Prediction

by   Yueyu Hu, et al.

Intra prediction is an important component of modern video codecs, which is able to efficiently squeeze out the spatial redundancy in video frames. With preceding pixels as the context, traditional intra prediction schemes generate linear predictions based on several predefined directions (i.e. modes) for blocks to be encoded. However, these modes are relatively simple and their predictions may fail when facing blocks with complex textures, which leads to additional bits encoding the residue. In this paper, we design a Progressive Spatial Recurrent Neural Network (PS-RNN) that learns to conduct intra prediction. Specifically, our PS-RNN consists of three spatial recurrent units and progressively generates predictions by passing information along from preceding contents to blocks to be encoded. To make our network generate predictions considering both distortion and bit-rate, we propose to use Sum of Absolute Transformed Difference (SATD) as the loss function to train PS-RNN since SATD is able to measure rate-distortion cost of encoding a residue block. Moreover, our method supports variable-block-size for intra prediction, which is more practical in real coding conditions. The proposed intra prediction scheme achieves on average 2.4 settings under the same reconstruction quality compared with HEVC.


page 4

page 5

page 7

page 9


Data Clustering-Driven Neural Network for Intra Prediction

As a crucial part of video compression, intra prediction utilizes local ...

Convolutional Neural Networks based Intra Prediction for HEVC

Traditional intra prediction methods for HEVC rely on using the nearest ...

Performing Video Frame Prediction of Microbial Growth with a Recurrent Neural Network

A Recurrent Neural Network (RNN) was used to perform video frame predict...

Context-adaptive neural network based prediction for image compression

This paper describes a set of neural network architectures, called Predi...

Combining Progressive Rethinking and Collaborative Learning: A Deep Framework for In-Loop Filtering

In this paper, we aim to address two critical issues in deep-learning ba...

Predicting Chroma from Luma in AV1

Chroma from luma (CfL) prediction is a new and promising chroma-only int...

Cross-Block Difference Guided Fast CU Partition for VVC Intra Coding

In this paper, we propose a new fast CU partition algorithm for VVC intr...