A Group Variational Transformation Neural Network for Fractional Interpolation of Video Coding

06/19/2018
by   Sifeng Xia, et al.
0

Motion compensation is an important technology in video coding to remove the temporal redundancy between coded video frames. In motion compensation, fractional interpolation is used to obtain more reference blocks at sub-pixel level. Existing video coding standards commonly use fixed interpolation filters for fractional interpolation, which are not efficient enough to handle diverse video signals well. In this paper, we design a group variational transformation convolutional neural network (GVTCNN) to improve the fractional interpolation performance of the luma component in motion compensation. GVTCNN infers samples at different sub-pixel positions from the input integer-position sample. It first extracts a shared feature map from the integer-position sample to infer various sub-pixel position samples. Then a group variational transformation technique is used to transform a group of copied shared feature maps to samples at different sub-pixel positions. Experimental results have identified the interpolation efficiency of our GVTCNN. Compared with the interpolation method of High Efficiency Video Coding, our method achieves 1.9 and up to 5.6

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/10/2017

A Convolutional Neural Network Approach for Half-Pel Interpolation in Video Coding

Motion compensation is a fundamental technology in video coding to remov...
research
06/11/2020

Interpreting CNN for Low Complexity Learned Sub-pixel Motion Compensation in Video Coding

Deep learning has shown great potential in image and video compression t...
research
07/01/2022

Ray-Space Motion Compensation for Lenslet Plenoptic Video Coding

Plenoptic images and videos bearing rich information demand a tremendous...
research
06/16/2021

Improved CNN-based Learning of Interpolation Filters for Low-Complexity Inter Prediction in Video Coding

The versatility of recent machine learning approaches makes them ideal f...
research
02/11/2022

Dilated convolutional neural network-based deep reference picture generation for video compression

Motion estimation and motion compensation are indispensable parts of int...
research
05/16/2019

Deep Reference Generation with Multi-Domain Hierarchical Constraints for Inter Prediction

Inter prediction is an important module in video coding for temporal red...
research
08/08/2022

Boosting neural video codecs by exploiting hierarchical redundancy

In video compression, coding efficiency is improved by reusing pixels fr...

Please sign up or login with your details

Forgot password? Click here to reset