MuZero with Self-competition for Rate Control in VP9 Video Compression

02/14/2022
by   Amol Mandhane, et al.
0

Video streaming usage has seen a significant rise as entertainment, education, and business increasingly rely on online video. Optimizing video compression has the potential to increase access and quality of content to users, and reduce energy use and costs overall. In this paper, we present an application of the MuZero algorithm to the challenge of video compression. Specifically, we target the problem of learning a rate control policy to select the quantization parameters (QP) in the encoding process of libvpx, an open source VP9 video compression library widely used by popular video-on-demand (VOD) services. We treat this as a sequential decision making problem to maximize the video quality with an episodic constraint imposed by the target bitrate. Notably, we introduce a novel self-competition based reward mechanism to solve constrained RL with variable constraint satisfaction difficulty, which is challenging for existing constrained RL methods. We demonstrate that the MuZero-based rate control achieves an average 6.28 compressed videos for the same delivered video quality level (measured as PSNR BD-rate) compared to libvpx's two-pass VBR rate control policy, while having better constraint satisfaction behavior.

READ FULL TEXT
research
12/09/2020

Neural Rate Control for Video Encoding using Imitation Learning

In modern video encoders, rate control is a critical component and has b...
research
05/24/2022

A Rate Control Algorithm for Video-based Point Cloud Compression

Video-based point cloud compression (V-PCC) has been an emerging compres...
research
06/07/2023

Video Compression with Arbitrary Rescaling Network

Most video platforms provide video streaming services with different qua...
research
07/14/2021

RCLC: ROI-based joint conventional and learning video compression

COVID-19 leads to the high demand for remote interactive systems ever se...
research
06/16/2023

HiNeRV: Video Compression with Hierarchical Encoding based Neural Representation

Learning-based video compression is currently one of the most popular re...
research
08/30/2023

Deep Video Codec Control

Lossy video compression is commonly used when transmitting and storing v...
research
12/16/2020

Learning to Run with Potential-Based Reward Shaping and Demonstrations from Video Data

Learning to produce efficient movement behaviour for humanoid robots fro...

Please sign up or login with your details

Forgot password? Click here to reset