MPAI-EEV: Standardization Efforts of Artificial Intelligence based End-to-End Video Coding

09/14/2023
by   Chuanmin Jia, et al.
0

The rapid advancement of artificial intelligence (AI) technology has led to the prioritization of standardizing the processing, coding, and transmission of video using neural networks. To address this priority area, the Moving Picture, Audio, and Data Coding by Artificial Intelligence (MPAI) group is developing a suite of standards called MPAI-EEV for "end-to-end optimized neural video coding." The aim of this AI-based video standard project is to compress the number of bits required to represent high-fidelity video data by utilizing data-trained neural coding technologies. This approach is not constrained by how data coding has traditionally been applied in the context of a hybrid framework. This paper presents an overview of recent and ongoing standardization efforts in this area and highlights the key technologies and design philosophy of EEV. It also provides a comparison and report on some primary efforts such as the coding efficiency of the reference model. Additionally, it discusses emerging activities such as learned Unmanned-Aerial-Vehicles (UAVs) video coding which are currently planned, under development, or in the exploration phase. With a focus on UAV video signals, this paper addresses the current status of these preliminary efforts. It also indicates development timelines, summarizes the main technical details, and provides pointers to further points of reference. The exploration experiment shows that the EEV model performs better than the state-of-the-art video coding standard H.266/VVC in terms of perceptual evaluation metric.

READ FULL TEXT

page 1

page 3

page 8

page 12

page 13

research
04/07/2019

Image and Video Compression with Neural Networks: A Review

In recent years, the image and video coding technologies have advanced b...
research
05/08/2019

AI Enabling Technologies: A Survey

Artificial Intelligence (AI) has the opportunity to revolutionize the wa...
research
02/09/2022

AIVC: Artificial Intelligence based Video Codec

This paper introduces AIVC, an end-to-end neural video codec. It is base...
research
01/15/2023

Learning to Compress Unmanned Aerial Vehicle (UAV) Captured Video: Benchmark and Analysis

During the past decade, the Unmanned-Aerial-Vehicles (UAVs) have attract...
research
05/30/2023

VVC Extension Scheme for Object Detection Using Contrast Reduction

In recent years, video analysis using Artificial Intelligence (AI) has b...
research
07/25/2023

A Comprehensive Review of Recent Research Trends on UAVs

The growing interest in unmanned aerial vehicles (UAVs) from both scient...
research
12/05/2018

HEVC Inter Coding Using Deep Recurrent Neural Networks and Artificial Reference Pictures

The efficiency of motion compensated prediction in modern video codecs h...

Please sign up or login with your details

Forgot password? Click here to reset