Extend the FFmpeg Framework to Analyze Media Content

03/05/2021
by   Xintian Wu, et al.
0

This paper introduces a new set of video analytics plugins developed for the FFmpeg framework. Multimedia applications that increasingly utilize the FFmpeg media features for its comprehensive media encoding, decoding, muxing, and demuxing capabilities can now additionally analyze the video content based on AI models. The plugins are thread optimized for best performance overcoming certain FFmpeg threading limitations. The plugins utilize the Intel OpenVINO Toolkit inference engine as the backend. The analytics workloads are accelerated on different platforms such as CPU, GPU, FPGA or specialized analytics accelerators. With our reference implementation, the feature of OpenVINO as inference backend has been pushed into FFmpeg mainstream repository. We plan to submit more patches later.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/02/2022

Computation offloading to hardware accelerators in Intel SGX and Gramine Library OS

The Intel Software Guard Extensions (SGX) technology enables application...
research
05/22/2023

An Optimized Tri-store System for Multi-model Data Analytics

Data science applications increasingly rely on heterogeneous data source...
research
11/25/2022

Task-Oriented Communication for Edge Video Analytics

With the development of artificial intelligence (AI) techniques and the ...
research
06/17/2020

Visor: Privacy-Preserving Video Analytics as a Cloud Service

Video-analytics-as-a-service is becoming an important offering for cloud...
research
07/09/2022

A Survey of Task-Based Machine Learning Content Extraction Services for VIDINT

This paper provides a comparison of current video content extraction too...
research
08/01/2021

Hyper360 – a Next Generation Toolset for Immersive Media

Spherical 360 video is a novel media format, rapidly becoming adopted in...
research
05/04/2011

Considerations and Results in Multimedia and DVB Application Development on Philips Nexperia Platform

This paper presents some experiments regarding applications development ...

Please sign up or login with your details

Forgot password? Click here to reset