The Anatomy of Video Editing: A Dataset and Benchmark Suite for AI-Assisted Video Editing

07/20/2022
by   Dawit Mureja Argaw, et al.
0

Machine learning is transforming the video editing industry. Recent advances in computer vision have leveled-up video editing tasks such as intelligent reframing, rotoscoping, color grading, or applying digital makeups. However, most of the solutions have focused on video manipulation and VFX. This work introduces the Anatomy of Video Editing, a dataset, and benchmark, to foster research in AI-assisted video editing. Our benchmark suite focuses on video editing tasks, beyond visual effects, such as automatic footage organization and assisted video assembling. To enable research on these fronts, we annotate more than 1.5M tags, with relevant concepts to cinematography, from 196176 shots sampled from movie scenes. We establish competitive baseline methods and detailed analyses for each of the tasks. We hope our work sparks innovative research towards underexplored areas of AI-assisted video editing.

READ FULL TEXT

page 19

page 20

research
09/16/2021

AI video editing tools. What editors want and how far is AI from delivering?

Video editing can be a very tedious task, so unsurprisingly Artificial I...
research
07/03/2020

Task-agnostic Temporally Consistent Facial Video Editing

Recent research has witnessed the advances in facial image editing tasks...
research
10/30/2020

OpenKinoAI: An Open Source Framework for Intelligent Cinematography and Editing of Live Performances

OpenKinoAI is an open source framework for post-production of ultra high...
research
03/03/2023

AutoMatch: A Large-scale Audio Beat Matching Benchmark for Boosting Deep Learning Assistant Video Editing

The explosion of short videos has dramatically reshaped the manners peop...
research
07/17/2019

Towards Data-Driven Automatic Video Editing

Automatic video editing involving at least the steps of selecting the mo...
research
02/19/2021

Clarification of Video Retrieval Query Results by the Automated Insertion of Supporting Shots

Computational Video Editing Systems output video generally follows a par...
research
11/22/2022

VideoMap: Video Editing in Latent Space

Video has become a dominant form of media. However, video editing interf...

Please sign up or login with your details

Forgot password? Click here to reset