TransNet V2: An effective deep network architecture for fast shot transition detection

08/11/2020
by   Tomáš Souček, et al.
0

Although automatic shot transition detection approaches are already investigated for more than two decades, an effective universal human-level model was not proposed yet. Even for common shot transitions like hard cuts or simple gradual changes, the potential diversity of analyzed video contents may still lead to both false hits and false dismissals. Recently, deep learning-based approaches significantly improved the accuracy of shot transition detection using 3D convolutional architectures and artificially created training data. Nevertheless, one hundred percent accuracy is still an unreachable ideal. In this paper, we share the current version of our deep network TransNet V2 that reaches state-of-the-art performance on respected benchmarks. A trained instance of the model is provided so it can be instantly utilized by the community for a highly efficient analysis of large video archives. Furthermore, the network architecture, as well as our experience with the training process, are detailed, including simple code snippets for convenient usage of the proposed model and visualization of results.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 4

06/08/2019

TransNet: A deep network for fast detection of common shot transitions

Shot boundary detection (SBD) is an important first step in many video p...
08/13/2018

Fast Video Shot Transition Localization with Deep Structured Models

Detection of video shot transition is a crucial pre-processing step in v...
05/23/2017

Ridiculously Fast Shot Boundary Detection with Fully Convolutional Neural Networks

Shot boundary detection (SBD) is an important component of many video an...
10/02/2019

DeepMark: One-Shot Clothing Detection

The one-shot approach, DeepMark, for fast clothing detection as a modifi...
03/24/2020

KFNet: Learning Temporal Camera Relocalization using Kalman Filtering

Temporal camera relocalization estimates the pose with respect to each v...
12/03/2018

What can I do here? Leveraging Deep 3D saliency and geometry for fast and scalable multiple affordance detection

This paper develops and evaluates a novel method that allows for the det...
05/09/2017

Large-scale, Fast and Accurate Shot Boundary Detection through Spatio-temporal Convolutional Neural Networks

Shot boundary detection (SBD) is an important pre-processing step for vi...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.