DeepAI AI Chat
Log In Sign Up

SpeedNet: Learning the Speediness in Videos

by   Sagie Benaim, et al.

We wish to automatically predict the "speediness" of moving objects in videos—whether they move faster, at, or slower than their "natural" speed. The core component in our approach is SpeedNet—a novel deep network trained to detect if a video is playing at normal rate, or if it is sped up. SpeedNet is trained on a large corpus of natural videos in a self-supervised manner, without requiring any manual annotations. We show how this single, binary classification network can be used to detect arbitrary rates of speediness of objects. We demonstrate prediction results by SpeedNet on a wide range of videos containing complex natural motions, and examine the visual cues it utilizes for making those predictions. Importantly, we show that through predicting the speed of videos, the model learns a powerful and meaningful space-time representation that goes beyond simple motion cues. We demonstrate how those learned features can boost the performance of self-supervised action recognition, and can be used for video retrieval. Furthermore, we also apply SpeedNet for generating time-varying, adaptive video speedups, which can allow viewers to watch videos faster, but with less of the jittery, unnatural motions typical to videos that are sped up uniformly.


page 1

page 2

page 3

page 4

page 5

page 6

page 8

page 9


Video 3D Sampling for Self-supervised Representation Learning

Most of the existing video self-supervised methods mainly leverage tempo...

Omnimatte: Associating Objects and Their Effects in Video

Computer vision is increasingly effective at segmenting objects in image...

End-to-End Learning of Visual Representations from Uncurated Instructional Videos

Annotating videos is cumbersome, expensive and not scalable. Yet, many s...

Violence Detection in Videos

In the recent years, there has been a tremendous increase in the amount ...

Self-Learning for Player Localization in Sports Video

This paper introduces a novel self-learning framework that automates the...

Self-Supervised Motion Retargeting with Safety Guarantee

In this paper, we present self-supervised shared latent embedding (S3LE)...

Video-ReTime: Learning Temporally Varying Speediness for Time Remapping

We propose a method for generating a temporally remapped video that matc...