DeepAI AI Chat
Log In Sign Up

Video Time: Properties, Encoders and Evaluation

by   Amir Ghodrati, et al.

Time-aware encoding of frame sequences in a video is a fundamental problem in video understanding. While many attempted to model time in videos, an explicit study on quantifying video time is missing. To fill this lacuna, we aim to evaluate video time explicitly. We describe three properties of video time, namely a) temporal asymmetry, b)temporal continuity and c) temporal causality. Based on each we formulate a task able to quantify the associated property. This allows assessing the effectiveness of modern video encoders, like C3D and LSTM, in their ability to model time. Our analysis provides insights about existing encoders while also leading us to propose a new video time encoder, which is better suited for the video time recognition tasks than C3D and LSTM. We believe the proposed meta-analysis can provide a reasonable baseline to assess video time encoders on equal grounds on a set of temporal-aware tasks.


page 3

page 6

page 8


TSP: Temporally-Sensitive Pretraining of Video Encoders for Localization Tasks

Understanding videos is challenging in computer vision. In particular, t...

Object Detection-Based Variable Quantization Processing

In this paper, we propose a preprocessing method for conventional image ...

Learning to Compress Videos without Computing Motion

With the development of higher resolution contents and displays, its sig...

SiEVE: Semantically Encoded Video Analytics on Edge and Cloud

Recent advances in computer vision and neural networks have made it poss...

Multi-stream CNN based Video Semantic Segmentation for Automated Driving

Majority of semantic segmentation algorithms operate on a single frame e...

User Generated HDR Gaming Video Streaming: Dataset, Codec Comparison and Challenges

Gaming video streaming services have grown tremendously in the past few ...

Automatic Generation of H.264 Parameter Sets to Recover Video File Fragments

We address the problem of decoding video file fragments when the necessa...