The THUMOS Challenge on Action Recognition for Videos "in the Wild"

04/21/2016
by   Haroon Idrees, et al.
0

Automatically recognizing and localizing wide ranges of human actions has crucial importance for video understanding. Towards this goal, the THUMOS challenge was introduced in 2013 to serve as a benchmark for action recognition. Until then, video action recognition, including THUMOS challenge, had focused primarily on the classification of pre-segmented (i.e., trimmed) videos, which is an artificial task. In THUMOS 2014, we elevated action recognition to a more practical level by introducing temporally untrimmed videos. These also include `background videos' which share similar scenes and backgrounds as action videos, but are devoid of the specific actions. The three editions of the challenge organized in 2013--2015 have made THUMOS a common benchmark for action classification and detection and the annual challenge is widely attended by teams from around the world. In this paper we describe the THUMOS benchmark in detail and give an overview of data collection and annotation procedures. We present the evaluation protocols used to quantify results in the two THUMOS tasks of action classification and temporal detection. We also present results of submissions to the THUMOS 2015 challenge and review the participating approaches. Additionally, we include a comprehensive empirical study evaluating the differences in action recognition between trimmed and untrimmed videos, and how well methods trained on trimmed videos generalize to untrimmed videos. We conclude by proposing several directions and improvements for future THUMOS challenges.

READ FULL TEXT

page 5

page 17

page 19

page 26

page 31

page 34

page 38

page 39

research
06/06/2020

ARID: A New Dataset for Recognizing Action in the Dark

The task of action recognition in dark videos is useful in various scena...
research
06/02/2022

A Survey on Video Action Recognition in Sports: Datasets, Methods and Applications

To understand human behaviors, action recognition based on videos is a c...
research
11/30/2020

Annotation-Efficient Untrimmed Video Action Recognition

Deep learning has achieved great success in recognizing video actions, b...
research
11/24/2015

Fine-Grain Annotation of Cricket Videos

The recognition of human activities is one of the key problems in video ...
research
10/31/2021

Distantly Supervised Semantic Text Detection and Recognition for Broadcast Sports Videos Understanding

Comprehensive understanding of key players and actions in multiplayer sp...
research
07/11/2021

Review of Video Predictive Understanding: Early Action Recognition and Future Action Prediction

Video predictive understanding encompasses a wide range of efforts that ...
research
10/20/2022

VideoPipe 2022 Challenge: Real-World Video Understanding for Urban Pipe Inspection

Video understanding is an important problem in computer vision. Currentl...

Please sign up or login with your details

Forgot password? Click here to reset