Diagnosing Error in Temporal Action Detectors

07/27/2018
by   Humam Alwassel, et al.
0

Despite the recent progress in video understanding and the continuous rate of improvement in temporal action localization throughout the years, it is still unclear how far (or close?) we are to solving the problem. To this end, we introduce a new diagnostic tool to analyze the performance of temporal action detectors in videos and compare different methods beyond a single scalar metric. We exemplify the use of our tool by analyzing the performance of the top rewarded entries in the latest ActivityNet action localization challenge. Our analysis shows that the most impactful areas to work on are: strategies to better handle temporal context around the instances, improving the robustness w.r.t. the instance absolute and relative size, and strategies to reduce the localization errors. Moreover, our experimental analysis finds the lack of agreement among annotator is not a major roadblock to attain progress in the field. Our diagnostic tool is publicly available to keep fueling the minds of other researchers with additional insights about their algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/25/2021

Diagnosing Errors in Video Relation Detectors

Video relation detection forms a new and challenging problem in computer...
research
06/23/2022

Learning to Refactor Action and Co-occurrence Features for Temporal Action Localization

The main challenge of Temporal Action Localization is to retrieve subtle...
research
05/24/2021

FineAction: A Fined Video Dataset for Temporal Action Localization

On the existing benchmark datasets, THUMOS14 and ActivityNet, temporal a...
research
02/10/2022

OWL (Observe, Watch, Listen): Localizing Actions in Egocentric Video via Audiovisual Temporal Context

Temporal action localization (TAL) is an important task extensively expl...
research
05/25/2019

Exploring Feature Representation and Training strategies in Temporal Action Localization

Temporal action localization has recently attracted significant interest...
research
05/04/2017

Am I Done? Predicting Action Progress in Videos

In this paper we introduce the problem of predicting action progress in ...
research
03/14/2022

RCL: Recurrent Continuous Localization for Temporal Action Detection

Temporal representation is the cornerstone of modern action detection te...

Please sign up or login with your details

Forgot password? Click here to reset