TACNet: Transition-Aware Context Network for Spatio-Temporal Action Detection

05/31/2019
by   Lin Song, et al.
0

Current state-of-the-art approaches for spatio-temporal action detection have achieved impressive results but remain unsatisfactory for temporal extent detection. The main reason comes from that, there are some ambiguous states similar to the real actions which may be treated as target actions even by a well-trained network. In this paper, we define these ambiguous samples as "transitional states", and propose a Transition-Aware Context Network (TACNet) to distinguish transitional states. The proposed TACNet includes two main components, i.e., temporal context detector and transition-aware classifier. The temporal context detector can extract long-term context information with constant time complexity by constructing a recurrent network. The transition-aware classifier can further distinguish transitional states by classifying action and transitional states simultaneously. Therefore, the proposed TACNet can substantially improve the performance of spatio-temporal action detection. We extensively evaluate the proposed TACNet on UCF101-24 and J-HMDB datasets. The experimental results demonstrate that TACNet obtains competitive performance on JHMDB and significantly outperforms the state-of-the-art methods on the untrimmed UCF101-24 in terms of both frame-mAP and video-mAP.

READ FULL TEXT

page 1

page 3

page 7

page 8

research
05/04/2017

Action Tubelet Detector for Spatio-Temporal Action Localization

Current state-of-the-art approaches for spatio-temporal action localizat...
research
06/28/2018

Modeling Spatio-Temporal Human Track Structure for Action Localization

This paper addresses spatio-temporal localization of human actions in vi...
research
04/19/2019

STEP: Spatio-Temporal Progressive Learning for Video Action Detection

In this paper, we propose Spatio-TEmporal Progressive (STEP) action dete...
research
04/19/2018

Motion Fused Frames: Data Level Fusion Strategy for Hand Gesture Recognition

Acquiring spatio-temporal states of an action is the most crucial step f...
research
11/17/2020

Spatio-Temporal Analysis of Facial Actions using Lifecycle-Aware Capsule Networks

Most state-of-the-art approaches for Facial Action Unit (AU) detection r...
research
01/15/2013

Recurrent Online Clustering as a Spatio-Temporal Feature Extractor in DeSTIN

This paper presents a basic enhancement to the DeSTIN deep learning arch...
research
05/14/2018

Spatio-temporal Bayesian On-line Changepoint Detection with Model Selection

Bayesian On-line Changepoint Detection is extended to on-line model sele...

Please sign up or login with your details

Forgot password? Click here to reset