Slow Motion Matters: A Slow Motion Enhanced Network for Weakly Supervised Temporal Action Localization

11/21/2022
by   Weiqi Sun, et al.
0

Weakly supervised temporal action localization (WTAL) aims to localize actions in untrimmed videos with only weak supervision information (e.g. video-level labels). Most existing models handle all input videos with a fixed temporal scale. However, such models are not sensitive to actions whose pace of the movements is different from the “normal" speed, especially slow-motion action instances, which complete the movements with a much slower speed than their counterparts with a normal speed. Here arises the slow-motion blurred issue: It is hard to explore salient slow-motion information from videos at “normal" speed. In this paper, we propose a novel framework termed Slow Motion Enhanced Network (SMEN) to improve the ability of a WTAL network by compensating its sensitivity on slow-motion action segments. The proposed SMEN comprises a Mining module and a Localization module. The mining module generates mask to mine slow-motion-related features by utilizing the relationships between the normal motion and slow motion; while the localization module leverages the mined slow-motion features as complementary information to improve the temporal action localization results. Our proposed framework can be easily adapted by existing WTAL networks and enable them be more sensitive to slow-motion actions. Extensive experiments on three benchmarks are conducted, which demonstrate the high performance of our proposed framework.

READ FULL TEXT

page 1

page 2

page 9

page 10

page 13

research
12/14/2017

Weakly Supervised Action Localization by Sparse Temporal Pooling Network

We propose a weakly supervised temporal action localization algorithm on...
research
03/30/2023

JCDNet: Joint of Common and Definite phases Network for Weakly Supervised Temporal Action Localization

Weakly-supervised temporal action localization aims to localize action i...
research
08/12/2021

Deep Motion Prior for Weakly-Supervised Temporal Action Localization

Weakly-Supervised Temporal Action Localization (WSTAL) aims to localize ...
research
03/30/2021

CoLA: Weakly-Supervised Temporal Action Localization with Snippet Contrastive Learning

Weakly-supervised temporal action localization (WS-TAL) aims to localize...
research
02/04/2022

The influence of labeling techniques in classifying human manipulation movement of different speed

In this work, we investigate the influence of labeling methods on the cl...
research
08/07/2022

Weakly Supervised Online Action Detection for Infant General Movements

To make the earlier medical intervention of infants' cerebral palsy (CP)...
research
12/21/2021

ACGNet: Action Complement Graph Network for Weakly-supervised Temporal Action Localization

Weakly-supervised temporal action localization (WTAL) in untrimmed video...

Please sign up or login with your details

Forgot password? Click here to reset