Precise Temporal Action Localization by Evolving Temporal Proposals

04/13/2018
by   Haonan Qiu, et al.
0

Locating actions in long untrimmed videos has been a challenging problem in video content analysis. The performances of existing action localization approaches remain unsatisfactory in precisely determining the beginning and the end of an action. Imitating the human perception procedure with observations and refinements, we propose a novel three-phase action localization framework. Our framework is embedded with an Actionness Network to generate initial proposals through frame-wise similarity grouping, and then a Refinement Network to conduct boundary adjustment on these proposals. Finally, the refined proposals are sent to a Localization Network for further fine-grained location regression. The whole process can be deemed as multi-stage refinement using a novel non-local pyramid feature under various temporal granularities. We evaluate our framework on THUMOS14 benchmark and obtain a significant improvement over the state-of-the-arts approaches. Specifically, the performance gain is remarkable under precise localization with high IoU thresholds. Our proposed framework achieves mAP@IoU=0.5 of 34.2

READ FULL TEXT

page 1

page 3

page 7

research
03/24/2021

Temporal Context Aggregation Network for Temporal Action Proposal Refinement

Temporal action proposal generation aims to estimate temporal intervals ...
research
05/30/2017

Generic Tubelet Proposals for Action Localization

We develop a novel framework for action localization in videos. We propo...
research
08/07/2021

Temporal Action Localization Using Gated Recurrent Units

Temporal Action Localization (TAL) task in which the aim is to predict t...
research
05/02/2017

Cascaded Boundary Regression for Temporal Action Detection

Temporal action detection in long videos is an important problem. State-...
research
07/05/2022

MVP: Robust Multi-View Practice for Driving Action Localization

Distracted driving causes thousands of deaths per year, and how to apply...
research
07/27/2021

Enriching Local and Global Contexts for Temporal Action Localization

Effectively tackling the problem of temporal action localization (TAL) n...
research
03/10/2020

PBRnet: Pyramidal Bounding Box Refinement to Improve Object Localization Accuracy

Many recently developed object detectors focused on coarse-to-fine frame...

Please sign up or login with your details

Forgot password? Click here to reset