Cascaded Boundary Regression for Temporal Action Detection

05/02/2017
by   Jiyang Gao, et al.
0

Temporal action detection in long videos is an important problem. State-of-the-art methods address this problem by applying action classifiers on sliding windows. Although sliding windows may contain an identifiable portion of the actions, they may not necessarily cover the entire action instance, which would lead to inferior performance. We adapt a two-stage temporal action detection pipeline with Cascaded Boundary Regression (CBR) model. Class-agnostic proposals and specific actions are detected respectively in the first and the second stage. CBR uses temporal coordinate regression to refine the temporal boundaries of the sliding windows. The salient aspect of the refinement process is that, inside each stage, the temporal boundaries are adjusted in a cascaded way by feeding the refined windows back to the system for further boundary refinement. We test CBR on THUMOS-14 and TVSeries, and achieve state-of-the-art performance on both datasets. The performance gain is especially remarkable under high IoU thresholds, e.g. map@tIoU=0.5 on THUMOS-14 is improved from 19.0

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/12/2018

CTAP: Complementary Temporal Action Proposal Generation

Temporal action proposal generation is an important task, akin to object...
research
10/25/2022

Refining Action Boundaries for One-stage Detection

Current one-stage action detection methods, which simultaneously predict...
research
04/13/2018

Precise Temporal Action Localization by Evolving Temporal Proposals

Locating actions in long untrimmed videos has been a challenging problem...
research
03/17/2017

TURN TAP: Temporal Unit Regression Network for Temporal Action Proposals

Temporal Action Proposal (TAP) generation is an important problem, as fa...
research
11/06/2018

BLP - Boundary Likelihood Pinpointing Networks for Accurate Temporal Action Localization

Despite tremendous progress achieved in temporal action detection, state...
research
08/25/2020

Boundary Uncertainty in a Single-Stage Temporal Action Localization Network

In this paper, we address the problem of temporal action localization wi...
research
10/26/2021

CTRN: Class-Temporal Relational Network for Action Detection

Action detection is an essential and challenging task, especially for de...

Please sign up or login with your details

Forgot password? Click here to reset