A Proposal-Based Solution to Spatio-Temporal Action Detection in Untrimmed Videos

11/20/2018
by   Joshua Gleason, et al.
20

Existing approaches for spatio-temporal action detection in videos are limited by the spatial extent and temporal duration of the actions. In this paper, we present a modular system for spatio-temporal action detection in untrimmed surveillance videos. We propose a two stage approach. The first stage generates dense spatio-temporal proposals using hierarchical clustering and temporal jittering techniques on frame-wise object detections. The second stage is a Temporal Refinement I3D (TRI-3D) network that performs action classification and temporal refinement on the generated proposals. The object detection-based proposal generation step helps in detecting actions occurring in a small spatial region of a video frame, while temporal jittering and refinement helps in detecting actions of variable lengths. Experimental results on an unconstrained surveillance action detection dataset - DIVA - show the effectiveness of our system. For comparison, the performance of our system is also evaluated on the THUMOS14 temporal action detection dataset.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/31/2017

Spatio-Temporal Action Detection with Cascade Proposal and Location Anticipation

In this work, we address the problem of spatio-temporal action detection...
research
04/19/2019

STEP: Spatio-Temporal Progressive Learning for Video Action Detection

In this paper, we propose Spatio-TEmporal Progressive (STEP) action dete...
research
04/01/2020

Spatio-temporal Tubelet Feature Aggregation and Object Linking in Videos

This paper addresses the problem of how to exploit spatio-temporal infor...
research
04/09/2022

E^2TAD: An Energy-Efficient Tracking-based Action Detector

Video action detection (spatio-temporal action localization) is usually ...
research
11/21/2014

Finding Action Tubes

We address the problem of action detection in videos. Driven by the late...
research
07/03/2019

Deformable Tube Network for Action Detection in Videos

We address the problem of spatio-temporal action detection in videos. Ex...
research
06/22/2017

A Self-Adaptive Proposal Model for Temporal Action Detection based on Reinforcement Learning

Existing action detection algorithms usually generate action proposals t...

Please sign up or login with your details

Forgot password? Click here to reset