DeepAI AI Chat
Log In Sign Up

Combining Spatio-Temporal Appearance Descriptors and Optical Flow for Human Action Recognition in Video Data

by   Karla Brkić, et al.

This paper proposes combining spatio-temporal appearance (STA) descriptors with optical flow for human action recognition. The STA descriptors are local histogram-based descriptors of space-time, suitable for building a partial representation of arbitrary spatio-temporal phenomena. Because of the possibility of iterative refinement, they are interesting in the context of online human action recognition. We investigate the use of dense optical flow as the image function of the STA descriptor for human action recognition, using two different algorithms for computing the flow: the Farnebäck algorithm and the TVL1 algorithm. We provide a detailed analysis of the influencing optical flow algorithm parameters on the produced optical flow fields. An extensive experimental validation of optical flow-based STA descriptors in human action recognition is performed on the KTH human action dataset. The encouraging experimental results suggest the potential of our approach in online human action recognition.


page 3

page 4

page 5


Optical Flow Guided Feature: A Fast and Robust Motion Representation for Video Action Recognition

Motion representation plays a vital role in human action recognition in ...

On the Integration of Optical Flow and Action Recognition

Most of the top performing action recognition methods use optical flow a...

Long-term Temporal Convolutions for Action Recognition

Typical human actions last several seconds and exhibit characteristic sp...

A robust and efficient video representation for action recognition

This paper introduces a state-of-the-art video representation and applie...

Human Action Recognition System using Good Features and Multilayer Perceptron Network

Human action recognition involves the characterization of human actions ...

Human Action Recognition using Local Two-Stream Convolution Neural Network Features and Support Vector Machines

This paper proposes a simple yet effective method for human action recog...

STAR-Net: Action Recognition using Spatio-Temporal Activation Reprojection

While depth cameras and inertial sensors have been frequently leveraged ...