Curvature: A signature for Action Recognition in Video Sequences

04/30/2019
by   He Chen, et al.
0

In this paper, a novel signature of human action recognition, namely the curvature of a video sequence, is introduced. In this way, the distribution of sequential data is modeled, which enables few-shot learning. Instead of depending on recognizing features within images, our algorithm views actions as sequences on the universal time scale across a whole sequence of images. The video sequence, viewed as a curve in pixel space, is aligned by reparameterization using the arclength of the curve in pixel space. Once such curvatures are obtained, statistical indexes are extracted and fed into a learning-based classifier. Overall, our method is simple but powerful. Preliminary experimental results show that our method is effective and achieves state-of-the-art performance in video-based human action recognition. Moreover, we see latent capacity in transferring this idea into other sequence-based recognition applications such as speech recognition, machine translation, and text generation.

READ FULL TEXT

page 4

page 5

page 6

research
04/21/2016

Improving Human Action Recognition by Non-action Classification

In this paper we consider the task of recognizing human actions in reali...
research
07/13/2017

Leveraging the Path Signature for Skeleton-based Human Action Recognition

Human action recognition in videos is one of the most challenging tasks ...
research
09/25/2020

Online Learnable Keyframe Extraction in Videos and its Application with Semantic Word Vector in Action Recognition

Video processing has become a popular research direction in computer vis...
research
06/17/2019

A Temporal Sequence Learning for Action Recognition and Prediction

In this work[This work was supported in part by the National Science Fou...
research
10/13/2020

Few-shot Action Recognition with Implicit Temporal Alignment and Pair Similarity Optimization

Few-shot learning aims to recognize instances from novel classes with fe...
research
03/30/2020

Speech2Action: Cross-modal Supervision for Action Recognition

Is it possible to guess human action from dialogue alone? In this work w...
research
07/26/2022

Fractal Images as Number Sequences I An Introduction

In this article, we considered a fractal image as a fractal curve, that ...

Please sign up or login with your details

Forgot password? Click here to reset