3D Human Action Recognition with Siamese-LSTM Based Deep Metric Learning

07/05/2018
by   Seyma Yucer, et al.
0

This paper proposes a new 3D Human Action Recognition system as a two-phase system: (1) Deep Metric Learning Module which learns a similarity metric between two 3D joint sequences using Siamese-LSTM networks; (2) A Multiclass Classification Module that uses the output of the first module to produce the final recognition output. This model has several advantages: the first module is trained with a larger set of data because it uses many combinations of sequence pairs.Our deep metric learning module can also be trained independently of the datasets, which makes our system modular and generalizable. We tested the proposed system on standard and newly introduced datasets that showed us that initial results are promising. We will continue developing this system by adding more sophisticated LSTM blocks and by cross-training between different datasets.

READ FULL TEXT

page 4

page 6

research
02/27/2020

Action Quality Assessment using Siamese Network-Based Deep Metric Learning

Automated vision-based score estimation models can be used as an alterna...
research
12/26/2020

Skeleton-DML: Deep Metric Learning for Skeleton-Based One-Shot Action Recognition

One-shot action recognition allows the recognition of human-performed ac...
research
04/23/2020

Signal Level Deep Metric Learning for Multimodal One-Shot Action Recognition

Recognizing an activity with a single reference sample using metric lear...
research
12/02/2018

Deep Cosine Metric Learning for Person Re-Identification

Metric learning aims to construct an embedding where two extracted featu...
research
06/26/2017

Skeleton-Based Action Recognition Using Spatio-Temporal LSTM Network with Trust Gates

Skeleton-based human action recognition has attracted a lot of research ...
research
01/30/2019

Invariant Feature Mappings for Generalizing Affordance Understanding Using Regularized Metric Learning

This paper presents an approach for learning invariant features for obje...
research
04/10/2020

ASL Recognition with Metric-Learning based Lightweight Network

In the past decades the set of human tasks that are solved by machines w...

Please sign up or login with your details

Forgot password? Click here to reset