Human Action Recognition in Egocentric Perspective Using 2D Object and Hands Pose

06/08/2023
by   Wiktor Mucha, et al.
0

Egocentric action recognition is essential for healthcare and assistive technology that relies on egocentric cameras because it allows for the automatic and continuous monitoring of activities of daily living (ADLs) without requiring any conscious effort from the user. This study explores the feasibility of using 2D hand and object pose information for egocentric action recognition. While current literature focuses on 3D hand pose information, our work shows that using 2D skeleton data is a promising approach for hand-based action classification, might offer privacy enhancement, and could be less computationally demanding. The study uses a state-of-the-art transformer-based method to classify sequences and achieves validation results of 94 outperforming other existing solutions. The accuracy of the test subset drops to 76 research highlights the potential of 2D hand and object pose information for action recognition tasks and offers a promising alternative to 3D-based methods.

READ FULL TEXT
research
02/01/2018

A Fusion of Appearance based CNNs and Temporal evolution of Skeleton with LSTM for Daily Living Action Recognition

In this paper, we propose efficient method which combines skeleton infor...
research
07/21/2022

Real-Time Elderly Monitoring for Senior Safety by Lightweight Human Action Recognition

With an increasing number of elders living alone, care-giving from a dis...
research
09/08/2017

Detecting Hands in Egocentric Videos: Towards Action Recognition

Recently, there has been a growing interest in analyzing human daily act...
research
10/18/2019

Development of a hand pose recognition system on an embedded computer using CNNs

Demand of hand pose recognition systems are growing in the last years in...
research
12/04/2018

Sensorless Pose Determination using Randomized Action Sequences

This paper is a study of 2D manipulation without sensing and planning, b...
research
09/08/2021

Egocentric View Hand Action Recognition by Leveraging Hand Surface and Hand Grasp Type

We introduce a multi-stage framework that uses mean curvature on a hand ...
research
04/19/2021

HEAR: Human Action Recognition via Neural Networks on Homomorphically Encrypted Data

Remote monitoring to support "aging in place" is an active area of resea...

Please sign up or login with your details

Forgot password? Click here to reset