Real-Time Online Skeleton Extraction and Gesture Recognition on Pepper

06/22/2022
by   Axel Lefrant, et al.
0

We present a multi-stage pipeline for simple gesture recognition. The novelty of our approach is the association of different technologies, resulting in the first real-time system as of now to conjointly extract skeletons and recognise gesture on a Pepper robot. For this task, Pepper has been augmented with an embedded GPU for running deep CNNs and a fish-eye camera to capture whole scene interaction. We show in this article that real-case scenarios are challenging, and the state-of-the-art approaches hardly deal with unknown human gestures. We present here a way to handle such cases.

READ FULL TEXT

page 1

page 2

page 8

research
10/29/2021

On-device Real-time Hand Gesture Recognition

We present an on-device real-time hand gesture recognition (HGR) system,...
research
09/14/2019

Progression Modelling for Online and Early Gesture Detection

Online and Early detection of gestures is crucial for building touchless...
research
12/13/2019

Solving Visual Object Ambiguities when Pointing: An Unsupervised Learning Approach

Whenever we are addressing a specific object or refer to a certain spati...
research
06/12/2018

Real-time on-device nod and shake recognition

We discuss methods for teaching systems to identify gestures such as hea...
research
12/01/2020

Tracking Ensemble Performance on Touch-Screens with Gesture Classification and Transition Matrices

We present and evaluate a novel interface for tracking ensemble performa...
research
12/08/2014

Real-Time System of Hand Detection And Gesture Recognition In Cyber Presence Interactive System For E-Learning

The development of technologies of multimedia, linked to that of Interne...
research
09/08/2019

A New GNG Graph-Based Hand Gesture Recognition Approach

Hand Gesture Recognition (HGR) is of major importance for Human-Computer...

Please sign up or login with your details

Forgot password? Click here to reset