Continual Learning of Hand Gestures for Human-Robot Interaction

04/13/2023
by   Xavier Cucurull, et al.
0

In this paper, we present an efficient method to incrementally learn to classify static hand gestures. This method allows users to teach a robot to recognize new symbols in an incremental manner. Contrary to other works which use special sensors or external devices such as color or data gloves, our proposed approach makes use of a single RGB camera to perform static hand gesture recognition from 2D images. Furthermore, our system is able to incrementally learn up to 38 new symbols using only 5 samples for each old class, achieving a final average accuracy of over 90%. In addition to that, the incremental training time can be reduced to a 10% of the time required when using all data available.

READ FULL TEXT

page 1

page 2

page 4

research
05/16/2017

Static Gesture Recognition using Leap Motion

In this report, an automated bartender system was developed for making o...
research
09/20/2022

HyperPalm: DNN-based hand gesture recognition interface for intelligent communication with quadruped robot in 3D space

Nowadays, autonomous mobile robots support people in many areas where hu...
research
02/07/2019

Commodifying Pointing in HRI: Simple and Fast Pointing Gesture Detection from RGB-D Images

We present and characterize a simple method for detecting pointing gestu...
research
04/20/2020

CatNet: Class Incremental 3D ConvNets for Lifelong Egocentric Gesture Recognition

Egocentric gestures are the most natural form of communication for human...
research
04/29/2021

Hand Gesture Recognition Based on a Nonconvex Regularization

Recognition of hand gestures is one of the most fundamental tasks in hum...
research
10/20/2020

PIXEL: Interactive Light System Design Based On Simple Gesture Recognition

In this project, by utilizing the real-time human gestures captured by K...
research
01/17/2023

Knowledge Acquisition and Completion for Long-Term Human-Robot Interactions using Knowledge Graph Embedding

In Human-Robot Interaction (HRI) systems, a challenging task is sharing ...

Please sign up or login with your details

Forgot password? Click here to reset