DeepAI
Log In Sign Up

Cross-modal Learning of Graph Representations using Radar Point Cloud for Long-Range Gesture Recognition

03/31/2022
by   Souvik Hazra, et al.
0

Gesture recognition is one of the most intuitive ways of interaction and has gathered particular attention for human computer interaction. Radar sensors possess multiple intrinsic properties, such as their ability to work in low illumination, harsh weather conditions, and being low-cost and compact, making them highly preferable for a gesture recognition solution. However, most literature work focuses on solutions with a limited range that is lower than a meter. We propose a novel architecture for a long-range (1m - 2m) gesture recognition solution that leverages a point cloud-based cross-learning approach from camera point cloud to 60-GHz FMCW radar point cloud, which allows learning better representations while suppressing noise. We use a variant of Dynamic Graph CNN (DGCNN) for the cross-learning, enabling us to model relationships between the points at a local and global level and to model the temporal dynamics a Bi-LSTM network is employed. In the experimental results section, we demonstrate our model's overall accuracy of 98.4 generalization capability.

READ FULL TEXT

page 2

page 3

02/07/2020

Long-Range Gesture Recognition Using Millimeter Wave Radar

Millimeter wave (mmWave) based gesture recognition technology provides a...
11/19/2021

DSPoint: Dual-scale Point Cloud Recognition with High-frequency Fusion

Point cloud processing is a challenging task due to its sparsity and irr...
11/22/2022

PointCMC: Cross-Modal Multi-Scale Correspondences Learning for Point Cloud Understanding

Some self-supervised cross-modal learning approaches have recently demon...
07/05/2022

Open-Vocabulary 3D Detection via Image-level Class and Debiased Cross-modal Contrastive Learning

Current point-cloud detection methods have difficulty detecting the open...
04/24/2018

Spatiotemporal Learning of Dynamic Gestures from 3D Point Cloud Data

In this paper, we demonstrate an end-to-end spatiotemporal gesture learn...
07/01/2022

Literature on Hand GESTURE Recognition using Graph based methods

Skeleton based recognition systems are gaining popularity and machine le...
07/20/2016

HoloMed: A Low-Cost Gesture-Based Holographic

During medicine studies, visualization of certain elements is common and...