A Single RGB Camera Based Gait Analysis with a Mobile Tele-Robot for Healthcare

02/11/2020
by   Ziyang Wang, et al.
23

With the increasing awareness of high-quality life, there is a growing need for health monitoring devices running robust algorithms in home environment. Health monitoring technologies enable real-time analysis of users' health status, offering long-term healthcare support and reducing hospitalization time. The purpose of this work is twofold, the software focuses on the analysis of gait, which is widely adopted for joint correction and assessing any lower limb or spinal problem. On the hardware side, we design a novel marker-less gait analysis device using a low-cost RGB camera mounted on a mobile tele-robot. As gait analysis with a single camera is much more challenging compared to previous works utilizing multi-cameras, a RGB-D camera or wearable sensors, we propose using vision-based human pose estimation approaches. More specifically, based on the output of two state-of-the-art human pose estimation models (Openpose and VNect), we devise measurements for four bespoke gait parameters: inversion/eversion, dorsiflexion/plantarflexion, ankle and foot progression angles. We thereby classify walking patterns into normal, supination, pronation and limp. We also illustrate how to run the purposed machine learning models in low-resource environments such as a single entry-level CPU. Experiments show that our single RGB camera method achieves competitive performance compared to state-of-the-art methods based on depth cameras or multi-camera motion capture system, at smaller hardware costs.

READ FULL TEXT

page 2

page 4

research
07/19/2021

A Benchmark for Gait Recognition under Occlusion Collected by Multi-Kinect SDAS

Human gait is one of important biometric characteristics for human ident...
research
12/01/2018

Vision-Based Gait Analysis for Senior Care

As the senior population rapidly increases, it is challenging yet crucia...
research
09/21/2020

When Healthcare Meets Off-the-Shelf WiFi: A Non-Wearable and Low-Costs Approach for In-Home Monitoring

As elderly population grows, social and health care begin to face valida...
research
12/07/2022

GaitVibe+: Enhancing Structural Vibration-based Footstep Localization Using Temporary Cameras for In-home Gait Analysis

In-home gait analysis is important for providing early diagnosis and ada...
research
10/15/2022

mRI: Multi-modal 3D Human Pose Estimation Dataset using mmWave, RGB-D, and Inertial Sensors

The ability to estimate 3D human body pose and movement, also known as h...
research
03/30/2021

Binarized Neural Networks for Resource-Constrained On-Device Gait Identification

User authentication through gait analysis is a promising application of ...
research
07/06/2023

Recognition and Estimation of Human Finger Pointing with an RGB Camera for Robot Directive

In communication between humans, gestures are often preferred or complem...

Please sign up or login with your details

Forgot password? Click here to reset