GaGARoS: A Gaze Guided Assistive Robotic System for Daily-Living Activities

07/14/2018
by   Ming-Yao Wang, et al.
0

Patients suffering from tetraplegia or quadriplegia have limited body motion which prevents them from performing daily-living activities. We have developed GaGARoS, an assistive robotic system with an intuitive free-view gaze interface. The user's point of regard is estimated in 3D space while allowing free head movement, and is combined with object recognition and trajectory planning. This framework allows the user to interact with objects using fixations. Two operational modes have been implemented to cater for different eventualities. The automatic mode performs a pre-defined task associated with a gaze-selected object, while the manual mode allows gaze control of the robot's end-effector position on the user's frame of reference. User studies reported effortless operation in automatic mode. A manual pick and place task achieved a success rate of 100

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

research
07/14/2018

Free-View, 3D Gaze-Guided, Assistive Robotic System for Activities of Daily Living

Patients suffering from quadriplegia have limited body motion which prev...
research
10/16/2015

You-Do, I-Learn: Unsupervised Multi-User egocentric Approach Towards Video-Based Guidance

This paper presents an unsupervised approach towards automatically extra...
research
09/21/2018

Gaze-based, Context-aware Robotic System for Assisted Reaching and Grasping

Assistive robotic systems endeavour to support those with movement disab...
research
04/18/2022

Interaction Design of Dwell Selection Toward Gaze-based AR/VR Interaction

In this paper, we first position the current dwell selection among gaze-...
research
03/09/2023

Assistive Robot Teleoperation Using Behavior Trees

Robotic assistance in robot arm teleoperation tasks has recently gained ...
research
10/31/2017

A Multiple Source Framework for the Identification of Activities of Daily Living Based on Mobile Device Data

The monitoring of the lifestyles may be performed based on a system for ...
research
08/30/2023

GlassMessaging: Supporting Messaging Needs During Daily Activities Using OST-HMDs

The act of communicating with others during routine daily tasks is both ...

Please sign up or login with your details

Forgot password? Click here to reset