i-GSI: A Fast and Reliable Grasp-type Switching Interface based on Augmented Reality and Eye-tracking

04/22/2022
by   Chunyuan Shi, et al.
0

The control of multi-fingered dexterous prosthetics hand remains challenging due to the lack of an intuitive and efficient Grasp-type Switching Interface (GSI). We propose a new GSI (i-GSI) t hat integrates the manifold power of eye-tracking and augmentced reality technologies to solve this problem. It runs entirely in a HoloLens2 helmet, where users can glance at icons on the holographic interface to switch between six daily grasp types quickly. Compared to traditional GSIs (FSM-based, PR-based, and mobile APP-based), i-GSI achieved the best results in the experiment with eight healthy subjects, achieving a switching time of 0.84 s, a switching success rate of 99.0 efficiency of 93.50 deficiency, i-GSI achieved an equivalent great outcome as on healthy people, with a switching time of 0.78 s and switching success rate of 100 i-GSI, as a standalone module, can be combined with traditional proportional myoelectric control to form a hybrid-controlled prosthetic system that can help patients accomplish dexterous operations in various daily-life activities.

READ FULL TEXT

page 2

page 3

research
05/18/2022

i-MYO: A Hybrid Prosthetic Hand Control System based on Eye-tracking, Augmented Reality and Myoelectric signal

Dexterous prosthetic hands have better grasp performance than traditiona...
research
03/25/2021

Design and Test of an adaptive augmented reality interface to manage systems to assist critical missions

We present a user interface (UI) based on augmented reality (AR) with he...
research
09/13/2022

What You See is What You Grasp: User-Friendly Grasping Guided by Near-eye-tracking

This work presents a next-generation human-robot interface that can infe...
research
08/14/2023

Viia-hand: a Reach-and-grasp Restoration System Integrating Voice interaction, Computer vision and Auditory feedback for Blind Amputees

Visual feedback plays a crucial role in the process of amputation patien...
research
10/10/2018

The Hidden Cost of Window Management

Most window management systems support multitasking by allowing users to...
research
07/21/2020

Intelligent Exploration for User Interface Modules of Mobile App with Collective Learning

A mobile app interface usually consists of a set of user interface modul...
research
04/27/2018

An adaptive self-organizing fuzzy logic controller in a serious game for motor impairment rehabilitation

Rehabilitation robotics combined with video game technology provides a m...

Please sign up or login with your details

Forgot password? Click here to reset