Virtual and Augmented Reality-Based Assistive Interfaces for Upper-limb Prosthesis Control and Rehabilitation

04/28/2022
by   Yinghe Sun, et al.
0

Functional upper-limb prosthetic training can improve users performance in controlling prostheses and has been incorporated into occupational therapy for individuals in need. In recent years, virtual reality (VR) and augmented reality (AR) technologies have been shown to be promising avenues to improve the convenience of rehabilitative prosthesis training systems. However, it is uncertain if the comprehensive efficacy and effectiveness of VR or AR assistive tools are adequate compared to conventional prosthetic tools and if not, whether enhancements can be made through incorporation of other technical paradigms. This work first presents a mixed reality system we developed for prosthesis control and training. Five able-bodied subjects are involved to perform three-dimensional object manipulation tasks in analogous AR and VR environments. Multiple evaluation metrics are applied to assess subjects performances within the two paradigms. Based on the comparative analysis, we find that VR-based environment promotes more efficient motion along with higher task completion rate and path efficiency while AR paradigm allows subjects to perform motor tasks with shorter time consumed. Another study is conducted to evaluate the efficiency and feasibility of AR-facilitated prosthesis control system compared to that in real-world and if any technical additions can be applied to improve the AR-based system. Three able-bodied subjects were engaged in the experiment to perform object manipulation tasks in a) physical environment, b) AR-without-bypass environment, and c) AR-with-bypass environment. Based on the results obtained from the assessment, we conclude that while our AR-based system modestly lags behind the effectiveness of physical systems, the study conducted using a bypass prosthesis suggests that AR system has the potential to improve the efficacy of prosthesis control.

READ FULL TEXT

page 12

page 16

page 28

page 29

page 35

page 37

page 39

page 42

research
05/26/2023

The Economics of Augmented and Virtual Reality

This paper explores the economics of Augmented Reality (AR) and Virtual ...
research
01/15/2017

A feasibility study on SSVEP-based interaction with motivating and immersive virtual and augmented reality

Non-invasive steady-state visual evoked potential (SSVEP) based brain-co...
research
07/07/2022

Technical Report: Comparative Evaluation of AR-based, VR-based, and Traditional Basic Life Support Training

Basic life support (BLS) is crucial in the emergency response system as ...
research
03/05/2019

Augmented Reality Prosthesis Training Setup for Motor Skill Enhancement

Adjusting to amputation can often time be difficult for the body. Post-s...
research
11/05/2020

Playing optical tweezers with deep reinforcement learning: in virtual, physical and augmented environments

Reinforcement learning was carried out in a simulated environment to lea...
research
03/06/2023

The Dark Side of Augmented Reality: Exploring Manipulative Designs in AR

Augmented Reality (AR) applications are becoming more mainstream, with s...
research
11/20/2018

Generating Classes of 3D Virtual Mandibles for AR-Based Medical Simulation

Simulation and modeling represent promising tools for several applicatio...

Please sign up or login with your details

Forgot password? Click here to reset