Multimodal Sensing and Interaction for a Robotic Hand Orthosis

07/31/2018
by   Sangwoo Park, et al.
0

Wearable robotic hand rehabilitation devices can allow greater freedom and flexibility than their workstation-like counterparts. However, the field is generally lacking effective methods by which the user can operate the device: such controls must be effective, intuitive and robust to the wide range of possible impairment patterns. Even when focusing on a specific condition, such as stroke, the variety of encountered upper limb impairment patterns means that a single sensing modality, such as electromyography (EMG), is not sufficient to enable controls for a broad range of users. To address this significant gap, we introduce a multimodal sensing and interaction paradigm for an active hand orthosis. In our proof-of-concept implementation, EMG is complemented by other sensing modalities, such as finger bend and contact pressure sensors. We propose multimodal interaction methods that utilize this sensory data as input, and show they can enable tasks for stroke survivors who exhibit different impairment patterns. We believe that robotic hand orthoses developed as multimodal sensory platforms with help address some of the key challenges in physical interaction with the user.

READ FULL TEXT

page 1

page 3

research
11/13/2019

RecyGlide : A Forearm-worn Multi-modal Haptic Display aimedto Improve User VR Immersion

Haptic devices have been employed to immerse users in VR environments. I...
research
11/13/2019

RecyGlide : A Forearm-worn Multi-modal Haptic Display aimed to Improve User VR Immersion

Haptic devices have been employed to immerse users in VR environments. I...
research
04/29/2020

Touch? Speech? or Touch and Speech? Investigating Multimodal Interaction for Visual Network Exploration and Analysis

Interaction plays a vital role during visual network exploration as user...
research
08/26/2023

TeleFMG: A Wearable Force-Myography Device for Natural Teleoperation of Multi-finger Robotic Hands

Teleoperation enables a user to perform tasks from a remote location. He...
research
09/18/2023

General In-Hand Object Rotation with Vision and Touch

We introduce RotateIt, a system that enables fingertip-based object rota...
research
08/22/2019

A Wearable Tactile Sensor Array for Large Area Remote Vibration Sensing in the Hand

Tactile sensing is a essential for skilled manipulation and object perce...
research
12/18/2022

Exploring Workplace Behaviors through Speaking Patterns using Large-scale Multimodal Wearable Recordings: A Study of Healthcare Providers

Interpersonal spoken communication is central to human interaction and t...

Please sign up or login with your details

Forgot password? Click here to reset