Adaptive Grasp Control through Multi-Modal Interactions for Assistive Prosthetic Devices

10/18/2018
by   Michelle Esponda, et al.
0

The hand is one of the most complex and important parts of the human body. The dexterity provided by its multiple degrees of freedom enables us to perform many of the tasks of daily living which involve grasping and manipulating objects of interest. Contemporary prosthetic devices for people with transradial amputations or wrist disarticulation vary in complexity, from passive prosthetics to complex devices that are body or electrically driven. One of the important challenges in developing smart prosthetic hands is to create devices which are able to mimic all activities that a person might perform and address the needs of a wide variety of users. The approach explored here is to develop algorithms that permit a device to adapt its behavior to the preferences of the operator through interactions with the wearer. This device uses multiple sensing modalities including muscle activity from a myoelectric armband, visual information from an on-board camera, tactile input through a touchscreen interface, and speech input from an embedded microphone. Presented within this paper are the design, software and controls of a platform used to evaluate this architecture as well as results from experiments deigned to quantify the performance.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 7

research
02/01/2018

EMG Pattern Classification to Control a Hand Orthosis for Functional Grasp Assistance after Stroke

Wearable orthoses can function both as assistive devices, which allow th...
research
04/06/2018

Human Robot Interface for Assistive Grasping

This work describes a new human-in-the-loop (HitL) assistive grasping sy...
research
04/29/2021

Continuous Decoding of Daily-Life Hand Movements from Forearm Muscle Activity for Enhanced Myoelectric Control of Hand Prostheses

State-of-the-art motorized hand prostheses are endowed with actuators ab...
research
03/09/2023

Assistive Robot Teleoperation Using Behavior Trees

Robotic assistance in robot arm teleoperation tasks has recently gained ...
research
09/09/2021

Dynamic Modeling of Hand-Object Interactions via Tactile Sensing

Tactile sensing is critical for humans to perform everyday tasks. While ...
research
01/06/2022

Multi-modal data fusion of Voice and EMG data for Robotic Control

Wearable electronic equipment is constantly evolving and is increasing t...
research
12/04/2020

SensiX: A Platform for Collaborative Machine Learning on the Edge

The emergence of multiple sensory devices on or near a human body is unc...

Please sign up or login with your details

Forgot password? Click here to reset