Learning to Control Complex Robots Using High-Dimensional Interfaces: Preliminary Insights

by   Jongmin M. Lee, et al.

Human body motions can be captured as a high-dimensional continuous signal using motion sensor technologies. The resulting data can be surprisingly rich in information, even when captured from persons with limited mobility. In this work, we explore the use of limited upper-body motions, captured via motion sensors, as inputs to control a 7 degree-of-freedom assistive robotic arm. It is possible that even dense sensor signals lack the salient information and independence necessary for reliable high-dimensional robot control. As the human learns over time in the context of this limitation, intelligence on the robot can be leveraged to better identify key learning challenges, provide useful feedback, and support individuals until the challenges are managed. In this short paper, we examine two uninjured participants' data from an ongoing study, to extract preliminary results and share insights. We observe opportunities for robot intelligence to step in, including the identification of inconsistencies in time spent across all control dimensions, asymmetries in individual control dimensions, and user progress in learning. Machine reasoning about these situations may facilitate novel interface learning in the future.


Learning Latent Actions to Control Assistive Robots

Assistive robot arms enable people with disabilities to conduct everyday...

Controlling wheelchairs by body motions: A learning framework for the adaptive remapping of space

Learning to operate a vehicle is generally accomplished by forming a new...

A Subject-Specific Four-Degree-of-Freedom Foot Interface to Control a Robot Arm

In robotic surgery, the surgeon controls robotic instruments using dedic...

Teleoperation of a Humanoid Robot with Motion Imitation and Legged Locomotion

This work presents a teleoperated humanoid robot system that can imitate...

Control Interface for Hands-free Navigation of Standing Mobility Vehicles based on Upper-Body Natural Movements

In this paper, we propose and evaluate a novel human-machine interface (...

Using Learned Predictions as Feedback to Improve Control and Communication with an Artificial Limb: Preliminary Findings

Many people suffer from the loss of a limb. Learning to get by without a...

Learning body-affordances to simplify action spaces

Controlling embodied agents with many actuated degrees of freedom is a c...

Please sign up or login with your details

Forgot password? Click here to reset