Acting Thoughts: Towards a Mobile Robotic Service Assistant for Users with Limited Communication Skills

07/20/2017
by   Felix Burget, et al.
0

As autonomous service robots become more affordable and thus available also for the general public, there is a growing need for user friendly interfaces to control the robotic system. Currently available control modalities typically expect users to be able to express their desire through either touch, speech or gesture commands. While this requirement is fulfilled for the majority of users, paralyzed users may not be able to use such systems. In this paper, we present a novel framework, that allows these users to interact with a robotic service assistant in a closed-loop fashion, using only thoughts. The brain-computer interface (BCI) system is composed of several interacting components, i.e., non-invasive neuronal signal recording and decoding, high-level task planning, motion and manipulation planning as well as environment perception. In various experiments, we demonstrate its applicability and robustness in real world scenarios, considering fetch-and-carry tasks and tasks involving human-robot interaction. As our results demonstrate, our system is capable of adapting to frequent changes in the environment and reliably completing given tasks within a reasonable amount of time. Combined with high-level planning and autonomous robotic systems, interesting new perspectives open up for non-invasive BCI-based human-robot interactions.

READ FULL TEXT

page 1

page 4

research
08/29/2023

LLM-Based Human-Robot Collaboration Framework for Manipulation Tasks

This paper presents a novel approach to enhance autonomous robotic manip...
research
11/02/2022

CobotTouch: AR-based Interface with Fingertip-worn Tactile Display for Immersive Operation/Control of Collaborative Robots

Complex robotic tasks require human collaboration to benefit from their ...
research
09/21/2023

HiCRISP: A Hierarchical Closed-Loop Robotic Intelligent Self-Correction Planner

The integration of Large Language Models (LLMs) into robotics has revolu...
research
05/30/2019

Assistive robot operated via P300-based Brain Computer Interface

In this paper we present an architecture for the operation of an assisti...
research
01/02/2020

Fast Perception, Planning, and Execution for a Robotic Butler: Wheeled Humanoid M-Hubo

As the aging population grows at a rapid rate, there is an ever growing ...
research
06/08/2020

Synchronous Robotic Framework

We present a synchronous robotic testbed called SyROF that allows fast i...
research
11/22/2020

Experimental Assessment of Human-Robot Teaming for Multi-Step Remote Manipulation with Expert Operators

Remote robot manipulation with human control enables applications where ...

Please sign up or login with your details

Forgot password? Click here to reset