Brain Responses During Robot-Error Observation

by   Dominik Welke, et al.

Brain-controlled robots are a promising new type of assistive device for severely impaired persons. Little is however known about how to optimize the interaction of humans and brain-controlled robots. Information about the human's perceived correctness of robot performance might provide a useful teaching signal for adaptive control algorithms and thus help enhancing robot control. Here, we studied whether watching robots perform erroneous vs. correct action elicits differential brain responses that can be decoded from single trials of electroencephalographic (EEG) recordings, and whether brain activity during human-robot interaction is modulated by the robot's visual similarity to a human. To address these topics, we designed two experiments. In experiment I, participants watched a robot arm pour liquid into a cup. The robot performed the action either erroneously or correctly, i.e. it either spilled some liquid or not. In experiment II, participants observed two different types of robots, humanoid and non-humanoid, grabbing a ball. The robots either managed to grab the ball or not. We recorded high-resolution EEG during the observation tasks in both experiments to train a Filter Bank Common Spatial Pattern (FBCSP) pipeline on the multivariate EEG signal and decode for the correctness of the observed action, and for the type of the observed robot. Our findings show that it was possible to decode both correctness and robot type for the majority of participants significantly, although often just slightly, above chance level. Our findings suggest that non-invasive recordings of brain responses elicited when observing robots indeed contain decodable information about the correctness of the robot's action and the type of observed robot.


page 4

page 6

page 7


The role of robot design in decoding error-related information from EEG signals of a human observer

For utilization of robotic assistive devices in everyday life, means for...

Robot-Assisted Mindfulness Practice: Analysis of Neurophysiological Responses and Affective State Change

Mindfulness is the state of paying attention to the present moment on pu...

Wrapped Haptic Display for Communicating Physical Robot Learning

Physical interaction between humans and robots can help robots learn to ...

A proxemics game between festival visitors and an industrial robot

With increased applications of collaborative robots (cobots) in industri...

Towards Natural Brain-Machine Interaction using Endogenous Potentials based on Deep Neural Networks

Human-robot collaboration has the potential to maximize the efficiency o...

"I am the follower, also the boss": Exploring Different Levels of Autonomy and Machine Forms of Guiding Robots for the Visually Impaired

Guiding robots, in the form of canes or cars, have recently been explore...

Please sign up or login with your details

Forgot password? Click here to reset