Learning Motor Resonance in Human-Human and Human-Robot Interaction with Coupled Dynamical System

05/10/2019
by   Nuno Ferreira Duarte, et al.
0

Human interaction involves very sophisticated non-verbal communication skills like understanding the goals and actions of others and coordinating our own actions accordingly. Neuroscience refers to this mechanism as motor resonance, in the sense that the perception of another person's actions and sensory experiences activates the observer's brain as if (s)he would be performing the same actions and having the same experiences. We analyze and model non-verbal cues (arm movements) exchanged between two humans that interact and execute handover actions. The contributions of this paper are the following: (i) computational models, using recorded motion data, describing the motor behaviour of each actor in action-in-interaction situations, (ii) a computational model that captures the behaviour if the "giver" and "receiver" during an object handover action, by coupling the arm motion of both actors, and (iii) embedded these models in the iCub robot for both action execution and recognition. Our results show that: (i) the robot can interpret the human arm motion and recognize handover actions; and (ii) behave in a "human-like" manner to receive the object of the recognized handover action.

READ FULL TEXT

page 1

page 7

research
02/08/2018

Action Anticipation: Reading the Intentions of Humans and Robots

Humans have the fascinating capacity to understand, and anticipate the a...
research
11/23/2020

Language guided machine action

Here we build a hierarchical modular network called Language guided mach...
research
12/24/2021

Rediscovering Affordance: A Reinforcement Learning Perspective

Affordance refers to the perception of possible actions allowed by an ob...
research
06/11/2022

Precise Affordance Annotation for Egocentric Action Video Datasets

Object affordance is an important concept in human-object interaction, p...
research
10/23/2018

A predictive processing model of perception and action for self-other distinction

During interaction with others, we perceive and produce social actions i...
research
03/04/2019

Automated Generation of Reactive Programs from Human Demonstration for Orchestration of Robot Behaviors

Social robots or collaborative robots that have to interact with people ...

Please sign up or login with your details

Forgot password? Click here to reset