Action Anticipation: Reading the Intentions of Humans and Robots

02/08/2018
by   Nuno Duarte, et al.
0

Humans have the fascinating capacity to understand, and anticipate the actions of other humans in the same space, without requiring verbal communication. This "intention reading" capacity is underpinned by a common motor-repertoire that is shared by all humans, and afforded by a subtle coordination of eye-head-arm movements that encodes the cues and signals that will ultimately be deciphered by another human. In this paper we study the action anticipation capacity of humans and robots with a focus on three steps: (i) conducting human interaction studies to record a set of relevant motion signals and cues, (ii) use these data to build computational motor control models, and (iii) incorporate this model in a robot controller. In the human studies we ask participants to guess what action the actor was performing: giving or placing an object on a table. Our results reveal that giving actions present a more complex behavior of the human gaze compared to the placing actions. These findings are integrated in our motor control together with the arm movement modeled from human behavior. Gaussian Mixture models the human arm movement, and then Gaussian Mixture Regression generates the controller. The readability of the controller is tested on a human-robot scenario validating the results acquired from the human experiment. Our work is a step forward to building robotic systems that are not only capable of reading and anticipating the actions of human collaborators but also, at the same time, to act in a way that is legible to their human counterparts.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 7

research
05/10/2019

Learning Motor Resonance in Human-Human and Human-Robot Interaction with Coupled Dynamical System

Human interaction involves very sophisticated non-verbal communication s...
research
02/09/2023

Gaze-based intention estimation: principles, methodologies, and applications in HRI

Intention prediction has become a relevant field of research in Human-Ma...
research
05/04/2023

Language Control in Robotics

For robots performing a assistive tasks for the humans, it is crucial to...
research
06/11/2019

Deep learning control of artificial avatars in group coordination tasks

In many joint-action scenarios, humans and robots have to coordinate the...
research
06/23/2023

Exploring AI-enhanced Shared Control for an Assistive Robotic Arm

Assistive technologies and in particular assistive robotic arms have the...
research
11/23/2022

Comparison of Motion Encoding Frameworks on Human Manipulation Actions

Movement generation, and especially generalisation to unseen situations,...

Please sign up or login with your details

Forgot password? Click here to reset