Action Prediction in Humans and Robots

by   Florentin Wörgötter, et al.

Efficient action prediction is of central importance for the fluent workflow between humans and equally so for human-robot interaction. To achieve prediction, actions can be encoded by a series of events, where every event corresponds to a change in a (static or dynamic) relation between some of the objects in a scene. Manipulation actions and others can be uniquely encoded this way and only, on average, less than 60 until an action can be predicted. Using a virtual reality setup and testing ten different manipulation actions, here we show that in most cases humans predict actions at the same event as the algorithm. In addition, we perform an in-depth analysis about the temporal gain resulting from such predictions when chaining actions and show in some robotic experiments that the percentage gain for humans and robots is approximately equal. Thus, if robots use this algorithm then their prediction-moments will be compatible to those of their human interaction partners, which should much benefit natural human-robot collaboration.



page 5

page 8

page 25


Human and Machine Action Prediction Independent of Object Information

Predicting other people's action is key to successful social interaction...

Spatial Computing and Intuitive Interaction: Bringing Mixed Reality and Robotics Together

Spatial computing – the ability of devices to be aware of their surround...

Human-Robot Collaboration in Microgravity: The Object Handover Problem

Collaborative space robots are an emerging research field with high impa...

Morphology dictates a robot's ability to ground crowd-proposed language

As more robots act in physical proximity to people, it is essential to e...

Object and Relation Centric Representations for Push Effect Prediction

Pushing is an essential non-prehensile manipulation skill used for tasks...

Beyond the Self: Using Grounded Affordances to Interpret and Describe Others' Actions

We propose a developmental approach that allows a robot to interpret and...

BEHAVE: Dataset and Method for Tracking Human Object Interactions

Modelling interactions between humans and objects in natural environment...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.