DeepAI AI Chat
Log In Sign Up

Interactive Robot Learning of Gestures, Language and Affordances

by   Giovanni Saponaro, et al.
KTH Royal Institute of Technology
University of Lisbon
Queen Mary University of London

A growing field in robotics and Artificial Intelligence (AI) research is human-robot collaboration, whose target is to enable effective teamwork between humans and robots. However, in many situations human teams are still superior to human-robot teams, primarily because human teams can easily agree on a common goal with language, and the individual members observe each other effectively, leveraging their shared motor repertoire and sensorimotor resources. This paper shows that for cognitive robots it is possible, and indeed fruitful, to combine knowledge acquired from interacting with elements of the environment (affordance exploration) with the probabilistic observation of another agent's actions. We propose a model that unites (i) learning robot affordances and word descriptions with (ii) statistical recognition of human gestures with vision sensors. We discuss theoretical motivations, possible implementations, and we show initial results which highlight that, after having acquired knowledge of its surrounding environment, a humanoid robot can generalize this knowledge to the case when it observes another agent (human partner) performing the same motor actions previously executed during training.


Sharing Cognition: Human Gesture and Natural Language Grounding Based Planning and Navigation for Indoor Robots

Cooperation among humans makes it easy to execute tasks and navigate sea...

Proceedings of the AI-HRI Symposium at AAAI-FSS 2018

The goal of the Interactive Learning for Artificial Intelligence (AI) fo...

Robotic Self-Assessment of Competence

In robotics, one of the main challenges is that the on-board Artificial ...

Learning from My Partner's Actions: Roles in Decentralized Robot Teams

When teams of robots collaborate to complete a task, communication is of...

Interspecies Collaboration in the Design of Visual Identity: A Case Study

Design usually relies on human ingenuity, but the past decade has seen t...

Neural Architectures for Robot Intelligence

We argue that the direct experimental approaches to elucidate the archit...