Interactive Robot Learning of Gestures, Language and Affordances

11/24/2017
by   Giovanni Saponaro, et al.
0

A growing field in robotics and Artificial Intelligence (AI) research is human-robot collaboration, whose target is to enable effective teamwork between humans and robots. However, in many situations human teams are still superior to human-robot teams, primarily because human teams can easily agree on a common goal with language, and the individual members observe each other effectively, leveraging their shared motor repertoire and sensorimotor resources. This paper shows that for cognitive robots it is possible, and indeed fruitful, to combine knowledge acquired from interacting with elements of the environment (affordance exploration) with the probabilistic observation of another agent's actions. We propose a model that unites (i) learning robot affordances and word descriptions with (ii) statistical recognition of human gestures with vision sensors. We discuss theoretical motivations, possible implementations, and we show initial results which highlight that, after having acquired knowledge of its surrounding environment, a humanoid robot can generalize this knowledge to the case when it observes another agent (human partner) performing the same motor actions previously executed during training.

READ FULL TEXT
research
04/25/2023

Improved Trust in Human-Robot Collaboration with ChatGPT

Human robot collaboration is becoming increasingly important as robots b...
research
08/14/2021

Sharing Cognition: Human Gesture and Natural Language Grounding Based Planning and Navigation for Indoor Robots

Cooperation among humans makes it easy to execute tasks and navigate sea...
research
09/18/2018

Proceedings of the AI-HRI Symposium at AAAI-FSS 2018

The goal of the Interactive Learning for Artificial Intelligence (AI) fo...
research
05/04/2020

Robotic Self-Assessment of Competence

In robotics, one of the main challenges is that the on-board Artificial ...
research
07/07/2022

Sociable and Ergonomic Human-Robot Collaboration through Action Recognition and Augmented Hierarchical Quadratic Programming

The recognition of actions performed by humans and the anticipation of t...
research
04/06/2019

Utilizing Bluetooth Low Energy to recognize proximity, touch and humans

Interacting with humans is one of the main challenges for mobile robots ...
research
01/25/2022

Interspecies Collaboration in the Design of Visual Identity: A Case Study

Design usually relies on human ingenuity, but the past decade has seen t...

Please sign up or login with your details

Forgot password? Click here to reset