Learning body models: from humans to humanoids

11/06/2022
by   Matej Hoffmann, et al.
0

Humans and animals excel in combining information from multiple sensory modalities, controlling their complex bodies, adapting to growth, failures, or using tools. These capabilities are also highly desirable in robots. They are displayed by machines to some extent. Yet, the artificial creatures are lagging behind. The key foundation is an internal representation of the body that the agent - human, animal, or robot - has developed. The mechanisms of operation of body models in the brain are largely unknown and even less is known about how they are constructed from experience after birth. In collaboration with developmental psychologists, we conducted targeted experiments to understand how infants acquire first "sensorimotor body knowledge". These experiments inform our work in which we construct embodied computational models on humanoid robots that address the mechanisms behind learning, adaptation, and operation of multimodal body representations. At the same time, we assess which of the features of the "body in the brain" should be transferred to robots to give rise to more adaptive and resilient, self-calibrating machines. We extend traditional robot kinematic calibration focusing on self-contained approaches where no external metrology is needed: self-contact and self-observation. Problem formulation allowing to combine several ways of closing the kinematic chain simultaneously is presented, along with a calibration toolbox and experimental validation on several robot platforms. Finally, next to models of the body itself, we study peripersonal space - the space immediately surrounding the body. Again, embodied computational models are developed and subsequently, the possibility of turning these biologically inspired representations into safe human-robot collaboration is studied.

READ FULL TEXT

page 14

page 22

research
10/19/2020

Body models in humans, animals, and robots

Humans and animals excel in combining information from multiple sensory ...
research
11/25/2020

Sensorimotor representation learning for an "active self" in robots: A model survey

Safe human-robot interactions require robots to be able to learn how to ...
research
01/17/2018

Compact Real-time avoidance on a Humanoid Robot for Human-robot Interaction

With robots leaving factories and entering less controlled domains, poss...
research
11/08/2020

Learning Extended Body Schemas from Visual Keypoints for Object Manipulation

Humans have impressive generalization capabilities when it comes to mani...
research
01/20/2022

Body Models in Humans and Robots

Neurocognitive models of higher-level somatosensory processing have emph...
research
09/05/2019

The homunculus for proprioception: Toward learning the representation of a humanoid robot's joint space using self-organizing maps

In primate brains, tactile and proprioceptive inputs are relayed to the ...
research
04/17/2020

Diversity-based Design Assist for Large Legged Robots

We combine MAP-Elites and highly parallelisable simulation to explore th...

Please sign up or login with your details

Forgot password? Click here to reset