Hierarchical generative modelling for autonomous robots

08/15/2023
by   Kai Yuan, et al.
0

Humans can produce complex whole-body motions when interacting with their surroundings, by planning, executing and combining individual limb movements. We investigated this fundamental aspect of motor control in the setting of autonomous robotic operations. We approach this problem by hierarchical generative modelling equipped with multi-level planning-for autonomous task completion-that mimics the deep temporal architecture of human motor control. Here, temporal depth refers to the nested time scales at which successive levels of a forward or generative model unfold, for example, delivering an object requires a global plan to contextualise the fast coordination of multiple local movements of limbs. This separation of temporal scales also motivates robotics and control. Specifically, to achieve versatile sensorimotor control, it is advantageous to hierarchically structure the planning and low-level motor control of individual limbs. We use numerical and physical simulation to conduct experiments and to establish the efficacy of this formulation. Using a hierarchical generative model, we show how a humanoid robot can autonomously complete a complex task that necessitates a holistic use of locomotion, manipulation, and grasping. Specifically, we demonstrate the ability of a humanoid robot that can retrieve and transport a box, open and walk through a door to reach the destination, approach and kick a football, while showing robust performance in presence of body damage and ground irregularities. Our findings demonstrated the effectiveness of using human-inspired motor control algorithms, and our method provides a viable hierarchical architecture for the autonomous completion of challenging goal-directed tasks.

READ FULL TEXT

page 7

page 10

page 12

page 17

page 39

page 41

research
11/23/2018

Hierarchical visuomotor control of humanoids

We aim to build complex humanoid agents that integrate perception, motor...
research
10/14/2022

Learning to Autonomously Reach Objects with NICO and Grow-When-Required Networks

The act of reaching for an object is a fundamental yet complex skill for...
research
05/25/2021

From Motor Control to Team Play in Simulated Humanoid Football

Intelligent behaviour in the physical world exhibits structure at multip...
research
07/17/2023

Robot motor learning shows emergence of frequency-modulated, robust swimming with an invariant Strouhal-number

Fish locomotion emerges from a diversity of interactions among deformabl...
research
03/07/2022

Hands-free Telelocomotion of a Wheeled Humanoid toward Dynamic Mobile Manipulation via Teleoperation

Robotic systems that can dynamically combine manipulation and locomotion...
research
02/02/2012

The implications of embodiment for behavior and cognition: animal and robotic case studies

In this paper, we will argue that if we want to understand the function ...
research
10/19/2018

Autonomous Functional Locomotion in a Tendon-Driven Limb via Limited Experience

Robots will become ubiquitously useful only when they can use few attemp...

Please sign up or login with your details

Forgot password? Click here to reset