Run, skeleton, run: skeletal model in a physics-based simulation

11/18/2017
by   Mikhail Pavlov, et al.
0

In this paper, we present our approach to solve a physics-based reinforcement learning challenge "Learning to Run" with objective to train physiologically-based human model to navigate a complex obstacle course as quickly as possible. The environment is computationally expensive, has a high-dimensional continuous action space and is stochastic. We benchmark state of the art policy-gradient methods and test several improvements, such as layer normalization, parameter noise, action and state reflecting, to stabilize training and improve its sample-efficiency. We found that the Deep Deterministic Policy Gradient method is the most efficient method for this environment and the improvements we have introduced help to stabilize training. Learned models are able to generalize to new physical scenarios, e.g. different obstacle courses.

READ FULL TEXT
research
04/02/2018

Learning to Run challenge solutions: Adapting reinforcement learning methods for neuromusculoskeletal environments

In the NIPS 2017 Learning to Run challenge, participants were tasked wit...
research
07/20/2023

Exploring reinforcement learning techniques for discrete and continuous control tasks in the MuJoCo environment

We leverage the fast physics simulator, MuJoCo to run tasks in a continu...
research
03/31/2018

Learning to Run challenge: Synthesizing physiologically accurate motion using deep reinforcement learning

Synthesizing physiologically-accurate human movement in a variety of con...
research
05/09/2023

Policy Gradient Methods in the Presence of Symmetries and State Abstractions

Reinforcement learning on high-dimensional and complex problems relies o...
research
05/07/2019

Object Exchangeability in Reinforcement Learning: Extended Abstract

Although deep reinforcement learning has advanced significantly over the...
research
11/06/2020

Sample-efficient Reinforcement Learning in Robotic Table Tennis

Reinforcement learning (RL) has recently shown impressive success in var...
research
05/08/2023

Reinforcement Learning for Topic Models

We apply reinforcement learning techniques to topic modeling by replacin...

Please sign up or login with your details

Forgot password? Click here to reset