Reinforcement Learning of Musculoskeletal Control from Functional Simulations

07/13/2020
by   Emanuel Joos, et al.
0

To diagnose, plan, and treat musculoskeletal pathologies, understanding and reproducing muscle recruitment for complex movements is essential. With muscle activations for movements often being highly redundant, nonlinear, and time dependent, machine learning can provide a solution for their modeling and control for anatomy-specific musculoskeletal simulations. Sophisticated biomechanical simulations often require specialized computational environments, being numerically complex and slow, hindering their integration with typical deep learning frameworks. In this work, a deep reinforcement learning (DRL) based inverse dynamics controller is trained to control muscle activations of a biomechanical model of the human shoulder. In a generalizable end-to-end fashion, muscle activations are learned given current and desired position-velocity pairs. A customized reward functions for trajectory control is introduced, enabling straightforward extension to additional muscles and higher degrees of freedom. Using the biomechanical model, multiple episodes are simulated on a cluster simultaneously using the evolving neural models of the DRL being trained. Results are presented for a single-axis motion control of shoulder abduction for the task of following randomly generated angular trajectories.

READ FULL TEXT

page 3

page 8

research
02/16/2023

Deep Reinforcement Learning Based Tracking Control of an Autonomous Surface Vessel in Natural Waters

Accurate control of autonomous marine robots still poses challenges due ...
research
04/30/2019

Synthesis of Biologically Realistic Human Motion Using Joint Torque Actuation

Using joint actuators to drive the skeletal movements is a common practi...
research
11/15/2019

Adaptive Leader-Follower Formation Control and Obstacle Avoidance via Deep Reinforcement Learning

We propose a deep reinforcement learning (DRL) methodology for the track...
research
10/25/2018

Differential Variable Speed Limits Control for Freeway Recurrent Bottlenecks via Deep Reinforcement learning

Variable speed limits (VSL) control is a flexible way to improve traffic...
research
06/13/2017

Prediction of Muscle Activations for Reaching Movements using Deep Neural Networks

The motor control problem involves determining the time-varying muscle a...
research
01/27/2023

Exploring Deep Reinforcement Learning for Holistic Smart Building Control

In this paper, we take a holistic approach to deal with the tradeoffs be...
research
05/23/2023

Control of a simulated MRI scanner with deep reinforcement learning

Magnetic resonance imaging (MRI) is a highly versatile and widely used c...

Please sign up or login with your details

Forgot password? Click here to reset