Visualizing Movement Control Optimization Landscapes

09/17/2019
by   Perttu Hämäläinen, et al.
6

A large body of animation research focuses on optimization of movement control, either as action sequences or policy parameters. However, as closed-form expressions of the objective functions are often not available, our understanding of the optimization problems is limited. Building on recent work on analyzing neural network training, we contribute novel visualizations of high-dimensional control optimization landscapes; this yields insights into why control optimization is hard and why common practices like early termination and spline-based action parameterizations make optimization easier. For example, our experiments show how trajectory optimization can become increasingly ill-conditioned with longer trajectories, but parameterizing control as partial target states - e.g., target angles converted to torques using a PD-controller - can act as an efficient preconditioner. Both our visualizations and quantitative empirical data also indicate that neural network policy optimization scales better than trajectory optimization for long planning horizons. Our work advances the understanding of movement optimization and our visualizations should also provide value in educational use.

READ FULL TEXT

page 4

page 6

page 8

research
09/22/2020

Learning Task-Agnostic Action Spaces for Movement Optimization

We propose a novel method for exploring the dynamics of physically based...
research
09/09/2021

Mini Cheetah, the Falling Cat: A Case Study in Machine Learning and Trajectory Optimization for Robot Acrobatics

Seemingly in defiance of basic physics, cats consistently land on their ...
research
10/13/2021

Guided Policy Search using Sequential Convex Programming for Initialization of Trajectory Optimization Algorithms

Nonlinear trajectory optimization algorithms have been developed to hand...
research
06/20/2019

Exploring Model-based Planning with Policy Networks

Model-based reinforcement learning (MBRL) with model-predictive control ...
research
06/21/2022

Boosting Performance Optimization with Interactive Data Movement Visualization

Optimizing application performance in today's hardware architecture land...
research
07/02/2020

Regularization of the movement of a material point along a flat trajectory: application to robotics problems

The control problem of the working tool movement along a predefined traj...
research
03/29/2021

Distributionally Robust Trajectory Optimization Under Uncertain Dynamics via Relative-Entropy Trust Regions

Trajectory optimization and model predictive control are essential techn...

Please sign up or login with your details

Forgot password? Click here to reset