DiffTune: Auto-Tuning through Auto-Differentiation

09/20/2022
by   Sheng Cheng, et al.
0

The performance of a robot controller depends on the choice of its parameters, which require careful tuning. In this paper, we present DiffTune, a novel, gradient-based automatic tuning framework. Our method unrolls the dynamical system and controller as a computational graph and updates the controller parameters through gradient-based optimization. Unlike the commonly used back-propagation scheme, the gradient in DiffTune is obtained through sensitivity propagation, a forward-mode auto differentiation technique that runs parallel to the system's evolution. We validate the proposed auto-tune approach on a Dubin's car and a quadrotor in challenging simulation environments. Simulation experiments show that the approach is robust to uncertainties in the system dynamics and environment and generalizes well to unseen trajectories in tuning.

READ FULL TEXT
12/06/2022

DiffTune^+: Hyperparameter-Free Auto-Tuning using Auto-Differentiation

Controller tuning is a vital step to ensure the controller delivers its ...
08/01/2018

Structured Differential Learning for Automatic Threshold Setting

We introduce a technique that can automatically tune the parameters of a...
06/03/2023

Correcting auto-differentiation in neural-ODE training

Does the use of auto-differentiation yield reasonable updates to deep ne...
02/19/2021

Deluca – A Differentiable Control Library: Environments, Methods, and Benchmarking

We present an open-source library of natively differentiable physics and...
03/01/2020

Inverse design of photonic crystals through automatic differentiation

Gradient-based inverse design in photonics has already achieved remarkab...
09/11/2022

Performance-Driven Controller Tuning via Derivative-Free Reinforcement Learning

Choosing an appropriate parameter set for the designed controller is cri...

Please sign up or login with your details

Forgot password? Click here to reset