Reactive Anticipatory Robot Skills with Memory

by   Hakan Girgin, et al.
Idiap Research Institute

Optimal control in robotics has been increasingly popular in recent years and has been applied in many applications involving complex dynamical systems. Closed-loop optimal control strategies include model predictive control (MPC) and time-varying linear controllers optimized through iLQR. However, such feedback controllers rely on the information of the current state, limiting the range of robotic applications where the robot needs to remember what it has done before to act and plan accordingly. The recently proposed system level synthesis (SLS) framework circumvents this limitation via a richer controller structure with memory. In this work, we propose to optimally design reactive anticipatory robot skills with memory by extending SLS to tracking problems involving nonlinear systems and nonquadratic cost functions. We showcase our method with two scenarios exploiting task precisions and object affordances in pick-and-place tasks in a simulated and a real environment with a 7-axis Franka Emika robot.


page 2

page 10

page 11

page 12


Full-Body Torque-Level Non-linear Model Predictive Control for Aerial Manipulation

Non-linear model predictive control (nMPC) is a powerful approach to con...

Neural Lyapunov and Optimal Control

Optimal control (OC) is an effective approach to controlling complex dyn...

Stochastic Optimal Control as Approximate Input Inference

Optimal control of stochastic nonlinear dynamical systems is a major cha...

A Passivity-based Approach for Variable Stiffness Control with Dynamical Systems

In this paper, we present a controller that combines motion generation a...

Model-Based Reinforcement Learning for Stochastic Hybrid Systems

Optimal control of general nonlinear systems is a central challenge in a...

A Modular Robotic Arm Control Stack for Research: Franka-Interface and FrankaPy

We designed a modular robotic control stack that provides a customizable...

Automatic Encoding and Repair of Reactive High-Level Tasks with Learned Abstract Representations

We present a framework that, given a set of skills a robot can perform, ...

Please sign up or login with your details

Forgot password? Click here to reset