On a probabilistic approach to synthesize control policies from example datasets

03/19/2021
by   giovarusso, et al.
0

This paper is concerned with the design of control policies from example data. The case considered is when just a black box description of the system to be controlled is available and the system is affected by actuation constraints. These constraints are unknown to the demonstrators and hence might not be satisfied in the possibly noisy example data. In this context, we introduce a number of theoretical results to compute a control policy from the examples that: (i) makes the behavior of the closed-loop system similar to the one illustrated in the dataset; (ii) guarantees compliance with the constraints. The theoretical results give an explicit expression for the control policy and this allows to turn our findings into an algorithmic procedure. The procedure gives a systematic tool to compute the policy. The effectiveness of our approach is illustrated via a numerical example, where we use real data collected from test drives to synthesize a control policy for the merging of a car on a highway.

READ FULL TEXT

page 10

page 11

research
12/21/2021

Discrete fully probabilistic design: a tool to design control policies from examples

We present a discretized design that expounds an algorithm recently intr...
research
01/13/2020

On the synthesis of control policies from noisy example datasets: a probabilistic approach

In this note we consider the problem of synthesizing optimal control pol...
research
03/02/2022

Learning Stochastic Parametric Differentiable Predictive Control Policies

The problem of synthesizing stochastic explicit model predictive control...
research
03/20/2019

Batch Policy Learning under Constraints

When learning policies for real-world domains, two important questions a...
research
03/03/2022

Reinforcement Learning in Possibly Nonstationary Environments

We consider reinforcement learning (RL) methods in offline nonstationary...
research
06/24/2023

On Convex Data-Driven Inverse Optimal Control for Nonlinear, Non-stationary and Stochastic Systems

This paper is concerned with a finite-horizon inverse control problem, w...
research
03/13/2019

Automated Construction of Metric Maps using a Stochastic Robotic Swarm Leveraging Received Signal Strength

In this work, we present a novel automated procedure for constructing a ...

Please sign up or login with your details

Forgot password? Click here to reset