Trajectory Generation, Control, and Safety with Denoising Diffusion Probabilistic Models

06/27/2023
by   Nicolò Botteghi, et al.
0

We present a framework for safety-critical optimal control of physical systems based on denoising diffusion probabilistic models (DDPMs). The technology of control barrier functions (CBFs), encoding desired safety constraints, is used in combination with DDPMs to plan actions by iteratively denoising trajectories through a CBF-based guided sampling procedure. At the same time, the generated trajectories are also guided to maximize a future cumulative reward representing a specific task to be optimally executed. The proposed scheme can be seen as an offline and model-based reinforcement learning algorithm resembling in its functionalities a model-predictive control optimization scheme with receding horizon in which the selected actions lead to optimal and safe trajectories.

READ FULL TEXT

page 13

page 16

research
11/08/2022

Safety-Critical Ergodic Exploration in Cluttered Environments via Control Barrier Functions

In this paper, we address the problem of safe trajectory planning for au...
research
05/20/2022

Planning with Diffusion for Flexible Behavior Synthesis

Model-based reinforcement learning methods often use learning only for t...
research
05/12/2021

Acting upon Imagination: when to trust imagined trajectories in model based reinforcement learning

Model based reinforcement learning (MBRL) uses an imperfect model of the...
research
09/24/2021

Guided Probabilistic Simulation of Complex Systems Toward Rare and Extreme Events

Simulation based or dynamic probabilistic risk assessment methodologies ...
research
03/22/2018

Learning-based Model Predictive Control for Safe Exploration and Reinforcement Learning

Learning-based methods have been successful in solving complex control t...
research
10/22/2018

Learning Probabilistic Trajectory Models of Aircraft in Terminal Airspace from Position Data

Models for predicting aircraft motion are an important component of mode...
research
01/03/2023

Safe Reinforcement Learning for an Energy-Efficient Driver Assistance System

Reinforcement learning (RL)-based driver assistance systems seek to impr...

Please sign up or login with your details

Forgot password? Click here to reset