Reactive and Safe Road User Simulations using Neural Barrier Certificates

09/14/2021
by   Yue Meng, et al.
0

Reactive and safe agent modelings are important for nowadays traffic simulator designs and safe planning applications. In this work, we proposed a reactive agent model which can ensure safety without comprising the original purposes, by learning only high-level decisions from expert data and a low-level decentralized controller guided by the jointly learned decentralized barrier certificates. Empirical results show that our learned road user simulation models can achieve a significant improvement in safety comparing to state-of-the-art imitation learning and pure control-based methods, while being similar to human agents by having smaller errors to the expert data. Moreover, our learned reactive agents are shown to generalize better to unseen traffic conditions, and react better to other road users and therefore can help understand challenging planning problems pragmatically.

READ FULL TEXT

page 5

page 6

page 7

research
03/23/2021

Safe Multi-Agent Reinforcement Learning through Decentralized Multiple Control Barrier Functions

Multi-Agent Reinforcement Learning (MARL) algorithms show amazing perfor...
research
03/19/2019

Safe Policy Synthesis in Multi-Agent POMDPs via Discrete-Time Barrier Functions

A multi-agent partially observable Markov decision process (MPOMDP) is a...
research
01/22/2020

Safety Considerations in Deep Control Policies with Probabilistic Safety Barrier Certificates

Recent advances in Deep Machine Learning have shown promise in solving c...
research
02/18/2021

Closing the Closed-Loop Distribution Shift in Safe Imitation Learning

Commonly used optimization-based control strategies such as model-predic...
research
07/09/2021

Adversarial Mixture Density Networks: Learning to Drive Safely from Collision Data

Imitation learning has been widely used to learn control policies for au...
research
01/26/2012

A multiagent urban traffic simulation

We built a multiagent simulation of urban traffic to model both ordinary...
research
01/18/2021

Deep Structured Reactive Planning

An intelligent agent operating in the real-world must balance achieving ...

Please sign up or login with your details

Forgot password? Click here to reset