Log In Sign Up

BARK: Open Behavior Benchmarking in Multi-Agent Environments

by   Julian Bernhard, et al.

Predicting and planning interactive behaviors in complex traffic situations presents a challenging task. Especially in scenarios involving multiple traffic participants that interact densely, autonomous vehicles still struggle to interpret situations and to eventually achieve their own driving goal. As driving tests are costly and challenging scenarios are hard to find and reproduce, simulation is widely used to develop, test, and benchmark behavior models. However, most simulations rely on datasets and simplistic behavior models for traffic participants and do not cover the full variety of real-world, interactive human behaviors. In this work, we introduce BARK, an open-source behavior benchmarking environment designed to mitigate the shortcomings stated above. In BARK, behavior models are (re-)used for planning, prediction, and simulation. A range of models is currently available, such as Monte-Carlo Tree Search and Reinforcement Learning-based behavior models. We use a public dataset and sampling-based scenario generation to show the inter-exchangeability of behavior models in BARK. We evaluate how well the models used cope with interactions and how robust they are towards exchanging behavior models. Our evaluation shows that BARK provides a suitable framework for a systematic development of behavior models.


page 1

page 2

page 3

page 4


Modeling and Testing Multi-Agent Traffic Rules within Interactive Behavior Planning

Autonomous vehicles need to abide by the same rules that humans follow. ...

Interaction-Aware Behavior Planning for Autonomous Vehicles Validated with Real Traffic Data

Autonomous vehicles (AVs) need to interact with other traffic participan...

Risk-Constrained Interactive Safety under Behavior Uncertainty for Autonomous Driving

Balancing safety and efficiency when planning in dense traffic is challe...

A behavior driven approach for sampling rare event situations for autonomous vehicles

Performance evaluation of urban autonomous vehicles requires a realistic...

Analyzing Multiagent Interactions in Traffic Scenes via Topological Braids

We focus on the problem of analyzing multiagent interactions in traffic ...

Adaptive Synthetic Characters for Military Training

Behaviors of the synthetic characters in current military simulations ar...

BITS: Bi-level Imitation for Traffic Simulation

Simulation is the key to scaling up validation and verification for robo...