Instance-Aware Predictive Navigation in Multi-Agent Environments

01/14/2021
by   Jinkun Cao, et al.
5

In this work, we aim to achieve efficient end-to-end learning of driving policies in dynamic multi-agent environments. Predicting and anticipating future events at the object level are critical for making informed driving decisions. We propose an Instance-Aware Predictive Control (IPC) approach, which forecasts interactions between agents as well as future scene structures. We adopt a novel multi-instance event prediction module to estimate the possible interaction among agents in the ego-centric view, conditioned on the selected action sequence of the ego-vehicle. To decide the action at each step, we seek the action sequence that can lead to safe future states based on the prediction module outputs by repeatedly sampling likely action sequences. We design a sequential action sampling strategy to better leverage predicted states on both scene-level and instance-level. Our method establishes a new state of the art in the challenging CARLA multi-agent driving simulation environments without expert demonstration, giving better explainability and sample efficiency.

READ FULL TEXT

page 1

page 3

page 4

page 8

research
11/27/2022

FJMP: Factorized Joint Multi-Agent Motion Prediction over Learned Directed Acyclic Interaction Graphs

Predicting the future motion of road agents is a critical task in an aut...
research
02/13/2023

Multi-Agent Path Integral Control for Interaction-Aware Motion Planning in Urban Canals

Autonomous vehicles that operate in urban environments shall comply with...
research
04/29/2020

Action Sequence Predictions of Vehicles in Urban Environments using Map and Social Context

This work studies the problem of predicting the sequence of future actio...
research
11/19/2022

Prediction-aware and Reinforcement Learning based Altruistic Cooperative Driving

Autonomous vehicle (AV) navigation in the presence of Human-driven vehic...
research
05/10/2023

Think Twice before Driving: Towards Scalable Decoders for End-to-End Autonomous Driving

End-to-end autonomous driving has made impressive progress in recent yea...
research
10/17/2022

Learning Control Admissibility Models with Graph Neural Networks for Multi-Agent Navigation

Deep reinforcement learning in continuous domains focuses on learning co...
research
09/21/2021

Self-Supervised Action-Space Prediction for Automated Driving

Making informed driving decisions requires reliable prediction of other ...

Please sign up or login with your details

Forgot password? Click here to reset