Distribution-aware Goal Prediction and Conformant Model-based Planning for Safe Autonomous Driving

12/16/2022
by   Jonathan Francis, et al.
0

The feasibility of collecting a large amount of expert demonstrations has inspired growing research interests in learning-to-drive settings, where models learn by imitating the driving behaviour from experts. However, exclusively relying on imitation can limit agents' generalisability to novel scenarios that are outside the support of the training data. In this paper, we address this challenge by factorising the driving task, based on the intuition that modular architectures are more generalisable and more robust to changes in the environment compared to monolithic, end-to-end frameworks. Specifically, we draw inspiration from the trajectory forecasting community and reformulate the learning-to-drive task as obstacle-aware perception and grounding, distribution-aware goal prediction, and model-based planning. Firstly, we train the obstacle-aware perception module to extract salient representation of the visual context. Then, we learn a multi-modal goal distribution by performing conditional density-estimation using normalising flow. Finally, we ground candidate trajectory predictions road geometry, and plan the actions based on on vehicle dynamics. Under the CARLA simulator, we report state-of-the-art results on the CARNOVEL benchmark.

READ FULL TEXT

page 4

page 8

research
11/03/2022

Safe Real-World Autonomous Driving by Learning to Predict and Plan with a Mixture of Experts

The goal of autonomous vehicles is to navigate public roads safely and c...
research
04/19/2021

Multi-Modal Fusion Transformer for End-to-End Autonomous Driving

How should representations from complementary sensors be integrated for ...
research
08/03/2023

Target-point Attention Transformer: A novel trajectory predict network for end-to-end autonomous driving

In the field of autonomous driving, there have been many excellent perce...
research
04/28/2022

Control-Aware Prediction Objectives for Autonomous Driving

Autonomous vehicle software is typically structured as a modular pipelin...
research
12/07/2018

ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worst

Our goal is to train a policy for autonomous driving via imitation learn...
research
12/20/2022

Goal-oriented Autonomous Driving

Modern autonomous driving system is characterized as modular tasks in se...
research
05/05/2022

Learn-to-Race Challenge 2022: Benchmarking Safe Learning and Cross-domain Generalisation in Autonomous Racing

We present the results of our autonomous racing virtual challenge, based...

Please sign up or login with your details

Forgot password? Click here to reset