DeepAI AI Chat
Log In Sign Up

Control-Aware Prediction Objectives for Autonomous Driving

04/28/2022
by   Rowan McAllister, et al.
Toyota Research Institute
berkeley college
7

Autonomous vehicle software is typically structured as a modular pipeline of individual components (e.g., perception, prediction, and planning) to help separate concerns into interpretable sub-tasks. Even when end-to-end training is possible, each module has its own set of objectives used for safety assurance, sample efficiency, regularization, or interpretability. However, intermediate objectives do not always align with overall system performance. For example, optimizing the likelihood of a trajectory prediction module might focus more on easy-to-predict agents than safety-critical or rare behaviors (e.g., jaywalking). In this paper, we present control-aware prediction objectives (CAPOs), to evaluate the downstream effect of predictions on control without requiring the planner be differentiable. We propose two types of importance weights that weight the predictive likelihood: one using an attention model between agents, and another based on control variation when exchanging predicted trajectories for ground truth trajectories. Experimentally, we show our objectives improve overall system performance in suburban driving scenarios using the CARLA simulator.

READ FULL TEXT

page 1

page 5

08/02/2022

ViP3D: End-to-end Visual Trajectory Prediction via 3D Agent Queries

Existing autonomous driving pipelines separate the perception module fro...
06/17/2022

Improving Diversity of Multiple Trajectory Prediction based on Map-adaptive Lane Loss

Prior arts in the field of motion predictions for autonomous driving ten...
12/13/2022

DiffStack: A Differentiable and Modular Control Stack for Autonomous Vehicles

Autonomous vehicle (AV) stacks are typically built in a modular fashion,...
03/02/2023

Differentiable Trajectory Generation for Car-like Robots with Interpolating Radial Basis Function Networks

The design of Autonomous Vehicle software has largely followed the Sense...
12/16/2022

Distribution-aware Goal Prediction and Conformant Model-based Planning for Safe Autonomous Driving

The feasibility of collecting a large amount of expert demonstrations ha...
03/14/2022

COP: Control Observability-aware Planning

In this research, we aim to answer the question: How to combine Closed-L...
10/18/2021

MTP: Multi-Hypothesis Tracking and Prediction for Reduced Error Propagation

Recently, there has been tremendous progress in developing each individu...