Trajectory-guided Control Prediction for End-to-end Autonomous Driving: A Simple yet Strong Baseline

06/16/2022
by   Penghao Wu, et al.
0

Current end-to-end autonomous driving methods either run a controller based on a planned trajectory or perform control prediction directly, which have spanned two separately studied lines of research. Seeing their potential mutual benefits to each other, this paper takes the initiative to explore the combination of these two well-developed worlds. Specifically, our integrated approach has two branches for trajectory planning and direct control, respectively. The trajectory branch predicts the future trajectory, while the control branch involves a novel multi-step prediction scheme such that the relationship between current actions and future states can be reasoned. The two branches are connected so that the control branch receives corresponding guidance from the trajectory branch at each time step. The outputs from two branches are then fused to achieve complementary advantages. Our results are evaluated in the closed-loop urban driving setting with challenging scenarios using the CARLA simulator. Even with a monocular camera input, the proposed approach ranks first on the official CARLA Leaderboard, outperforming other complex candidates with multiple sensors or fusion mechanisms by a large margin. The source code and data will be made publicly available at https://github.com/OpenPerceptionX/TCP.

READ FULL TEXT

page 2

page 9

page 14

page 15

research
05/17/2023

Rethinking the Open-Loop Evaluation of End-to-End Autonomous Driving in nuScenes

Modern autonomous driving systems are typically divided into three main ...
research
05/09/2021

Trajectory Prediction for Autonomous Driving with Topometric Map

State-of-the-art autonomous driving systems rely on high definition (HD)...
research
07/15/2022

ST-P3: End-to-end Vision-based Autonomous Driving via Spatial-Temporal Feature Learning

Many existing autonomous driving paradigms involve a multi-stage discret...
research
04/21/2021

FIERY: Future Instance Prediction in Bird's-Eye View from Surround Monocular Cameras

Driving requires interacting with road agents and predicting their futur...
research
09/19/2022

Real-Time Unified Trajectory Planning and Optimal Control for Urban Autonomous Driving Under Static and Dynamic Obstacle Constraints

Trajectory planning and control have historically been separated into tw...
research
11/30/2021

Fast and Real-time End to End Control in Autonomous Racing Cars Through Representation Learning

The challenges presented in an autonomous racing situation are distinct ...
research
08/30/2018

Learning End-to-end Autonomous Driving using Guided Auxiliary Supervision

Learning to drive faithfully in highly stochastic urban settings remains...

Please sign up or login with your details

Forgot password? Click here to reset