Deep Multi-Task Learning for Joint Localization, Perception, and Prediction

01/17/2021
by   John Phillips, et al.
0

Over the last few years, we have witnessed tremendous progress on many subtasks of autonomous driving, including perception, motion forecasting, and motion planning. However, these systems often assume that the car is accurately localized against a high-definition map. In this paper we question this assumption, and investigate the issues that arise in state-of-the-art autonomy stacks under localization error. Based on our observations, we design a system that jointly performs perception, prediction, and localization. Our architecture is able to reuse computation between both tasks, and is thus able to correct localization errors efficiently. We show experiments on a large-scale autonomy dataset, demonstrating the efficiency and accuracy of our proposed approach.

READ FULL TEXT

page 2

page 5

research
08/13/2020

Perceive, Predict, and Plan: Safe Motion Planning Through Interpretable Semantic Representations

In this paper we propose a novel end-to-end learnable network that perfo...
research
03/03/2023

Visual Exemplar Driven Task-Prompting for Unified Perception in Autonomous Driving

Multi-task learning has emerged as a powerful paradigm to solve a range ...
research
05/19/2022

BEVerse: Unified Perception and Prediction in Birds-Eye-View for Vision-Centric Autonomous Driving

In this paper, we present BEVerse, a unified framework for 3D perception...
research
04/20/2021

Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Dataset

As autonomous driving systems mature, motion forecasting has received in...
research
08/19/2019

How far should self-driving cars see? Effect of observation range on vehicle self-localization

Accuracy and time efficiency are two essential requirements for the self...
research
09/02/2020

A perception centred self-driving system without HD Maps

This paper proposes a new self-driving system to solve the localization ...
research
08/07/2020

Fisher Information Field: an Efficient and Differentiable Map for Perception-aware Planning

Considering visual localization accuracy at the planning time gives pref...

Please sign up or login with your details

Forgot password? Click here to reset