End-to-end Autonomous Driving Perception with Sequential Latent Representation Learning

03/21/2020
by   Jianyu Chen, et al.
0

Current autonomous driving systems are composed of a perception system and a decision system. Both of them are divided into multiple subsystems built up with lots of human heuristics. An end-to-end approach might clean up the system and avoid huge efforts of human engineering, as well as obtain better performance with increasing data and computation resources. Compared to the decision system, the perception system is more suitable to be designed in an end-to-end framework, since it does not require online driving exploration. In this paper, we propose a novel end-to-end approach for autonomous driving perception. A latent space is introduced to capture all relevant features useful for perception, which is learned through sequential latent representation learning. The learned end-to-end perception model is able to solve the detection, tracking, localization and mapping problems altogether with only minimum human engineering efforts and without storing any maps online. The proposed method is evaluated in a realistic urban driving simulator, with both camera image and lidar point cloud as sensor inputs. The codes and videos of this work are available at our github repo and project website.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

01/23/2020

Interpretable End-to-end Urban Autonomous Driving with Latent Deep Reinforcement Learning

Unlike popular modularized framework, end-to-end autonomous driving seek...
04/12/2022

Fully End-to-end Autonomous Driving with Semantic Depth Cloud Mapping and Multi-Agent

Focusing on the task of point-to-point navigation for an autonomous driv...
11/30/2021

Fast and Real-time End to End Control in Autonomous Racing Cars Through Representation Learning

The challenges presented in an autonomous racing situation are distinct ...
08/03/2020

PillarFlow: End-to-end Birds-eye-view Flow Estimation for Autonomous Driving

In autonomous driving, accurately estimating the state of surrounding ob...
08/21/2020

Action-Based Representation Learning for Autonomous Driving

Human drivers produce a vast amount of data which could, in principle, b...
10/02/2021

Cycle-Consistent World Models for Domain Independent Latent Imagination

End-to-end autonomous driving seeks to solve the perception, decision, a...
10/26/2019

Deep Learning and Control Algorithms of Direct Perception for Autonomous Driving

Based on the direct perception paradigm of autonomous driving, we invest...

Code Repositories

detect-loc-map

End-to-end Autonomous Driving Perception with Sequential Latent Representation Learning


view repo
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.