Driving Policy Transfer via Modularity and Abstraction

04/25/2018
by   Matthias Müller, et al.
0

End-to-end approaches to autonomous driving have high sample complexity and are difficult to scale to realistic urban driving. Simulation can help end-to-end driving systems by providing a cheap, safe, and diverse training environment. Yet training driving policies in simulation brings up the problem of transferring such policies to the real world. We present an approach to transferring driving policies from simulation to reality via modularity and abstraction. Our approach is inspired by classic driving systems and aims to combine the benefits of modular architectures and end-to-end deep learning approaches. The key idea is to encapsulate the driving policy such that it is not directly exposed to raw perceptual input or low-level vehicle dynamics. We evaluate the presented approach in simulated urban environments and in the real world. In particular, we transfer a driving policy trained in simulation to a 1/5-scale robotic truck that is deployed in a variety of conditions, with no finetuning, on two continents. The supplementary video can be viewed at https://youtu.be/BrMDJqI6H5U

READ FULL TEXT

page 2

page 6

page 7

page 8

page 10

research
11/10/2017

CARLA: An Open Urban Driving Simulator

We introduce CARLA, an open-source simulator for autonomous driving rese...
research
03/13/2020

A Survey of End-to-End Driving: Architectures and Training Methods

Autonomous driving is of great interest to industry and academia alike. ...
research
12/10/2018

Learning to Drive from Simulation without Real World Labels

Simulation can be a powerful tool for understanding machine learning sys...
research
01/01/2019

Closing the gap towards end-to-end autonomous vehicle system

Designing a driving policy for autonomous vehicles is a difficult task. ...
research
05/16/2019

Autonomous Vehicle Control: End-to-end Learning in Simulated Urban Environments

In recent years, considerable progress has been made towards a vehicle's...
research
07/20/2023

Driving Policy Prediction based on Deep Learning Models

In this project, we implemented an end-to-end system that takes in combi...
research
10/25/2022

Sim-to-Real via Sim-to-Seg: End-to-end Off-road Autonomous Driving Without Real Data

Autonomous driving is complex, requiring sophisticated 3D scene understa...

Please sign up or login with your details

Forgot password? Click here to reset