DeepAI AI Chat
Log In Sign Up

End-to-End Urban Driving by Imitating a Reinforcement Learning Coach

by   Zhejun Zhang, et al.
ETH Zurich

End-to-end approaches to autonomous driving commonly rely on expert demonstrations. Although humans are good drivers, they are not good coaches for end-to-end algorithms that demand dense on-policy supervision. On the contrary, automated experts that leverage privileged information can efficiently generate large scale on-policy and off-policy demonstrations. However, existing automated experts for urban driving make heavy use of hand-crafted rules and perform suboptimally even on driving simulators, where ground-truth information is available. To address these issues, we train a reinforcement learning expert that maps bird's-eye view images to continuous low-level actions. While setting a new performance upper-bound on CARLA, our expert is also a better coach that provides informative supervision signals for imitation learning agents to learn from. Supervised by our reinforcement learning coach, a baseline end-to-end agent with monocular camera-input achieves expert-level performance. Our end-to-end agent achieves a 78 and new weather on the NoCrash-dense benchmark and state-of-the-art performance on the more challenging CARLA LeaderBoard.


page 1

page 4

page 13


Scaling Self-Supervised End-to-End Driving with Multi-View Attention Learning

On end-to-end driving, a large amount of expert driving demonstrations i...

Learning End-to-end Autonomous Driving using Guided Auxiliary Supervision

Learning to drive faithfully in highly stochastic urban settings remains...

Learning by Watching

When in a new situation or geographical location, human drivers have an ...

MMFN: Multi-Modal-Fusion-Net for End-to-End Driving

Inspired by the fact that humans use diverse sensory organs to perceive ...

LiDAR-as-Camera for End-to-End Driving

The core task of any autonomous driving system is to transform sensory i...