Closing the gap towards end-to-end autonomous vehicle system

01/01/2019
by   Yonatan Glassner, et al.
0

Designing a driving policy for autonomous vehicles is a difficult task. Recent studies suggested an end-toend (E2E) training of a policy to predict car actuators directly from raw sensory inputs. It is appealing due to the ease of labeled data collection and since handcrafted features are avoided. Explicit drawbacks such as interpretability, safety enforcement and learning efficiency limit the practical application of the approach. In this paper, we amend the basic E2E architecture to address these shortcomings, while retaining the power of end-to-end learning. A key element in our proposed architecture is formulation of the learning problem as learning of trajectory. We also apply a Gaussian mixture model loss to contend with multi-modal data, and adopt a finance risk measure, conditional value at risk, to emphasize rare events. We analyze the effect of each concept and present driving performance in a highway scenario in the TORCS simulator. Video is available in this link: https://www.youtube.com/watch?v=1JYNBZNOe_4

READ FULL TEXT

page 8

page 9

research
09/18/2020

Multi-modal Experts Network for Autonomous Driving

End-to-end learning from sensory data has shown promising results in aut...
research
04/25/2018

Driving Policy Transfer via Modularity and Abstraction

End-to-end approaches to autonomous driving have high sample complexity ...
research
07/16/2019

A General Framework for Uncertainty Estimation in Deep Learning

End-to-end learning has recently emerged as a promising technique to tac...
research
12/16/2021

End-to-End Multi-Task Deep Learning and Model Based Control Algorithm for Autonomous Driving

End-to-end driving with a deep learning neural network (DNN) has become ...
research
07/19/2021

ObserveNet Control: A Vision-Dynamics Learning Approach to Predictive Control in Autonomous Vehicles

A key component in autonomous driving is the ability of the self-driving...
research
12/04/2016

End-to-end Learning of Driving Models from Large-scale Video Datasets

Robust perception-action models should be learned from training data wit...

Please sign up or login with your details

Forgot password? Click here to reset