On the Choice of Data for Efficient Training and Validation of End-to-End Driving Models

06/01/2022
by   Marvin Klingner, et al.
0

The emergence of data-driven machine learning (ML) has facilitated significant progress in many complicated tasks such as highly-automated driving. While much effort is put into improving the ML models and learning algorithms in such applications, little focus is put into how the training data and/or validation setting should be designed. In this paper we investigate the influence of several data design choices regarding training and validation of deep driving models trainable in an end-to-end fashion. Specifically, (i) we investigate how the amount of training data influences the final driving performance, and which performance limitations are induced through currently used mechanisms to generate training data. (ii) Further, we show by correlation analysis, which validation design enables the driving performance measured during validation to generalize well to unknown test environments. (iii) Finally, we investigate the effect of random seeding and non-determinism, giving insights which reported improvements can be deemed significant. Our evaluations using the popular CARLA simulator provide recommendations regarding data generation and driving route selection for an efficient future development of end-to-end driving models.

READ FULL TEXT

page 3

page 4

page 6

research
04/25/2023

VeML: An End-to-End Machine Learning Lifecycle for Large-scale and High-dimensional Data

An end-to-end machine learning (ML) lifecycle consists of many iterative...
research
06/13/2023

Hidden Biases of End-to-End Driving Models

End-to-end driving systems have recently made rapid progress, in particu...
research
05/23/2023

survAIval: Survival Analysis with the Eyes of AI

In this study, we propose a novel approach to enrich the training data f...
research
12/26/2020

Improving the Generalization of End-to-End Driving through Procedural Generation

Recently there is a growing interest in the end-to-end training of auton...
research
05/26/2021

SimNet: Learning Reactive Self-driving Simulations from Real-world Observations

In this work, we present a simple end-to-end trainable machine learning ...
research
09/20/2021

Description of Corner Cases in Automated Driving: Goals and Challenges

Scaling the distribution of automated vehicles requires handling various...
research
11/19/2021

Data Excellence for AI: Why Should You Care

The efficacy of machine learning (ML) models depends on both algorithms ...

Please sign up or login with your details

Forgot password? Click here to reset