Log In Sign Up

An investigation into the state-of-the-practice autonomous driving testing

by   Guannan Lou, et al.

Autonomous driving shows great potential to reform modern transportation and its safety is attracting much attention from public. Autonomous driving systems generally include deep neural networks (DNNs) for gaining better performance (e.g., accuracy on object detection and trajectory prediction). However, compared with traditional software systems, this new paradigm (i.e., program + DNNs) makes software testing more difficult. Recently, software engineering community spent significant effort in developing new testing methods for autonomous driving systems. However, it is not clear that what extent those testing methods have addressed the needs of industrial practitioners of autonomous driving. To fill this gap, in this paper, we present the first comprehensive study to identify the current practices and needs of testing autonomous driving systems in industry. We conducted semi-structured interviews with developers from 10 autonomous driving companies and surveyed 100 developers who have worked on autonomous driving systems. Through thematic analysis of interview and questionnaire data, we identified five urgent needs of testing autonomous driving systems from industry. We further analyzed the limitations of existing testing methods to address those needs and proposed several future directions for software testing researchers.


page 4

page 7

page 8

page 9

page 10

page 11


SMET: Scenario-based Metamorphic Testing for Autonomous Driving Models

To improve the security and robustness of autonomous driving models, thi...

Challenges in Designing Datasets and Validation for Autonomous Driving

Autonomous driving is getting a lot of attention in the last decade and ...

Concepts in Testing of Autonomous Systems: Academic Literature and Industry Practice

Testing of autonomous systems is extremely important as many of them are...

Reducing DNN Labelling Cost using Surprise Adequacy: An Industrial Case Study for Autonomous Driving

Deep Neural Networks (DNNs) are rapidly being adopted by the automotive ...

Energy-Efficient Adaptive System Reconfiguration for Dynamic Deadlines in Autonomous Driving

The increasing computing demands of autonomous driving applications make...

Teaching Autonomous Driving Using a Modular and Integrated Approach

Autonomous driving is not one single technology but rather a complex sys...

helyOS: A customized off-the-shelf solution for autonomous driving applications in delimited areas

Microservice Architectures (MSA), known to successfully handle complex s...