Machine Learning Testing: Survey, Landscapes and Horizons

06/19/2019
by   Jie M. Zhang, et al.
0

This paper provides a comprehensive survey of Machine Learning Testing (ML testing) research. It covers 128 papers on testing properties (e.g., correctness, robustness, and fairness), testing components (e.g., the data, learning program, and framework), testing workflow (e.g., test generation and test evaluation), and application scenarios (e.g., autonomous driving, machine translation). The paper also analyses trends concerning datasets, research trends, and research focus, concluding with research challenges and promising research directions in ML testing.

READ FULL TEXT
research
07/20/2022

Fairness Testing: A Comprehensive Survey and Analysis of Trends

Software systems are vulnerable to fairness bugs and frequently exhibit ...
research
04/18/2018

Simulation-based Adversarial Test Generation for Autonomous Vehicles with Machine Learning Components

Many organizations are developing autonomous driving systems, which are ...
research
04/01/2021

Perspective, Survey and Trends: Public Driving Datasets and Toolsets for Autonomous Driving Virtual Test

Owing to the merits of early safety and reliability guarantee, autonomou...
research
05/10/2019

Assuring the Machine Learning Lifecycle: Desiderata, Methods, and Challenges

Machine learning has evolved into an enabling technology for a wide rang...
research
08/22/2023

Machine learning assisted exploration for affine Deligne-Lusztig varieties

This paper presents a novel, interdisciplinary study that leverages a Ma...
research
07/08/2020

A Survey on Adaptive Random Testing

Random testing (RT) is a well-studied testing method that has been widel...
research
02/27/2019

Architecting Dependable Learning-enabled Autonomous Systems: A Survey

We provide a summary over architectural approaches that can be used to c...

Please sign up or login with your details

Forgot password? Click here to reset