Fairness Testing: A Comprehensive Survey and Analysis of Trends

07/20/2022
by   Zhenpeng Chen, et al.
0

Software systems are vulnerable to fairness bugs and frequently exhibit unfair behaviors, making software fairness an increasingly important concern for software engineers. Research has focused on helping software engineers to detect fairness bugs automatically. This paper provides a comprehensive survey of existing research on fairness testing. We collect 122 papers and organise them based on the testing workflow (i.e., the testing activities) and the testing components (i.e., where to find fairness bugs) for conducting fairness testing. We also analyze the research focus, trends, promising directions, as well as widely-adopted datasets and open source tools for fairness testing.

READ FULL TEXT

page 17

page 18

research
06/19/2019

Machine Learning Testing: Survey, Landscapes and Horizons

This paper provides a comprehensive survey of Machine Learning Testing (...
research
10/06/2020

Astraea: Grammar-based Fairness Testing

Software often produces biased outputs. In particular, machine learning ...
research
05/18/2022

Software Fairness: An Analysis and Survey

In the last decade, researchers have studied fairness as a software prop...
research
11/17/2021

Fairness Testing of Deep Image Classification with Adequacy Metrics

As deep image classification applications, e.g., face recognition, becom...
research
08/29/2018

Evaluating Fuzz Testing

Fuzz testing has enjoyed great success at discovering security critical ...
research
09/03/2020

Smoke Testing for Machine Learning: Simple Tests to Discover Severe Defects

Machine learning is nowadays a standard technique for data analysis with...
research
07/26/2018

Assurances in Software Testing: A Roadmap

As software engineering researchers, we already understand how to make t...

Please sign up or login with your details

Forgot password? Click here to reset