Detecting discriminatory risk through data annotation based on Bayesian inferences

by   Elena Beretta, et al.

Thanks to the increasing growth of computational power and data availability, the research in machine learning has advanced with tremendous rapidity. Nowadays, the majority of automatic decision making systems are based on data. However, it is well known that machine learning systems can present problematic results if they are built on partial or incomplete data. In fact, in recent years several studies have found a convergence of issues related to the ethics and transparency of these systems in the process of data collection and how they are recorded. Although the process of rigorous data collection and analysis is fundamental in the model design, this step is still largely overlooked by the machine learning community. For this reason, we propose a method of data annotation based on Bayesian statistical inference that aims to warn about the risk of discriminatory results of a given data set. In particular, our method aims to deepen knowledge and promote awareness about the sampling practices employed to create the training set, highlighting that the probability of success or failure conditioned to a minority membership is given by the structure of the data available. We empirically test our system on three datasets commonly accessed by the machine learning community and we investigate the risk of racial discrimination.


page 1

page 2

page 3

page 4


Lessons from Archives: Strategies for Collecting Sociocultural Data in Machine Learning

A growing body of work shows that many problems in fairness, accountabil...

Sampling Bias Correction for Supervised Machine Learning: A Bayesian Inference Approach with Practical Applications

Given a supervised machine learning problem where the training set has b...

Conscientious Classification: A Data Scientist's Guide to Discrimination-Aware Classification

Recent research has helped to cultivate growing awareness that machine l...

Pitfalls in Machine Learning Research: Reexamining the Development Cycle

Machine learning has the potential to fuel further advances in data scie...

Learning to Limit Data Collection via Scaling Laws: Data Minimization Compliance in Practice

Data minimization is a legal obligation defined in the European Union's ...

Case study: Mapping potential informal settlements areas in Tegucigalpa with machine learning to plan ground survey

Data collection through censuses is conducted every 10 years on average ...

Is Writing Prompts Really Making Art?

In recent years Generative Machine Learning systems have advanced signif...

Please sign up or login with your details

Forgot password? Click here to reset