Towards Measuring Bias in Image Classification

07/01/2021
by   Nina Schaaf, et al.
0

Convolutional Neural Networks (CNN) have become de fact state-of-the-art for the main computer vision tasks. However, due to the complex underlying structure their decisions are hard to understand which limits their use in some context of the industrial world. A common and hard to detect challenge in machine learning (ML) tasks is data bias. In this work, we present a systematic approach to uncover data bias by means of attribution maps. For this purpose, first an artificial dataset with a known bias is created and used to train intentionally biased CNNs. The networks' decisions are then inspected using attribution maps. Finally, meaningful metrics are used to measure the attribution maps' representativeness with respect to the known bias. The proposed study shows that some attribution map techniques highlight the presence of bias in the data better than others and metrics can support the identification of bias.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/22/2022

Evaluating Feature Attribution Methods in the Image Domain

Feature attribution maps are a popular approach to highlight the most im...
research
06/14/2021

Discerning the painter's hand: machine learning on surface topography

Attribution of paintings is a critical problem in art history. This stud...
research
09/30/2014

An agent-driven semantical identifier using radial basis neural networks and reinforcement learning

Due to the huge availability of documents in digital form, and the decep...
research
03/21/2023

Better Understanding Differences in Attribution Methods via Systematic Evaluations

Deep neural networks are very successful on many vision tasks, but hard ...
research
05/20/2022

Towards Better Understanding Attribution Methods

Deep neural networks are very successful on many vision tasks, but hard ...
research
05/06/2015

A Deeper Look at Dataset Bias

The presence of a bias in each image data collection has recently attrac...
research
08/14/2019

Debiasing Personal Identities in Toxicity Classification

As Machine Learning models continue to be relied upon for making automat...

Please sign up or login with your details

Forgot password? Click here to reset