Beyond Algorithmic Bias: A Socio-Computational Interrogation of the Google Search by Image Algorithm

We perform a socio-computational interrogation of the google search by image algorithm, a main component of the google search engine. We audit the algorithm by presenting it with more than 40 thousands faces of all ages and more than four races and collecting and analyzing the assigned labels with the appropriate statistical tools. We find that the algorithm reproduces white male patriarchal structures, often simplifying, stereotyping and discriminating females and non-white individuals, while providing more diverse and positive descriptions of white men. By drawing from Bourdieu's theory of cultural reproduction, we link these results to the attitudes of the algorithm's designers, owners, and the dataset the algorithm was trained on. We further underpin the problematic nature of the algorithm by using the ethnographic practice of studying-up: We show how the algorithm places individuals at the top of the tech industry within the socio-cultural reality that they shaped, many times creating biased representations of them. We claim that the use of social-theoretic frameworks such as the above are able to contribute to improved algorithmic accountability, algorithmic impact assessment and provide additional and more critical depth in algorithmic bias and auditing studies. Based on the analysis, we discuss the scientific and design implications and provide suggestions for alternative ways to design just socioalgorithmic systems.

READ FULL TEXT

page 2

page 5

page 7

page 9

page 10

page 11

research
03/09/2023

Algorithmic neutrality

Bias infects the algorithms that wield increasing control over our lives...
research
03/28/2023

A Perspectival Mirror of the Elephant: Investigating Language Bias on Google, ChatGPT, Wikipedia, and YouTube

Contrary to Google Search's mission of delivering information from "many...
research
05/06/2023

Fairness in Image Search: A Study of Occupational Stereotyping in Image Retrieval and its Debiasing

Multi-modal search engines have experienced significant growth and wides...
research
06/21/2022

Case Study: The Impact of Location on Bias in Search Results

In this work, we aim to investigate the impact of location (different co...
research
03/22/2018

Paving the Way for Culturally Competent Robots: a Position Paper

Cultural competence is a well known requirement for an effective healthc...
research
07/01/2022

American == White in Multimodal Language-and-Image AI

Three state-of-the-art language-and-image AI models, CLIP, SLIP, and BLI...
research
05/17/2020

Studying the Transfer of Biases from Programmers to Programs

It is generally agreed that one origin of machine bias is resulting from...

Please sign up or login with your details

Forgot password? Click here to reset