Algorithmic Collective Action in Machine Learning

02/08/2023
by   Moritz Hardt, et al.
0

We initiate a principled study of algorithmic collective action on digital platforms that deploy machine learning algorithms. We propose a simple theoretical model of a collective interacting with a firm's learning algorithm. The collective pools the data of participating individuals and executes an algorithmic strategy by instructing participants how to modify their own data to achieve a collective goal. We investigate the consequences of this model in three fundamental learning-theoretic settings: the case of a nonparametric optimal learning algorithm, a parametric risk minimizer, and gradient-based optimization. In each setting, we come up with coordinated algorithmic strategies and characterize natural success criteria as a function of the collective's size. Complementing our theory, we conduct systematic experiments on a skill classification task involving tens of thousands of resumes from a gig platform for freelancers. Through more than two thousand model training runs of a BERT-like language model, we see a striking correspondence emerge between our empirical observations and the predictions made by our theory. Taken together, our theory and experiments broadly support the conclusion that algorithmic collectives of exceedingly small fractional size can exert significant control over a platform's learning algorithm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/05/2022

Impossibility of Collective Intelligence

Democratization of AI involves training and deploying machine learning m...
research
12/22/2021

Algorithmic Probability of Large Datasets and the Simplicity Bubble Problem in Machine Learning

When mining large datasets in order to predict new data, limitations of ...
research
03/16/2020

Timing uncertainty in collective risk dilemmas encourages group reciprocation and polarization

Human social dilemmas are often shaped by actions involving uncertain go...
research
06/22/2021

Reasoning about Emergence of Collective Memory

We offer a very simple model of how collective memory may form. Agents k...
research
06/30/2022

Efficient Collective Action for Tackling Time-Critical Cybersecurity Threats

The latency reduction between the discovery of vulnerabilities, the buil...
research
11/28/2017

A reinforcement learning algorithm for building collaboration in multi-agent systems

This paper presents a proof-of concept study for demonstrating the viabi...
research
01/06/2021

Connecting The Dots To Combat Collective Fraud

Modern fraudsters write malicious programs to coordinate a group of acco...

Please sign up or login with your details

Forgot password? Click here to reset