Algorithms that Remember: Model Inversion Attacks and Data Protection Law

07/12/2018
by   Michael Veale, et al.
0

Many individuals are concerned about the governance of machine learning systems and the prevention of algorithmic harms. The EU's recent General Data Protection Regulation (GDPR) has been seen as a core tool for achieving better governance of this area. While the GDPR does apply to the use of models in some limited situations, most of its provisions relate to the governance of personal data, while models have traditionally been seen as intellectual property. We present recent work from the information security literature around `model inversion' and `membership inference' attacks, which indicate that the process of turning training data into machine learned systems is not one-way, and demonstrate how this could lead some models to be legally classified as personal data. Taking this as a probing experiment, we explore the different rights and obligations this would trigger and their utility, and posit future directions for algorithmic governance and regulation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/21/2020

Amnesiac Machine Learning

The Right to be Forgotten is part of the recently enacted General Data P...
research
07/26/2020

Anonymizing Machine Learning Models

There is a known tension between the need to analyze personal data to dr...
research
03/16/2018

Some HCI Priorities for GDPR-Compliant Machine Learning

In this short paper, we consider the roles of HCI in enabling the better...
research
09/29/2020

The General Law Principles for Protection the Personal Data and their Importance

Rapid technological change and globalization have created new challenges...
research
10/25/2018

Law and Adversarial Machine Learning

When machine learning systems fail because of adversarial manipulation, ...
research
04/05/2021

Revisiting Rashomon: A Comment on "The Two Cultures"

Here, I provide some reflections on Prof. Leo Breiman's "The Two Culture...
research
11/25/2022

Picking on the Same Person: Does Algorithmic Monoculture lead to Outcome Homogenization?

As the scope of machine learning broadens, we observe a recurring theme ...

Please sign up or login with your details

Forgot password? Click here to reset