Ethical Testing in the Real World: Evaluating Physical Testing of Adversarial Machine Learning

12/03/2020
by   Kendra Albert, et al.
0

This paper critically assesses the adequacy and representativeness of physical domain testing for various adversarial machine learning (ML) attacks against computer vision systems involving human subjects. Many papers that deploy such attacks characterize themselves as "real world." Despite this framing, however, we found the physical or real-world testing conducted was minimal, provided few details about testing subjects and was often conducted as an afterthought or demonstration. Adversarial ML research without representative trials or testing is an ethical, scientific, and health/safety issue that can cause real harms. We introduce the problem and our methodology, and then critique the physical domain testing methodologies employed by papers in the field. We then explore various barriers to more inclusive physical testing in adversarial ML and offer recommendations to improve such testing notwithstanding these challenges.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/22/2020

Ethical Machine Learning in Health Care

The use of machine learning (ML) in health care raises numerous ethical ...
research
12/29/2022

"Real Attackers Don't Compute Gradients": Bridging the Gap Between Adversarial ML Research and Practice

Recent years have seen a proliferation of research on adversarial machin...
research
06/08/2022

Resolving the Human Subjects Status of Machine Learning's Crowdworkers

In recent years, machine learning (ML) has come to rely more heavily on ...
research
03/13/2023

Review on the Feasibility of Adversarial Evasion Attacks and Defenses for Network Intrusion Detection Systems

Nowadays, numerous applications incorporate machine learning (ML) algori...
research
02/01/2020

Politics of Adversarial Machine Learning

In addition to their security properties, adversarial machine-learning a...
research
08/16/2018

Identifying Implementation Bugs in Machine Learning based Image Classifiers using Metamorphic Testing

We have recently witnessed tremendous success of Machine Learning (ML) i...
research
08/23/2023

The Challenges of Machine Learning for Trust and Safety: A Case Study on Misinformation Detection

We examine the disconnect between scholarship and practice in applying m...

Please sign up or login with your details

Forgot password? Click here to reset