You Don't Need Robust Machine Learning to Manage Adversarial Attack Risks

06/16/2023
by   Edward Raff, et al.
0

The robustness of modern machine learning (ML) models has become an increasing concern within the community. The ability to subvert a model into making errant predictions using seemingly inconsequential changes to input is startling, as is our lack of success in building models robust to this concern. Existing research shows progress, but current mitigations come with a high cost and simultaneously reduce the model's accuracy. However, such trade-offs may not be necessary when other design choices could subvert the risk. In this survey we review the current literature on attacks and their real-world occurrences, or limited evidence thereof, to critically evaluate the real-world risks of adversarial machine learning (AML) for the average entity. This is done with an eye toward how one would then mitigate these attacks in practice, the risks for production deployment, and how those risks could be managed. In doing so we elucidate that many AML threats do not warrant the cost and trade-offs of robustness due to a low likelihood of attack or availability of superior non-ML mitigations. Our analysis also recommends cases where an actor should be concerned about AML to the degree where robust ML models are necessary for a complete deployment.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/21/2022

The Risks of Machine Learning Systems

The speed and scale at which machine learning (ML) systems are deployed ...
research
07/04/2020

Regulating Accuracy-Efficiency Trade-Offs in Distributed Machine Learning Systems

In this paper we discuss the trade-off between accuracy and efficiency i...
research
09/20/2023

"It's a Fair Game”, or Is It? Examining How Users Navigate Disclosure Risks and Benefits When Using LLM-Based Conversational Agents

The widespread use of Large Language Model (LLM)-based conversational ag...
research
07/28/2023

Adversarial training for tabular data with attack propagation

Adversarial attacks are a major concern in security-centered application...
research
01/21/2020

Designing for the Long Tail of Machine Learning

Recent technical advances has made machine learning (ML) a promising com...
research
06/22/2023

Anticipatory Thinking Challenges in Open Worlds: Risk Management

Anticipatory thinking drives our ability to manage risk - identification...
research
06/29/2020

Legal Risks of Adversarial Machine Learning Research

Adversarial Machine Learning is booming with ML researchers increasingly...

Please sign up or login with your details

Forgot password? Click here to reset