Existence and Minimax Theorems for Adversarial Surrogate Risks in Binary Classification

06/18/2022
by   Natalie S. Frank, et al.
0

Adversarial training is one of the most popular methods for training methods robust to adversarial attacks, however, it is not well-understood from a theoretical perspective. We prove and existence, regularity, and minimax theorems for adversarial surrogate risks. Our results explain some empirical observations on adversarial robustness from prior work and suggest new directions in algorithm development. Furthermore, our results extend previously known existence and minimax theorems for the adversarial classification risk to surrogate risks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/18/2022

The Consistency of Adversarial Training for Binary Classification

Robustness to adversarial perturbations is of paramount concern in moder...
research
05/17/2023

The Adversarial Consistency of Surrogate Risks for Binary Classification

We study the consistency of surrogate risks for robust binary classifica...
research
04/28/2023

On the existence of solutions to adversarial training in multiclass classification

We study three models of the problem of adversarial training in multicla...
research
09/10/2023

Outlier Robust Adversarial Training

Supervised learning models are challenged by the intrinsic complexities ...
research
11/13/2018

Theoretical Analysis of Adversarial Learning: A Minimax Approach

We propose a general theoretical method for analyzing the risk bound in ...
research
09/07/2021

Regularized Learning in Banach Spaces

This article presents a different way to study the theory of regularized...
research
11/26/2021

The Geometry of Adversarial Training in Binary Classification

We establish an equivalence between a family of adversarial training pro...

Please sign up or login with your details

Forgot password? Click here to reset