On Adversarial Risk and Training

06/07/2018
by   Arun Sai Suggala, et al.
0

In this work we formally define the notions of adversarial perturbations, adversarial risk and adversarial training and analyze their properties. Our analysis provides several interesting insights into adversarial risk, adversarial training, and their relation to the classification risk, "traditional" training. We also show that adversarial training can result in models with better classification accuracy and can result in better explainable models than traditional training. Although adversarial training is computationally expensive, our results and insights suggest that one should prefer adversarial training over traditional risk minimization for learning complex models from data.

READ FULL TEXT

page 11

page 20

research
10/26/2020

Asymptotic Behavior of Adversarial Training in Binary Classification

It is widely known that several machine learning models are susceptible ...
research
07/06/2021

On Generalization of Graph Autoencoders with Adversarial Training

Adversarial training is an approach for increasing model's resilience ag...
research
09/02/2023

Non-Asymptotic Bounds for Adversarial Excess Risk under Misspecified Models

We propose a general approach to evaluating the performance of robust es...
research
06/03/2019

Analysis and Improvement of Adversarial Training in DQN Agents With Adversarially-Guided Exploration (AGE)

This paper investigates the effectiveness of adversarial training in enh...
research
02/08/2021

Improving filling level classification with adversarial training

We investigate the problem of classifying - from a single image - the le...
research
10/30/2019

Is Supervised Learning With Adversarial Features Provably Better Than Sole Supervision?

Generative Adversarial Networks (GAN) have shown promising results on a ...
research
11/26/2021

The Geometry of Adversarial Training in Binary Classification

We establish an equivalence between a family of adversarial training pro...

Please sign up or login with your details

Forgot password? Click here to reset