Optimal Transport Classifier: Defending Against Adversarial Attacks by Regularized Deep Embedding

11/19/2018
by   Yao Li, et al.
0

Recent studies have demonstrated the vulnerability of deep convolutional neural networks against adversarial examples. Inspired by the observation that the intrinsic dimension of image data is much smaller than its pixel space dimension and the vulnerability of neural networks grows with the input dimension, we propose to embed high-dimensional input images into a low-dimensional space to perform classification. However, arbitrarily projecting the input images to a low-dimensional space without regularization will not improve the robustness of deep neural networks. Leveraging optimal transport theory, we propose a new framework, Optimal Transport Classifier (OT-Classifier), and derive an objective that minimizes the discrepancy between the distribution of the true label and the distribution of the OT-Classifier output. Experimental results on several benchmark datasets show that, our proposed framework achieves state-of-the-art performance against strong adversarial attack methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/24/2019

Adversarial Computation of Optimal Transport Maps

Computing optimal transport maps between high-dimensional and continuous...
research
11/08/2021

Efficient estimates of optimal transport via low-dimensional embeddings

Optimal transport distances (OT) have been widely used in recent work in...
research
03/21/2023

OTJR: Optimal Transport Meets Optimal Jacobian Regularization for Adversarial Robustness

Deep neural networks are widely recognized as being vulnerable to advers...
research
06/11/2020

Achieving robustness in classification using optimal transport with hinge regularization

We propose a new framework for robust binary classification, with Deep N...
research
02/10/2023

Predicting Out-of-Distribution Error with Confidence Optimal Transport

Out-of-distribution (OOD) data poses serious challenges in deployed mach...
research
05/16/2022

A scalable deep learning approach for solving high-dimensional dynamic optimal transport

The dynamic formulation of optimal transport has attracted growing inter...
research
07/11/2020

Representation Learning via Adversarially-Contrastive Optimal Transport

In this paper, we study the problem of learning compact (low-dimensional...

Please sign up or login with your details

Forgot password? Click here to reset