Provably Robust Metric Learning

06/12/2020
by   Lu Wang, et al.
0

Metric learning is an important family of algorithms for classification and similarity search, but the robustness of learned metrics against small adversarial perturbations is less studied. In this paper, we show that existing metric learning algorithms, which focus on boosting the clean accuracy, can result in metrics that are less robust than the Euclidean distance. To overcome this problem, we propose a novel metric learning algorithm to find a Mahalanobis distance that is robust against adversarial perturbations, and the robustness of the resulting model is certifiable. Experimental results show that the proposed metric learning algorithm improves both certified robust errors and empirical robust errors (errors under adversarial attacks). Furthermore, unlike neural network defenses which usually encounter a trade-off between clean and robust errors, our method does not sacrifice clean errors compared with previous metric learning methods. Our code is available at https://github.com/wangwllu/provably_robust_metric_learning.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/05/2012

Robustness and Generalization for Metric Learning

Metric learning has attracted a lot of interest over the last decade, bu...
research
05/12/2014

Two-Stage Metric Learning

In this paper, we present a novel two-stage metric learning algorithm. W...
research
05/26/2019

SemBleu: A Robust Metric for AMR Parsing Evaluation

Evaluating AMR parsing accuracy involves comparing pairs of AMR graphs. ...
research
09/03/2019

Metric Learning for Adversarial Robustness

Deep networks are well-known to be fragile to adversarial attacks. Using...
research
11/04/2022

Improving Adversarial Robustness to Sensitivity and Invariance Attacks with Deep Metric Learning

Intentionally crafted adversarial samples have effectively exploited wea...
research
05/11/2019

A Distributed Approach towards Discriminative Distance Metric Learning

Distance metric learning is successful in discovering intrinsic relation...
research
06/10/2020

Towards Certified Robustness of Metric Learning

Metric learning aims to learn a distance metric such that semantically s...

Please sign up or login with your details

Forgot password? Click here to reset