Secure Metric Learning via Differential Pairwise Privacy

03/30/2020
by   Jing Li, et al.
12

Distance Metric Learning (DML) has drawn much attention over the last two decades. A number of previous works have shown that it performs well in measuring the similarities of individuals given a set of correctly labeled pairwise data by domain experts. These important and precisely-labeled pairwise data are often highly sensitive in real world (e.g., patients similarity). This paper studies, for the first time, how pairwise information can be leaked to attackers during distance metric learning, and develops differential pairwise privacy (DPP), generalizing the definition of standard differential privacy, for secure metric learning. Unlike traditional differential privacy which only applies to independent samples, thus cannot be used for pairwise data, DPP successfully deals with this problem by reformulating the worst case. Specifically, given the pairwise data, we reveal all the involved correlations among pairs in the constructed undirected graph. DPP is then formalized that defines what kind of DML algorithm is private to preserve pairwise data. After that, a case study employing the contrastive loss is exhibited to clarify the details of implementing a DPP-DML algorithm. Particularly, the sensitivity reduction technique is proposed to enhance the utility of the output distance metric. Experiments both on a toy dataset and benchmarks demonstrate that the proposed scheme achieves pairwise data privacy without compromising the output performance much (Accuracy declines less than 0.01 throughout all benchmark datasets when the privacy budget is set at 4).

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

05/07/2021

Differential Privacy for Pairwise Learning: Non-convex Analysis

Pairwise learning focuses on learning tasks with pairwise loss functions...
06/20/2012

Bayesian Active Distance Metric Learning

Distance metric learning is an important component for many tasks, such ...
05/26/2021

Exploring dual information in distance metric learning for clustering

Distance metric learning algorithms aim to appropriately measure similar...
01/03/2012

Random Forests for Metric Learning with Implicit Pairwise Position Dependence

Metric learning makes it plausible to learn distances for complex distri...
03/27/2021

Embedding Transfer with Label Relaxation for Improved Metric Learning

This paper presents a novel method for embedding transfer, a task of tra...
04/23/2018

Individual Sensitivity Preprocessing for Data Privacy

The sensitivity metric in differential privacy, which is informally defi...
01/07/2017

Similarity Function Tracking using Pairwise Comparisons

Recent work in distance metric learning has focused on learning transfor...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.