Multi-Trigger-Key: Towards Multi-Task Privacy Preserving In Deep Learning

10/06/2021
by   Ren Wang, et al.
0

Deep learning-based Multi-Task Classification (MTC) is widely used in applications like facial attributes and healthcare that warrant strong privacy guarantees. In this work, we aim to protect sensitive information in the inference phase of MTC and propose a novel Multi-Trigger-Key (MTK) framework to achieve the privacy-preserving objective. MTK associates each secured task in the multi-task dataset with a specifically designed trigger-key. The true information can be revealed by adding the trigger-key if the user is authorized. We obtain such an MTK model by training it with a newly generated training set. To address the information leakage malaise resulting from correlations among different tasks, we generalize the training process by incorporating an MTK decoupling process with a controllable trade-off between the protective efficacy and the model performance. Theoretical guarantees and experimental results demonstrate the effectiveness of the privacy protection without appreciable hindering on the model performance.

READ FULL TEXT
research
09/18/2018

Model-Protected Multi-Task Learning

Multi-task learning (MTL) refers to the paradigm of learning multiple re...
research
06/14/2023

Protecting User Privacy in Remote Conversational Systems: A Privacy-Preserving framework based on text sanitization

Large Language Models (LLMs) are gaining increasing attention due to the...
research
07/02/2020

A Novel DNN Training Framework via Data Sampling and Multi-Task Optimization

Conventional DNN training paradigms typically rely on one training set a...
research
06/12/2019

Privacy-Preserving Deep Visual Recognition: An Adversarial Learning Framework and A New Dataset

This paper aims to boost privacy-preserving visual recognition, an incre...
research
05/19/2021

A Lightweight Privacy-Preserving Scheme Using Label-based Pixel Block Mixing for Image Classification in Deep Learning

To ensure the privacy of sensitive data used in the training of deep lea...
research
07/22/2018

Towards Privacy-Preserving Visual Recognition via Adversarial Training: A Pilot Study

This paper aims to improve privacy-preserving visual recognition, an inc...
research
12/01/2017

Together or Alone: The Price of Privacy in Joint Learning

Machine Learning is a widely-used method for prediction generation. Thes...

Please sign up or login with your details

Forgot password? Click here to reset