DeepAI AI Chat
Log In Sign Up

Privacy Meets Explainability: A Comprehensive Impact Benchmark

11/08/2022
by   Saifullah Saifullah, et al.
DFKI GmbH
0

Since the mid-10s, the era of Deep Learning (DL) has continued to this day, bringing forth new superlatives and innovations each year. Nevertheless, the speed with which these innovations translate into real applications lags behind this fast pace. Safety-critical applications, in particular, underlie strict regulatory and ethical requirements which need to be taken care of and are still active areas of debate. eXplainable AI (XAI) and privacy-preserving machine learning (PPML) are both crucial research fields, aiming at mitigating some of the drawbacks of prevailing data-hungry black-box models in DL. Despite brisk research activity in the respective fields, no attention has yet been paid to their interaction. This work is the first to investigate the impact of private learning techniques on generated explanations for DL-based models. In an extensive experimental analysis covering various image and time series datasets from multiple domains, as well as varying privacy techniques, XAI methods, and model architectures, the effects of private training on generated explanations are studied. The findings suggest non-negligible changes in explanations through the introduction of privacy. Apart from reporting individual effects of PPML on XAI, the paper gives clear recommendations for the choice of techniques in real applications. By unveiling the interdependencies of these pivotal technologies, this work is a first step towards overcoming the remaining hurdles for practically applicable AI in safety-critical domains.

READ FULL TEXT

page 1

page 7

page 9

page 10

page 11

page 12

page 13

page 16

02/08/2022

Time to Focus: A Comprehensive Benchmark Using Time Series Attribution Methods

In the last decade neural network have made huge impact both in industry...
01/10/2021

Explainable Artificial Intelligence (XAI): An Engineering Perspective

The remarkable advancements in Deep Learning (DL) algorithms have fueled...
07/31/2018

Security and Privacy Issues in Deep Learning

With the development of machine learning, expectations for artificial in...
09/07/2019

Explainable Deep Learning for Video Recognition Tasks: A Framework Recommendations

The popularity of Deep Learning for real-world applications is ever-grow...
03/28/2023

From Private to Public: Benchmarking GANs in the Context of Private Time Series Classification

Deep learning has proven to be successful in various domains and for dif...
07/05/2023

SoK: Privacy-Preserving Data Synthesis

As the prevalence of data analysis grows, safeguarding data privacy has ...