Attack-agnostic Adversarial Detection on Medical Data Using Explainable Machine Learning

05/05/2021
by   Matthew Watson, et al.
46

Explainable machine learning has become increasingly prevalent, especially in healthcare where explainable models are vital for ethical and trusted automated decision making. Work on the susceptibility of deep learning models to adversarial attacks has shown the ease of designing samples to mislead a model into making incorrect predictions. In this work, we propose a model agnostic explainability-based method for the accurate detection of adversarial samples on two datasets with different complexity and properties: Electronic Health Record (EHR) and chest X-ray (CXR) data. On the MIMIC-III and Henan-Renmin EHR datasets, we report a detection accuracy of 77 Adversarial Attack. On the MIMIC-CXR dataset, we achieve an accuracy of 88 significantly improving on the state of the art of adversarial detection in both datasets by over 10 based method using explainability techniques to detect adversarial samples which is able to generalise to different attack methods without a need for retraining.

READ FULL TEXT

page 4

page 7

page 12

page 13

research
07/17/2023

Analyzing the Impact of Adversarial Examples on Explainable Machine Learning

Adversarial attacks are a type of attack on machine learning models wher...
research
05/05/2017

Detecting Adversarial Samples Using Density Ratio Estimates

Machine learning models, especially based on deep architectures are used...
research
06/28/2021

Feature Importance Guided Attack: A Model Agnostic Adversarial Attack

Machine learning models are susceptible to adversarial attacks which dra...
research
10/14/2021

Brittle interpretations: The Vulnerability of TCAV and Other Concept-based Explainability Tools to Adversarial Attack

Methods for model explainability have become increasingly critical for t...
research
10/11/2021

Towards Explainable Real Estate Valuation via Evolutionary Algorithms

Human lives are increasingly influenced by algorithms, which therefore n...
research
10/05/2022

HeartSpot: Privatized and Explainable Data Compression for Cardiomegaly Detection

Advances in data-driven deep learning for chest X-ray image analysis und...
research
05/13/2021

Explainable Machine Learning for Fraud Detection

The application of machine learning to support the processing of large d...

Please sign up or login with your details

Forgot password? Click here to reset