Adversarial Robustness of MR Image Reconstruction under Realistic Perturbations

08/05/2022
by   Jan Nikolas Morshuis, et al.
0

Deep Learning (DL) methods have shown promising results for solving ill-posed inverse problems such as MR image reconstruction from undersampled k-space data. However, these approaches currently have no guarantees for reconstruction quality and the reliability of such algorithms is only poorly understood. Adversarial attacks offer a valuable tool to understand possible failure modes and worst case performance of DL-based reconstruction algorithms. In this paper we describe adversarial attacks on multi-coil k-space measurements and evaluate them on the recently proposed E2E-VarNet and a simpler UNet-based model. In contrast to prior work, the attacks are targeted to specifically alter diagnostically relevant regions. Using two realistic attack models (adversarial k-space noise and adversarial rotations) we are able to show that current state-of-the-art DL-based reconstruction algorithms are indeed sensitive to such perturbations to a degree where relevant diagnostic information may be lost. Surprisingly, in our experiments the UNet and the more sophisticated E2E-VarNet were similarly sensitive to such attacks. Our findings add further to the evidence that caution must be exercised as DL-based methods move closer to clinical practice.

READ FULL TEXT

page 7

page 8

research
11/09/2020

Solving Inverse Problems With Deep Neural Networks – Robustness Included?

In the past five years, deep learning methods have become state-of-the-a...
research
10/30/2020

Adversarial Robust Training in MRI Reconstruction

Deep Learning has shown potential in accelerating Magnetic Resonance Ima...
research
06/20/2023

Towards a robust and reliable deep learning approach for detection of compact binary mergers in gravitational wave data

The ability of deep learning (DL) approaches to learn generalised signal...
research
02/25/2021

On Instabilities of Conventional Multi-Coil MRI Reconstruction to Small Adverserial Perturbations

Although deep learning (DL) has received much attention in accelerated M...
research
09/07/2020

Adversarial attacks on deep learning models for fatty liver disease classification by modification of ultrasound image reconstruction method

Convolutional neural networks (CNNs) have achieved remarkable success in...
research
05/29/2020

Adversarial Robustness of Deep Convolutional Candlestick Learner

Deep learning (DL) has been applied extensively in a wide range of field...
research
11/22/2022

A Neural-Network-Based Convex Regularizer for Image Reconstruction

The emergence of deep-learning-based methods for solving inverse problem...

Please sign up or login with your details

Forgot password? Click here to reset