On instabilities of deep learning in image reconstruction - Does AI come at a cost?

02/14/2019
by   Vegard Antun, et al.
14

Deep learning, due to its unprecedented success in tasks such as image classification, has emerged as a new tool in image reconstruction with potential to change the field. In this paper we demonstrate a crucial phenomenon: deep learning typically yields unstablemethods for image reconstruction. The instabilities usually occur in several forms: (1) tiny, almost undetectable perturbations, both in the image and sampling domain, may result in severe artefacts in the reconstruction, (2) a small structural change, for example a tumour, may not be captured in the reconstructed image and (3) (a counterintuitive type of instability) more samples may yield poorer performance. Our new stability test with algorithms and easy to use software detects the instability phenomena. The test is aimed at researchers to test their networks for instabilities and for government agencies, such as the Food and Drug Administration (FDA), to secure safe use of deep learning methods.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 9

page 10

page 11

page 12

research
05/23/2018

Toward a Thinking Microscope: Deep Learning in Optical Microscopy and Image Reconstruction

We discuss recently emerging applications of the state-of-art deep learn...
research
03/27/2020

Interval Neural Networks as Instability Detectors for Image Reconstructions

This work investigates the detection of instabilities that may occur whe...
research
08/09/2021

Using Deep Learning for Visual Decoding and Reconstruction from Brain Activity: A Review

This literature review will discuss the use of deep learning methods for...
research
09/07/2020

Adversarial attacks on deep learning models for fatty liver disease classification by modification of ultrasound image reconstruction method

Convolutional neural networks (CNNs) have achieved remarkable success in...
research
09/23/2021

End-to-End AI-based MRI Reconstruction and Lesion Detection Pipeline for Evaluation of Deep Learning Image Reconstruction

Deep learning techniques have emerged as a promising approach to highly ...
research
06/11/2022

Learned reconstruction with convergence guarantees

In recent years, deep learning has achieved remarkable empirical success...
research
12/25/2022

A Lightweight Reconstruction Network for Surface Defect Inspection

Currently, most deep learning methods cannot solve the problem of scarci...

Please sign up or login with your details

Forgot password? Click here to reset