Learning The Invisible: A Hybrid Deep Learning-Shearlet Framework for Limited Angle Computed Tomography

11/12/2018
by   T. A. Bubba, et al.
8

The high complexity of various inverse problems poses a significant challenge to model-based reconstruction schemes, which in such situations often reach their limits. At the same time, we witness an exceptional success of data-based methodologies such as deep learning. However, in the context of inverse problems, deep neural networks mostly act as black box routines, used for instance for a somewhat unspecified removal of artifacts in classical image reconstructions. In this paper, we will focus on the severely ill-posed inverse problem of limited angle computed tomography, in which entire boundary sections are not captured in the measurements. We will develop a hybrid reconstruction framework that fuses model-based sparse regularization with data-driven deep learning. Our method is reliable in the sense that we only learn the part that can provably not be handled by model-based methods, while applying the theoretically controllable sparse regularization technique to the remaining parts. Such a decomposition into visible and invisible segments is achieved by means of the shearlet transform that allows to resolve wavefront sets in the phase space. Furthermore, this split enables us to assign the clear task of inferring unknown shearlet coefficients to the neural network and thereby offering an interpretation of its performance in the context of limited angle computed tomography. Our numerical experiments show that our algorithm significantly surpasses both pure model- and more data-based reconstruction methods.

READ FULL TEXT

page 13

page 16

page 19

page 22

page 23

page 24

page 25

page 26

research
05/29/2018

Adversarial Regularizers in Inverse Problems

Inverse Problems in medical imaging and computer vision are traditionall...
research
09/13/2023

Limited-Angle Tomography Reconstruction via Deep End-To-End Learning on Synthetic Data

Computed tomography (CT) has become an essential part of modern science ...
research
06/02/2020

Deep neural networks for inverse problems with pseudodifferential operators: an application to limited-angle tomography

We propose a novel convolutional neural network (CNN), called ΨDONet, de...
research
06/17/2019

Differentiated Backprojection Domain Deep Learning for Conebeam Artifact Removal

Conebeam CT using a circular trajectory is quite often used for various ...
research
04/21/2022

On Learning the Invisible in Photoacoustic Tomography with Flat Directionally Sensitive Detector

In photoacoustic tomography (PAT) with flat sensor, we routinely encount...
research
03/10/2020

Computed Tomography Reconstruction Using Deep Image Prior and Learned Reconstruction Methods

In this work, we investigate the application of deep learning methods fo...
research
01/02/2017

Deep learning for plasma tomography using the bolometer system at JET

Deep learning is having a profound impact in many fields, especially tho...

Please sign up or login with your details

Forgot password? Click here to reset