Interpretable Modeling and Reduction of Unknown Errors in Mechanistic Operators

by   Maryam Toloubidokhti, et al.

Prior knowledge about the imaging physics provides a mechanistic forward operator that plays an important role in image reconstruction, although myriad sources of possible errors in the operator could negatively impact the reconstruction solutions. In this work, we propose to embed the traditional mechanistic forward operator inside a neural function, and focus on modeling and correcting its unknown errors in an interpretable manner. This is achieved by a conditional generative model that transforms a given mechanistic operator with unknown errors, arising from a latent space of self-organizing clusters of potential sources of error generation. Once learned, the generative model can be used in place of a fixed forward operator in any traditional optimization-based reconstruction process where, together with the inverse solution, the error in prior mechanistic forward operator can be minimized and the potential source of error uncovered. We apply the presented method to the reconstruction of heart electrical potential from body surface potential. In controlled simulation experiments and in-vivo real data experiments, we demonstrate that the presented method allowed reduction of errors in the physics-based forward operator and thereby delivered inverse reconstruction of heart-surface potential with increased accuracy.


page 1

page 2

page 3

page 4


Learning Geometry-Dependent and Physics-Based Inverse Image Reconstruction

Deep neural networks have shown great potential in image reconstruction ...

Generative Modeling and Inverse Imaging of Cardiac Transmembrane Potential

Noninvasive reconstruction of cardiac transmembrane potential (TMP) from...

Image reconstruction with imperfect forward models and applications in deblurring

We present and analyse an approach to image reconstruction problems with...

Exploring the solution space of linear inverse problems with GAN latent geometry

Inverse problems consist in reconstructing signals from incomplete sets ...

The Joint Weighted Average (JWA) Operator

Information aggregation is a vital tool for human and machine decision m...

Learning-based approaches for reconstructions with inexact operators in nanoCT applications

Imaging problems such as the one in nanoCT require the solution of an in...

Operator Sketching for Deep Unrolling Networks

In this work we propose a new paradigm for designing efficient deep unro...

Please sign up or login with your details

Forgot password? Click here to reset