Transformer Meets Boundary Value Inverse Problems

09/29/2022
by   Ruchi Guo, et al.
0

A Transformer-based deep direct sampling method is proposed for solving a class of boundary value inverse problem. A real-time reconstruction is achieved by evaluating the learned inverse operator between carefully designed data and the reconstructed images. An effort is made to give a case study for a fundamental and critical question: whether and how one can benefit from the theoretical structure of a mathematical problem to develop task-oriented and structure-conforming deep neural network? Inspired by direct sampling methods for inverse problems, the 1D boundary data are preprocessed by a partial differential equation-based feature map to yield 2D harmonic extensions in different frequency input channels. Then, by introducing learnable non-local kernel, the approximation of direct sampling is recast to a modified attention mechanism. The proposed method is then applied to electrical impedance tomography, a well-known severely ill-posed nonlinear inverse problem. The new method achieves superior accuracy over its predecessors and contemporary operator learners, as well as shows robustness with respect to noise. This research shall strengthen the insights that the attention mechanism, despite being invented for natural language processing tasks, offers great flexibility to be modified in conformity with the a priori mathematical knowledge, which ultimately leads to the design of more physics-compatible neural architectures.

READ FULL TEXT

page 17

page 18

page 19

research
12/23/2019

Deep learning architectures for nonlinear operator functions and nonlinear inverse problems

We develop a theoretical analysis for special neural network architectur...
research
04/07/2022

A CCBM-based generalized GKB iterative regularizing algorithm for inverse Cauchy problems

This paper examines inverse Cauchy problems that are governed by a kind ...
research
04/15/2021

Learn an index operator by CNN for solving diffusive optical tomography: a deep direct sampling method

In this work, we investigate the diffusive optical tomography (DOT) prob...
research
02/12/2020

On parameter identification problems for elliptic boundary value problems in divergence form, Part I: An abstract framework

Parameter identification problems for partial differential equations are...
research
11/25/2019

Solving Traveltime Tomography with Deep Learning

This paper introduces a neural network approach for solving two-dimensio...
research
07/20/2022

Deep Preconditioners and their application to seismic wavefield processing

Seismic data processing heavily relies on the solution of physics-driven...
research
09/17/2020

Construct Deep Neural Networks Based on Direct Sampling Methods for Solving Electrical Impedance Tomography

This work investigates the electrical impedance tomography (EIT) problem...

Please sign up or login with your details

Forgot password? Click here to reset