Equivariant Neural Networks for Indirect Measurements

06/28/2023
by   Matthias Beckmann, et al.
0

In the recent years, deep learning techniques have shown great success in various tasks related to inverse problems, where a target quantity of interest can only be observed through indirect measurements by a forward operator. Common approaches apply deep neural networks in a post-processing step to the reconstructions obtained by classical reconstruction methods. However, the latter methods can be computationally expensive and introduce artifacts that are not present in the measured data and, in turn, can deteriorate the performance on the given task. To overcome these limitations, we propose a class of equivariant neural networks that can be directly applied to the measurements to solve the desired task. To this end, we build appropriate network structures by developing layers that are equivariant with respect to data transformations induced by well-known symmetries in the domain of the forward operator. We rigorously analyze the relation between the measurement operator and the resulting group representations and prove a representer theorem that characterizes the class of linear operators that translate between a given pair of group actions. Based on this theory, we extend the existing concepts of Lie group equivariant deep learning to inverse problems and introduce new representations that result from the involved measurement operations. This allows us to efficiently solve classification, regression or even reconstruction tasks based on indirect measurements also for very sparse data problems, where a classical reconstruction-based approach may be hard or even impossible. We illustrate the effectiveness of our approach in numerical experiments and compare with existing methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/25/2020

Data-consistent neural networks for solving nonlinear inverse problems

Data assisted reconstruction algorithms, incorporating trained neural ne...
research
10/19/2021

Stochastic Primal-Dual Deep Unrolling Networks for Imaging Inverse Problems

In this work we present a new type of efficient deep-unrolling networks ...
research
07/19/2023

Learning-based approaches for reconstructions with inexact operators in nanoCT applications

Imaging problems such as the one in nanoCT require the solution of an in...
research
02/23/2021

Equivariant neural networks for inverse problems

In recent years the use of convolutional layers to encode an inductive b...
research
03/23/2022

Sampling Theorems for Unsupervised Learning in Linear Inverse Problems

Solving a linear inverse problem requires knowledge about the underlying...
research
04/20/2020

Sparse aNETT for Solving Inverse Problems with Deep Learning

We propose a sparse reconstruction framework (aNETT) for solving inverse...
research
02/28/2022

Limitations of Deep Learning for Inverse Problems on Digital Hardware

Deep neural networks have seen tremendous success over the last years. S...

Please sign up or login with your details

Forgot password? Click here to reset