Memory Efficient Invertible Neural Networks for 3D Photoacoustic Imaging

04/24/2022
by   Rafael Orozco, et al.
0

Photoacoustic imaging (PAI) can image high-resolution structures of clinical interest such as vascularity in cancerous tumor monitoring. When imaging human subjects, geometric restrictions force limited-view data retrieval causing imaging artifacts. Iterative physical model based approaches reduce artifacts but require prohibitively time consuming PDE solves. Machine learning (ML) has accelerated PAI by combining physical models and learned networks. However, the depth and overall power of ML methods is limited by memory intensive training. We propose using invertible neural networks (INNs) to alleviate memory pressure. We demonstrate INNs can image 3D photoacoustic volumes in the setting of limited-view, noisy, and subsampled data. The frugal constant memory usage of INNs enables us to train an arbitrary depth of learned layers on a consumer GPU with 16GB RAM.

READ FULL TEXT
research
08/08/2018

Highly Accelerated Multishot EPI through Synergistic Combination of Machine Learning and Joint Reconstruction

Purpose: To introduce a combined machine learning (ML) and physics-based...
research
11/11/2019

Limited View and Sparse Photoacoustic Tomography for Neuroimaging with Deep Learning

Photoacoustic tomography (PAT) is a nonionizing imaging modality capable...
research
09/09/2020

Combining data assimilation and machine learning to infer unresolved scale parametrisation

In recent years, machine learning (ML) has been proposed to devise data-...
research
10/06/2020

Memory-efficient GAN-based Domain Translation of High Resolution 3D Medical Images

Generative adversarial networks (GANs) are currently rarely applied on 3...
research
08/31/2017

Model based learning for accelerated, limited-view 3D photoacoustic tomography

Recent advances in deep learning for tomographic reconstructions have sh...
research
11/25/2019

Invert to Learn to Invert

Iterative learning to infer approaches have become popular solvers for i...
research
08/25/2022

Algorithmic Differentiation for Automatized Modelling of Machine Learned Force Fields

Reconstructing force fields (FF) from atomistic simulation data is a cha...

Please sign up or login with your details

Forgot password? Click here to reset