NeRP: Implicit Neural Representation Learning with Prior Embedding for Sparsely Sampled Image Reconstruction

08/24/2021
by   Liyue Shen, et al.
1

Image reconstruction is an inverse problem that solves for a computational image based on sampled sensor measurement. Sparsely sampled image reconstruction poses addition challenges due to limited measurements. In this work, we propose an implicit Neural Representation learning methodology with Prior embedding (NeRP) to reconstruct a computational image from sparsely sampled measurements. The method differs fundamentally from previous deep learning-based image reconstruction approaches in that NeRP exploits the internal information in an image prior, and the physics of the sparsely sampled measurements to produce a representation of the unknown subject. No large-scale data is required to train the NeRP except for a prior image and sparsely sampled measurements. In addition, we demonstrate that NeRP is a general methodology that generalizes to different imaging modalities such as CT and MRI. We also show that NeRP can robustly capture the subtle yet significant image changes required for assessing tumor progression.

READ FULL TEXT

page 1

page 2

page 3

page 6

page 7

page 8

page 9

page 10

research
09/29/2020

Deep Image Reconstruction using Unregistered Measurements without Groundtruth

One of the key limitations in conventional deep learning based image rec...
research
05/08/2018

Highly Scalable Image Reconstruction using Deep Neural Networks with Bandpass Filtering

To increase the flexibility and scalability of deep neural networks for ...
research
08/29/2020

Unsupervised MRI Reconstruction with Generative Adversarial Networks

Deep learning-based image reconstruction methods have achieved promising...
research
11/25/2022

PIP: Positional-encoding Image Prior

In Deep Image Prior (DIP), a Convolutional Neural Network (CNN) is fitte...
research
08/27/2022

Uniformly Sampled Polar and Cylindrical Grid Approach for 2D, 3D Image Reconstruction using Algebraic Algorithm

Image reconstruction by Algebraic Methods (AM) outperforms the transform...
research
08/31/2020

Data and Image Prior Integration for Image Reconstruction Using Consensus Equilibrium

Image domain prior models have been shown to improve the quality of reco...
research
07/18/2020

Learning Geometry-Dependent and Physics-Based Inverse Image Reconstruction

Deep neural networks have shown great potential in image reconstruction ...

Please sign up or login with your details

Forgot password? Click here to reset