Cross-domain Unsupervised Reconstruction with Equivariance for Photoacoustic Computed Tomography

01/17/2023
by   Hengrong Lan, et al.
0

Accurate image reconstruction is crucial for photoacoustic (PA) computed tomography (PACT). Recently, deep learning has been used to reconstruct the PA image with a supervised scheme, which requires high-quality images as ground truth labels. In practice, there are inevitable trade-offs between cost and performance since the use of more channels is an expensive strategy to access more measurements. Here, we propose a cross-domain unsupervised reconstruction (CDUR) strategy with a pure transformer model, which overcomes the lack of ground truth labels from limited PA measurements. The proposed approach exploits the equivariance of PACT to achieve high performance with a smaller number of channels. We implement a self-supervised reconstruction in a model-based form. Meanwhile, we also leverage the self-supervision to enforce the measurement and image consistency on three partitions of measured PA data, by randomly masking different channels. We find that dynamically masking a high proportion of the channels, e.g., 80 both image and signal domains, which decrease the multiplicity of the pseudo solution to efficiently reconstruct the image from fewer PA measurements with minimum error of the image. Experimental results on in-vivo PACT dataset of mice demonstrate the potential of our unsupervised framework. In addition, our method shows a high performance (0.83 structural similarity index (SSIM) in the extreme sparse case with 13 channels), which is close to that of supervised scheme (0.77 SSIM with 16 channels). On top of all the advantages, our method may be deployed on different trainable models in an end-to-end manner.

READ FULL TEXT

page 2

page 6

page 8

page 9

page 10

research
07/06/2021

Unsupervised Knowledge-Transfer for Learned Image Reconstruction

Deep learning-based image reconstruction approaches have demonstrated im...
research
12/04/2020

Photoacoustic Image Reconstruction Beyond Supervised to Compensate Limit-view and Remove Artifacts

Photoacoustic computed tomography (PACT) reconstructs the initial pressu...
research
05/29/2021

Compressed Sensing for Photoacoustic Computed Tomography Using an Untrained Neural Network

Photoacoustic (PA) computed tomography (PACT) shows great potentials in ...
research
09/07/2022

CGAN-ECT: Tomography Image Reconstruction from Electrical Capacitance Measurements Using CGANs

Due to the rapid growth of Electrical Capacitance Tomography (ECT) appli...
research
03/15/2023

Learning to Reconstruct Signals From Binary Measurements

Recent advances in unsupervised learning have highlighted the possibilit...
research
10/03/2022

Spectral2Spectral: Image-spectral Similarity Assisted Spectral CT Deep Reconstruction without Reference

The photon-counting detector (PCD) based spectral computed tomography at...
research
06/24/2023

Score-based Generative Models for Photoacoustic Image Reconstruction with Rotation Consistency Constraints

Photoacoustic tomography (PAT) is a newly emerged imaging modality which...

Please sign up or login with your details

Forgot password? Click here to reset