Multi-scale Image Fusion Between Pre-operative Clinical CT and X-ray Microtomography of Lung Pathology

02/27/2017
by   Holger R. Roth, et al.
0

Computational anatomy allows the quantitative analysis of organs in medical images. However, most analysis is constrained to the millimeter scale because of the limited resolution of clinical computed tomography (CT). X-ray microtomography (μCT) on the other hand allows imaging of ex-vivo tissues at a resolution of tens of microns. In this work, we use clinical CT to image lung cancer patients before partial pneumonectomy (resection of pathological lung tissue). The resected specimen is prepared for μCT imaging at a voxel resolution of 50 μm (0.05 mm). This high-resolution image of the lung cancer tissue allows further insides into understanding of tumor growth and categorization. For making full use of this additional information, image fusion (registration) needs to be performed in order to re-align the μCT image with clinical CT. We developed a multi-scale non-rigid registration approach. After manual initialization using a few landmark points and rigid alignment, several levels of non-rigid registration between down-sampled (in the case of μCT) and up-sampled (in the case of clinical CT) representations of the image are performed. Any non-lung tissue is ignored during the computation of the similarity measure used to guide the registration during optimization. We are able to recover the volume differences introduced by the resection and preparation of the lung specimen. The average (± std. dev.) minimum surface distance between μCT and clinical CT at the resected lung surface is reduced from 3.3 ± 2.9 (range: [0.1, 15.9]) to 2.3 mm ± 2.8 (range: [0.0, 15.3]) mm. The alignment of clinical CT with μCT will allow further registration with even finer resolutions of μCT (up to 10 μm resolution) and ultimately with histopathological microscopy images for further macro to micro image fusion that can aid medical image analysis.

READ FULL TEXT
research
10/20/2020

Micro CT Image-Assisted Cross Modality Super-Resolution of Clinical CT Images Utilizing Synthesized Training Dataset

This paper proposes a novel, unsupervised super-resolution (SR) approach...
research
10/15/2020

Analysis of Heterogeneity of Pneumothorax-associated Deformation using Model-based Registration

Recent advances in imaging techniques have enabled us to visualize lung ...
research
12/30/2019

Multi-modality super-resolution loss for GAN-based super-resolution of clinical CT images using micro CT image database

This paper newly introduces multi-modality loss function for GAN-based s...
research
12/15/2022

CNN-based real-time 2D-3D deformable registration from a single X-ray projection

Purpose: The purpose of this paper is to present a method for real-time ...
research
04/27/2018

A matrix-free approach to parallel and memory-efficient deformable image registration

We present a novel computational approach to fast and memory-efficient d...
research
06/08/2021

Automatic 2D-3D Registration without Contrast Agent during Neurovascular Interventions

Fusing live fluoroscopy images with a 3D rotational reconstruction of th...
research
02/15/2022

Deep Learning-Assisted Co-registration of Full-Spectral Autofluorescence Lifetime Microscopic Images with H E-Stained Histology Images

Autofluorescence lifetime images reveal unique characteristics of endoge...

Please sign up or login with your details

Forgot password? Click here to reset