Symmetric-Constrained Irregular Structure Inpainting for Brain MRI Registration with Tumor Pathology

by   Xiaofeng Liu, et al.

Deformable registration of magnetic resonance images between patients with brain tumors and healthy subjects has been an important tool to specify tumor geometry through location alignment and facilitate pathological analysis. Since tumor region does not match with any ordinary brain tissue, it has been difficult to deformably register a patients brain to a normal one. Many patient images are associated with irregularly distributed lesions, resulting in further distortion of normal tissue structures and complicating registration's similarity measure. In this work, we follow a multi-step context-aware image inpainting framework to generate synthetic tissue intensities in the tumor region. The coarse image-to-image translation is applied to make a rough inference of the missing parts. Then, a feature-level patch-match refinement module is applied to refine the details by modeling the semantic relevance between patch-wise features. A symmetry constraint reflecting a large degree of anatomical symmetry in the brain is further proposed to achieve better structure understanding. Deformable registration is applied between inpainted patient images and normal brains, and the resulting deformation field is eventually used to deform original patient data for the final alignment. The method was applied to the Multimodal Brain Tumor Segmentation (BraTS) 2018 challenge database and compared against three existing inpainting methods. The proposed method yielded results with increased peak signal-to-noise ratio, structural similarity index, inception score, and reduced L1 error, leading to successful patient-to-normal brain image registration.


page 4

page 6

page 7

page 8


A Deep Network for Joint Registration and Reconstruction of Images with Pathologies

Registration of images with pathologies is challenging due to tissue app...

The Brain Tumor Segmentation (BraTS) Challenge 2023: Local Synthesis of Healthy Brain Tissue via Inpainting

A myriad of algorithms for the automatic analysis of brain MR images is ...

Brain Tumor Sequence Registration with Non-iterative Coarse-to-fine Networks and Dual Deep Supervision

In this study, we focus on brain tumor sequence registration between pre...

3D Inception-Based TransMorph: Pre- and Post-operative Multi-contrast MRI Registration in Brain Tumors

Deformable image registration is a key task in medical image analysis. T...

Brain Extraction from Normal and Pathological Images: A Joint PCA/Image-Reconstruction Approach

Brain extraction from 3D medical images is a common pre-processing step....

Exploiting bilateral symmetry in brain lesion segmentation

Brain lesions, including stroke and tumours, have a high degree of varia...

Please sign up or login with your details

Forgot password? Click here to reset