FlowReg: Fast Deformable Unsupervised Medical Image Registration using Optical Flow

01/24/2021
by   Sergiu Mocanu, et al.
46

We propose FlowReg, a deep learning-based framework for unsupervised image registration for neuroimaging applications. The system is composed of two architectures that are trained sequentially: FlowReg-A which affinely corrects for gross differences between moving and fixed volumes in 3D followed by FlowReg-O which performs pixel-wise deformations on a slice-by-slice basis for fine tuning in 2D. The affine network regresses the 3D affine matrix based on a correlation loss function that enforces global similarity. The deformable network operates on 2D image slices based on the optical flow network FlowNet-Simple but with three loss components. The photometric loss minimizes pixel intensity differences differences, the smoothness loss encourages similar magnitudes between neighbouring vectors, and a correlation loss that is used to maintain the intensity similarity between fixed and moving image slices. The proposed method is compared to four open source registration techniques ANTs, Demons, SE, and Voxelmorph. In total, 4643 FLAIR MR imaging volumes are used from dementia and vascular disease cohorts, acquired from over 60 international centres with varying acquisition parameters. A battery of quantitative novel registration validation metrics are proposed that focus on the structural integrity of tissues, spatial alignment, and intensity similarity. Experimental results show FlowReg (FlowReg-A+O) performs better than iterative-based registration algorithms for intensity and spatial alignment metrics with a Pixelwise Agreement of 0.65, correlation coefficient of 0.80, and Mutual Information of 0.29. Among the deep learning frameworks, FlowReg-A or FlowReg-A+O provided the highest performance over all but one of the metrics. Results show that FlowReg is able to obtain high intensity and spatial similarity while maintaining the shape and structure of anatomy and pathology.

READ FULL TEXT

page 2

page 13

page 14

page 23

page 24

page 25

page 26

page 33

research
09/17/2018

A Deep Learning Framework for Unsupervised Affine and Deformable Image Registration

Image registration, the process of aligning two or more images, is the c...
research
04/28/2020

Convolutional Neural Networks vs. Deformable Image Registration For Medical Slice Interpolation

Medical image slice interpolation is an active field of research. The me...
research
07/03/2020

Dueling Deep Q-Network for Unsupervised Inter-frame Eye Movement Correction in Optical Coherence Tomography Volumes

In optical coherence tomography (OCT) volumes of retina, the sequential ...
research
08/23/2019

Mutual information neural estimation in CNN-based end-to-end medical image registration

Image registration is one of the most underlined processes in medical im...
research
05/19/2017

MRI-PET Registration with Automated Algorithm in Pre-clinical Studies

Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET) ...
research
07/18/2009

Registration of Standardized Histological Images in Feature Space

In this paper, we propose three novel and important methods for the regi...
research
10/20/2021

Closed-loop Feedback Registration for Consecutive Images of Moving Flexible Targets

Advancement of imaging techniques enables consecutive image sequences to...

Please sign up or login with your details

Forgot password? Click here to reset