FlowReg: Fast Deformable Unsupervised Medical Image Registration using Optical Flow

01/24/2021
by   Sergiu Mocanu, et al.
46

We propose FlowReg, a deep learning-based framework for unsupervised image registration for neuroimaging applications. The system is composed of two architectures that are trained sequentially: FlowReg-A which affinely corrects for gross differences between moving and fixed volumes in 3D followed by FlowReg-O which performs pixel-wise deformations on a slice-by-slice basis for fine tuning in 2D. The affine network regresses the 3D affine matrix based on a correlation loss function that enforces global similarity. The deformable network operates on 2D image slices based on the optical flow network FlowNet-Simple but with three loss components. The photometric loss minimizes pixel intensity differences differences, the smoothness loss encourages similar magnitudes between neighbouring vectors, and a correlation loss that is used to maintain the intensity similarity between fixed and moving image slices. The proposed method is compared to four open source registration techniques ANTs, Demons, SE, and Voxelmorph. In total, 4643 FLAIR MR imaging volumes are used from dementia and vascular disease cohorts, acquired from over 60 international centres with varying acquisition parameters. A battery of quantitative novel registration validation metrics are proposed that focus on the structural integrity of tissues, spatial alignment, and intensity similarity. Experimental results show FlowReg (FlowReg-A+O) performs better than iterative-based registration algorithms for intensity and spatial alignment metrics with a Pixelwise Agreement of 0.65, correlation coefficient of 0.80, and Mutual Information of 0.29. Among the deep learning frameworks, FlowReg-A or FlowReg-A+O provided the highest performance over all but one of the metrics. Results show that FlowReg is able to obtain high intensity and spatial similarity while maintaining the shape and structure of anatomy and pathology.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 2

page 13

page 14

page 23

page 24

page 25

page 26

page 33

09/17/2018

A Deep Learning Framework for Unsupervised Affine and Deformable Image Registration

Image registration, the process of aligning two or more images, is the c...
04/28/2020

Convolutional Neural Networks vs. Deformable Image Registration For Medical Slice Interpolation

Medical image slice interpolation is an active field of research. The me...
07/03/2020

Dueling Deep Q-Network for Unsupervised Inter-frame Eye Movement Correction in Optical Coherence Tomography Volumes

In optical coherence tomography (OCT) volumes of retina, the sequential ...
02/26/2020

Deform-GAN:An Unsupervised Learning Model for Deformable Registration

Deformable registration is one of the most challenging task in the field...
08/05/2020

A coarse-to-fine framework for unsupervised multi-contrast MR image deformable registration with dual consistency constraint

Multi-contrast magnetic resonance (MR) image registration is essential i...
12/05/2018

Enhancing Label-Driven Deep Deformable Image Registration with Local Distance Metrics for State-of-the-Art Cardiac Motion Tracking

While deep learning has achieved significant advances in accuracy for me...
10/20/2021

Closed-loop Feedback Registration for Consecutive Images of Moving Flexible Targets

Advancement of imaging techniques enables consecutive image sequences to...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.