Test-Time Training for Deformable Multi-Scale Image Registration

03/25/2021
by   Wentao Zhu, et al.
1

Registration is a fundamental task in medical robotics and is often a crucial step for many downstream tasks such as motion analysis, intra-operative tracking and image segmentation. Popular registration methods such as ANTs and NiftyReg optimize objective functions for each pair of images from scratch, which are time-consuming for 3D and sequential images with complex deformations. Recently, deep learning-based registration approaches such as VoxelMorph have been emerging and achieve competitive performance. In this work, we construct a test-time training for deep deformable image registration to improve the generalization ability of conventional learning-based registration model. We design multi-scale deep networks to consecutively model the residual deformations, which is effective for high variational deformations. Extensive experiments validate the effectiveness of multi-scale deep registration with test-time training based on Dice coefficient for image segmentation and mean square error (MSE), normalized local cross-correlation (NLCC) for tissue dense tracking tasks. Two videos are in https://www.youtube.com/watch?v=NvLrCaqCiAE and https://www.youtube.com/watch?v=pEA6ZmtTNuQ

READ FULL TEXT

page 2

page 5

page 6

research
10/04/2019

NeurReg: Neural Registration and Its Application to Image Segmentation

Registration is a fundamental task in medical image analysis which can b...
research
07/22/2022

Meta-Registration: Learning Test-Time Optimization for Single-Pair Image Registration

Neural networks have been proposed for medical image registration by lea...
research
07/07/2022

Deformer: Towards Displacement Field Learning for Unsupervised Medical Image Registration

Recently, deep-learning-based approaches have been widely studied for de...
research
08/03/2020

3D B-mode ultrasound speckle reduction using deep learning for 3D registration applications

Ultrasound (US) speckles are granular patterns which can impede image po...
research
06/18/2019

Neural Multi-Scale Self-Supervised Registration for Echocardiogram Dense Tracking

Echocardiography has become routinely used in the diagnosis of cardiomyo...
research
07/28/2023

Scale-aware Test-time Click Adaptation for Pulmonary Nodule and Mass Segmentation

Pulmonary nodules and masses are crucial imaging features in lung cancer...
research
04/30/2020

A Multi-scale Optimization Learning Framework for Diffeomorphic Deformable Registration

Conventional deformable registration methods aim at solving a specifical...

Please sign up or login with your details

Forgot password? Click here to reset