Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translation

03/18/2020
by   Moab Arar, et al.
0

Many applications, such as autonomous driving, heavily rely on multi-modal data where spatial alignment between the modalities is required. Most multi-modal registration methods struggle computing the spatial correspondence between the images using prevalent cross-modality similarity measures. In this work, we bypass the difficulties of developing cross-modality similarity measures, by training an image-to-image translation network on the two input modalities. This learned translation allows training the registration network using simple and reliable mono-modality metrics. We perform multi-modal registration using two networks - a spatial transformation network and a translation network. We show that by encouraging our translation network to be geometry preserving, we manage to train an accurate spatial transformation network. Compared to state-of-the-art multi-modal methods our presented method is unsupervised, requiring no pairs of aligned modalities for training, and can be adapted to any pair of modalities. We evaluate our method quantitatively and qualitatively on commercial datasets, showing that it performs well on several modalities and achieves accurate alignment.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 6

page 8

page 9

page 10

research
04/28/2022

Unsupervised Multi-Modal Medical Image Registration via Discriminator-Free Image-to-Image Translation

In clinical practice, well-aligned multi-modal images, such as Magnetic ...
research
09/06/2023

MAD: Modality Agnostic Distance Measure for Image Registration

Multi-modal image registration is a crucial pre-processing step in many ...
research
11/12/2014

Multi-modal Image Registration for Correlative Microscopy

Correlative microscopy is a methodology combining the functionality of l...
research
04/21/2020

Learning Multi-Modal Image Registration without Real Data

We introduce a learning-based strategy for multi-modal registration of i...
research
03/01/2023

Indescribable Multi-modal Spatial Evaluator

Multi-modal image registration spatially aligns two images with differen...
research
01/22/2018

MRI Image-to-Image Translation for Cross-Modality Image Registration and Segmentation

We develop a novel cross-modality generation framework that learns to ge...
research
12/12/2014

Edge Preserving Multi-Modal Registration Based On Gradient Intensity Self-Similarity

Image registration is a challenging task in the world of medical imaging...

Please sign up or login with your details

Forgot password? Click here to reset