Image-and-Spatial Transformer Networks for Structure-Guided Image Registration

07/22/2019
by   Matthew C. H. Lee, et al.
2

Image registration with deep neural networks has become an active field of research and exciting avenue for a long standing problem in medical imaging. The goal is to learn a complex function that maps the appearance of input image pairs to parameters of a spatial transformation in order to align corresponding anatomical structures. We argue and show that the current direct, non-iterative approaches are sub-optimal, in particular if we seek accurate alignment of Structures-of-Interest (SoI). Information about SoI is often available at training time, for example, in form of segmentations or landmarks. We introduce a novel, generic framework, Image-and-Spatial Transformer Networks (ISTNs), to leverage SoI information allowing us to learn new image representations that are optimised for the downstream registration task. Thanks to these representations we can employ a test-specific, iterative refinement over the transformation parameters which yields highly accurate registration even with very limited training data. Performance is demonstrated on pairwise 3D brain registration and illustrative synthetic data.

READ FULL TEXT

page 2

page 5

page 7

page 8

research
04/05/2020

DeepFLASH: An Efficient Network for Learning-based Medical Image Registration

This paper presents DeepFLASH, a novel network with efficient training a...
research
02/01/2022

Towards Positive Jacobian: Learn to Postprocess Diffeomorphic Image Registration with Matrix Exponential

We present a postprocessing layer for deformable image registration to m...
research
06/30/2019

Conditional Segmentation in Lieu of Image Registration

Classical pairwise image registration methods search for a spatial trans...
research
04/07/2018

Statistical transformer networks: learning shape and appearance models via self supervision

We generalise Spatial Transformer Networks (STN) by replacing the parame...
research
03/14/2018

On the Ambiguity of Registration Uncertainty

Estimating the uncertainty in image registration is an area of current r...
research
07/25/2017

ssEMnet: Serial-section Electron Microscopy Image Registration using a Spatial Transformer Network with Learned Features

The alignment of serial-section electron microscopy (ssEM) images is cri...
research
04/07/2023

Combined Registration and Fusion of Evidential Occupancy Grid Maps for Live Digital Twins of Traffic

Cooperation of automated vehicles (AVs) can improve safety, efficiency a...

Please sign up or login with your details

Forgot password? Click here to reset