Probabilistic Motion Modeling from Medical Image Sequences: Application to Cardiac Cine-MRI

07/31/2019
by   Julian Krebs, et al.
2

We propose to learn a probabilistic motion model from a sequence of images. Besides spatio-temporal registration, our method offers to predict motion from a limited number of frames, useful for temporal super-resolution. The model is based on a probabilistic latent space and a novel temporal dropout training scheme. This enables simulation and interpolation of realistic motion patterns given only one or any subset of frames of a sequence. The encoded motion also allows to be transported from one subject to another without the need of inter-subject registration. An unsupervised generative deformation model is applied within a temporal convolutional network which leads to a diffeomorphic motion model, encoded as a low-dimensional motion matrix. Applied to cardiac cine-MRI sequences, we show improved registration accuracy and spatio-temporally smoother deformations compared to three state-of-the-art registration algorithms. Besides, we demonstrate the model's applicability to motion transport by simulating a pathology in a healthy case. Furthermore, we show an improved motion reconstruction from incomplete sequences compared to linear and cubic interpolation.

READ FULL TEXT

page 3

page 6

page 7

research
11/03/2020

Learning a Generative Motion Model from Image Sequences based on a Latent Motion Matrix

We propose to learn a probabilistic motion model from a sequence of imag...
research
01/18/2020

Accelerating the Registration of Image Sequences by Spatio-temporal Multilevel Strategies

Multilevel strategies are an integral part of many image registration al...
research
06/07/2021

Multi-frame sequence generator of 4D human body motion

We examine the problem of generating temporally and spatially dense 4D h...
research
04/19/2018

Learning Structured Deformations using Diffeomorphic Registration

Studying organ motion or pathology progression is an important task in d...
research
08/23/2023

TAI-GAN: Temporally and Anatomically Informed GAN for early-to-late frame conversion in dynamic cardiac PET motion correction

The rapid tracer kinetics of rubidium-82 (^82Rb) and high variation of c...
research
03/24/2020

Registration by tracking for sequential 2D MRI

Our anatomy is in constant motion. With modern MR imaging it is possible...
research
01/05/2012

Probabilistic Motion Estimation Based on Temporal Coherence

We develop a theory for the temporal integration of visual motion motiva...

Please sign up or login with your details

Forgot password? Click here to reset