Deformation equivariant cross-modality image synthesis with paired non-aligned training data

08/26/2022
by   Joel Honkamaa, et al.
1

Cross-modality image synthesis is an active research topic with multiple medical clinically relevant applications. Recently, methods allowing training with paired but misaligned data have started to emerge. However, no robust and well-performing methods applicable to a wide range of real world data sets exist. In this work, we propose a generic solution to the problem of cross-modality image synthesis with paired but non-aligned data by introducing new deformation equivariance encouraging loss functions. The method consists of joint training of an image synthesis network together with separate registration networks and allows adversarial training conditioned on the input even with misaligned data. The work lowers the bar for new clinical applications by allowing effortless training of cross-modality image synthesis networks for more difficult data sets and opens up opportunities for the development of new generic learning based cross-modality registration algorithms.

READ FULL TEXT

page 2

page 4

page 7

page 10

page 12

page 13

page 14

page 15

research
02/14/2022

A Survey of Cross-Modality Brain Image Synthesis

The existence of completely aligned and paired multi-modal neuroimaging ...
research
07/30/2021

Synth-by-Reg (SbR): Contrastive learning for synthesis-based registration of paired images

Nonlinear inter-modality registration is often challenging due to the la...
research
07/19/2023

Make-A-Volume: Leveraging Latent Diffusion Models for Cross-Modality 3D Brain MRI Synthesis

Cross-modality medical image synthesis is a critical topic and has the p...
research
07/11/2019

FIRE: Unsupervised bi-directional inter-modality registration using deep networks

Inter-modality image registration is an critical preprocessing step for ...
research
05/24/2022

Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registration

Recent learning-based image fusion methods have marked numerous progress...
research
06/15/2017

DOTE: Dual cOnvolutional filTer lEarning for Super-Resolution and Cross-Modality Synthesis in MRI

Cross-modal image synthesis is a topical problem in medical image comput...
research
05/07/2023

SynthMix: Mixing up Aligned Synthesis for Medical Cross-Modality Domain Adaptation

The adversarial methods showed advanced performance by producing synthet...

Please sign up or login with your details

Forgot password? Click here to reset