Variable Augmented Network for Invertible Modality Synthesis-Fusion

09/02/2021
by   Yuhao Wang, et al.
9

As an effective way to integrate the information contained in multiple medical images under different modalities, medical image synthesis and fusion have emerged in various clinical applications such as disease diagnosis and treatment planning. In this paper, an invertible and variable augmented network (iVAN) is proposed for medical image synthesis and fusion. In iVAN, the channel number of the network input and output is the same through variable augmentation technology, and data relevance is enhanced, which is conducive to the generation of characterization information. Meanwhile, the invertible network is used to achieve the bidirectional inference processes. Due to the invertible and variable augmentation schemes, iVAN can not only be applied to the mappings of multi-input to one-output and multi-input to multi-output, but also be applied to one-input to multi-output. Experimental results demonstrated that the proposed method can obtain competitive or superior performance in comparison to representative medical image synthesis and fusion methods.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 7

page 8

page 9

research
12/31/2013

Medical Image Fusion: A survey of the state of the art

Medical image fusion is the process of registering and combining multipl...
research
06/01/2019

A Semantic-based Medical Image Fusion Approach

It is necessary for clinicians to comprehensively analyze patient inform...
research
01/26/2020

Visualisation of Medical Image Fusion and Translation for Accurate Diagnosis of High Grade Gliomas

The medical image fusion combines two or more modalities into a single v...
research
12/09/2022

An Attention-based Multi-Scale Feature Learning Network for Multimodal Medical Image Fusion

Medical images play an important role in clinical applications. Multimod...
research
09/12/2023

Deep evidential fusion with uncertainty quantification and contextual discounting for multimodal medical image segmentation

Single-modality medical images generally do not contain enough informati...
research
11/02/2022

DC-cycleGAN: Bidirectional CT-to-MR Synthesis from Unpaired Data

Magnetic resonance (MR) and computer tomography (CT) images are two typi...
research
01/23/2018

Automatic construction of Chinese herbal prescription from tongue image via CNNs and auxiliary latent therapy topics

The tongue image is an important physical information of human, it is of...

Please sign up or login with your details

Forgot password? Click here to reset