Coupled Feature Learning for Multimodal Medical Image Fusion

02/17/2021
by   Farshad G. Veshki, et al.
0

Multimodal image fusion aims to combine relevant information from images acquired with different sensors. In medical imaging, fused images play an essential role in both standard and automated diagnosis. In this paper, we propose a novel multimodal image fusion method based on coupled dictionary learning. The proposed method is general and can be employed for different medical imaging modalities. Unlike many current medical fusion methods, the proposed approach does not suffer from intensity attenuation nor loss of critical information. Specifically, the images to be fused are decomposed into coupled and independent components estimated using sparse representations with identical supports and a Pearson correlation constraint, respectively. An alternating minimization algorithm is designed to solve the resulting optimization problem. The final fusion step uses the max-absolute-value rule. Experiments are conducted using various pairs of multimodal inputs, including real MR-CT and MR-PET images. The resulting performance and execution times show the competitiveness of the proposed method in comparison with state-of-the-art medical image fusion methods.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 3

page 4

page 5

page 6

page 8

page 9

06/01/2019

A Semantic-based Medical Image Fusion Approach

It is necessary for clinicians to comprehensively analyze patient inform...
11/18/2018

Multimodal Densenet

Humans make accurate decisions by interpreting complex data from multipl...
07/22/2020

A Novel adaptive optimization of Dual-Tree Complex Wavelet Transform for Medical Image Fusion

In recent years, many research achievements are made in the medical imag...
08/11/2019

Structural Similarity based Anatomical and Functional Brain Imaging Fusion

Multimodal medical image fusion helps in combining contrasting features ...
05/30/2017

Multi-Focus Image Fusion Via Coupled Sparse Representation and Dictionary Learning

We address the multi-focus image fusion problem, where multiple images c...
01/31/2017

Feature Selection based on PCA and PSO for Multimodal Medical Image Fusion using DTCWT

Multimodal medical image fusion helps to increase efficiency in medical ...
01/26/2020

Visualisation of Medical Image Fusion and Translation for Accurate Diagnosis of High Grade Gliomas

The medical image fusion combines two or more modalities into a single v...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.