Coupled Feature Learning for Multimodal Medical Image Fusion

by   Farshad G. Veshki, et al.

Multimodal image fusion aims to combine relevant information from images acquired with different sensors. In medical imaging, fused images play an essential role in both standard and automated diagnosis. In this paper, we propose a novel multimodal image fusion method based on coupled dictionary learning. The proposed method is general and can be employed for different medical imaging modalities. Unlike many current medical fusion methods, the proposed approach does not suffer from intensity attenuation nor loss of critical information. Specifically, the images to be fused are decomposed into coupled and independent components estimated using sparse representations with identical supports and a Pearson correlation constraint, respectively. An alternating minimization algorithm is designed to solve the resulting optimization problem. The final fusion step uses the max-absolute-value rule. Experiments are conducted using various pairs of multimodal inputs, including real MR-CT and MR-PET images. The resulting performance and execution times show the competitiveness of the proposed method in comparison with state-of-the-art medical image fusion methods.



There are no comments yet.


page 1

page 3

page 4

page 5

page 6

page 8

page 9


A Semantic-based Medical Image Fusion Approach

It is necessary for clinicians to comprehensively analyze patient inform...

Multimodal Densenet

Humans make accurate decisions by interpreting complex data from multipl...

A Novel adaptive optimization of Dual-Tree Complex Wavelet Transform for Medical Image Fusion

In recent years, many research achievements are made in the medical imag...

Structural Similarity based Anatomical and Functional Brain Imaging Fusion

Multimodal medical image fusion helps in combining contrasting features ...

Multi-Focus Image Fusion Via Coupled Sparse Representation and Dictionary Learning

We address the multi-focus image fusion problem, where multiple images c...

Feature Selection based on PCA and PSO for Multimodal Medical Image Fusion using DTCWT

Multimodal medical image fusion helps to increase efficiency in medical ...

Visualisation of Medical Image Fusion and Translation for Accurate Diagnosis of High Grade Gliomas

The medical image fusion combines two or more modalities into a single v...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.