Bridging the gap between Natural and Medical Images through Deep Colorization

by   Lia Morra, et al.

Deep learning has thrived by training on large-scale datasets. However, in many applications, as for medical image diagnosis, getting massive amount of data is still prohibitive due to privacy, lack of acquisition homogeneity and annotation cost. In this scenario, transfer learning from natural image collections is a standard practice that attempts to tackle shape, texture and color discrepancies all at once through pretrained model fine-tuning. In this work, we propose to disentangle those challenges and design a dedicated network module that focuses on color adaptation. We combine learning from scratch of the color module with transfer learning of different classification backbones, obtaining an end-to-end, easy-to-train architecture for diagnostic image recognition on X-ray images. Extensive experiments showed how our approach is particularly efficient in case of data scarcity and provides a new path for further transferring the learned color information across multiple medical datasets.


page 2

page 6


Cats, not CAT scans: a study of dataset similarity in transfer learning for 2D medical image classification

Transfer learning is a commonly used strategy for medical image classifi...

Revisiting Hidden Representations in Transfer Learning for Medical Imaging

While a key component to the success of deep learning is the availabilit...

Transfer Learning based Detection of Diabetic Retinopathy from Small Dataset

Annotated training data insufficiency remains to be one of the challenge...

Synthetic Sample Selection via Reinforcement Learning

Synthesizing realistic medical images provides a feasible solution to th...

Domain Adaptor Networks for Hyperspectral Image Recognition

We consider the problem of adapting a network trained on three-channel c...

Please sign up or login with your details

Forgot password? Click here to reset