Bridging the gap between Natural and Medical Images through Deep Colorization

05/31/2020
by   Lia Morra, et al.
1

Deep learning has thrived by training on large-scale datasets. However, in many applications, as for medical image diagnosis, getting massive amount of data is still prohibitive due to privacy, lack of acquisition homogeneity and annotation cost. In this scenario, transfer learning from natural image collections is a standard practice that attempts to tackle shape, texture and color discrepancies all at once through pretrained model fine-tuning. In this work, we propose to disentangle those challenges and design a dedicated network module that focuses on color adaptation. We combine learning from scratch of the color module with transfer learning of different classification backbones, obtaining an end-to-end, easy-to-train architecture for diagnostic image recognition on X-ray images. Extensive experiments showed how our approach is particularly efficient in case of data scarcity and provides a new path for further transferring the learned color information across multiple medical datasets.

READ FULL TEXT

page 2

page 6

07/13/2021

Cats, not CAT scans: a study of dataset similarity in transfer learning for 2D medical image classification

Transfer learning is a commonly used strategy for medical image classifi...
02/16/2023

Revisiting Hidden Representations in Transfer Learning for Medical Imaging

While a key component to the success of deep learning is the availabilit...
05/17/2019

Transfer Learning based Detection of Diabetic Retinopathy from Small Dataset

Annotated training data insufficiency remains to be one of the challenge...
08/26/2020

Synthetic Sample Selection via Reinforcement Learning

Synthesizing realistic medical images provides a feasible solution to th...
08/03/2021

Domain Adaptor Networks for Hyperspectral Image Recognition

We consider the problem of adapting a network trained on three-channel c...

Please sign up or login with your details

Forgot password? Click here to reset