Feature Representation Analysis of Deep Convolutional Neural Network using Two-stage Feature Transfer -An Application for Diffuse Lung Disease Classification-

by   Aiga Suzuki, et al.

Transfer learning is a machine learning technique designed to improve generalization performance by using pre-trained parameters obtained from other learning tasks. For image recognition tasks, many previous studies have reported that, when transfer learning is applied to deep neural networks, performance improves, despite having limited training data. This paper proposes a two-stage feature transfer learning method focusing on the recognition of textural medical images. During the proposed method, a model is successively trained with massive amounts of natural images, some textural images, and the target images. We applied this method to the classification task of textural X-ray computed tomography images of diffuse lung diseases. In our experiment, the two-stage feature transfer achieves the best performance compared to a from-scratch learning and a conventional single-stage feature transfer. We also investigated the robustness of the target dataset, based on size. Two-stage feature transfer shows better robustness than the other two learning methods. Moreover, we analyzed the feature representations obtained from DLDs imagery inputs for each feature transfer models using a visualization method. We showed that the two-stage feature transfer obtains both edge and textural features of DLDs, which does not occur in conventional single-stage feature transfer models.


page 1

page 2

page 3

page 4


Transfer learning for time series classification

Transfer learning for deep neural networks is the process of first train...

Feature discriminativity estimation in CNNs for transfer learning

The purpose of feature extraction on convolutional neural networks is to...

Brain-mediated Transfer Learning of Convolutional Neural Networks

Human flexible cognition and behavior indicate that the human brain can ...

Deep Collaborative Weight-based Classification

One of the biggest problems in deep learning is its difficulty to retain...

Unsupervised machine learning via transfer learning and k-means clustering to classify materials image data

Unsupervised machine learning offers significant opportunities for extra...

Apple Leaf Disease Identification through Region-of-Interest-Aware Deep Convolutional Neural Network

A new method of recognizing apple leaf diseases through region-of-intere...

DCNNs: A Transfer Learning comparison of Full Weapon Family threat detection forDual-Energy X-Ray Baggage Imagery

Recent advancements in Convolutional Neural Networks have yielded super-...

Please sign up or login with your details

Forgot password? Click here to reset