All-Transfer Learning for Deep Neural Networks and its Application to Sepsis Classification

11/13/2017
by   Yoshihide Sawada, et al.
0

In this article, we propose a transfer learning method for deep neural networks (DNNs). Deep learning has been widely used in many applications. However, applying deep learning is problematic when a large amount of training data are not available. One of the conventional methods for solving this problem is transfer learning for DNNs. In the field of image recognition, state-of-the-art transfer learning methods for DNNs re-use parameters trained on source domain data except for the output layer. However, this method may result in poor classification performance when the amount of target domain data is significantly small. To address this problem, we propose a method called All-Transfer Deep Learning, which enables the transfer of all parameters of a DNN. With this method, we can compute the relationship between the source and target labels by the source domain knowledge. We applied our method to actual two-dimensional electrophoresis image (2-DE image) classification for determining if an individual suffers from sepsis; the first attempt to apply a classification approach to 2-DE images for proteomics, which has attracted considerable attention as an extension beyond genomics. The results suggest that our proposed method outperforms conventional transfer learning methods for DNNs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/30/2023

Multi-source adversarial transfer learning based on similar source domains with local features

Transfer learning leverages knowledge from other domains and has been su...
research
11/15/2016

Intrinsic Geometric Information Transfer Learning on Multiple Graph-Structured Datasets

Graphs provide a powerful means for representing complex interactions be...
research
12/23/2017

Transfer Regression via Pairwise Similarity Regularization

Transfer learning methods address the situation where little labeled tra...
research
07/31/2016

Hyperparameter Transfer Learning through Surrogate Alignment for Efficient Deep Neural Network Training

Recently, several optimization methods have been successfully applied to...
research
12/28/2019

Transfer Learning in General Lensless Imaging through Scattering Media

Recently deep neural networks (DNNs) have been successfully introduced t...
research
03/26/2019

Weighted Multisource Tradaboost

In this paper we propose an improved method for transfer learning that t...
research
05/20/2022

Deep transfer learning for image classification: a survey

Deep neural networks such as convolutional neural networks (CNNs) and tr...

Please sign up or login with your details

Forgot password? Click here to reset