Intrinsic Geometric Information Transfer Learning on Multiple Graph-Structured Datasets

11/15/2016
by   Jaekoo Lee, et al.
0

Graphs provide a powerful means for representing complex interactions between entities. Recently, deep learning approaches are emerging for representing and modeling graph-structured data, although the conventional deep learning methods (such as convolutional neural networks and recurrent neural networks) have mainly focused on grid-structured inputs (image and audio). Leveraged by the capability of representation learning, deep learning based techniques are reporting promising results for graph applications by detecting structural characteristics of graphs in an automated fashion. In this paper, we attempt to advance deep learning for graph-structured data by incorporating another component, transfer learning. By transferring the intrinsic geometric information learned in the source domain, our approach can help us to construct a model for a new but related task in the target domain without collecting new data and without training a new model from scratch. We thoroughly test our approach with large-scale real corpora and confirm the effectiveness of the proposed transfer learning framework for deep learning on graphs. According to our experiments, transfer learning is most effective when the source and target domains bear a high level of structural similarity in their graph representations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/13/2017

All-Transfer Learning for Deep Neural Networks and its Application to Sepsis Classification

In this article, we propose a transfer learning method for deep neural n...
research
07/04/2022

NodeTrans: A Graph Transfer Learning Approach for Traffic Prediction

Recently, deep learning methods have made great progress in traffic pred...
research
09/04/2020

A Comprehensive Analysis of Information Leakage in Deep Transfer Learning

Transfer learning is widely used for transferring knowledge from a sourc...
research
11/29/2015

The Multiverse Loss for Robust Transfer Learning

Deep learning techniques are renowned for supporting effective transfer ...
research
08/25/2017

Accelerating Dependency Graph Learning from Heterogeneous Categorical Event Streams via Knowledge Transfer

Dependency graph, as a heterogeneous graph representing the intrinsic re...
research
11/14/2021

Improving Compound Activity Classification via Deep Transfer and Representation Learning

Recent advances in molecular machine learning, especially deep neural ne...
research
06/14/2018

GLoMo: Unsupervisedly Learned Relational Graphs as Transferable Representations

Modern deep transfer learning approaches have mainly focused on learning...

Please sign up or login with your details

Forgot password? Click here to reset