Non-IID Transfer Learning on Graphs

12/15/2022
by   Jun Wu, et al.
0

Transfer learning refers to the transfer of knowledge or information from a relevant source domain to a target domain. However, most existing transfer learning theories and algorithms focus on IID tasks, where the source/target samples are assumed to be independent and identically distributed. Very little effort is devoted to theoretically studying the knowledge transferability on non-IID tasks, e.g., cross-network mining. To bridge the gap, in this paper, we propose rigorous generalization bounds and algorithms for cross-network transfer learning from a source graph to a target graph. The crucial idea is to characterize the cross-network knowledge transferability from the perspective of the Weisfeiler-Lehman graph isomorphism test. To this end, we propose a novel Graph Subtree Discrepancy to measure the graph distribution shift between source and target graphs. Then the generalization error bounds on cross-network transfer learning, including both cross-network node classification and link prediction tasks, can be derived in terms of the source knowledge and the Graph Subtree Discrepancy across domains. This thereby motivates us to propose a generic graph adaptive network (GRADE) to minimize the distribution shift between source and target graphs for cross-network transfer learning. Experimental results verify the effectiveness and efficiency of our GRADE framework on both cross-network node classification and cross-domain recommendation tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/01/2023

Dynamic Transfer Learning across Graphs

Transferring knowledge across graphs plays a pivotal role in many high-s...
research
07/05/2022

A Unified Meta-Learning Framework for Dynamic Transfer Learning

Transfer learning refers to the transfer of knowledge or information fro...
research
06/07/2021

Quantifying and Improving Transferability in Domain Generalization

Out-of-distribution generalization is one of the key challenges when tra...
research
12/09/2022

Augmenting Knowledge Transfer across Graphs

Given a resource-rich source graph and a resource-scarce target graph, h...
research
02/17/2021

ConTraKG: Contrastive-based Transfer Learning for Visual Object Recognition using Knowledge Graphs

Deep learning techniques achieve high accuracy in computer vision tasks....
research
02/27/2023

You Only Transfer What You Share: Intersection-Induced Graph Transfer Learning for Link Prediction

Link prediction is central to many real-world applications, but its perf...
research
06/05/2020

Continuous Transfer Learning with Label-informed Distribution Alignment

Transfer learning has been successfully applied across many high-impact ...

Please sign up or login with your details

Forgot password? Click here to reset