Augmenting Knowledge Transfer across Graphs

12/09/2022
by   Yuzhen Mao, et al.
0

Given a resource-rich source graph and a resource-scarce target graph, how can we effectively transfer knowledge across graphs and ensure a good generalization performance? In many high-impact domains (e.g., brain networks and molecular graphs), collecting and annotating data is prohibitively expensive and time-consuming, which makes domain adaptation an attractive option to alleviate the label scarcity issue. In light of this, the state-of-the-art methods focus on deriving domain-invariant graph representation that minimizes the domain discrepancy. However, it has recently been shown that a small domain discrepancy loss may not always guarantee a good generalization performance, especially in the presence of disparate graph structures and label distribution shifts. In this paper, we present TRANSNET, a generic learning framework for augmenting knowledge transfer across graphs. In particular, we introduce a novel notion named trinity signal that can naturally formulate various graph signals at different granularity (e.g., node attributes, edges, and subgraphs). With that, we further propose a domain unification module together with a trinity-signal mixup scheme to jointly minimize the domain discrepancy and augment the knowledge transfer across graphs. Finally, comprehensive empirical results show that TRANSNET outperforms all existing approaches on seven benchmark datasets by a significant margin.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/01/2023

Dynamic Transfer Learning across Graphs

Transferring knowledge across graphs plays a pivotal role in many high-s...
research
12/15/2022

Non-IID Transfer Learning on Graphs

Transfer learning refers to the transfer of knowledge or information fro...
research
09/19/2023

Semi-supervised Domain Adaptation in Graph Transfer Learning

As a specific case of graph transfer learning, unsupervised domain adapt...
research
12/06/2020

Select, Label, and Mix: Learning Discriminative Invariant Feature Representations for Partial Domain Adaptation

Partial domain adaptation which assumes that the unknown target label sp...
research
09/14/2023

Semi-supervised Domain Adaptation on Graphs with Contrastive Learning and Minimax Entropy

Label scarcity in a graph is frequently encountered in real-world applic...
research
03/14/2018

Domain Adaptation on Graphs by Learning Aligned Graph Bases

We propose a method for domain adaptation on graphs. Given sufficiently ...
research
08/21/2022

MentorGNN: Deriving Curriculum for Pre-Training GNNs

Graph pre-training strategies have been attracting a surge of attention ...

Please sign up or login with your details

Forgot password? Click here to reset