Predicting the Silent Majority on Graphs: Knowledge Transferable Graph Neural Network

02/02/2023
by   Wendong Bi, et al.
0

Graphs consisting of vocal nodes ("the vocal minority") and silent nodes ("the silent majority"), namely VS-Graph, are ubiquitous in the real world. The vocal nodes tend to have abundant features and labels. In contrast, silent nodes only have incomplete features and rare labels, e.g., the description and political tendency of politicians (vocal) are abundant while not for ordinary people (silent) on the twitter's social network. Predicting the silent majority remains a crucial yet challenging problem. However, most existing message-passing based GNNs assume that all nodes belong to the same domain, without considering the missing features and distribution-shift between domains, leading to poor ability to deal with VS-Graph. To combat the above challenges, we propose Knowledge Transferable Graph Neural Network (KT-GNN), which models distribution shifts during message passing and representation learning by transferring knowledge from vocal nodes to silent nodes. Specifically, we design the domain-adapted "feature completion and message passing mechanism" for node representation learning while preserving domain difference. And a knowledge transferable classifier based on KL-divergence is followed. Comprehensive experiments on real-world scenarios (i.e., company financial risk assessment and political elections) demonstrate the superior performance of our method. Our source code has been open sourced.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/04/2021

Uniting Heterogeneity, Inductiveness, and Efficiency for Graph Representation Learning

With the ubiquitous graph-structured data in various applications, model...
research
02/01/2022

Memory-based Message Passing: Decoupling the Message for Propogation from Discrimination

Message passing is a fundamental procedure for graph neural networks in ...
research
03/27/2023

Towards Open Temporal Graph Neural Networks

Graph neural networks (GNNs) for temporal graphs have recently attracted...
research
04/01/2018

Attentional Multilabel Learning over Graphs - A message passing approach

We address a largely open problem of multilabel classification over grap...
research
08/31/2023

Domain-adaptive Message Passing Graph Neural Network

Cross-network node classification (CNNC), which aims to classify nodes i...
research
03/02/2023

Steering Graph Neural Networks with Pinning Control

In the semi-supervised setting where labeled data are largely limited, i...
research
04/14/2023

Symbiotic Message Passing Model for Transfer Learning between Anti-Fungal and Anti-Bacterial Domains

Machine learning, and representation learning in particular, has the pot...

Please sign up or login with your details

Forgot password? Click here to reset