Unsupervised Heterophilous Network Embedding via r-Ego Network Discrimination

03/21/2022
by   Zhiqiang Zhong, et al.
5

Recently, supervised network embedding (NE) has emerged as a predominant technique for representing complex systems that take the form of networks, and various downstream node- and network-level tasks have benefited from its remarkable developments. However, unsupervised NE still remains challenging due to the uncertainty in defining a learning objective. In addition, it is still an unexplored research question whether existing NE methods adapt well to heterophilous networks. This paper introduces the first empirical study on the influence of homophily ratio on the performance of existing unsupervised NE methods and reveals their limitations. Inspired by our empirical findings, we design unsupervised NE task as an r-ego network discrimination problem and further develop a SELf-supErvised Network Embedding (Selene) framework for learning useful node representations for both homophilous and heterophilous networks. Specifically, we propose a dual-channel feature embedding mechanism to fuse node attributes and network structure information and leverage a sampling and anonymisation strategy to break the implicit homophily assumption of existing embedding mechanisms. Lastly, we introduce a negative-sample-free SSL objective function to optimise the framework. We conduct extensive experiments and a series of ablation studies on 12 real-world datasets and 20 synthetic networks. Results demonstrate Selene's superior performance and confirm the effectiveness of each component.

READ FULL TEXT

page 1

page 9

research
09/07/2018

Deep Feature Learning of Multi-Network Topology for Node Classification

Networks are ubiquitous structure that describes complex relationships b...
research
05/17/2021

Understanding and Improvement of Adversarial Training for Network Embedding from an Optimization Perspective

Network Embedding aims to learn a function mapping the nodes to Euclidea...
research
02/15/2021

HDMI: High-order Deep Multiplex Infomax

Networks have been widely used to represent the relations between object...
research
09/06/2023

Towards Unsupervised Graph Completion Learning on Graphs with Features and Structure Missing

In recent years, graph neural networks (GNN) have achieved significant d...
research
07/19/2021

Unsupervised Embedding Learning from Uncertainty Momentum Modeling

Existing popular unsupervised embedding learning methods focus on enhanc...
research
02/22/2017

SIGNet: Scalable Embeddings for Signed Networks

Recent successes in word embedding and document embedding have motivated...
research
02/28/2022

Point Set Self-Embedding

This work presents an innovative method for point set self-embedding, th...

Please sign up or login with your details

Forgot password? Click here to reset