COIN: Co-Cluster Infomax for Bipartite Graphs

05/31/2022
by   Baoyu Jing, et al.
0

Bipartite graphs are powerful data structures to model interactions between two types of nodes, which have been used in a variety of applications, such as recommender systems, information retrieval, and drug discovery. A fundamental challenge for bipartite graphs is how to learn informative node embeddings. Despite the success of recent self-supervised learning methods on bipartite graphs, their objectives are discriminating instance-wise positive and negative node pairs, which could contain cluster-level errors. In this paper, we introduce a novel co-cluster infomax (COIN) framework, which captures the cluster-level information by maximizing the mutual information of co-clusters. Different from previous infomax methods which estimate mutual information by neural networks, COIN could easily calculate mutual information. Besides, COIN is an end-to-end co-clustering method which can be trained jointly with other objective functions and optimized via back-propagation. Furthermore, we also provide theoretical analysis for COIN. We theoretically prove that COIN is able to effectively maximize the mutual information of node embeddings and COIN is upper-bounded by the prior distributions of nodes. We extensively evaluate the proposed COIN framework on various benchmark datasets and tasks to demonstrate the effectiveness of COIN.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/10/2020

Bipartite Graph Embedding via Mutual Information Maximization

Bipartite graph embedding has recently attracted much attention due to t...
research
09/08/2021

Graph-MVP: Multi-View Prototypical Contrastive Learning for Multiplex Graphs

Contrastive Learning (CL) is one of the most popular self-supervised lea...
research
03/23/2022

Node Representation Learning in Graph via Node-to-Neighbourhood Mutual Information Maximization

The key towards learning informative node representations in graphs lies...
research
05/10/2022

Deep Graph Clustering via Mutual Information Maximization and Mixture Model

Attributed graph clustering or community detection which learns to clust...
research
10/04/2021

Clustering with Respect to the Information Distance

We discuss the notion of a dense cluster with respect to the information...
research
08/15/2023

MOLE: MOdular Learning FramEwork via Mutual Information Maximization

This paper is to introduce an asynchronous and local learning framework ...
research
04/26/2023

Mutual information of spin systems from autoregressive neural networks

We describe a direct approach to estimate bipartite mutual information o...

Please sign up or login with your details

Forgot password? Click here to reset