From Latent Graph to Latent Topology Inference: Differentiable Cell Complex Module

05/25/2023
by   Claudio Battiloro, et al.
0

Latent Graph Inference (LGI) relaxed the reliance of Graph Neural Networks (GNNs) on a given graph topology by dynamically learning it. However, most of LGI methods assume to have a (noisy, incomplete, improvable, ...) input graph to rewire and can solely learn regular graph topologies. In the wake of the success of Topological Deep Learning (TDL), we study Latent Topology Inference (LTI) for learning higher-order cell complexes (with sparse and not regular topology) describing multi-way interactions between data points. To this aim, we introduce the Differentiable Cell Complex Module (DCM), a novel learnable function that computes cell probabilities in the complex to improve the downstream task. We show how to integrate DCM with cell complex message passing networks layers and train it in a end-to-end fashion, thanks to a two-step inference procedure that avoids an exhaustive search across all possible cells in the input, thus maintaining scalability. Our model is tested on several homophilic and heterophilic graph datasets and it is shown to outperform other state-of-the-art techniques, offering significant improvements especially in cases where an input graph is not provided.

READ FULL TEXT

page 9

page 16

06/23/2021

Weisfeiler and Lehman Go Cellular: CW Networks

Graph Neural Networks (GNNs) are limited in their expressive power, stru...
06/06/2023

CIN++: Enhancing Topological Message Passing

Graph Neural Networks (GNNs) have demonstrated remarkable success in lea...
08/02/2023

Factor Graph Neural Networks

In recent years, we have witnessed a surge of Graph Neural Networks (GNN...
10/02/2020

Cell Complex Neural Networks

Cell complexes are topological spaces constructed from simple blocks cal...
07/18/2023

Learning Adaptive Neighborhoods for Graph Neural Networks

Graph convolutional networks (GCNs) enable end-to-end learning on graph ...
02/11/2020

Differentiable Graph Module (DGM) Graph Convolutional Networks

Graph deep learning has recently emerged as a powerful ML concept allowi...

Please sign up or login with your details

Forgot password? Click here to reset