Stability and Generalization of Hypergraph Collaborative Networks

08/04/2023
by   Michael Ng, et al.
0

Graph neural networks have been shown to be very effective in utilizing pairwise relationships across samples. Recently, there have been several successful proposals to generalize graph neural networks to hypergraph neural networks to exploit more complex relationships. In particular, the hypergraph collaborative networks yield superior results compared to other hypergraph neural networks for various semi-supervised learning tasks. The collaborative network can provide high quality vertex embeddings and hyperedge embeddings together by formulating them as a joint optimization problem and by using their consistency in reconstructing the given hypergraph. In this paper, we aim to establish the algorithmic stability of the core layer of the collaborative network and provide generalization guarantees. The analysis sheds light on the design of hypergraph filters in collaborative networks, for instance, how the data and hypergraph filters should be scaled to achieve uniform stability of the learning process. Some experimental results on real-world datasets are presented to illustrate the theory.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/23/2019

Hypergraph Convolution and Hypergraph Attention

Recently, graph neural networks have attracted great attention and achie...
research
03/09/2023

On the Expressiveness and Generalization of Hypergraph Neural Networks

This extended abstract describes a framework for analyzing the expressiv...
research
05/03/2019

Stability and Generalization of Graph Convolutional Neural Networks

Inspired by convolutional neural networks on 1D and 2D data, graph convo...
research
09/07/2018

HyperGCN: Hypergraph Convolutional Networks for Semi-Supervised Classification

Graph-based semi-supervised learning (SSL) is an important learning prob...
research
02/03/2021

Noise-robust classification with hypergraph neural network

This paper presents a novel version of the hypergraph neural network met...
research
07/21/2023

Formal Concept Lattice Representations and Algorithms for Hypergraphs

There is increasing focus on analyzing data represented as hypergraphs, ...
research
03/27/2021

A nonlinear diffusion method for semi-supervised learning on hypergraphs

Hypergraphs are a common model for multiway relationships in data, and h...

Please sign up or login with your details

Forgot password? Click here to reset