Equivariant Hypergraph Neural Networks

08/22/2022
by   Jinwoo Kim, et al.
18

Many problems in computer vision and machine learning can be cast as learning on hypergraphs that represent higher-order relations. Recent approaches for hypergraph learning extend graph neural networks based on message passing, which is simple yet fundamentally limited in modeling long-range dependencies and expressive power. On the other hand, tensor-based equivariant neural networks enjoy maximal expressiveness, but their application has been limited in hypergraphs due to heavy computation and strict assumptions on fixed-order hyperedges. We resolve these problems and present Equivariant Hypergraph Neural Network (EHNN), the first attempt to realize maximally expressive equivariant layers for general hypergraph learning. We also present two practical realizations of our framework based on hypernetworks (EHNN-MLP) and self-attention (EHNN-Transformer), which are easy to implement and theoretically more expressive than most message passing approaches. We demonstrate their capability in a range of hypergraph learning problems, including synthetic k-edge identification, semi-supervised classification, and visual keypoint matching, and report improved performances over strong message passing baselines. Our implementation is available at https://github.com/jw9730/ehnn.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/03/2021

UniGNN: a Unified Framework for Graph and Hypergraph Neural Networks

Hypergraph, an expressive structure with flexibility to model the higher...
research
12/30/2022

Node-Element Hypergraph Message Passing for Fluid Dynamics Simulations

A recent trend in deep learning research features the application of gra...
research
01/28/2022

HEAT: Hyperedge Attention Networks

Learning from structured data is a core machine learning task. Commonly,...
research
01/31/2022

Weisfeiler and Leman Go Infinite: Spectral and Combinatorial Pre-Colorings

Graph isomorphism testing is usually approached via the comparison of gr...
research
03/31/2022

Message Passing Neural Networks for Hypergraphs

Hypergraph representations are both more efficient and better suited to ...
research
11/06/2018

Fast OBDD Reordering using Neural Message Passing on Hypergraph

Ordered binary decision diagrams (OBDDs) are an efficient data structure...
research
03/28/2022

Equivariant Point Cloud Analysis via Learning Orientations for Message Passing

Equivariance has been a long-standing concern in various fields ranging ...

Please sign up or login with your details

Forgot password? Click here to reset