A Practical Method for Constructing Equivariant Multilayer Perceptrons for Arbitrary Matrix Groups

04/19/2021
by   Marc Finzi, et al.
0

Symmetries and equivariance are fundamental to the generalization of neural networks on domains such as images, graphs, and point clouds. Existing work has primarily focused on a small number of groups, such as the translation, rotation, and permutation groups. In this work we provide a completely general algorithm for solving for the equivariant layers of matrix groups. In addition to recovering solutions from other works as special cases, we construct multilayer perceptrons equivariant to multiple groups that have never been tackled before, including O(1,3), O(5), Sp(n), and the Rubik's cube group. Our approach outperforms non-equivariant baselines, with applications to particle physics and dynamical systems. We release our software library to enable researchers to construct equivariant layers for arbitrary matrix groups.

READ FULL TEXT

page 1

page 5

research
03/13/2017

Orbital Graphs

We introduce orbital graphs and discuss some of their basic properties. ...
research
12/20/2020

LieTransformer: Equivariant self-attention for Lie Groups

Group equivariant neural networks are used as building blocks of group i...
research
05/31/2023

A General Framework for Equivariant Neural Networks on Reductive Lie Groups

Reductive Lie Groups, such as the orthogonal groups, the Lorentz group, ...
research
02/25/2020

Generalizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary Continuous Data

The translation equivariance of convolutional layers enables convolution...
research
05/02/2022

Design equivariant neural networks for 3D point cloud

This work seeks to improve the generalization and robustness of existing...
research
02/04/2021

A formalization of Dedekind domains and class groups of global fields

Dedekind domains and their class groups are notions in commutative algeb...
research
08/17/2020

Lazy caterer jigsaw puzzles: Models, properties, and a mechanical system-based solver

Jigsaw puzzle solving, the problem of constructing a coherent whole from...

Please sign up or login with your details

Forgot password? Click here to reset