Generative Adversarial Symmetry Discovery

02/01/2023
by   Jianke Yang, et al.
0

Despite the success of equivariant neural networks in scientific applications, they require knowing the symmetry group a priori. However, it may be difficult to know the right symmetry to use as an inductive bias in practice and enforcing the wrong symmetry could hurt the performance. In this paper, we propose a framework, LieGAN, to automatically discover equivariances from a dataset using a paradigm akin to generative adversarial training. Specifically, a generator learns a group of transformations applied to the data, which preserves the original distribution and fools the discriminator. LieGAN represents symmetry as interpretable Lie algebra basis and can discover various symmetries such as rotation group SO(n) and restricted Lorentz group SO(1,3)^+ in trajectory prediction and top quark tagging tasks. The learned symmetry can also be readily used in several existing equivariant neural networks to improve accuracy and generalization in prediction.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/04/2023

Learning Lie Group Symmetry Transformations with Neural Networks

The problem of detecting and quantifying the presence of symmetries in d...
research
11/16/2022

The Surprising Effectiveness of Equivariant Models in Domains with Latent Symmetry

Extensive work has demonstrated that equivariant neural networks can sig...
research
11/11/2022

Equivariance with Learned Canonicalization Functions

Symmetry-based neural networks often constrain the architecture in order...
research
05/27/2023

Approximation-Generalization Trade-offs under (Approximate) Group Equivariance

The explicit incorporation of task-specific inductive biases through sym...
research
10/22/2020

Learning Invariances in Neural Networks

Invariances to translations have imbued convolutional neural networks wi...
research
02/21/2023

On discrete symmetries of robotics systems: A group-theoretic and data-driven analysis

In this work, we study discrete morphological symmetries of dynamical sy...
research
05/28/2021

Symmetry-driven graph neural networks

Exploiting symmetries and invariance in data is a powerful, yet not full...

Please sign up or login with your details

Forgot password? Click here to reset