DeepAI AI Chat
Log In Sign Up

The passive symmetries of machine learning

01/31/2023
by   Soledad Villar, et al.
0

Any representation of data involves arbitrary investigator choices. Because those choices are external to the data-generating process, each choice leads to an exact symmetry, corresponding to the group of transformations that takes one possible representation to another. These are the passive symmetries; they include coordinate freedom, gauge symmetry and units covariance, all of which have led to important results in physics. Our goal is to understand the implications of passive symmetries for machine learning: Which passive symmetries play a role (e.g., permutation symmetry in graph neural networks)? What are dos and don'ts in machine learning practice? We assay conditions under which passive symmetries can be implemented as group equivariances. We also discuss links to causal modeling, and argue that the implementation of passive symmetries is particularly valuable when the goal of the learning problem is to generalize out of sample. While this paper is purely conceptual, we believe that it can have a significant impact on helping machine learning make the transition that took place for modern physics in the first half of the Twentieth century.

READ FULL TEXT

page 1

page 2

page 3

page 4

04/02/2022

Dimensionless machine learning: Imposing exact units equivariance

Units equivariance is the exact symmetry that follows from the requireme...
04/01/2023

Branch Identification in Passive Optical Networks using Machine Learning

A machine learning approach for improving monitoring in passive optical ...
11/16/2018

Symmetry constrained machine learning

Symmetry, a central concept in understanding the laws of nature, has bee...
03/23/2022

Passive Haptic Rehearsal for Accelerated Piano Skill Acquisition

Passive haptic learning (PHL) uses vibrotactile stimulation to train pia...
04/30/2019

Minimal model of permutation symmetry in unsupervised learning

Permutation of any two hidden units yields invariant properties in typic...
09/14/2021

Nonlinearities in Steerable SO(2)-Equivariant CNNs

Invariance under symmetry is an important problem in machine learning. O...
05/25/2023

Passive learning of active causal strategies in agents and language models

What can be learned about causality and experimentation from passive dat...