Symmetry Breaking in Symmetric Tensor Decomposition

03/10/2021
by   Yossi Arjevani, et al.
12

In this note, we consider the optimization problem associated with computing the rank decomposition of a symmetric tensor. We show that, in a well-defined sense, minima in this highly nonconvex optimization problem break the symmetry of the target tensor – but not too much. This phenomenon of symmetry breaking applies to various choices of tensor norms, and makes it possible to study the optimization landscape using a set of recently-developed symmetry-based analytical tools. The fact that the objective function under consideration is a multivariate polynomial allows us to apply symbolic methods from computational algebra to obtain more refined information on the symmetry breaking phenomenon.

READ FULL TEXT

page 2

page 9

page 11

research
06/13/2023

Symmetry Critical Points for Symmetric Tensor Decomposition Problems

We consider the non-convex optimization problem associated with the deco...
research
04/18/2023

A Study of Neural Collapse Phenomenon: Grassmannian Frame, Symmetry, Generalization

In this paper, we extends original Neural Collapse Phenomenon by proving...
research
09/06/2023

A Unified Framework for Discovering Discrete Symmetries

We consider the problem of learning a function respecting a symmetry fro...
research
07/06/2021

Equivariant bifurcation, quadratic equivariants, and symmetry breaking for the standard representation of S_n

Motivated by questions originating from the study of a class of shallow ...
research
07/14/2020

From Symmetry to Geometry: Tractable Nonconvex Problems

As science and engineering have become increasingly data-driven, the rol...

Please sign up or login with your details

Forgot password? Click here to reset