Group-invariant tensor train networks for supervised learning

06/30/2022
by   Brent Sprangers, et al.
0

Invariance has recently proven to be a powerful inductive bias in machine learning models. One such class of predictive or generative models are tensor networks. We introduce a new numerical algorithm to construct a basis of tensors that are invariant under the action of normal matrix representations of an arbitrary discrete group. This method can be up to several orders of magnitude faster than previous approaches. The group-invariant tensors are then combined into a group-invariant tensor train network, which can be used as a supervised machine learning model. We applied this model to a protein binding classification problem, taking into account problem-specific invariances, and obtained prediction accuracy in line with state-of-the-art deep learning approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/31/2021

UNiTE: Unitary N-body Tensor Equivariant Network with Applications to Quantum Chemistry

Equivariant neural networks have been successful in incorporating variou...
research
06/14/2023

TensorKrowch: Smooth integration of tensor networks in machine learning

Tensor networks are factorizations of high-dimensional tensors into netw...
research
02/27/2017

Tensor Balancing on Statistical Manifold

We solve tensor balancing, rescaling an Nth order nonnegative tensor by ...
research
02/04/2022

Group invariant machine learning by fundamental domain projections

We approach the well-studied problem of supervised group invariant and e...
research
11/08/2022

Non-existence of a short algorithm for multiplication of 3×3 matrices with group S_4× S_3, II

It is proved that there is no an algorithm for multiplication of 3×3 mat...
research
06/10/2023

TensorNet: Cartesian Tensor Representations for Efficient Learning of Molecular Potentials

The development of efficient machine learning models for molecular syste...
research
06/05/2019

Invariant Tensor Feature Coding

We propose a novel feature coding method that exploits invariance. We co...

Please sign up or login with your details

Forgot password? Click here to reset