On the CVP for the root lattices via folding with deep ReLU neural networks

02/06/2019
by   Vincent Corlay, et al.
0

Point lattices and their decoding via neural networks are considered in this paper. Lattice decoding in Rn, known as the closest vector problem (CVP), becomes a classification problem in the fundamental parallelotope with a piecewise linear function defining the boundary. Theoretical results are obtained by studying root lattices. We show how the number of pieces in the boundary function reduces dramatically with folding, from exponential to linear. This translates into a two-layer ReLU network requiring a number of neurons growing exponentially in n to solve the CVP, whereas this complexity becomes polynomial in n for a deep ReLU network.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/13/2020

Neural network approaches to point lattice decoding

We characterize the complexity of the lattice decoding problem from a ne...
research
05/16/2023

Deep ReLU Networks Have Surprisingly Simple Polytopes

A ReLU network is a piecewise linear function over polytopes. Figuring o...
research
02/28/2019

A lattice-based approach to the expressivity of deep ReLU neural networks

We present new families of continuous piecewise linear (CPWL) functions ...
research
03/20/2023

Memorization Capacity of Neural Networks with Conditional Computation

Many empirical studies have demonstrated the performance benefits of con...
research
07/17/2022

Nonparametric regression with modified ReLU networks

We consider regression estimation with modified ReLU neural networks in ...
research
06/12/2019

Decoupling Gating from Linearity

ReLU neural-networks have been in the focus of many recent theoretical w...
research
05/09/2023

SkelEx and BoundEx: Natural Visualization of ReLU Neural Networks

Despite their limited interpretability, weights and biases are still the...

Please sign up or login with your details

Forgot password? Click here to reset