Smaller Low-Depth Circuits for Kronecker Powers

11/09/2022
by   Josh Alman, et al.
0

We give new, smaller constructions of constant-depth linear circuits for computing any matrix which is the Kronecker power of a fixed matrix. A standard argument (e.g., the mixed product property of Kronecker products, or a generalization of the Fast Walsh-Hadamard transform) shows that any such N × N matrix has a depth-2 circuit of size O(N^1.5). We improve on this for all such matrices, and especially for some such matrices of particular interest: - For any integer q > 1 and any matrix which is the Kronecker power of a fixed q × q matrix, we construct a depth-2 circuit of size O(N^1.5 - a_q), where a_q > 0 is a positive constant depending only on q. No bound beating size O(N^1.5) was previously known for any q>2. - For the case q=2, i.e., for any matrix which is the Kronecker power of a fixed 2 × 2 matrix, we construct a depth-2 circuit of size O(N^1.446), improving the prior best size O(N^1.493) [Alman, 2021]. - For the Walsh-Hadamard transform, we construct a depth-2 circuit of size O(N^1.443), improving the prior best size O(N^1.476) [Alman, 2021]. - For the disjointness matrix (the communication matrix of set disjointness, or equivalently, the matrix for the linear transform that evaluates a multilinear polynomial on all 0/1 inputs), we construct a depth-2 circuit of size O(N^1.258), improving the prior best size O(N^1.272) [Jukna and Sergeev, 2013]. Our constructions also generalize to improving the standard construction for any depth ≤ O(log N). Our main technical tool is an improved way to convert a nontrivial circuit for any matrix into a circuit for its Kronecker powers. Our new bounds provably could not be achieved using the approaches of prior work.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/24/2021

Kronecker Products, Low-Depth Circuits, and Matrix Rigidity

For a matrix M and a positive integer r, the rank r rigidity of M is the...
research
05/17/2022

On Algebraic Constructions of Neural Networks with Small Weights

Neural gates compute functions based on weighted sums of the input varia...
research
10/26/2017

Minimum Circuit Size, Graph Isomorphism, and Related Problems

We study the computational power of deciding whether a given truth-table...
research
04/07/2018

A Near-Optimal Depth-Hierarchy Theorem for Small-Depth Multilinear Circuits

We study the size blow-up that is necessary to convert an algebraic circ...
research
03/29/2020

A Polynomial Degree Bound on Defining Equations of Non-rigid Matrices and Small Linear Circuits

We show that there is a defining equation of degree at most 𝗉𝗈𝗅𝗒(n) for ...
research
03/09/2023

Range Avoidance for Constant-Depth Circuits: Hardness and Algorithms

Range Avoidance (AVOID) is a total search problem where, given a Boolean...
research
09/03/2021

Circuit Lower Bounds for the p-Spin Optimization Problem

We consider the problem of finding a near ground state of a p-spin model...

Please sign up or login with your details

Forgot password? Click here to reset