Representing Piecewise Linear Functions by Functions with Small Arity

05/26/2023
by   Christoph Koutschan, et al.
0

A piecewise linear function can be described in different forms: as an arbitrarily nested expression of min- and max-functions, as a difference of two convex piecewise linear functions, or as a linear combination of maxima of affine-linear functions. In this paper, we provide two main results: first, we show that for every piecewise linear function there exists a linear combination of max-functions with at most n+1 arguments, and give an algorithm for its computation. Moreover, these arguments are contained in the finite set of affine-linear functions that coincide with the given function in some open set. Second, we prove that the piecewise linear function max(0, x_1, …, x_n) cannot be represented as a linear combination of maxima of less than n+1 affine-linear arguments. This was conjectured by Wang and Sun in 2005 in a paper on representations of piecewise linear functions as linear combination of maxima.

READ FULL TEXT
research
07/05/2020

Piecewise Linear Regression via a Difference of Convex Functions

We present a new piecewise linear regression methodology that utilizes f...
research
03/21/2023

Sampling from a Gaussian distribution conditioned on the level set of a piecewise affine, continuous function

We consider how to use Hamiltonian Monte Carlo to sample from a distribu...
research
04/25/2018

Notes on stable learning with piecewise-linear basis functions

We discuss technical results on learning function approximations using p...
research
11/20/2021

SPINE: Soft Piecewise Interpretable Neural Equations

Relu Fully Connected Networks are ubiquitous but uninterpretable because...
research
10/22/2018

From Hard to Soft: Understanding Deep Network Nonlinearities via Vector Quantization and Statistical Inference

Nonlinearity is crucial to the performance of a deep (neural) network (D...
research
11/06/2020

Sparse Approximate Solutions to Max-Plus Equations with Application to Multivariate Convex Regression

In this work, we study the problem of finding approximate, with minimum ...
research
06/14/2022

Tailored max-out networks for learning convex PWQ functions

Convex piecewise quadratic (PWQ) functions frequently appear in control ...

Please sign up or login with your details

Forgot password? Click here to reset