Efficient Second-Order Shape-Constrained Function Fitting

05/06/2019
by   David Durfee, et al.
0

We give an algorithm to compute a one-dimensional shape-constrained function that best fits given data in weighted-L_∞ norm. We give a single algorithm that works for a variety of commonly studied shape constraints including monotonicity, Lipschitz-continuity and convexity, and more generally, any shape constraint expressible by bounds on first- and/or second-order differences. Our algorithm computes an approximation with additive error ε in O(n U/ε) time, where U captures the range of input values. We also give a simple greedy algorithm that runs in O(n) time for the special case of unweighted L_∞ convex regression. These are the first (near-)linear-time algorithms for second-order-constrained function fitting. To achieve these results, we use a novel geometric interpretation of the underlying dynamic programming problem. We further show that a generalization of the corresponding problems to directed acyclic graphs (DAGs) is as difficult as linear programming.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/26/2020

Efficient algorithms for multivariate shape-constrained convex regression problems

Shape-constrained convex regression problem deals with fitting a convex ...
research
07/26/2016

Uniform Approximation by Neural Networks Activated by First and Second Order Ridge Splines

We establish sup-norm error bounds for functions that are approximated b...
research
04/08/2020

Shape-Constrained Regression using Sum of Squares Polynomials

We consider the problem of fitting a polynomial to a set of data points,...
research
05/26/2020

Hard Shape-Constrained Kernel Machines

Shape constraints (such as non-negativity, monotonicity, convexity) play...
research
09/09/2018

Fitting a Graph to One-Dimensional Data

Given n data points in R^d, an appropriate edge-weighted graph connectin...
research
11/06/2020

A dynamic programming approach for generalized nearly isotonic optimization

Shape restricted statistical estimation problems have been extensively s...
research
10/02/2018

A flexible sequential Monte Carlo algorithm for shape-constrained regression

We propose an algorithm that is capable of imposing shape constraints on...

Please sign up or login with your details

Forgot password? Click here to reset