L_0 Isotonic Regression With Secondary Objectives

06/01/2021
by   Quentin F. Stout, et al.
0

We provide algorithms for isotonic regression minimizing L_0 error (Hamming distance). This is also known as monotonic relabeling, and is applicable when labels have a linear ordering but not necessarily a metric. There may be exponentially many optimal relabelings, so we look at secondary criteria to determine which are best. For arbitrary ordinal labels the criterion is maximizing the number of labels which are only changed to an adjacent label (and recursively apply this). For real-valued labels we minimize the L_p error. For linearly ordered sets we also give algorithms which minimize the sum of the L_p and weighted L_0 errors, a form of penalized (regularized) regression. We also examine L_0 isotonic regression on multidimensional coordinate-wise orderings. Previous algorithms took Θ(n^3) time, but we reduce this to o(n^3/2).

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/01/2021

L_p Isotonic Regression Algorithms Using an L_0 Approach

Significant advances in maximum flow algorithms have changed the relativ...
research
06/01/2023

Best L_p Isotonic Regressions, p ∈{0, 1, ∞}

Given a real-valued weighted function f on a finite dag, the L_p isotoni...
research
11/18/2020

Isoperimetric Inequalities for Real-Valued Functions with Applications to Monotonicity Testing

We generalize the celebrated isoperimetric inequality of Khot, Minzer, a...
research
05/12/2023

Reduced Label Complexity For Tight ℓ_2 Regression

Given data X∈ℝ^n× d and labels 𝐲∈ℝ^n the goal is find 𝐰∈ℝ^d to minimize ...
research
10/22/2012

Supervised Learning with Similarity Functions

We address the problem of general supervised learning when data can only...
research
06/09/2020

Accelerating the pool-adjacent-violators algorithm for isotonic distributional regression

In this note we describe in detail how to apply the pool-adjacent-violat...
research
05/19/2021

L1 Regression with Lewis Weights Subsampling

We consider the problem of finding an approximate solution to ℓ_1 regres...

Please sign up or login with your details

Forgot password? Click here to reset