Partition-wise Linear Models

10/31/2014
by   Hidekazu Oiwa, et al.
0

Region-specific linear models are widely used in practical applications because of their non-linear but highly interpretable model representations. One of the key challenges in their use is non-convexity in simultaneous optimization of regions and region-specific models. This paper proposes novel convex region-specific linear models, which we refer to as partition-wise linear models. Our key ideas are 1) assigning linear models not to regions but to partitions (region-specifiers) and representing region-specific linear models by linear combinations of partition-specific models, and 2) optimizing regions via partition selection from a large number of given partition candidates by means of convex structured regularizations. In addition to providing initialization-free globally-optimal solutions, our convex formulation makes it possible to derive a generalization bound and to use such advanced optimization techniques as proximal methods and decomposition of the proximal maps for sparsity-inducing regularizations. Experimental results demonstrate that our partition-wise linear models perform better than or are at least competitive with state-of-the-art region-specific or locally linear models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/07/2017

Distributed Bayesian Piecewise Sparse Linear Models

The importance of interpretability of machine learning models has been i...
research
03/15/2012

On a Class of Bias-Amplifying Variables that Endanger Effect Estimates

This note deals with a class of variables that, if conditioned on, tends...
research
07/08/2020

Non-parametric Models for Non-negative Functions

Linear models have shown great effectiveness and flexibility in many fie...
research
06/01/2018

Locally D-optimal Designs for Non-linear Models on the k-dimensional Ball

In this paper we construct (locally) D-optimal designs for a wide class ...
research
08/29/2013

Universal Approximation Using Shuffled Linear Models

This paper proposes a specific type of Local Linear Model, the Shuffled ...
research
07/23/2020

Hierarchical Verification for Adversarial Robustness

We introduce a new framework for the exact point-wise ℓ_p robustness ver...
research
05/23/2016

Stochastic Patching Process

Stochastic partition models tailor a product space into a number of rect...

Please sign up or login with your details

Forgot password? Click here to reset