Soft (Gaussian CDE) regression models and loss functions

11/05/2012
by   Jose Hernandez-Orallo, et al.
0

Regression, unlike classification, has lacked a comprehensive and effective approach to deal with cost-sensitive problems by the reuse (and not a re-training) of general regression models. In this paper, a wide variety of cost-sensitive problems in regression (such as bids, asymmetric losses and rejection rules) can be solved effectively by a lightweight but powerful approach, consisting of: (1) the conversion of any traditional one-parameter crisp regression model into a two-parameter soft regression model, seen as a normal conditional density estimator, by the use of newly-introduced enrichment methods; and (2) the reframing of an enriched soft regression model to new contexts by an instance-dependent optimisation of the expected loss derived from the conditional normal distribution.

READ FULL TEXT

page 19

page 24

research
03/30/2023

A Note On Nonlinear Regression Under L2 Loss

We investigate the nonlinear regression problem under L2 loss (square lo...
research
11/06/2018

Strong consistency of kernel estimator in a semiparametric regression model

Estimating the effective dimension reduction (EDR) space, related to the...
research
09/23/2019

On the Whittle estimator for linear random noise spectral density parameter in continuous-time nonlinear regression models

A continuous-time nonlinear regression model with Lévy-driven linear noi...
research
05/02/2021

Asymptotic properties in the Probit-Zero-inflated Binomial regression model

Zero-inflated regression models have had wide application recently and h...
research
07/18/2019

Minimizing the expected value of the asymmetric loss and an inequality of the variance of the loss

For some estimations and predictions, we solve minimization problems wit...
research
07/03/2018

Coopetitive Soft Gating Ensemble

In this article, we proposed the Coopetititve Soft Gating Ensemble or CS...
research
05/27/2021

Quantile Encoder: Tackling High Cardinality Categorical Features in Regression Problems

Regression problems have been widely studied in machinelearning literatu...

Please sign up or login with your details

Forgot password? Click here to reset