Generalized XGBoost Method

09/15/2021
by   Yang Guang, et al.
0

The XGBoost method has many advantages and is especially suitable for statistical analysis of big data, but its loss function is limited to convex functions. In many specific applications, a nonconvex loss function would be preferable. In this paper, we propose a generalized XGBoost method, which requires weaker loss function condition and involves more general loss functions, including convex loss functions and some non-convex loss functions. Furthermore, this generalized XGBoost method is extended to multivariate loss function to form a more generalized XGBoost method. This method is a multivariate regularized tree boosting method, which can model multiple parameters in most of the frequently-used parametric probability distributions to be fitted by predictor variables. Meanwhile, the related algorithms and some examples in non-life insurance pricing are given.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/11/2017

A More General Robust Loss Function

We present a two-parameter loss function which can be viewed as a genera...
research
11/30/2020

Persistent Reductions in Regularized Loss Minimization for Variable Selection

In the context of regularized loss minimization with polyhedral gauges, ...
research
12/30/2020

Risk Guarantees for End-to-End Prediction and Optimization Processes

Prediction models are often employed in estimating parameters of optimiz...
research
10/03/2013

Multivariate regression and fit function uncertainty

This article describes a multivariate polynomial regression method where...
research
10/24/2019

Structured Prediction with Projection Oracles

We propose in this paper a general framework for deriving loss functions...
research
06/06/2019

Toward a Characterization of Loss Functions for Distribution Learning

In this work we study loss functions for learning and evaluating probabi...
research
10/08/2016

Indirect Gaussian Graph Learning beyond Gaussianity

This paper studies how to capture dependency graph structures from real ...

Please sign up or login with your details

Forgot password? Click here to reset