Big Data Regression Using Tree Based Segmentation

07/24/2017
by   Rajiv Sambasivan, et al.
0

Scaling regression to large datasets is a common problem in many application areas. We propose a two step approach to scaling regression to large datasets. Using a regression tree (CART) to segment the large dataset constitutes the first step of this approach. The second step of this approach is to develop a suitable regression model for each segment. Since segment sizes are not very large, we have the ability to apply sophisticated regression techniques if required. A nice feature of this two step approach is that it can yield models that have good explanatory power as well as good predictive performance. Ensemble methods like Gradient Boosted Trees can offer excellent predictive performance but may not provide interpretable models. In the experiments reported in this study, we found that the predictive performance of the proposed approach matched the predictive performance of Gradient Boosted Trees.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/17/2016

GENESIM: genetic extraction of a single, interpretable model

Models obtained by decision tree induction techniques excel in being int...
research
11/23/2017

Grabit: Gradient Tree Boosted Tobit Models for Default Prediction

We introduce a novel model which is obtained by applying gradient tree b...
research
03/14/2023

Hall effect thruster design via deep neural network for additive manufacturing

Hall effect thrusters are one of the most versatile and popular electric...
research
06/10/2020

Hybrid Tree-based Models for Insurance Claims

Two-part models and Tweedie generalized linear models (GLMs) have been u...
research
06/15/2019

Linear Aggregation in Tree-based Estimators

Regression trees and their ensemble methods are popular methods for non-...
research
11/17/2021

Sampling To Improve Predictions For Underrepresented Observations In Imbalanced Data

Data imbalance is common in production data, where controlled production...
research
10/21/2020

ASCII: ASsisted Classification with Ignorance Interchange

The rapid development in data collecting devices and computation platfor...

Please sign up or login with your details

Forgot password? Click here to reset