Trees-Based Models for Correlated Data

02/16/2021
by   Assaf Rabinowicz, et al.
0

This paper presents a new approach for trees-based regression, such as simple regression tree, random forest and gradient boosting, in settings involving correlated data. We show the problems that arise when implementing standard trees-based regression models, which ignore the correlation structure. Our new approach explicitly takes the correlation structure into account in the splitting criterion, stopping rules and fitted values in the leaves, which induces some major modifications of standard methodology. The superiority of our new approach over trees-based models that do not account for the correlation is supported by simulation experiments and real data analyses.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/27/2021

Boost-S: Gradient Boosted Trees for Spatial Data and Its Application to FDG-PET Imaging Data

Boosting Trees are one of the most successful statistical learning appro...
research
04/12/2023

Neural Attention Forests: Transformer-Based Forest Improvement

A new approach called NAF (the Neural Attention Forest) for solving regr...
research
01/08/2022

Attention-based Random Forest and Contamination Model

A new approach called ABRF (the attention-based random forest) and its m...
research
08/13/2020

An information criterion for automatic gradient tree boosting

An information theoretic approach to learning the complexity of classifi...
research
05/18/2019

Gradient tree boosting with random output projections for multi-label classification and multi-output regression

In many applications of supervised learning, multiple classification or ...
research
07/19/2018

A Projection Pursuit Forest Algorithm for Supervised Classification

This paper presents a new ensemble learning method for classification pr...
research
11/02/2020

Learning from Non-Binary Constituency Trees via Tensor Decomposition

Processing sentence constituency trees in binarised form is a common and...

Please sign up or login with your details

Forgot password? Click here to reset