Combining Gradient Boosting Machines with Collective Inference to Predict Continuous Values

07/01/2016
by   Iman Alodah, et al.
0

Gradient boosting of regression trees is a competitive procedure for learning predictive models of continuous data that fits the data with an additive non-parametric model. The classic version of gradient boosting assumes that the data is independent and identically distributed. However, relational data with interdependent, linked instances is now common and the dependencies in such data can be exploited to improve predictive performance. Collective inference is one approach to exploit relational correlation patterns and significantly reduce classification error. However, much of the work on collective learning and inference has focused on discrete prediction tasks rather than continuous. this work, we investigate how to combine these two paradigms together to improve regression in relational domains. Specifically, we propose a boosting algorithm for learning a collective inference model that predicts a continuous target variable. In the algorithm, we learn a basic relational model, collectively infer the target values, and then iteratively learn relational models to predict the residuals. We evaluate our proposed algorithm on a real network dataset and show that it outperforms alternative boosting methods. However, our investigation also revealed that the relational features interact together to produce better predictions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/25/2021

Relational Boosted Regression Trees

Many tasks use data housed in relational databases to train boosted regr...
research
01/18/2020

A Comparative Study of Social Network Classifiers for Predicting Churn in the Telecommunication Industry

Relational learning in networked data has been shown to be effective in ...
research
09/15/2016

Column Networks for Collective Classification

Relational learning deals with data that are characterized by relational...
research
02/28/2018

Collective Entity Disambiguation with Structured Gradient Tree Boosting

We present a gradient-tree-boosting-based structured learning model for ...
research
03/15/2012

Lifted Inference for Relational Continuous Models

Relational Continuous Models (RCMs) represent joint probability densitie...
research
01/18/2020

Social Network Analytics for Churn Prediction in Telco: Model Building, Evaluation and Network Architecture

Social network analytics methods are being used in the telecommunication...
research
02/09/2017

Graph Based Relational Features for Collective Classification

Statistical Relational Learning (SRL) methods have shown that classifica...

Please sign up or login with your details

Forgot password? Click here to reset