Extreme Gradient Boosted Multi-label Trees for Dynamic Classifier Chains

by   Bohlender, et al.

Classifier chains is a key technique in multi-label classification, since it allows to consider label dependencies effectively. However, the classifiers are aligned according to a static order of the labels. In the concept of dynamic classifier chains (DCC) the label ordering is chosen for each prediction dynamically depending on the respective instance at hand. We combine this concept with the boosting of extreme gradient boosted trees (XGBoost), an effective and scalable state-of-the-art technique, and incorporate DCC in a fast multi-label extension of XGBoost which we make publicly available. As only positive labels have to be predicted and these are usually only few, the training costs can be further substantially reduced. Moreover, as experiments on eleven datasets show, the length of the chain allows for a more control over the usage of previous predictions and hence over the measure one want to optimize.



page 12


Tree-Based Dynamic Classifier Chains

Classifier chains are an effective technique for modeling label dependen...

Speeding-up One-vs-All Training for Extreme Classification via Smart Initialization

In this paper we show that a simple, data dependent way of setting the i...

Dynamic classifier chains for multi-label learning

In this paper, we deal with the task of building a dynamic ensemble of c...

Asymptotic consistency and order specification for logistic classifier chains in multi-label learning

Classifier chains are popular and effective method to tackle a multi-lab...

Classifier Chains: A Review and Perspectives

The family of methods collectively known as classifier chains has become...

Bayesian Network Based Label Correlation Analysis For Multi-label Classifier Chain

Classifier chain (CC) is a multi-label learning approach that constructs...

Efficient Monte Carlo Methods for Multi-Dimensional Learning with Classifier Chains

Multi-dimensional classification (MDC) is the supervised learning proble...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.