Memory-Efficient Global Refinement of Decision-Tree Ensembles and its Application to Face Alignment

02/27/2017
by   Nenad Markuš, et al.
0

Ren et al. recently introduced a method for aggregating multiple decision trees into a strong predictor by interpreting a path taken by a sample down each tree as a binary vector and performing linear regression on top of these vectors stacked together. They provided experimental evidence that the method offers advantages over the usual approaches for combining decision trees (random forests and boosting). The method truly shines when the regression target is a large vector with correlated dimensions, such as a 2D face shape represented with the positions of several facial landmarks. However, we argue that their basic method is not applicable in many practical scenarios due to large memory requirements. This paper shows how this issue can be solved through the use of quantization and architectural changes of the predictor that maps decision tree-derived encodings to the desired output.

READ FULL TEXT
research
06/01/2021

Decision Concept Lattice vs. Decision Trees and Random Forests

Decision trees and their ensembles are very popular models of supervised...
research
11/18/2017

Tree-Structured Boosting: Connections Between Gradient Boosted Stumps and Full Decision Trees

Additive models, such as produced by gradient boosting, and full interac...
research
01/10/2019

Efficient Bayesian Decision Tree Algorithm

Bayesian Decision Trees are known for their probabilistic interpretabili...
research
04/28/2021

Universal Consistency of Decision Trees in High Dimensions

This paper shows that decision trees constructed with Classification and...
research
03/29/2019

Online Multi-target regression trees with stacked leaf models

The amount of available data raises at large steps. Developing machine l...
research
09/18/2023

Des-q: a quantum algorithm to construct and efficiently retrain decision trees for regression and binary classification

Decision trees are widely used in machine learning due to their simplici...
research
08/09/2022

Global Evaluation for Decision Tree Learning

We transfer distances on clusterings to the building process of decision...

Please sign up or login with your details

Forgot password? Click here to reset