Contrast Trees and Distribution Boosting

12/08/2019
by   Jerome H. Friedman, et al.
0

Often machine learning methods are applied and results reported in cases where there is little to no information concerning accuracy of the output. Simply because a computer program returns a result does not insure its validity. If decisions are to be made based on such results it is important to have some notion of their veracity. Contrast trees represent a new approach for assessing the accuracy of many types of machine learning estimates that are not amenable to standard (cross) validation methods. In situations where inaccuracies are detected boosted contrast trees can often improve performance. A special case, distribution boosting, provides an assumption free method for estimating the full probability distribution of an outcome variable given any set of joint input predictor variable values.

READ FULL TEXT
research
06/19/2020

Gradient boosting machine with partially randomized decision trees

The gradient boosting machine is a powerful ensemble-based machine learn...
research
01/24/2022

Probability Distribution on Rooted Trees

The hierarchical and recursive expressive capability of rooted trees is ...
research
07/23/2021

Entropy, Derivation Operators and Huffman Trees

We build a theory of binary trees on finite multisets that categorifies,...
research
09/19/2018

Interpretable Reinforcement Learning with Ensemble Methods

We propose to use boosted regression trees as a way to compute human-int...
research
09/27/2021

Probability Distribution on Full Rooted Trees

The recursive and hierarchical structure of full rooted trees is applica...
research
12/08/2019

VAT tax gap prediction: a 2-steps Gradient Boosting approach

Tax evasion is the illegal non-payment of taxes by individuals, corporat...
research
07/03/2020

Team voyTECH: User Activity Modeling with Boosting Trees

This paper describes our winning solution for the ECML-PKDD ChAT Discove...

Please sign up or login with your details

Forgot password? Click here to reset