Distributed Decision Trees

12/19/2014
by   Ozan Irsoy, et al.
0

Recently proposed budding tree is a decision tree algorithm in which every node is part internal node and part leaf. This allows representing every decision tree in a continuous parameter space, and therefore a budding tree can be jointly trained with backpropagation, like a neural network. Even though this continuity allows it to be used in hierarchical representation learning, the learned representations are local: Activation makes a soft selection among all root-to-leaf paths in a tree. In this work we extend the budding tree and propose the distributed tree where the children use different and independent splits and hence multiple paths in a tree can be traversed at the same time. This ability to combine multiple paths gives the power of a distributed representation, as in a traditional perceptron layer. We show that distributed trees perform comparably or better than budding and traditional hard trees on classification and regression tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/27/2021

Decision Machines: Interpreting Decision Tree as a Model Combination Method

Based on decision trees, it is efficient to handle tabular data. Convent...
research
09/26/2014

Autoencoder Trees

We discuss an autoencoder model in which the encoding and decoding funct...
research
02/23/2017

Neural Decision Trees

In this paper we propose a synergistic melting of neural networks and de...
research
05/11/2022

Subspace Learning Machine (SLM): Methodology and Performance

Inspired by the feedforward multilayer perceptron (FF-MLP), decision tre...
research
09/03/2019

Illuminated Decision Trees with Lucid

The Lucid methods described by Olah et al. (2018) provide a way to inspe...
research
07/04/2022

Discrete Tree Flows via Tree-Structured Permutations

While normalizing flows for continuous data have been extensively resear...
research
12/03/2018

Deep Hierarchical Machine: a Flexible Divide-and-Conquer Architecture

We propose Deep Hierarchical Machine (DHM), a model inspired from the di...

Please sign up or login with your details

Forgot password? Click here to reset