Decision Concept Lattice vs. Decision Trees and Random Forests

06/01/2021
by   Egor Dudyrev, et al.
0

Decision trees and their ensembles are very popular models of supervised machine learning. In this paper we merge the ideas underlying decision trees, their ensembles and FCA by proposing a new supervised machine learning model which can be constructed in polynomial time and is applicable for both classification and regression problems. Specifically, we first propose a polynomial-time algorithm for constructing a part of the concept lattice that is based on a decision tree. Second, we describe a prediction scheme based on a concept lattice for solving both classification and regression tasks with prediction quality comparable to that of state-of-the-art models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/01/2021

Properly learning decision trees in almost polynomial time

We give an n^O(loglog n)-time membership query algorithm for properly an...
research
02/27/2017

Memory-Efficient Global Refinement of Decision-Tree Ensembles and its Application to Face Alignment

Ren et al. recently introduced a method for aggregating multiple decisio...
research
04/19/2021

The Impact of Hyper-Parameter Tuning for Landscape-Aware Performance Regression and Algorithm Selection

Automated algorithm selection and configuration methods that build on ex...
research
09/23/2018

Interaction Detection with Bayesian Decision Tree Ensembles

Methods based on Bayesian decision tree ensembles have proven valuable i...
research
10/13/2016

Bank Card Usage Prediction Exploiting Geolocation Information

We describe the solution of team ISMLL for the ECML-PKDD 2016 Discovery ...
research
03/03/2021

Combining Prediction and Interpretation in Decision Trees (PrInDT) – a Linguistic Example

In this paper, we show that conditional inference trees and ensembles ar...
research
09/16/2022

Linear TreeShap

Decision trees are well-known due to their ease of interpretability. To ...

Please sign up or login with your details

Forgot password? Click here to reset