An Approach to Evaluating Learning Algorithms for Decision Trees

10/26/2020
by   Tianqi Xiao, et al.
0

Learning algorithms produce software models for realising critical classification tasks. Decision trees models are simpler than other models such as neural network and they are used in various critical domains such as the medical and the aeronautics. Low or unknown learning ability algorithms does not permit us to trust the produced software models, which lead to costly test activities for validating the models and to the waste of learning time in case the models are likely to be faulty due to the learning inability. Methods for evaluating the decision trees learning ability, as well as that for the other models, are needed especially since the testing of the learned models is still a hot topic. We propose a novel oracle-centered approach to evaluate (the learning ability of) learning algorithms for decision trees. It consists of generating data from reference trees playing the role of oracles, producing learned trees with existing learning algorithms, and determining the degree of correctness (DOE) of the learned trees by comparing them with the oracles. The average DOE is used to estimate the quality of the learning algorithm. the We assess five decision tree learning algorithms based on the proposed approach.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/12/2020

dtControl: Decision Tree Learning Algorithms for Controller Representation

Decision tree learning is a popular classification technique most common...
10/25/2021

QuantifyML: How Good is my Machine Learning Model?

The efficacy of machine learning models is typically determined by compu...
10/19/2017

Decision Trees for Helpdesk Advisor Graphs

We use decision trees to build a helpdesk agent reference network to fac...
09/17/2021

Decision Tree Learning with Spatial Modal Logics

Symbolic learning represents the most straightforward approach to interp...
06/20/2020

Model family selection for classification using Neural Decision Trees

Model selection consists in comparing several candidate models according...
10/13/2021

Sub-Setting Algorithm for Training Data Selection in Pattern Recognition

Modern pattern recognition tasks use complex algorithms that take advant...
06/01/2021

Automated Grading of Anatomical Objective Structured Practical Exams Using Decision Trees

An Objective Structured Practical Examination (OSPE) is an effective and...