Time and space complexity of deterministic and nondeterministic decision trees

01/04/2022
by   Mikhail Moshkov, et al.
0

In this paper, we study arbitrary infinite binary information systems each of which consists of an infinite set called universe and an infinite set of two-valued functions (attributes) defined on the universe. We consider the notion of a problem over information system which is described by a finite number of attributes and a mapping corresponding a decision to each tuple of attribute values. As algorithms for problem solving, we use deterministic and nondeterministic decision trees. As time and space complexity, we study the depth and the number of nodes in the decision trees. In the worst case, with the growth of the number of attributes in the problem description, (i) the minimum depth of deterministic decision trees grows either almost as logarithm or linearly, (ii) the minimum depth of nondeterministic decision trees either is bounded from above by a constant or grows linearly, (iii) the minimum number of nodes in deterministic decision trees has either polynomial or exponential growth, and (iv) the minimum number of nodes in nondeterministic decision trees has either polynomial or exponential growth. Based on these results, we divide the set of all infinite binary information systems into five complexity classes, and study for each class issues related to time-space trade-off for decision trees.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/12/2022

Exact learning and test theory

In this paper, based on results of exact learning and test theory, we st...
research
07/13/2018

On Ternary Coding and Three-Valued Logic

Mathematically, ternary coding is more efficient than binary coding. It ...
research
01/13/2022

Exact learning for infinite families of concepts

In this paper, based on results of exact learning, test theory, and roug...
research
05/10/2023

Deterministic and Strongly Nondeterministic Decision Trees for Decision Tables from Closed Classes

In this paper, we consider classes of decision tables with 0-1-decisions...
research
10/18/2019

Proof complexity of systems of (non-deterministic) decision trees and branching programs

This paper studies propositional proof systems in which lines are sequen...
research
10/14/2020

Decision trees as partitioning machines to characterize their generalization properties

Decision trees are popular machine learning models that are simple to bu...
research
03/29/2021

One Network Fits All? Modular versus Monolithic Task Formulations in Neural Networks

Can deep learning solve multiple tasks simultaneously, even when they ar...

Please sign up or login with your details

Forgot password? Click here to reset