Superpolynomial Lower Bounds for Learning Monotone Classes

01/20/2023
by   Nader H. Bshouty, et al.
0

Koch, Strassle, and Tan [SODA 2023], show that, under the randomized exponential time hypothesis, there is no distribution-free PAC-learning algorithm that runs in time n^Õ(loglog s) for the classes of n-variable size-s DNF, size-s Decision Tree, and log s-Junta by DNF (that returns a DNF hypothesis). Assuming a natural conjecture on the hardness of set cover, they give the lower bound n^Ω(log s). This matches the best known upper bound for n-variable size-s Decision Tree, and log s-Junta. In this paper, we give the same lower bounds for PAC-learning of n-variable size-s Monotone DNF, size-s Monotone Decision Tree, and Monotone log s-Junta by DNF. This solves the open problem proposed by Koch, Strassle, and Tan and subsumes the above results. The lower bound holds, even if the learner knows the distribution, can draw a sample according to the distribution in polynomial time, and can compute the target function on all the points of the support of the distribution in polynomial time.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/12/2022

Superpolynomial Lower Bounds for Decision Tree Learning and Testing

We establish new hardness results for decision tree optimization problem...
research
11/18/2019

Top-down induction of decision trees: rigorous guarantees and inherent limitations

Consider the following heuristic for building a decision tree for a func...
research
08/31/2022

Fine-Grained Distribution-Dependent Learning Curves

Learning curves plot the expected error of a learning algorithm as a fun...
research
12/07/2020

Monotone Circuit Lower Bounds from Robust Sunflowers

Robust sunflowers are a generalization of combinatorial sunflowers that ...
research
05/07/2023

Sampling and Certifying Symmetric Functions

A circuit 𝒞 samples a distribution 𝐗 with an error ϵ if the statistical ...
research
01/30/2018

Indistinguishable binomial decision tree of 3-SAT: Proof of class P is a proper subset of class NP

This paper solves a long standing open problem of whether NP-complete pr...
research
07/09/2023

Properly Learning Decision Trees with Queries Is NP-Hard

We prove that it is NP-hard to properly PAC learn decision trees with qu...

Please sign up or login with your details

Forgot password? Click here to reset