Distribution-Independent PAC Learning of Halfspaces with Massart Noise

06/24/2019
by   Ilias Diakonikolas, et al.
0

We study the problem of distribution-independent PAC learning of halfspaces in the presence of Massart noise. Specifically, we are given a set of labeled examples (x, y) drawn from a distribution D on R^d+1 such that the marginal distribution on the unlabeled points x is arbitrary and the labels y are generated by an unknown halfspace corrupted with Massart noise at noise rate η<1/2. The goal is to find a hypothesis h that minimizes the misclassification error Pr_(x, y) ∼D[ h(x) ≠ y ]. We give a poly(d, 1/ϵ) time algorithm for this problem with misclassification error η+ϵ. We also provide evidence that improving on the error guarantee of our algorithm might be computationally hard. Prior to our work, no efficient weak (distribution-independent) learner was known in this model, even for the class of disjunctions. The existence of such an algorithm for halfspaces (or even disjunctions) has been posed as an open question in various works, starting with Sloan (1988), Cohen (1997), and was most recently highlighted in Avrim Blum's FOCS 2003 tutorial.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/17/2020

Hardness of Learning Halfspaces with Massart Noise

We study the complexity of PAC learning halfspaces in the presence of Ma...
research
02/12/2019

Crowdsourced PAC Learning under Classification Noise

In this paper, we analyze PAC learnability from labels produced by crowd...
research
06/14/2021

Boosting in the Presence of Massart Noise

We study the problem of boosting the accuracy of a weak learner in the (...
research
06/01/2023

Attribute-Efficient PAC Learning of Low-Degree Polynomial Threshold Functions with Nasty Noise

The concept class of low-degree polynomial threshold functions (PTFs) pl...
research
11/01/2017

Active Tolerant Testing

In this work, we give the first algorithms for tolerant testing of nontr...
research
02/13/2023

Do PAC-Learners Learn the Marginal Distribution?

We study a foundational variant of Valiant and Vapnik and Chervonenkis' ...
research
03/16/2023

The existence of the least favorable noise

Suppose that a random variable X of interest is observed. This paper con...

Please sign up or login with your details

Forgot password? Click here to reset