Efficient Testable Learning of Halfspaces with Adversarial Label Noise

03/09/2023
by   Ilias Diakonikolas, et al.
0

We give the first polynomial-time algorithm for the testable learning of halfspaces in the presence of adversarial label noise under the Gaussian distribution. In the recently introduced testable learning model, one is required to produce a tester-learner such that if the data passes the tester, then one can trust the output of the robust learner on the data. Our tester-learner runs in time (d/) and outputs a halfspace with misclassification error O()+, where is the 0-1 error of the best fitting halfspace. At a technical level, our algorithm employs an iterative soft localization technique enhanced with appropriate testers to ensure that the data distribution is sufficiently similar to a Gaussian.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/28/2023

An Efficient Tester-Learner for Halfspaces

We give the first efficient algorithm for learning halfspaces in the tes...
research
07/28/2022

Cryptographic Hardness of Learning Halfspaces with Massart Noise

We study the complexity of PAC learning halfspaces in the presence of Ma...
research
07/08/2022

A law of adversarial risk, interpolation, and label noise

In supervised learning, it has been shown that label noise in the data c...
research
10/04/2020

A Polynomial Time Algorithm for Learning Halfspaces with Tsybakov Noise

We study the problem of PAC learning homogeneous halfspaces in the prese...
research
04/14/2022

Testing distributional assumptions of learning algorithms

There are many important high dimensional function classes that have fas...
research
12/06/2022

A Strongly Polynomial Algorithm for Approximate Forster Transforms and its Application to Halfspace Learning

The Forster transform is a method of regularizing a dataset by placing i...
research
06/22/2023

Adversarial Resilience in Sequential Prediction via Abstention

We study the problem of sequential prediction in the stochastic setting ...

Please sign up or login with your details

Forgot password? Click here to reset