The Polynomial Method is Universal for Distribution-Free Correlational SQ Learning

10/22/2020
by   Aravind Gollakota, et al.
0

We consider the problem of distribution-free learning for Boolean function classes in the PAC and agnostic models. Generalizing a recent beautiful work of Malach and Shalev-Shwartz (2020) who gave the first tight correlational SQ (CSQ) lower bounds for learning DNF formulas, we show that lower bounds on the threshold or approximate degree of any function class directly imply CSQ lower bounds for PAC or agnostic learning respectively. These match corresponding positive results using upper bounds on the threshold or approximate degree in the SQ model for PAC or agnostic learning. Many of these results were implicit in earlier works of Feldman and Sherstov.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/08/2021

The Optimality of Polynomial Regression for Agnostic Learning under Gaussian Marginals

We study the problem of agnostic learning under the Gaussian distributio...
research
08/29/2011

Learning Valuation Functions

In this paper we study the approximate learnability of valuations common...
research
09/20/2021

Abelian Repetition Threshold Revisited

Abelian repetition threshold ART(k) is the number separating fractional ...
research
12/07/2020

VC Dimension and Distribution-Free Sample-Based Testing

We consider the problem of determining which classes of functions can be...
research
03/08/2023

Agnostic PAC Learning of k-juntas Using L2-Polynomial Regression

Many conventional learning algorithms rely on loss functions other than ...
research
09/01/2012

Learning implicitly in reasoning in PAC-Semantics

We consider the problem of answering queries about formulas of propositi...
research
02/11/2021

On Agnostic PAC Learning using ℒ_2-polynomial Regression and Fourier-based Algorithms

We develop a framework using Hilbert spaces as a proxy to analyze PAC le...

Please sign up or login with your details

Forgot password? Click here to reset