Downsampling for Testing and Learning in Product Distributions

07/15/2020
by   Nathaniel Harms, et al.
0

We study the domain reduction problem of eliminating dependence on n from the complexity of property testing and learning algorithms on domain [n]^d, and the related problem of establishing testing and learning results for product distributions over ℝ^d. Our method, which we call downsampling, gives conceptually simple proofs for several results: 1. A 1-page proof of the recent o(d)-query monotonicity tester for the hypergrid (Black, Chakrabarty Seshadhri, SODA 2020), and an improvement from O(d^7) to O(d^4) in the sample complexity of their distribution-free monotonicity tester for product distributions over ℝ^d; 2. An ( O(kd))-time agnostic learning algorithm for functions of k convex sets in product distributions; 3. A polynomial-time agnostic learning algorithm for functions of a constant number of halfspaces in product distributions; 4. A polynomial-time agnostic learning algorithm for constant-degree polynomial threshold functions in product distributions; 5. An ( O(k √(d)))-time agnostic learning algorithm for k-alternating functions in product distributions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/13/2022

How Does Independence Help Generalization? Sample Complexity of ERM on Product Distributions

While many classical notions of learnability (e.g., PAC learnability) ar...
research
09/01/2022

Recurrent Convolutional Neural Networks Learn Succinct Learning Algorithms

Neural Networks (NNs) struggle to efficiently learn certain problems, su...
research
12/29/2020

Testing Product Distributions: A Closer Look

We study the problems of identity and closeness testing of n-dimensional...
research
05/28/2019

Private Identity Testing for High-Dimensional Distributions

In this work we present novel differentially private identity (goodness-...
research
02/10/2021

Agnostic Proper Learning of Halfspaces under Gaussian Marginals

We study the problem of agnostically learning halfspaces under the Gauss...
research
02/07/2022

Almost Optimal Proper Learning and Testing Polynomials

We give the first almost optimal polynomial-time proper learning algorit...
research
08/17/2023

Distribution-Free Proofs of Proximity

Motivated by the fact that input distributions are often unknown in adva...

Please sign up or login with your details

Forgot password? Click here to reset