A Unified Model and Dimension for Interactive Estimation

06/09/2023
by   Nataly Brukhim, et al.
0

We study an abstract framework for interactive learning called interactive estimation in which the goal is to estimate a target from its "similarity” to points queried by the learner. We introduce a combinatorial measure called dissimilarity dimension which largely captures learnability in our model. We present a simple, general, and broadly-applicable algorithm, for which we obtain both regret and PAC generalization bounds that are polynomial in the new dimension. We show that our framework subsumes and thereby unifies two classic learning models: statistical-query learning and structured bandits. We also delineate how the dissimilarity dimension is related to well-known parameters for both frameworks, in some cases yielding significantly improved analyses.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/28/2022

PAC Verification of Statistical Algorithms

Goldwasser et al. (2021) recently proposed the setting of PAC verificati...
research
07/07/2023

Optimal Learners for Realizable Regression: PAC Learning and Online Learning

In this work, we aim to characterize the statistical complexity of reali...
research
05/31/2023

Online-to-PAC Conversions: Generalization Bounds via Regret Analysis

We present a new framework for deriving bounds on the generalization bou...
research
04/14/2022

A Unified Analysis of Dynamic Interactive Learning

In this paper we investigate the problem of learning evolving concepts o...
research
02/08/2020

Towards a combinatorial characterization of bounded memory learning

Combinatorial dimensions play an important role in the theory of machine...
research
12/08/2017

Decomposing arrangements of hyperplanes: VC-dimension, combinatorial dimension, and point location

We re-examine parameters for the two main space decomposition technique...
research
09/23/2022

Unified Algorithms for RL with Decision-Estimation Coefficients: No-Regret, PAC, and Reward-Free Learning

Finding unified complexity measures and algorithms for sample-efficient ...

Please sign up or login with your details

Forgot password? Click here to reset