Online Active Regression

07/13/2022
by   Cheng Chen, et al.
0

Active regression considers a linear regression problem where the learner receives a large number of data points but can only observe a small number of labels. Since online algorithms can deal with incremental training data and take advantage of low computational cost, we consider an online extension of the active regression problem: the learner receives data points one by one and immediately decides whether it should collect the corresponding labels. The goal is to efficiently maintain the regression of received data points with a small budget of label queries. We propose novel algorithms for this problem under ℓ_p loss where p∈[1,2]. To achieve a (1+ϵ)-approximate solution, our proposed algorithms only require 𝒪̃(ϵ^-1 d log(nκ)) queries of labels, where n is the number of data points and κ is a quantity, called the condition number, of the data points. The numerical results verify our theoretical results and show that our methods have comparable performance with offline active regression algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/15/2021

How to distribute data across tasks for meta-learning?

Meta-learning models transfer the knowledge acquired from previous tasks...
research
05/19/2021

L1 Regression with Lewis Weights Subsampling

We consider the problem of finding an approximate solution to ℓ_1 regres...
research
06/11/2021

Twin Neural Network Regression is a Semi-Supervised Regression Algorithm

Twin neural network regression (TNNR) is a semi-supervised regression al...
research
02/16/2017

RIPML: A Restricted Isometry Property based Approach to Multilabel Learning

The multilabel learning problem with large number of labels, features, a...
research
05/12/2023

Reduced Label Complexity For Tight ℓ_2 Regression

Given data X∈ℝ^n× d and labels 𝐲∈ℝ^n the goal is find 𝐰∈ℝ^d to minimize ...
research
04/30/2017

Scaling Active Search using Linear Similarity Functions

Active Search has become an increasingly useful tool in information retr...
research
02/29/2020

Optimal Feature Manipulation Attacks Against Linear Regression

In this paper, we investigate how to manipulate the coefficients obtaine...

Please sign up or login with your details

Forgot password? Click here to reset