Active Labeling: Streaming Stochastic Gradients

05/26/2022
by   Vivien Cabannes, et al.
0

The workhorse of machine learning is stochastic gradient descent. To access stochastic gradients, it is common to consider iteratively input/output pairs of a training dataset. Interestingly, it appears that one does not need full supervision to access stochastic gradients, which is the main motivation of this paper. After formalizing the "active labeling" problem, which generalizes active learning based on partial supervision, we provide a streaming technique that provably minimizes the ratio of generalization error over number of samples. We illustrate our technique in depth for robust regression.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset