DeepAI AI Chat
Log In Sign Up

Learning to Robustly Aggregate Labeling Functions for Semi-supervised Data Programming

by   Ayush Maheshwari, et al.
IIT Bombay
The University of Texas at Dallas

A critical bottleneck in supervised machine learning is the need for large amounts of labeled data which is expensive and time consuming to obtain. However, it has been shown that a small amount of labeled data, while insufficient to re-train a model, can be effectively used to generate human-interpretable labeling functions (LFs). These LFs, in turn, have been used to generate a large amount of additional noisy labeled data, in a paradigm that is now commonly referred to as data programming. However, previous approaches to automatically generate LFs make no attempt to further use the given labeled data for model training, thus giving up opportunities for improved performance. Moreover, since the LFs are generated from a relatively small labeled dataset, they are prone to being noisy, and naively aggregating these LFs can lead to very poor performance in practice. In this work, we propose an LF based reweighting framework to solve these two critical limitations. Our algorithm learns a joint model on the (same) labeled dataset used for LF induction along with any unlabeled data in a semi-supervised manner, and more critically, reweighs each LF according to its goodness, influencing its contribution to the semi-supervised loss using a robust bi-level optimization algorithm. We show that our algorithm significantly outperforms prior approaches on several text classification datasets.


Semi-supervised Learning with Robust Loss in Brain Segmentation

In this work, we used a semi-supervised learning method to train deep le...

Persistent Laplacian-enhanced Algorithm for Scarcely Labeled Data Classification

The success of many machine learning (ML) methods depends crucially on h...

SPEAR : Semi-supervised Data Programming in Python

We present SPEAR, an open-source python library for data programming wit...

Textual Membership Queries

Human labeling of textual data can be very time-consuming and expensive,...

Good Data from Bad Models : Foundations of Threshold-based Auto-labeling

Creating large-scale high-quality labeled datasets is a major bottleneck...

Productive Crop Field Detection: A New Dataset and Deep Learning Benchmark Results

In precision agriculture, detecting productive crop fields is an essenti...