Incidental Supervision: Moving beyond Supervised Learning

05/25/2020
by   Dan Roth, et al.
10

Machine Learning and Inference methods have become ubiquitous in our attempt to induce more abstract representations of natural language text, visual scenes, and other messy, naturally occurring data, and support decisions that depend on it. However, learning models for these tasks is difficult partly because generating the necessary supervision signals for it is costly and does not scale. This paper describes several learning paradigms that are designed to alleviate the supervision bottleneck. It will illustrate their benefit in the context of multiple problems, all pertaining to inducing various levels of semantic representations from text.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/16/2020

Unsupervised Natural Language Inference via Decoupled Multimodal Contrastive Learning

We propose to solve the natural language inference problem without any s...
research
01/17/2023

Masked Visual Reconstruction in Language Semantic Space

Both masked image modeling (MIM) and natural language supervision have f...
research
02/10/2023

Is multi-modal vision supervision beneficial to language?

Vision (image and video) - Language (VL) pre-training is the recent popu...
research
02/22/2019

Learning to Learn Semantic Parsers from Natural Language Supervision

As humans, we often rely on language to learn language. For example, whe...
research
11/06/2019

Shaping Visual Representations with Language for Few-shot Classification

Language is designed to convey useful information about the world, thus ...
research
09/25/2017

EZLearn: Exploiting Organic Supervision in Large-Scale Data Annotation

Many real-world applications require large-scale data annotation, such a...
research
02/26/2021

DOCENT: Learning Self-Supervised Entity Representations from Large Document Collections

This paper explores learning rich self-supervised entity representations...

Please sign up or login with your details

Forgot password? Click here to reset