Merging Weak and Active Supervision for Semantic Parsing

11/29/2019
by   Ansong Ni, et al.
0

A semantic parser maps natural language commands (NLs) from the users to executable meaning representations (MRs), which are later executed in certain environment to obtain user-desired results. The fully-supervised training of such parser requires NL/MR pairs, annotated by domain experts, which makes them expensive to collect. However, weakly-supervised semantic parsers are learnt only from pairs of NL and expected execution results, leaving the MRs latent. While weak supervision is cheaper to acquire, learning from this input poses difficulties. It demands that parsers search a large space with a very weak learning signal and it is hard to avoid spurious MRs that achieve the correct answer in the wrong way. These factors lead to a performance gap between parsers trained in weakly- and fully-supervised setting. To bridge this gap, we examine the intersection between weak supervision and active learning, which allows the learner to actively select examples and query for manual annotations as extra supervision to improve the model trained under weak supervision. We study different active learning heuristics for selecting examples to query, and various forms of extra supervision for such queries. We evaluate the effectiveness of our method on two different datasets. Experiments on the WikiSQL show that by annotating only 1.8 state-of-the-art weakly-supervised baseline by 6.4 79.0 Experiments on WikiTableQuestions with human annotators show that our method can improve the performance with only 100 active queries, especially for weakly-supervised parsers learnt from a cold start.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/25/2022

Active Learning Strategies for Weakly-supervised Object Detection

Object detectors trained with weak annotations are affordable alternativ...
research
04/18/2021

Reference-based Weak Supervision for Answer Sentence Selection using Web Data

Answer sentence selection (AS2) modeling requires annotated data, i.e., ...
research
09/22/2015

Bandit Label Inference for Weakly Supervised Learning

The scarcity of data annotated at the desired level of granularity is a ...
research
06/12/2019

Unified Semantic Parsing with Weak Supervision

Semantic parsing over multiple knowledge bases enables a parser to explo...
research
02/27/2018

Tell Me Where to Look: Guided Attention Inference Network

Weakly supervised learning with only coarse labels can obtain visual exp...
research
05/04/2022

P3IV: Probabilistic Procedure Planning from Instructional Videos with Weak Supervision

In this paper, we study the problem of procedure planning in instruction...
research
08/09/2023

Discrepancy-based Active Learning for Weakly Supervised Bleeding Segmentation in Wireless Capsule Endoscopy Images

Weakly supervised methods, such as class activation maps (CAM) based, ha...

Please sign up or login with your details

Forgot password? Click here to reset