Coupling Retrieval and Meta-Learning for Context-Dependent Semantic Parsing

06/17/2019
by   Daya Guo, et al.
0

In this paper, we present an approach to incorporate retrieved datapoints as supporting evidence for context-dependent semantic parsing, such as generating source code conditioned on the class environment. Our approach naturally combines a retrieval model and a meta-learner, where the former learns to find similar datapoints from the training data, and the latter considers retrieved datapoints as a pseudo task for fast adaptation. Specifically, our retriever is a context-aware encoder-decoder model with a latent variable which takes context environment into consideration, and our meta-learner learns to utilize retrieved datapoints in a model-agnostic meta-learning paradigm for fast adaptation. We conduct experiments on CONCODE and CSQA datasets, where the context refers to class environment in JAVA codes and conversational history, respectively. We use sequence-to-action model as the base semantic parser, which performs the state-of-the-art accuracy on both datasets. Results show that both the context-aware retriever and the meta-learning strategy improve accuracy, and our approach performs better than retrieve-and-edit baselines.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/12/2020

Task-similarity Aware Meta-learning through Nonparametric Kernel Regression

Meta-learning refers to the process of abstracting a learning rule for a...
research
06/11/2020

Learning to Learn Kernels with Variational Random Features

In this work, we introduce kernels with random Fourier features in the m...
research
07/11/2017

Meta-Learning with Temporal Convolutions

Deep neural networks excel in regimes with large amounts of data, but te...
research
03/03/2020

Learning Context-aware Task Reasoning for Efficient Meta-reinforcement Learning

Despite recent success of deep network-based Reinforcement Learning (RL)...
research
07/17/2020

Probabilistic Active Meta-Learning

Data-efficient learning algorithms are essential in many practical appli...
research
09/12/2019

Neural Semantic Parsing in Low-Resource Settings with Back-Translation and Meta-Learning

Neural semantic parsing has achieved impressive results in recent years,...
research
08/27/2018

ParsRec: Meta-Learning Recommendations for Bibliographic Reference Parsing

Bibliographic reference parsers extract metadata (e.g. author names, tit...

Please sign up or login with your details

Forgot password? Click here to reset