Grammatical Sequence Prediction for Real-Time Neural Semantic Parsing

07/25/2019
by   Chunyang Xiao, et al.
0

While sequence-to-sequence (seq2seq) models achieve state-of-the-art performance in many natural language processing tasks, they can be too slow for real-time applications. One performance bottleneck is predicting the most likely next token over a large vocabulary; methods to circumvent this bottleneck are a current research topic. We focus specifically on using seq2seq models for semantic parsing, where we observe that grammars often exist which specify valid formal representations of utterance semantics. By developing a generic approach for restricting the predictions of a seq2seq model to grammatically permissible continuations, we arrive at a widely applicable technique for speeding up semantic parsing. The technique leads to a 74 speed-up on an in-house dataset with a large vocabulary, compared to the same neural model without grammatical restrictions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/24/2023

The Role of Output Vocabulary in T2T LMs for SPARQL Semantic Parsing

In this work, we analyse the role of output vocabulary for text-to-text ...
research
09/01/2018

Dependency-based Hybrid Trees for Semantic Parsing

We propose a novel dependency-based hybrid tree model for semantic parsi...
research
06/25/2021

Semantic Parsing Natural Language into Relational Algebra

Natural interface to database (NLIDB) has been researched a lot during t...
research
01/01/2023

Semantic Operator Prediction and Applications

In the present paper, semantic parsing challenges are briefly introduced...
research
12/23/2014

Grammar as a Foreign Language

Syntactic constituency parsing is a fundamental problem in natural langu...
research
01/05/2021

Dynamic Hybrid Relation Network for Cross-Domain Context-Dependent Semantic Parsing

Semantic parsing has long been a fundamental problem in natural language...
research
05/11/2018

Confidence Modeling for Neural Semantic Parsing

In this work we focus on confidence modeling for neural semantic parsers...

Please sign up or login with your details

Forgot password? Click here to reset