Learning a Natural Language Interface with Neural Programmer

11/28/2016
by   Arvind Neelakantan, et al.
0

Learning a natural language interface for database tables is a challenging task that involves deep language understanding and multi-step reasoning. The task is often approached by mapping natural language queries to logical forms or programs that provide the desired response when executed on the database. To our knowledge, this paper presents the first weakly supervised, end-to-end neural network model to induce such programs on a real-world dataset. We enhance the objective function of Neural Programmer, a neural network with built-in discrete operations, and apply it on WikiTableQuestions, a natural language question-answering dataset. The model is trained end-to-end with weak supervision of question-answer pairs, and does not require domain-specific grammars, rules, or annotations that are key elements in previous approaches to program induction. The main experimental result in this paper is that a single Neural Programmer model achieves 34.2 weak supervision. An ensemble of 15 models, with a trivial combination technique, achieves 37.7 state-of-the-art accuracy of 37.1 semantic parser.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/21/2017

Neural Multi-Step Reasoning for Question Answering on Semi-Structured Tables

Advances in natural language processing tasks have gained momentum in re...
research
12/04/2016

Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervision (Short Version)

Extending the success of deep neural networks to natural language unders...
research
12/03/2015

Neural Enquirer: Learning to Query Tables with Natural Language

We proposed Neural Enquirer as a neural network architecture to execute ...
research
04/18/2018

Object Ordering with Bidirectional Matchings for Visual Reasoning

Visual reasoning with compositional natural language instructions, e.g.,...
research
10/31/2016

Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervision

Harnessing the statistical power of neural networks to perform language ...
research
03/31/2018

A Language for Function Signature Representations

Recent work by (Richardson and Kuhn, 2017a,b; Richardson et al., 2018) l...
research
06/19/2015

A Neural Conversational Model

Conversational modeling is an important task in natural language underst...

Please sign up or login with your details

Forgot password? Click here to reset