Towards Neural Network-based Reasoning

08/22/2015
by   Baolin Peng, et al.
0

We propose Neural Reasoner, a framework for neural network-based reasoning over natural language sentences. Given a question, Neural Reasoner can infer over multiple supporting facts and find an answer to the question in specific forms. Neural Reasoner has 1) a specific interaction-pooling mechanism, allowing it to examine multiple facts, and 2) a deep architecture, allowing it to model the complicated logical relations in reasoning tasks. Assuming no particular structure exists in the question and facts, Neural Reasoner is able to accommodate different types of reasoning and different forms of language expressions. Despite the model complexity, Neural Reasoner can still be trained effectively in an end-to-end manner. Our empirical studies show that Neural Reasoner can outperform existing neural reasoning systems with remarkable margins on two difficult artificial tasks (Positional Reasoning and Path Finding) proposed in [8]. For example, it improves the accuracy on Path Finding(10K) from 33.4

READ FULL TEXT
research
04/07/2020

Guessing What's Plausible But Remembering What's True: Accurate Neural Reasoning for Question-Answering

Neural approaches to natural language processing (NLP) often fail at the...
research
01/29/2020

MEMO: A Deep Network for Flexible Combination of Episodic Memories

Recent research developing neural network architectures with external me...
research
10/25/2019

QASC: A Dataset for Question Answering via Sentence Composition

Composing knowledge from multiple pieces of texts is a key challenge in ...
research
08/05/2022

Knowledge Authoring with Factual English

Knowledge representation and reasoning (KRR) systems represent knowledge...
research
10/14/2014

Presence-absence reasoning for evolutionary phenotypes

Nearly invariably, phenotypes are reported in the scientific literature ...
research
12/17/2020

Autoregressive Reasoning over Chains of Facts with Transformers

This paper proposes an iterative inference algorithm for multi-hop expla...
research
12/14/2022

APOLLO: An Optimized Training Approach for Long-form Numerical Reasoning

Long-form numerical reasoning in financial analysis aims to generate a r...

Please sign up or login with your details

Forgot password? Click here to reset