NeuralLog: Natural Language Inference with Joint Neural and Logical Reasoning

05/29/2021
by   Zeming Chen, et al.
0

Deep learning (DL) based language models achieve high performance on various benchmarks for Natural Language Inference (NLI). And at this time, symbolic approaches to NLI are receiving less attention. Both approaches (symbolic and DL) have their advantages and weaknesses. However, currently, no method combines them in a system to solve the task of NLI. To merge symbolic and deep learning methods, we propose an inference framework called NeuralLog, which utilizes both a monotonicity-based logical inference engine and a neural network language model for phrase alignment. Our framework models the NLI task as a classic search problem and uses the beam search algorithm to search for optimal inference paths. Experiments show that our joint logic and neural inference system improves accuracy on the NLI task and can achieve state-of-art accuracy on the SICK and MED datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/20/2022

A Neural-Symbolic Approach to Natural Language Understanding

Deep neural networks, empowered by pre-trained language models, have ach...
research
06/05/2023

Modeling Human-like Concept Learning with Bayesian Inference over Natural Language

We model learning of abstract symbolic concepts by performing Bayesian i...
research
03/21/2023

Logical Reasoning over Natural Language as Knowledge Representation: A Survey

Logical reasoning is central to human cognition and intelligence. Past r...
research
09/13/2017

Natural Language Inference over Interaction Space

Natural Language Inference (NLI) task requires an agent to determine the...
research
07/28/2022

Multi-Step Deductive Reasoning Over Natural Language: An Empirical Study on Out-of-Distribution Generalisation

Combining deep learning with symbolic logic reasoning aims to capitalize...
research
01/28/2022

Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval

Retrieval-based language models (R-LM) model the probability of natural ...
research
11/26/2020

Braid: Weaving Symbolic and Neural Knowledge into Coherent Logical Explanations

Traditional symbolic reasoning engines, while attractive for their preci...

Please sign up or login with your details

Forgot password? Click here to reset