Machine Reading with Background Knowledge

12/16/2016
by   Ndapandula Nakashole, et al.
0

Intelligent systems capable of automatically understanding natural language text are important for many artificial intelligence applications including mobile phone voice assistants, computer vision, and robotics. Understanding language often constitutes fitting new information into a previously acquired view of the world. However, many machine reading systems rely on the text alone to infer its meaning. In this paper, we pursue a different approach; machine reading methods that make use of background knowledge to facilitate language understanding. To this end, we have developed two methods: The first method addresses prepositional phrase attachment ambiguity. It uses background knowledge within a semi-supervised machine learning algorithm that learns from both labeled and unlabeled data. This approach yields state-of-the-art results on two datasets against strong baselines; The second method extracts relationships from compound nouns. Our knowledge-aware method for compound noun analysis accurately extracts relationships and significantly outperforms a baseline that does not make use of background knowledge.

READ FULL TEXT

page 5

page 6

page 13

page 19

research
06/08/2017

Dynamic Integration of Background Knowledge in Neural NLU Systems

Common-sense or background knowledge is required to understand natural l...
research
10/05/2020

Self-training Improves Pre-training for Natural Language Understanding

Unsupervised pre-training has led to much recent progress in natural lan...
research
07/11/2019

Solving Hard Coreference Problems

Coreference resolution is a key problem in natural language understandin...
research
04/26/2020

Dual Learning for Semi-Supervised Natural Language Understanding

Natural language understanding (NLU) converts sentences into structured ...
research
03/29/2021

Industry Scale Semi-Supervised Learning for Natural Language Understanding

This paper presents a production Semi-Supervised Learning (SSL) pipeline...
research
04/15/2018

What Happened? Leveraging VerbNet to Predict the Effects of Actions in Procedural Text

Our goal is to answer questions about paragraphs describing processes (e...
research
09/30/2018

On the Winograd Schema Challenge: Levels of Language Understanding and the Phenomenon of the Missing Text

The Winograd Schema (WS) challenge has been proposed as an alternative t...

Please sign up or login with your details

Forgot password? Click here to reset