QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering

04/13/2021
by   Michihiro Yasunaga, et al.
15

The problem of answering questions using knowledge from pre-trained language models (LMs) and knowledge graphs (KGs) presents two challenges: given a QA context (question and answer choice), methods need to (i) identify relevant knowledge from large KGs, and (ii) perform joint reasoning over the QA context and KG. Here we propose a new model, QA-GNN, which addresses the above challenges through two key innovations: (i) relevance scoring, where we use LMs to estimate the importance of KG nodes relative to the given QA context, and (ii) joint reasoning, where we connect the QA context and KG to form a joint graph, and mutually update their representations through graph-based message passing. We evaluate QA-GNN on the CommonsenseQA and OpenBookQA datasets, and show its improvement over existing LM and LM+KG models, as well as its capability to perform interpretable and structured reasoning, e.g., correctly handling negation in questions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/22/2023

GrapeQA: GRaph Augmentation and Pruning to Enhance Question-Answering

Commonsense question-answering (QA) methods combine the power of pre-tra...
research
10/07/2021

GNN is a Counter? Revisiting GNN for Question Answering

Question Answering (QA) has been a long-standing research topic in AI an...
research
01/21/2022

GreaseLM: Graph REASoning Enhanced Language Models for Question Answering

Answering complex questions about textual narratives requires reasoning ...
research
09/17/2022

Flexible and Structured Knowledge Grounded Question Answering

Can language models (LM) ground question-answering (QA) tasks in the kno...
research
12/31/2019

What Does My QA Model Know? Devising Controlled Probes using Expert Knowledge

Open-domain question answering (QA) is known to involve several underlyi...
research
02/17/2023

Complex QA and language models hybrid architectures, Survey

This paper reviews the state-of-the-art of language models architectures...
research
06/09/2019

Question Answering as Global Reasoning over Semantic Abstractions

We propose a novel method for exploiting the semantic structure of text ...

Please sign up or login with your details

Forgot password? Click here to reset