Using Ternary Rewards to Reason over Knowledge Graphs with Deep Reinforcement Learning

02/26/2019
by   Fréderic Godin, et al.
0

In this paper, we investigate the practical challenges of using reinforcement learning agents for question-answering over knowledge graphs. We examine the performance metrics used by state-of-the-art systems and determine that they are inadequate. More specifically, they do not evaluate the systems correctly for situations when there is no answer available and thus agents optimized for these metrics are poor at modeling confidence. We introduce a simple new performance metric for evaluating question-answering agents that is more representative of practical usage conditions, and optimize for this metric by extending the binary reward structure used in prior work to a ternary reward structure which also rewards an agent for not answering a question rather than giving an incorrect answer. We show that this can drastically improve the precision of answered questions while only not answering a limited number of questions that were previously answered correctly.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/11/2021

Reinforcement Learning from Reformulations in Conversational Question Answering over Knowledge Graphs

The rise of personal assistants has made conversational question answeri...
research
08/13/2022

An Answer Verbalization Dataset for Conversational Question Answerings over Knowledge Graphs

We introduce a new dataset for conversational question answering over Kn...
research
03/03/2023

Answering Questions Over Knowledge Graphs Using Logic Programming Along with Language Models

Question Answering over Knowledge Graphs (KGQA) is the task of answering...
research
07/30/2023

Question Answering with Deep Neural Networks for Semi-Structured Heterogeneous Genealogical Knowledge Graphs

With the rising popularity of user-generated genealogical family trees, ...
research
05/27/2020

Sybil-proof Answer Querying Mechanism

We study a question answering problem on a social network, where a reque...
research
09/06/2018

ANS: Adaptive Network Scaling for Deep Rectifier Reinforcement Learning Models

This work provides a thorough study on how reward scaling can affect per...
research
09/12/2020

How Much Can We Really Trust You? Towards Simple, Interpretable Trust Quantification Metrics for Deep Neural Networks

A critical step to building trustworthy deep neural networks is trust qu...

Please sign up or login with your details

Forgot password? Click here to reset