Collaborative Policy Learning for Open Knowledge Graph Reasoning

08/31/2019
by   Cong Fu, et al.
19

In recent years, there has been a surge of interests in interpretable graph reasoning methods. However, these models often suffer from limited performance when working on sparse and incomplete graphs, due to the lack of evidential paths that can reach target entities. Here we study open knowledge graph reasoning---a task that aims to reason for missing facts over a graph augmented by a background text corpus. A key challenge of the task is to filter out "irrelevant" facts extracted from corpus, in order to maintain an effective search space during path inference. We propose a novel reinforcement learning framework to train two collaborative agents jointly, i.e., a multi-hop graph reasoner and a fact extractor. The fact extraction agent generates fact triples from corpora to enrich the graph on the fly; while the reasoning agent provides feedback to the fact extractor and guides it towards promoting facts that are helpful for the interpretable reasoning. Experiments on two public datasets demonstrate the effectiveness of the proposed approach. Source code and datasets used in this paper can be downloaded at https://github.com/shanzhenren/CPL

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/05/2020

Dynamic Anticipation and Completion for Multi-Hop Reasoning over Sparse Knowledge Graph

Multi-hop reasoning has been widely studied in recent years to seek an e...
research
12/04/2019

Cooperative Reasoning on Knowledge Graph and Corpus: A Multi-agentReinforcement Learning Approach

Knowledge-graph-based reasoning has drawn a lot of attention due to its ...
research
12/23/2021

Learning to Walk with Dual Agents for Knowledge Graph Reasoning

Graph walking based on reinforcement learning (RL) has shown great succe...
research
07/20/2017

DeepPath: A Reinforcement Learning Method for Knowledge Graph Reasoning

We study the problem of learning to reason in large scale knowledge grap...
research
02/20/2021

Rel4KC: A Reinforcement Learning Agent for Knowledge Graph Completion and Validation

Reinforcement Learning (RL) has been recently adopted to train agents fo...
research
01/17/2022

SQUIRE: A Sequence-to-sequence Framework for Multi-hop Knowledge Graph Reasoning

Multi-hop knowledge graph (KG) reasoning has been widely studied in rece...
research
06/13/2023

Noisy Positive-Unlabeled Learning with Self-Training for Speculative Knowledge Graph Reasoning

This paper studies speculative reasoning task on real-world knowledge gr...

Please sign up or login with your details

Forgot password? Click here to reset