Complex Logical Reasoning over Knowledge Graphs using Large Language Models

05/02/2023
by   Nurendra Choudhary, et al.
0

Reasoning over knowledge graphs (KGs) is a challenging task that requires a deep understanding of the complex relationships between entities and the underlying logic of their relations. Current approaches rely on learning geometries to embed entities in vector space for logical query operations, but they suffer from subpar performance on complex queries and dataset-specific representations. In this paper, we propose a novel decoupled approach, Language-guided Abstract Reasoning over Knowledge graphs (LARK), that formulates complex KG reasoning as a combination of contextual KG search and logical query reasoning, to leverage the strengths of graph extraction algorithms and large language models (LLM), respectively. Our experiments demonstrate that the proposed approach outperforms state-of-the-art KG reasoning methods on standard benchmark datasets across several logical query constructs, with significant performance gain for queries of higher complexity. Furthermore, we show that the performance of our approach improves proportionally to the increase in size of the underlying LLM, enabling the integration of the latest advancements in LLMs for logical reasoning over KGs. Our work presents a new direction for addressing the challenges of complex KG reasoning and paves the way for future research in this area.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/14/2020

Query2box: Reasoning over Knowledge Graphs in Vector Space using Box Embeddings

Answering complex logical queries on large-scale incomplete knowledge gr...
research
08/10/2017

Thinking, Fast and Slow: Combining Vector Spaces and Knowledge Graphs

Knowledge graphs and vector space models are robust knowledge representa...
research
10/26/2021

Probabilistic Entity Representation Model for Reasoning over Knowledge Graphs

Logical reasoning over Knowledge Graphs (KGs) is a fundamental technique...
research
12/23/2020

Self-Supervised Hyperboloid Representations from Logical Queries over Knowledge Graphs

Knowledge Graphs (KGs) are ubiquitous structures for information storage...
research
08/16/2023

Boosting Logical Reasoning in Large Language Models through a New Framework: The Graph of Thought

Recent advancements in large-scale models, such as GPT-4, have showcased...
research
05/23/2022

FLEX: Feature-Logic Embedding Framework for CompleX Knowledge Graph Reasoning

Current best performing models for knowledge graph reasoning (KGR) are b...
research
10/27/2021

Towards Robust Reasoning over Knowledge Graphs

Answering complex logical queries over large-scale knowledge graphs (KGs...

Please sign up or login with your details

Forgot password? Click here to reset