KnowledGPT: Enhancing Large Language Models with Retrieval and Storage Access on Knowledge Bases

08/17/2023
by   Xintao Wang, et al.
0

Large language models (LLMs) have demonstrated impressive impact in the field of natural language processing, but they still struggle with several issues regarding, such as completeness, timeliness, faithfulness and adaptability. While recent efforts have focuses on connecting LLMs with external knowledge sources, the integration of knowledge bases (KBs) remains understudied and faces several challenges. In this paper, we introduce KnowledGPT, a comprehensive framework to bridge LLMs with various knowledge bases, facilitating both the retrieval and storage of knowledge. The retrieval process employs the program of thought prompting, which generates search language for KBs in code format with pre-defined functions for KB operations. Besides retrieval, KnowledGPT offers the capability to store knowledge in a personalized KB, catering to individual user demands. With extensive experiments, we show that by integrating LLMs with KBs, KnowledGPT properly answers a broader range of questions requiring world knowledge compared with vanilla LLMs, utilizing both knowledge existing in widely-known KBs and extracted into personalized KBs.

READ FULL TEXT

page 3

page 5

page 8

page 10

page 14

page 15

page 16

page 17

research
08/25/2023

LLM2KB: Constructing Knowledge Bases using instruction tuned context aware Large Language Models

The advent of Large Language Models (LLM) has revolutionized the field o...
research
05/22/2023

Chain of Knowledge: A Framework for Grounding Large Language Models with Structured Knowledge Bases

We introduce Chain of Knowledge (CoK), a framework that augments large l...
research
04/22/2023

LaMP: When Large Language Models Meet Personalization

This paper highlights the importance of personalization in the current s...
research
08/20/2020

Language Models as Knowledge Bases: On Entity Representations, Storage Capacity, and Paraphrased Queries

Pretrained language models have been suggested as a possible alternative...
research
07/19/2023

Thrust: Adaptively Propels Large Language Models with External Knowledge

Although large-scale pre-trained language models (PTLMs) are shown to en...
research
09/15/2023

Data Distribution Bottlenecks in Grounding Language Models to Knowledge Bases

Language models (LMs) have already demonstrated remarkable abilities in ...
research
09/06/2023

Knowledge Solver: Teaching LLMs to Search for Domain Knowledge from Knowledge Graphs

Large language models (LLMs), such as ChatGPT and GPT-4, are versatile a...

Please sign up or login with your details

Forgot password? Click here to reset