Cognitive Mirage: A Review of Hallucinations in Large Language Models

09/13/2023
by   Hongbin Ye, et al.
0

As large language models continue to develop in the field of AI, text generation systems are susceptible to a worrisome phenomenon known as hallucination. In this study, we summarize recent compelling insights into hallucinations in LLMs. We present a novel taxonomy of hallucinations from various text generation tasks, thus provide theoretical insights, detection methods and improvement approaches. Based on this, future research directions are proposed. Our contribution are threefold: (1) We provide a detailed and complete taxonomy for hallucinations appearing in text generation tasks; (2) We provide theoretical analyses of hallucinations in LLMs and provide existing detection and improvement methods; (3) We propose several research directions that can be developed in the future. As hallucinations garner significant attention from the community, we will maintain updates on relevant research progress.

READ FULL TEXT

page 2

page 7

page 8

research
10/23/2022

Generative Knowledge Graph Construction: A Review

Generative Knowledge Graph Construction (KGC) refers to those methods th...
research
12/13/2022

Paraphrase Identification with Deep Learning: A Review of Datasets and Methods

The rapid advancement of AI technology has made text generation tools li...
research
07/25/2023

Watermarking Conditional Text Generation for AI Detection: Unveiling Challenges and a Semantic-Aware Watermark Remedy

To mitigate potential risks associated with language models, recent AI d...
research
02/02/2022

A Survey on Retrieval-Augmented Text Generation

Recently, retrieval-augmented text generation attracted increasing atten...
research
02/28/2021

Topic Modelling Meets Deep Neural Networks: A Survey

Topic modelling has been a successful technique for text analysis for al...
research
12/06/2022

Template-based Recruitment Email Generation For Job Recommendation

Text generation has long been a popular research topic in NLP. However, ...
research
08/21/2023

Inferring Power Grid Information with Power Line Communications: Review and Insights

High-frequency signals were widely studied in the last decade to identif...

Please sign up or login with your details

Forgot password? Click here to reset