Generative Relevance Feedback with Large Language Models

04/25/2023
by   Iain Mackie, et al.
0

Current query expansion models use pseudo-relevance feedback to improve first-pass retrieval effectiveness; however, this fails when the initial results are not relevant. Instead of building a language model from retrieved results, we propose Generative Relevance Feedback (GRF) that builds probabilistic feedback models from long-form text generated from Large Language Models. We study the effective methods for generating text by varying the zero-shot generation subtasks: queries, entities, facts, news articles, documents, and essays. We evaluate GRF on document retrieval benchmarks covering a diverse set of queries and document collections, and the results show that GRF methods significantly outperform previous PRF methods. Specifically, we improve MAP between 5-19 expansion, and achieve the best R@1k effectiveness on all datasets compared to state-of-the-art sparse, dense, and expansion models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/16/2023

GRM: Generative Relevance Modeling Using Relevance-Aware Sample Estimation for Document Retrieval

Recent studies show that Generative Relevance Feedback (GRF), using text...
research
05/12/2023

Generative and Pseudo-Relevant Feedback for Sparse, Dense and Learned Sparse Retrieval

Pseudo-relevance feedback (PRF) is a classical approach to address lexic...
research
05/05/2023

Query Expansion by Prompting Large Language Models

Query expansion is a widely used technique to improve the recall of sear...
research
08/01/2023

Generative Query Reformulation for Effective Adhoc Search

Performing automatic reformulations of a user's query is a popular parad...
research
04/18/2019

The Simplest Thing That Can Possibly Work: Pseudo-Relevance Feedback Using Text Classification

Motivated by recent commentary that has questioned today's pursuit of ev...
research
06/29/2023

Re-Rank - Expand - Repeat: Adaptive Query Expansion for Document Retrieval Using Words and Entities

Sparse and dense pseudo-relevance feedback (PRF) approaches perform poor...
research
09/15/2023

When do Generative Query and Document Expansions Fail? A Comprehensive Study Across Methods, Retrievers, and Datasets

Using large language models (LMs) for query or document expansion can im...

Please sign up or login with your details

Forgot password? Click here to reset