On the Equilibrium of Query Reformulation and Document Retrieval

07/06/2018
by   Shihao Zou, et al.
0

In this paper, we study the interactions between query reformulation and retrieval model relevance estimation in a game theoretical framework. Under the proposed strategic game of information retrieval (IR), a query formulator, as one of the players, taking actions to produce the optimal query, is expected to maximize its own utility with respect to the relevance estimation of documents produced by the other player, a retrieval modeler; simultaneously, the retrieval modeler, taking actions to produce the document relevance scores, needs to optimize its likelihood from the training data with respect to the refined query produced by the query formulator. Their equilibrium or equilibria will be reached when both are the best response to each other. We derive our equilibrium theory of IR using normal-form representations: when a standard relevance feedback algorithm is coupled with a retrieval model, they share the same objective function and thus would form a partnership game; by contrast, pseudo relevance feedback pursues a rather different objective than that of retrieval models, therefore the interactions between them would lead to a general-sum game (though implicitly collaborative). Our game theoretical analyses not only yield useful insights into the two major aspects of IR, but also offer new practical algorithms for achieving the equilibrium state of retrieval which have been shown to bring consistent performance improvements in both text retrieval and item recommendation applications.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/30/2018

NPRF: A Neural Pseudo Relevance Feedback Framework for Ad-hoc Information Retrieval

Pseudo-relevance feedback (PRF) is commonly used to boost the performanc...
research
07/01/2017

An Approach for Weakly-Supervised Deep Information Retrieval

Recent developments in neural information retrieval models have been pro...
research
12/21/2020

Neural Methods for Effective, Efficient, and Exposure-Aware Information Retrieval

Neural networks with deep architectures have demonstrated significant pe...
research
04/05/2017

Rhetorical relations for information retrieval

Typically, every part in most coherent text has some plausible reason fo...
research
04/11/2019

Investigating Retrieval Method Selection with Axiomatic Features

We consider algorithm selection in the context of ad-hoc information ret...
research
03/01/2021

A Linguistic Study on Relevance Modeling in Information Retrieval

Relevance plays a central role in information retrieval (IR), which has ...
research
08/05/2023

Towards Consistency Filtering-Free Unsupervised Learning for Dense Retrieval

Domain transfer is a prevalent challenge in modern neural Information Re...

Please sign up or login with your details

Forgot password? Click here to reset