EXS: Explainable Search Using Local Model Agnostic Interpretability

09/11/2018
by   Jaspreet Singh, et al.
0

Retrieval models in information retrieval are used to rank documents for typically under-specified queries. Today machine learning is used to learn retrieval models from click logs and/or relevance judgments that maximizes an objective correlated with user satisfaction. As these models become increasingly powerful and sophisticated, they also become harder to understand. Consequently, it is hard for to identify artifacts in training, data specific biases and intents from a complex trained model like neural rankers even if trained purely on text features. EXS is a search system designed specifically to provide its users with insight into the following questions: `What is the intent of the query according to the ranker?', `Why is this document ranked higher than another?' and `Why is this document relevant to the query?'. EXS uses a version of a popular posthoc explanation method for classifiers -- LIME, adapted specifically to answer these questions. We show how such a system can effectively help a user understand the results of neural rankers and highlight areas of improvement.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/13/2018

Interpreting search result rankings through intent modeling

Given the recent interest in arguably accurate yet non-interpretable neu...
research
01/21/2022

Less is Less: When Are Snippets Insufficient for Human vs Machine Relevance Estimation?

Traditional information retrieval (IR) ranking models process the full t...
research
11/02/2021

Explaining Documents' Relevance to Search Queries

We present GenEx, a generative model to explain search results to users ...
research
02/08/2020

Eliminating Search Intent Bias in Learning to Rank

Click-through data has proven to be a valuable resource for improving se...
research
02/27/2023

Pretraining De-Biased Language Model with Large-scale Click Logs for Document Ranking

Pre-trained language models have achieved great success in various large...
research
01/22/2019

Adapting The Secretary Hiring Problem for Optimal Hot-Cold Tier Placement under Top-K Workloads

Top-K queries are an established heuristic in information retrieval. Thi...
research
08/11/2021

Model-agnostic vs. Model-intrinsic Interpretability for Explainable Product Search

Product retrieval systems have served as the main entry for customers to...

Please sign up or login with your details

Forgot password? Click here to reset