Decomposing Complex Queries for Tip-of-the-tongue Retrieval

05/24/2023
by   Kevin Lin, et al.
5

When re-finding items, users who forget or are uncertain about identifying details often rely on creative strategies for expressing their information needs – complex queries that describe content elements (e.g., book characters or events), information beyond the document text (e.g., descriptions of book covers), or personal context (e.g., when they read a book). This retrieval setting, called tip of the tongue (TOT), is especially challenging for models heavily reliant on lexical and semantic overlap between query and document text. In this work, we introduce a simple yet effective framework for handling such complex queries by decomposing the query into individual clues, routing those as sub-queries to specialized retrievers, and ensembling the results. This approach allows us to take advantage of off-the-shelf retrievers (e.g., CLIP for retrieving images of book covers) or incorporate retriever-specific logic (e.g., date constraints). We show that our framework incorportating query decompositions into retrievers can improve gold book recall up to 7 again for Recall@5 on a new collection of 14,441 real-world query-book pairs from an online community for resolving TOT inquiries.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/19/2014

Efficient Media Retrieval from Non-Cooperative Queries

Text is ubiquitous in the artificial world and easily attainable when it...
research
11/03/2022

Book Cover Synthesis from the Summary

The cover is the face of a book and is a point of attraction for the rea...
research
01/20/2018

Ontology-based Adaptive e-Textbook Platform for Student and Machine Co-Learning

The use of electronic textbooks (e-book) has been heavily studied over t...
research
10/31/2020

Visual Companion for Booklovers

An innumerable number of individual choices go into discovering a new bo...
research
11/15/2020

Deep multi-modal networks for book genre classification based on its cover

Book covers are usually the very first impression to its readers and the...
research
06/24/2019

Serif or Sans: Visual Font Analytics on Book Covers and Online Advertisements

In this paper, we conduct a large-scale study of font statistics in book...
research
07/27/2017

Cheryl's Birthday

We present four logic puzzles and after that their solutions. Joseph Yeo...

Please sign up or login with your details

Forgot password? Click here to reset