Using Image Captions and Multitask Learning for Recommending Query Reformulations

by   Gaurav Verma, et al.

Interactive search sessions often contain multiple queries, where the user submits a reformulated version of the previous query in response to the original results. We aim to enhance the query recommendation experience for a commercial image search engine. Our proposed methodology incorporates current state-of-the-art practices from relevant literature – the use of generation-based sequence-to-sequence models that capture session context, and a multitask architecture that simultaneously optimizes the ranking of results. We extend this setup by driving the learning of such a model with captions of clicked images as the target, instead of using the subsequent query within the session. Since these captions tend to be linguistically richer, the reformulation mechanism can be seen as assistance to construct more descriptive queries. In addition, via the use of a pairwise loss for the secondary ranking task, we show that the generated reformulations are more diverse.


page 1

page 2

page 3

page 4


Session-Aware Query Auto-completion using Extreme Multi-label Ranking

Query auto-completion is a fundamental feature in search engines where t...

Learning to Attend, Copy, and Generate for Session-Based Query Suggestion

Users try to articulate their complex information needs during search se...

Lexical Query Modeling in Session Search

Lexical query modeling has been the leading paradigm for session search....

Modeling Information Need of Users in Search Sessions

Users issue queries to Search Engines, and try to find the desired infor...

High Quality Related Search Query Suggestions using Deep Reinforcement Learning

"High Quality Related Search Query Suggestions" task aims at recommendin...

Lookup or Exploratory: What is Your Search Intent?

Search query specificity is broadly divided into two categories - Explor...

Reproducing Personalised Session Search over the AOL Query Log

Despite its troubled past, the AOL Query Log continues to be an importan...

Please sign up or login with your details

Forgot password? Click here to reset