Utilising Information Foraging Theory for User Interaction with Image Query Auto-Completion

06/06/2020
by   Amit Kumar Jaiswal, et al.
0

Query Auto-completion (QAC) is a prominently used feature in search engines, where user interaction with such explicit feature is facilitated by the possible automatic suggestion of queries based on a prefix typed by the user. Existing QAC models have pursued a little on user interaction and cannot capture a user’s information need (IN) context. In this work, we devise a new task of QAC applied on an image for estimating patch (one of the key components of Information Foraging Theory) probabilities for query suggestion. Our work supports query completion by extending a user query prefix (one or two characters) to a complete query utilising a foraging-based probabilistic patch selection model. We present iBERT, to fine-tune the BERT (Bidirectional Encoder Representations from Transformers) model, which leverages combined textual-image queries for a solution to image QAC by computing probabilities of a large set of image patches. The reflected patch probabilities are used for selection while being agnostic to changing information need or contextual mechanisms. Experimental results show that query auto-completion using both natural language queries and images is more effective than using only language-level queries. Also, our fine-tuned iBERT model allows to efficiently rank patches in the image.

READ FULL TEXT
research
10/10/2019

Visual Natural Language Query Auto-Completion for Estimating Instance Probabilities

We present a new task of query auto-completion for estimating instance p...
research
12/09/2020

Session-Aware Query Auto-completion using Extreme Multi-label Ranking

Query auto-completion is a fundamental feature in search engines where t...
research
04/25/2018

Personalized Language Model for Query Auto-Completion

Query auto-completion is a search engine feature whereby the system sugg...
research
05/13/2020

Efficient and Effective Query Auto-Completion

Query Auto-Completion (QAC) is an ubiquitous feature of modern textual s...
research
09/02/2019

Subword Language Model for Query Auto-Completion

Current neural query auto-completion (QAC) systems rely on character-lev...
research
12/09/2019

Query Auto Completion for Math Formula Search

Query Auto Completion (QAC) is among the most appealing features of a we...
research
01/10/2023

Estimation of User's World Model Using Graph2vec

To obtain advanced interaction between autonomous robots and users, robo...

Please sign up or login with your details

Forgot password? Click here to reset