Dynamically Visual Disambiguation of Keyword-based Image Search

05/27/2019
by   Yazhou Yao, et al.
0

Due to the high cost of manual annotation, learning directly from the web has attracted broad attention. One issue that limits their performance is the problem of visual polysemy. To address this issue, we present an adaptive multi-model framework that resolves polysemy by visual disambiguation. Compared to existing methods, the primary advantage of our approach lies in that our approach can adapt to the dynamic changes in the search results. Our proposed framework consists of two major steps: we first discover and dynamically select the text queries according to the image search results, then we employ the proposed saliency-guided deep multi-instance learning network to remove outliers and learn classification models for visual disambiguation. Extensive experiments demonstrate the superiority of our proposed approach.

READ FULL TEXT

page 4

page 6

research
04/20/2019

Saliency-Guided Attention Network for Image-Sentence Matching

This paper studies the task of matching image and sentence, where learni...
research
03/14/2023

Efficient Image-Text Retrieval via Keyword-Guided Pre-Screening

Under the flourishing development in performance, current image-text ret...
research
06/08/2023

Multi-level Multiple Instance Learning with Transformer for Whole Slide Image Classification

Whole slide image (WSI) refers to a type of high-resolution scanned tiss...
research
11/22/2016

Exploiting Web Images for Dataset Construction: A Domain Robust Approach

Labelled image datasets have played a critical role in high-level image ...
research
05/15/2017

Learning Semantics for Image Annotation

Image search and retrieval engines rely heavily on textual annotation in...
research
11/29/2017

Saliency Weighted Convolutional Features for Instance Search

This work explores attention models to weight the contribution of local ...
research
12/25/2021

Semantic Clustering based Deduction Learning for Image Recognition and Classification

The paper proposes a semantic clustering based deduction learning by mim...

Please sign up or login with your details

Forgot password? Click here to reset