A novel image tag completion method based on convolutional neural network

03/02/2017
by   Yanyan Geng, et al.
0

In the problems of image retrieval and annotation, complete textual tag lists of images play critical roles. However, in real-world applications, the image tags are usually incomplete, thus it is important to learn the complete tags for images. In this paper, we study the problem of image tag complete and proposed a novel method for this problem based on a popular image representation method, convolutional neural network (CNN). The method estimates the complete tags from the convolutional filtering outputs of images based on a linear predictor. The CNN parameters, linear predictor, and the complete tags are learned jointly by our method. We build a minimization problem to encourage the consistency between the complete tags and the available incomplete tags, reduce the estimation error, and reduce the model complexity. An iterative algorithm is developed to solve the minimization problem. Experiments over benchmark image data sets show its effectiveness.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/10/2015

Image Tag Completion and Refinement by Subspace Clustering and Matrix Completion

Tag-based image retrieval (TBIR) has drawn much attention in recent year...
research
09/17/2014

Adaptive Tag Selection for Image Annotation

Not all tags are relevant to an image, and the number of relevant tags i...
research
02/28/2016

Measuring and Predicting Tag Importance for Image Retrieval

Textual data such as tags, sentence descriptions are combined with visua...
research
08/19/2017

Image2song: Song Retrieval via Bridging Image Content and Lyric Words

Image is usually taken for expressing some kinds of emotions or purposes...
research
04/21/2020

Automatic Tag Recommendation for Painting Artworks Using Diachronic Descriptions

In this paper, we deal with the problem of automatic tag recommendation ...
research
08/22/2017

Tags2Parts: Discovering Semantic Regions from Shape Tags

We propose a novel method for discovering shape regions that strongly co...
research
08/16/2020

From Lost to Found: Discover Missing UI Design Semantics through Recovering Missing Tags

Design sharing sites provide UI designers with a platform to share their...

Please sign up or login with your details

Forgot password? Click here to reset