DeepAI AI Chat
Log In Sign Up

Learning Deep Context-Network Architectures for Image Annotation

03/23/2018
by   Mingyuan Jiu, et al.
Laboratoire d'Informatique de Paris 6
THE FIRST AFFILIATED HOSPITAL OF ZHENGZHOU UNIVERSITY
0

Context plays an important role in visual pattern recognition as it provides complementary clues for different learning tasks including image classification and annotation. In the particular scenario of kernel learning, the general recipe of context-based kernel design consists in learning positive semi-definite similarity functions that return high values not only when data share similar content but also similar context. However, in spite of having a positive impact on performance, the use of context in these kernel design methods has not been fully explored; indeed, context has been handcrafted instead of being learned. In this paper, we introduce a novel context-aware kernel design framework based on deep learning. Our method discriminatively learns spatial geometric context as the weights of a deep network (DN). The architecture of this network is fully determined by the solution of an objective function that mixes content, context and regularization, while the parameters of this network determine the most relevant (discriminant) parts of the learned context. We apply this context and kernel learning framework to image classification using the challenging ImageCLEF Photo Annotation benchmark; the latter shows that our deep context learning provides highly effective kernels for image classification as corroborated through extensive experiments.

READ FULL TEXT
12/29/2019

Deep Context-Aware Kernel Networks

Context plays a crucial role in visual recognition as it provides comple...
06/26/2020

End-to-end training of deep kernel map networks for image classification

Deep kernel map networks have shown excellent performances in various cl...
12/21/2020

Image Annotation based on Deep Hierarchical Context Networks

Context modeling is one of the most fertile subfields of visual recognit...
12/17/2018

Attending Category Disentangled Global Context for Image Classification

In this paper, we propose a general framework for image classification u...
08/24/2020

Learning Kernel for Conditional Moment-Matching Discrepancy-based Image Classification

Conditional Maximum Mean Discrepancy (CMMD) can capture the discrepancy ...
07/18/2017

A Novel Deep Learning Architecture for Testis Histology Image Classification

Unlike other histology analysis, classification of tubule status in test...
03/27/2021

Abuse is Contextual, What about NLP? The Role of Context in Abusive Language Annotation and Detection

The datasets most widely used for abusive language detection contain lis...