Multi-layered Semantic Representation Network for Multi-label Image Classification

06/22/2021
by   Xiwen Qu, et al.
0

Multi-label image classification (MLIC) is a fundamental and practical task, which aims to assign multiple possible labels to an image. In recent years, many deep convolutional neural network (CNN) based approaches have been proposed which model label correlations to discover semantics of labels and learn semantic representations of images. This paper advances this research direction by improving both the modeling of label correlations and the learning of semantic representations. On the one hand, besides the local semantics of each label, we propose to further explore global semantics shared by multiple labels. On the other hand, existing approaches mainly learn the semantic representations at the last convolutional layer of a CNN. But it has been noted that the image representations of different layers of CNN capture different levels or scales of features and have different discriminative abilities. We thus propose to learn semantic representations at multiple convolutional layers. To this end, this paper designs a Multi-layered Semantic Representation Network (MSRN) which discovers both local and global semantics of labels through modeling label correlations and utilizes the label semantics to guide the semantic representations learning at multiple layers through an attention mechanism. Extensive experiments on four benchmark datasets including VOC 2007, COCO, NUS-WIDE, and Apparel show a competitive performance of the proposed MSRN against state-of-the-art models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/01/2020

Learning from Noisy Labels with Noise Modeling Network

Multi-label image classification has generated significant interest in r...
research
06/11/2021

MlTr: Multi-label Classification with Transformer

The task of multi-label image classification is to recognize all the obj...
research
04/04/2017

Multi-Label Learning with Global and Local Label Correlation

It is well-known that exploiting label correlations is important to mult...
research
12/02/2022

Learning Disentangled Label Representations for Multi-label Classification

Although various methods have been proposed for multi-label classificati...
research
08/03/2020

The pursuit of beauty: Converting image labels to meaningful vectors

A challenge of the computer vision community is to understand the semant...
research
11/24/2021

Spatial-context-aware deep neural network for multi-class image classification

Multi-label image classification is a fundamental but challenging task i...
research
11/20/2018

A Baseline for Multi-Label Image Classification Using Ensemble Deep CNN

Recent studies on multi-label image classification have been focusing on...

Please sign up or login with your details

Forgot password? Click here to reset