Multi-Scale Label Relation Learning for Multi-Label Classification Using 1-Dimensional Convolutional Neural Networks

07/13/2021
by   Junhyung Kim, et al.
0

We present Multi-Scale Label Dependence Relation Networks (MSDN), a novel approach to multi-label classification (MLC) using 1-dimensional convolution kernels to learn label dependencies at multi-scale. Modern multi-label classifiers have been adopting recurrent neural networks (RNNs) as a memory structure to capture and exploit label dependency relations. The RNN-based MLC models however tend to introduce a very large number of parameters that may cause under-/over-fitting problems. The proposed method uses the 1-dimensional convolutional neural network (1D-CNN) to serve the same purpose in a more efficient manner. By training a model with multiple kernel sizes, the method is able to learn the dependency relations among labels at multiple scales, while it uses a drastically smaller number of parameters. With public benchmark datasets, we demonstrate that our model can achieve better accuracies with much smaller number of model parameters compared to RNN-based MLC models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/15/2016

CNN-RNN: A Unified Framework for Multi-label Image Classification

While deep convolutional neural networks (CNNs) have shown a great succe...
research
09/08/2019

Order-free Learning Alleviating Exposure Bias in Multi-label Classification

Multi-label classification (MLC) assigns multiple labels to each sample....
research
11/01/2018

AttentionXML: Extreme Multi-Label Text Classification with Multi-Label Attention Based Recurrent Neural Networks

Extreme multi-label text classification (XMTC) is a task for tagging eac...
research
11/22/2019

Orderless Recurrent Models for Multi-label Classification

Recurrent neural networks (RNN) are popular for many computer vision tas...
research
01/15/2018

Multi-Label Learning from Medical Plain Text with Convolutional Residual Models

Predicting diagnoses from Electronic Health Records (EHRs) is an importa...
research
05/14/2019

Assessing the Difficulty of Classifying ConceptNet Relations in a Multi-Label Classification Setting

Commonsense knowledge relations are crucial for advanced NLU tasks. We e...
research
02/07/2018

Classification of Things in DBpedia using Deep Neural Networks

The Semantic Web aims at representing knowledge about the real world at ...

Please sign up or login with your details

Forgot password? Click here to reset