Semantic-Unit-Based Dilated Convolution for Multi-Label Text Classification

08/26/2018
by   Junyang Lin, et al.
0

We propose a novel model for multi-label text classification, which is based on sequence-to-sequence learning. The model generates higher-level semantic unit representations with multi-level dilated convolution as well as a corresponding hybrid attention mechanism that extracts both the information at the word-level and the level of the semantic unit. Our designed dilated convolution effectively reduces dimension and supports an exponential expansion of receptive fields without loss of local information, and the attention-over-attention mechanism is able to capture more summary relevant information from the source context. Results of our experiments show that the proposed model has significant advantages over the baseline models on the dataset RCV1-V2 and Ren-CECps, and our analysis demonstrates that our model is competitive to the deterministic hierarchical models and it is more robust to classifying low-frequency labels.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/21/2022

Academic Resource Text Level Multi-label Classification based on Attention

Hierarchical multi-label academic text classification (HMTC) is to assig...
research
05/24/2019

Label-aware Document Representation via Hybrid Attention for Extreme Multi-Label Text Classification

Extreme multi-label text classification (XMTC) aims at tagging a documen...
research
09/10/2018

A Deep Reinforced Sequence-to-Set Model for Multi-Label Text Classification

Multi-label text classification (MLTC) aims to assign multiple labels to...
research
02/22/2020

Incorporating Effective Global Information via Adaptive Gate Attention for Text Classification

The dominant text classification studies focus on training classifiers u...
research
10/02/2017

Attentive Convolution

In NLP, convolution neural networks (CNNs) have benefited less than recu...
research
10/26/2022

OTSeq2Set: An Optimal Transport Enhanced Sequence-to-Set Model for Extreme Multi-label Text Classification

Extreme multi-label text classification (XMTC) is the task of finding th...
research
02/17/2019

Attention-Based Prototypical Learning Towards Interpretable, Confident and Robust Deep Neural Networks

We propose a new framework for prototypical learning that bases decision...

Please sign up or login with your details

Forgot password? Click here to reset