A Robust Contrastive Alignment Method For Multi-Domain Text Classification

04/26/2022
by   Xuefeng Li, et al.
0

Multi-domain text classification can automatically classify texts in various scenarios. Due to the diversity of human languages, texts with the same label in different domains may differ greatly, which brings challenges to the multi-domain text classification. Current advanced methods use the private-shared paradigm, capturing domain-shared features by a shared encoder, and training a private encoder for each domain to extract domain-specific features. However, in realistic scenarios, these methods suffer from inefficiency as new domains are constantly emerging. In this paper, we propose a robust contrastive alignment method to align text classification features of various domains in the same feature space by supervised contrastive learning. By this means, we only need two universal feature extractors to achieve multi-domain text classification. Extensive experimental results show that our method performs on par with or sometimes better than the state-of-the-art method, which uses the complex multi-classifier in a private-shared framework.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/27/2022

A Curriculum Learning Approach for Multi-domain Text Classification Using Keyword weight Ranking

Text classification is a very classic NLP task, but it has two prominent...
research
05/04/2023

Multi-Domain Learning From Insufficient Annotations

Multi-domain learning (MDL) refers to simultaneously constructing a mode...
research
09/18/2019

Dual Adversarial Co-Learning for Multi-Domain Text Classification

In this paper we propose a novel dual adversarial co-learning approach f...
research
01/30/2022

Co-Regularized Adversarial Learning for Multi-Domain Text Classification

Multi-domain text classification (MDTC) aims to leverage all available r...
research
06/06/2022

Contrastive Graph Multimodal Model for Text Classification in Videos

The extraction of text information in videos serves as a critical step t...
research
09/21/2022

Text Revealer: Private Text Reconstruction via Model Inversion Attacks against Transformers

Text classification has become widely used in various natural language p...
research
01/31/2021

Mixup Regularized Adversarial Networks for Multi-Domain Text Classification

Using the shared-private paradigm and adversarial training has significa...

Please sign up or login with your details

Forgot password? Click here to reset