Heavy-tailed Representations, Text Polarity Classification Data Augmentation

03/25/2020
by   Hamid Jalalzai, et al.
0

The dominant approaches to text representation in natural language rely on learning embeddings on massive corpora which have convenient properties such as compositionality and distance preservation. In this paper, we develop a novel method to learn a heavy-tailed embedding with desirable regularity properties regarding the distributional tails, which allows to analyze the points far away from the distribution bulk using the framework of multivariate extreme value theory. In particular, a classifier dedicated to the tails of the proposed embedding is obtained which performance outperforms the baseline. This classifier exhibits a scale invariance property which we leverage by introducing a novel text generation method for label preserving dataset augmentation. Numerical experiments on synthetic and real text data demonstrate the relevance of the proposed framework and confirm that this method generates meaningful sentences with controllable attribute, e.g. positive or negative sentiment.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/15/2022

Classifiers are Better Experts for Controllable Text Generation

This paper proposes a simple method for controllable text generation bas...
research
06/17/2020

Fine-grained Sentiment Controlled Text Generation

Controlled text generation techniques aim to regulate specific attribute...
research
05/21/2022

Few-Shot Natural Language Inference Generation with PDD: Prompt and Dynamic Demonstration

Natural Language Inference Generation task is to generate a text hypothe...
research
10/06/2022

A Distributional Lens for Multi-Aspect Controllable Text Generation

Multi-aspect controllable text generation is a more challenging and prac...
research
09/18/2017

Leveraging Distributional Semantics for Multi-Label Learning

We present a novel and scalable label embedding framework for large-scal...
research
10/04/2020

Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Space

In this paper, we propose a novel data augmentation method, referred to ...
research
05/31/2023

An Invariant Learning Characterization of Controlled Text Generation

Controlled generation refers to the problem of creating text that contai...

Please sign up or login with your details

Forgot password? Click here to reset