Learning Invariant Representations for Sentiment Analysis: The Missing Material is Datasets

07/29/2019
by   Victor Bouvier, et al.
0

Learning representations which remain invariant to a nuisance factor has a great interest in Domain Adaptation, Transfer Learning, and Fair Machine Learning. Finding such representations becomes highly challenging in NLP tasks since the nuisance factor is entangled in a raw text. To our knowledge, a major issue is also that only few NLP datasets allow assessing the impact of such factor. In this paper, we introduce two generalization metrics to assess model robustness to a nuisance factor: generalization under target bias and generalization onto unknown. We combine those metrics with a simple data filtering approach to control the impact of the nuisance factor on the data and thus to build experimental biased datasets. We apply our method to standard datasets of the literature (Amazon and Yelp). Our work shows that a simple text classification baseline (i.e., sentiment analysis on reviews) may be badly affected by the product ID (considered as a nuisance factor) when learning the polarity of a review. The method proposed is generic and applicable as soon as the nuisance variable is annotated in the dataset.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/08/2017

Data Selection Strategies for Multi-Domain Sentiment Analysis

Domain adaptation is important in sentiment analysis as sentiment-indica...
research
08/23/2018

Financial Aspect-Based Sentiment Analysis using Deep Representations

The topic of aspect-based sentiment analysis (ABSA) has been explored fo...
research
06/04/2019

System Demo for Transfer Learning across Vision and Text using Domain Specific CNN Accelerator for On-Device NLP Applications

Power-efficient CNN Domain Specific Accelerator (CNN-DSA) chips are curr...
research
10/29/2019

An Efficient Model for Sentiment Analysis of Electronic Product Reviews in Vietnamese

In the past few years, the growth of e-commerce and digital marketing in...
research
02/24/2016

Ultradense Word Embeddings by Orthogonal Transformation

Embeddings are generic representations that are useful for many NLP task...
research
05/31/2017

Controllable Invariance through Adversarial Feature Learning

Learning meaningful representations that maintain the content necessary ...
research
07/19/2022

Enhancing Collaborative Filtering Recommender with Prompt-Based Sentiment Analysis

Collaborative Filtering(CF) recommender is a crucial application in the ...

Please sign up or login with your details

Forgot password? Click here to reset