Emotions are Subtle: Learning Sentiment Based Text Representations Using Contrastive Learning

12/02/2021
by   Ipsita Mohanty, et al.
0

Contrastive learning techniques have been widely used in the field of computer vision as a means of augmenting datasets. In this paper, we extend the use of these contrastive learning embeddings to sentiment analysis tasks and demonstrate that fine-tuning on these embeddings provides an improvement over fine-tuning on BERT-based embeddings to achieve higher benchmarks on the task of sentiment analysis when evaluated on the DynaSent dataset. We also explore how our fine-tuned models perform on cross-domain benchmark datasets. Additionally, we explore upsampling techniques to achieve a more balanced class distribution to make further improvements on our benchmark tasks.

READ FULL TEXT
research
08/18/2022

Mere Contrastive Learning for Cross-Domain Sentiment Analysis

Cross-domain sentiment analysis aims to predict the sentiment of texts i...
research
07/21/2021

Improved Text Classification via Contrastive Adversarial Training

We propose a simple and general method to regularize the fine-tuning of ...
research
05/19/2023

A Weak Supervision Approach for Few-Shot Aspect Based Sentiment

We explore how weak supervision on abundant unlabeled data can be levera...
research
04/12/2016

From Pixels to Sentiment: Fine-tuning CNNs for Visual Sentiment Prediction

Visual multimedia have become an inseparable part of our digital social ...
research
12/05/2020

Cross-Domain Sentiment Classification with In-Domain Contrastive Learning

Contrastive learning (CL) has been successful as a powerful representati...
research
06/06/2023

Systematic Analysis of Music Representations from BERT

There have been numerous attempts to represent raw data as numerical vec...
research
09/13/2017

Assessing State-of-the-Art Sentiment Models on State-of-the-Art Sentiment Datasets

There has been a good amount of progress in sentiment analysis over the ...

Please sign up or login with your details

Forgot password? Click here to reset