SentimentGPT: Exploiting GPT for Advanced Sentiment Analysis and its Departure from Current Machine Learning

07/16/2023
by   Kiana Kheiri, et al.
0

This study presents a thorough examination of various Generative Pretrained Transformer (GPT) methodologies in sentiment analysis, specifically in the context of Task 4 on the SemEval 2017 dataset. Three primary strategies are employed: 1) prompt engineering using the advanced GPT-3.5 Turbo, 2) fine-tuning GPT models, and 3) an inventive approach to embedding classification. The research yields detailed comparative insights among these strategies and individual GPT models, revealing their unique strengths and potential limitations. Additionally, the study compares these GPT-based methodologies with other current, high-performing models previously used with the same dataset. The results illustrate the significant superiority of the GPT approaches in terms of predictive performance, more than 22% in F1-score compared to the state-of-the-art. Further, the paper sheds light on common challenges in sentiment analysis tasks, such as understanding context and detecting sarcasm. It underscores the enhanced capabilities of the GPT models to effectively handle these complexities. Taken together, these findings highlight the promising potential of GPT models in sentiment analysis, setting the stage for future research in this field. The code can be found at https://github.com/DSAatUSU/SentimentGPT

READ FULL TEXT

page 1

page 4

research
04/21/2023

UBC-DLNLP at SemEval-2023 Task 12: Impact of Transfer Learning on African Sentiment Analysis

We describe our contribution to the SemEVAl 2023 AfriSenti-SemEval share...
research
01/06/2023

SAIDS: A Novel Approach for Sentiment Analysis Informed of Dialect and Sarcasm

Sentiment analysis becomes an essential part of every social network, as...
research
05/24/2023

Sentiment Analysis in the Era of Large Language Models: A Reality Check

Sentiment analysis (SA) has been a long-standing research area in natura...
research
06/13/2019

Sentiment analysis is not solved! Assessing and probing sentiment classification

Neural methods for SA have led to quantitative improvements over previou...
research
06/28/2023

Taqyim: Evaluating Arabic NLP Tasks Using ChatGPT Models

Large language models (LLMs) have demonstrated impressive performance on...
research
07/21/2016

A Perspective on Sentiment Analysis

Sentiment Analysis (SA) is indeed a fascinating area of research which h...
research
04/20/2023

Can ChatGPT Reproduce Human-Generated Labels? A Study of Social Computing Tasks

The release of ChatGPT has uncovered a range of possibilities whereby la...

Please sign up or login with your details

Forgot password? Click here to reset