T-BERT – Model for Sentiment Analysis of Micro-blogs Integrating Topic Model and BERT

06/02/2021
by   Sarojadevi Palani, et al.
0

Sentiment analysis (SA) has become an extensive research area in recent years impacting diverse fields including ecommerce, consumer business, and politics, driven by increasing adoption and usage of social media platforms. It is challenging to extract topics and sentiments from unsupervised short texts emerging in such contexts, as they may contain figurative words, strident data, and co-existence of many possible meanings for a single word or phrase, all contributing to obtaining incorrect topics. Most prior research is based on a specific theme/rhetoric/focused-content on a clean dataset. In the work reported here, the effectiveness of BERT(Bidirectional Encoder Representations from Transformers) in sentiment classification tasks from a raw live dataset taken from a popular microblogging platform is demonstrated. A novel T-BERT framework is proposed to show the enhanced performance obtainable by combining latent topics with contextual BERT embeddings. Numerical experiments were conducted on an ensemble with about 42000 datasets using NimbleBox.ai platform with a hardware configuration consisting of Nvidia Tesla K80(CUDA), 4 core CPU, 15GB RAM running on an isolated Google Cloud Platform instance. The empirical results show that the model improves in performance while adding topics to BERT and an accuracy rate of 90.81 proposed approach.

READ FULL TEXT

page 1

page 2

page 4

page 7

research
11/10/2022

BERT-Based Combination of Convolutional and Recurrent Neural Network for Indonesian Sentiment Analysis

Sentiment analysis is the computational study of opinions and emotions e...
research
12/05/2016

The Evolution of Sentiment Analysis - A Review of Research Topics, Venues, and Top Cited Papers

Sentiment analysis is one of the fastest growing research areas in compu...
research
07/02/2020

Bidirectional Encoder Representations from Transformers (BERT): A sentiment analysis odyssey

The purpose of the study is to investigate the relative effectiveness of...
research
01/14/2020

A BERT based Sentiment Analysis and Key Entity Detection Approach for Online Financial Texts

The emergence and rapid progress of the Internet have brought ever-incre...
research
06/09/2023

Causality between Sentiment and Cryptocurrency Prices

This study investigates the relationship between narratives conveyed thr...
research
01/01/2020

Stacked DeBERT: All Attention in Incomplete Data for Text Classification

In this paper, we propose Stacked DeBERT, short for Stacked Denoising Bi...
research
11/12/2021

Dataset of Philippine Presidents Speeches from 1935 to 2016

The dataset was collected to examine and identify possible key topics wi...

Please sign up or login with your details

Forgot password? Click here to reset