Emoji Prediction using Transformer Models

07/05/2023
by   Muhammad Osama Nusrat, et al.
0

In recent years, the use of emojis in social media has increased dramatically, making them an important element in understanding online communication. However, predicting the meaning of emojis in a given text is a challenging task due to their ambiguous nature. In this study, we propose a transformer-based approach for emoji prediction using BERT, a widely-used pre-trained language model. We fine-tuned BERT on a large corpus of text containing both text and emojis to predict the most appropriate emoji for a given text. Our experimental results demonstrate that our approach outperforms several state-of-the-art models in predicting emojis with an accuracy of over 75 % This work has potential applications in natural language processing, sentiment analysis, and social media marketing.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/10/2022

Myers-Briggs personality classification from social media text using pre-trained language models

In Natural Language Processing, the use of pre-trained language models h...
research
09/22/2022

Adaptation of domain-specific transformer models with text oversampling for sentiment analysis of social media posts on Covid-19 vaccines

Covid-19 has spread across the world and several vaccines have been deve...
research
04/22/2020

Keyphrase Prediction With Pre-trained Language Model

Recently, generative methods have been widely used in keyphrase predicti...
research
07/04/2022

BERT, can HE predict contrastive focus? Predicting and controlling prominence in neural TTS using a language model

Several recent studies have tested the use of transformer language model...
research
05/04/2023

Curating corpora with classifiers: A case study of clean energy sentiment online

Well curated, large-scale corpora of social media posts containing broad...
research
04/19/2021

UVCE-IIITT@DravidianLangTech-EACL2021: Tamil Troll Meme Classification: You need to Pay more Attention

Tamil is a Dravidian language that is commonly used and spoken in the so...
research
04/21/2023

Text2Time: Transformer-based Article Time Period Prediction

The task of predicting the publication period of text documents, such as...

Please sign up or login with your details

Forgot password? Click here to reset