Zero-shot hashtag segmentation for multilingual sentiment analysis

12/06/2021
by   Ruan Chaves Rodrigues, et al.
0

Hashtag segmentation, also known as hashtag decomposition, is a common step in preprocessing pipelines for social media datasets. It usually precedes tasks such as sentiment analysis and hate speech detection. For sentiment analysis in medium to low-resourced languages, previous research has demonstrated that a multilingual approach that resorts to machine translation can be competitive or superior to previous approaches to the task. We develop a zero-shot hashtag segmentation framework and demonstrate how it can be used to improve the accuracy of multilingual sentiment analysis pipelines. Our zero-shot framework establishes a new state-of-the-art for hashtag segmentation datasets, surpassing even previous approaches that relied on feature engineering and language models trained on in-domain data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/01/2023

UCAS-IIE-NLP at SemEval-2023 Task 12: Enhancing Generalization of Multilingual BERT for Low-resource Sentiment Analysis

This paper describes our system designed for SemEval-2023 Task 12: Senti...
research
05/02/2023

Stance Detection With Supervised, Zero-Shot, and Few-Shot Applications

Stance detection is the identification of an author's beliefs about a su...
research
05/23/2023

Multilingual Large Language Models Are Not (Yet) Code-Switchers

Multilingual Large Language Models (LLMs) have recently shown great capa...
research
07/26/2023

Developing and Evaluating Tiny to Medium-Sized Turkish BERT Models

This study introduces and evaluates tiny, mini, small, and medium-sized ...
research
03/27/2021

Unsupervised Self-Training for Sentiment Analysis of Code-Switched Data

Sentiment analysis is an important task in understanding social media co...
research
06/03/2019

Multi-task Pairwise Neural Ranking for Hashtag Segmentation

Hashtags are often employed on social media and beyond to add metadata t...
research
07/30/2021

Towards Universality in Multilingual Text Rewriting

In this work, we take the first steps towards building a universal rewri...

Please sign up or login with your details

Forgot password? Click here to reset