Challenges and Limitations with the Metrics Measuring the Complexity of Code-Mixed Text

06/18/2021
by   Vivek Srivastava, et al.
5

Code-mixing is a frequent communication style among multilingual speakers where they mix words and phrases from two different languages in the same utterance of text or speech. Identifying and filtering code-mixed text is a challenging task due to its co-existence with monolingual and noisy text. Over the years, several code-mixing metrics have been extensively used to identify and validate code-mixed text quality. This paper demonstrates several inherent limitations of code-mixing metrics with examples from the already existing datasets that are popularly used across various experiments.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/24/2021

MIPE: A Metric Independent Pipeline for Effective Code-Mixed NLG Evaluation

Code-mixing is a phenomenon of mixing words and phrases from two or more...
research
06/16/2022

PreCogIIITH at HinglishEval : Leveraging Code-Mixing Metrics Language Model Embeddings To Estimate Code-Mix Quality

Code-Mixing is a phenomenon of mixing two or more languages in a speech ...
research
02/23/2023

MUTANT: A Multi-sentential Code-mixed Hinglish Dataset

The multi-sentential long sequence textual data unfolds several interest...
research
06/15/2021

Challenges and Considerations with Code-Mixed NLP for Multilingual Societies

Multilingualism refers to the high degree of proficiency in two or more ...
research
07/04/2017

Complexity Metric for Code-Mixed Social Media Text

An evaluation metric is an absolute necessity for measuring the performa...
research
03/31/2017

Joining Hands: Exploiting Monolingual Treebanks for Parsing of Code-mixing Data

In this paper, we propose efficient and less resource-intensive strategi...
research
06/25/2020

IIT Gandhinagar at SemEval-2020 Task 9: Code-Mixed Sentiment Classification Using Candidate Sentence Generation and Selection

Code-mixing is the phenomenon of using multiple languages in the same ut...

Please sign up or login with your details

Forgot password? Click here to reset