PHINC: A Parallel Hinglish Social Media Code-Mixed Corpus for Machine Translation

04/20/2020
by   Vivek Srivastava, et al.
0

Code-mixing is the phenomenon of using more than one language in a sentence. It is a very frequently observed pattern of communication on social media platforms. Flexibility to use multiple languages in one text message might help to communicate efficiently with the target audience. But, it adds to the challenge of processing and understanding natural language to a much larger extent. This paper presents a parallel corpus of the 13,738 code-mixed English-Hindi sentences and their corresponding translation in English. The translations of sentences are done manually by the annotators. We are releasing the parallel corpus to facilitate future research opportunities in code-mixed machine translation. The annotated corpus is available at https://doi.org/10.5281/zenodo.3605597.

READ FULL TEXT

page 3

page 4

research
01/07/2018

MIZAN: A Large Persian-English Parallel Corpus

One of the most major and essential tasks in natural language processing...
research
10/18/2020

hinglishNorm – A Corpus of Hindi-English Code Mixed Sentences for Text Normalization

We present hinglishNorm – a human annotated corpus of Hindi-English code...
research
11/09/2019

Code-Mixed to Monolingual Translation Framework

The use of multilingualism in the new generation is widespread in the fo...
research
01/27/2022

Prabhupadavani: A Code-mixed Speech Translation Data for 25 Languages

Nowadays, code-mixing has become ubiquitous in Natural Language Processi...
research
06/06/2017

Acquisition of Translation Lexicons for Historically Unwritten Languages via Bridging Loanwords

With the advent of informal electronic communications such as social med...
research
07/04/2017

Complexity Metric for Code-Mixed Social Media Text

An evaluation metric is an absolute necessity for measuring the performa...
research
01/30/2020

Harnessing Code Switching to Transcend the Linguistic Barrier

Code mixing (or code switching) is a common phenomenon observed in socia...

Please sign up or login with your details

Forgot password? Click here to reset