LyricSIM: A novel Dataset and Benchmark for Similarity Detection in Spanish Song LyricS

06/02/2023
by   Alejandro Benito-Santos, et al.
0

In this paper, we present a new dataset and benchmark tailored to the task of semantic similarity in song lyrics. Our dataset, originally consisting of 2775 pairs of Spanish songs, was annotated in a collective annotation experiment by 63 native annotators. After collecting and refining the data to ensure a high degree of consensus and data integrity, we obtained 676 high-quality annotated pairs that were used to evaluate the performance of various state-of-the-art monolingual and multilingual language models. Consequently, we established baseline results that we hope will be useful to the community in all future academic and industrial applications conducted in this context.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/23/2021

Are Neural Language Models Good Plagiarists? A Benchmark for Neural Paraphrase Detection

The rise of language models such as BERT allows for high-quality text pa...
research
05/12/2022

SimRelUz: Similarity and Relatedness scores as a Semantic Evaluation dataset for Uzbek language

Semantic relatedness between words is one of the core concepts in natura...
research
03/17/2021

Investigating Monolingual and Multilingual BERTModels for Vietnamese Aspect Category Detection

Aspect category detection (ACD) is one of the challenging tasks in the A...
research
04/28/2023

HQP: A Human-Annotated Dataset for Detecting Online Propaganda

Online propaganda poses a severe threat to the integrity of societies. H...
research
10/21/2018

BCWS: Bilingual Contextual Word Similarity

This paper introduces the first dataset for evaluating English-Chinese B...
research
08/19/2021

Czech News Dataset for Semantic Textual Similarity

This paper describes a novel dataset consisting of sentences with semant...
research
04/15/2018

Are Automatic Methods for Cognate Detection Good Enough for Phylogenetic Reconstruction in Historical Linguistics?

We evaluate the performance of state-of-the-art algorithms for automatic...

Please sign up or login with your details

Forgot password? Click here to reset