DeepAI AI Chat
Log In Sign Up

SemEval-2022 Task 2: Multilingual Idiomaticity Detection and Sentence Embedding

by   Harish Tayyar Madabushi, et al.

This paper presents the shared task on Multilingual Idiomaticity Detection and Sentence Embedding, which consists of two subtasks: (a) a binary classification one aimed at identifying whether a sentence contains an idiomatic expression, and (b) a task based on semantic text similarity which requires the model to adequately represent potentially idiomatic expressions in context. Each subtask includes different settings regarding the amount of training data. Besides the task description, this paper introduces the datasets in English, Portuguese, and Galician and their annotation procedure, the evaluation metrics, and a summary of the participant systems and their results. The task had close to 100 registered participants organised into twenty five teams making over 650 and 150 submissions in the practice and evaluation phases respectively.


page 1

page 2

page 3

page 4


Findings of the Shared Task on Multilingual Coreference Resolution

This paper presents an overview of the shared task on multilingual coref...

Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description

We present the results from the second shared task on multimodal machine...

Findings of the NLP4IF-2019 Shared Task on Fine-Grained Propaganda Detection

We present the shared task on Fine-Grained Propaganda Detection, which w...

Fine-Tuned Neural Models for Propaganda Detection at the Sentence and Fragment levels

This paper presents the CUNLP submission for the NLP4IF 2019 shared-task...

Extended Multilingual Protest News Detection – Shared Task 1, CASE 2021 and 2022

We report results of the CASE 2022 Shared Task 1 on Multilingual Protest...

UAlberta at SemEval 2022 Task 2: Leveraging Glosses and Translations for Multilingual Idiomaticity Detection

We describe the University of Alberta systems for the SemEval-2022 Task ...