DeepAI AI Chat
Log In Sign Up

PerPaDa: A Persian Paraphrase Dataset based on Implicit Crowdsourcing Data Collection

01/17/2022
by   Salar Mohtaj, et al.
Freie Universität Berlin
Berlin Institute of Technology (Technische Universität Berlin)
0

In this paper we introduce PerPaDa, a Persian paraphrase dataset that is collected from users' input in a plagiarism detection system. As an implicit crowdsourcing experience, we have gathered a large collection of original and paraphrased sentences from Hamtajoo; a Persian plagiarism detection system, in which users try to conceal cases of text re-use in their documents by paraphrasing and re-submitting manuscripts for analysis. The compiled dataset contains 2446 instances of paraphrasing. In order to improve the overall quality of the collected data, some heuristics have been used to exclude sentences that don't meet the proposed criteria. The introduced corpus is much larger than the available datasets for the task of paraphrase identification in Persian. Moreover, there is less bias in the data compared to the similar datasets, since the users did not try some fixed predefined rules in order to generate similar texts to their original inputs.

READ FULL TEXT
08/27/2020

Uralic Language Identification (ULI) 2020 shared task dataset and the Wanca 2017 corpus

This article introduces the Wanca 2017 corpus of texts crawled from the ...
12/14/2021

Towards A Reliable Ground-Truth For Biased Language Detection

Reference texts such as encyclopedias and news articles can manifest bia...
11/07/2016

Crowdsourcing in Computer Vision

Computer vision systems require large amounts of manually annotated data...
11/04/2022

CochlScene: Acquisition of acoustic scene data using crowdsourcing

This paper describes a pipeline for collecting acoustic scene data by us...
03/03/2022

Towards Rich, Portable, and Large-Scale Pedestrian Data Collection

Recently, pedestrian behavior research has shifted towards machine learn...
12/09/2015

Where You Are Is Who You Are: User Identification by Matching Statistics

Most users of online services have unique behavioral or usage patterns. ...