VeriDark: A Large-Scale Benchmark for Authorship Verification on the Dark Web

07/07/2022
by   Andrei Manolache, et al.
10

The DarkWeb represents a hotbed for illicit activity, where users communicate on different market forums in order to exchange goods and services. Law enforcement agencies benefit from forensic tools that perform authorship analysis, in order to identify and profile users based on their textual content. However, authorship analysis has been traditionally studied using corpora featuring literary texts such as fragments from novels or fan fiction, which may not be suitable in a cybercrime context. Moreover, the few works that employ authorship analysis tools for cybercrime prevention usually employ ad-hoc experimental setups and datasets. To address these issues, we release VeriDark: a benchmark comprised of three large scale authorship verification datasets and one authorship identification dataset obtained from user activity from either Dark Web related Reddit communities or popular illicit Dark Web market forums. We evaluate competitive NLP baselines on the three datasets and perform an analysis of the predictions to better understand the limitations of such approaches. We make the datasets and baselines publicly available at https://github.com/bit-ml/VeriDark

READ FULL TEXT
research
12/17/2019

ORCA: a Benchmark for Data Web Crawlers

The number of RDF knowledge graphs available on the Web grows constantly...
research
10/13/2020

Annotationsaurus: A Searchable Directory of Annotation Tools

Manual annotation of textual documents is a necessary task when construc...
research
09/14/2022

On the State of the Art in Authorship Attribution and Authorship Verification

Despite decades of research on authorship attribution (AA) and authorshi...
research
12/30/2021

Benchmarking Chinese Text Recognition: Datasets, Baselines, and an Empirical Study

The flourishing blossom of deep learning has witnessed the rapid develop...
research
01/25/2008

Between conjecture and memento: shaping a collective emotional perception of the future

Large scale surveys of public mood are costly and often impractical to p...
research
02/18/2019

A Broad Evaluation of the Tor English Content Ecosystem

Tor is among most well-known dark net in the world. It has noble uses, i...

Please sign up or login with your details

Forgot password? Click here to reset