CARONTE: Crawling Adversarial Resources Over Non-Trusted, High-Profile Environments

by   Michele Campobasso, et al.

The monitoring of underground criminal activities is often automated to maximize the data collection and to train ML models to automatically adapt data collection tools to different communities. On the other hand, sophisticated adversaries may adopt crawling-detection capabilities that may significantly jeopardize researchers' opportunities to perform the data collection, for example by putting their accounts under the spotlight and being expelled from the community. This is particularly undesirable in prominent and high-profile criminal communities where entry costs are significant (either monetarily or for example for background checking or other trust-building mechanisms). This paper presents CARONTE, a tool to semi-automatically learn virtually any forum structure for parsing and data-extraction, while maintaining a low profile for the data collection and avoiding the requirement of collecting massive datasets to maintain tool scalability. We showcase the tool against four underground forums, and compare the network traffic it generates (as seen from the adversary's position, i.e. the underground community's server) against state-of-the-art tools for web-crawling as well as human users.



There are no comments yet.


page 1

page 4


Privacidade digital como direito do cidadao: o caso dos grupos indigenas do Brasil

The article presents a brief review of the Brazilian legislation that im...

Harvesting data revolution for transmission electron microscopy (TEM) using signal processing

TEM (Transmission Electron Microscopy) is a powerful tool for imaging ma...

Towards Formalizing HRI Data Collection Processes

Within the human-robot interaction (HRI) community, many researchers hav...

Are Privacy Dashboards Good for End Users? Evaluating User Perceptions and Reactions to Google's My Activity (Extended Version)

Privacy dashboards and transparency tools help users review and manage t...

Measuring Data Collection Quality for Community Healthcare

Machine learning has tremendous potential to provide targeted interventi...

Sharing Practices for Datasets Related to Accessibility and Aging

Datasets sourced from people with disabilities and older adults play an ...

Learning to automate cryo-electron microscopy data collection with Ptolemy

Over the past decade, cryogenic electron microscopy (cryo-EM) has emerge...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.