CARONTE: Crawling Adversarial Resources Over Non-Trusted, High-Profile Environments

09/17/2020
by   Michele Campobasso, et al.
0

The monitoring of underground criminal activities is often automated to maximize the data collection and to train ML models to automatically adapt data collection tools to different communities. On the other hand, sophisticated adversaries may adopt crawling-detection capabilities that may significantly jeopardize researchers' opportunities to perform the data collection, for example by putting their accounts under the spotlight and being expelled from the community. This is particularly undesirable in prominent and high-profile criminal communities where entry costs are significant (either monetarily or for example for background checking or other trust-building mechanisms). This paper presents CARONTE, a tool to semi-automatically learn virtually any forum structure for parsing and data-extraction, while maintaining a low profile for the data collection and avoiding the requirement of collecting massive datasets to maintain tool scalability. We showcase the tool against four underground forums, and compare the network traffic it generates (as seen from the adversary's position, i.e. the underground community's server) against state-of-the-art tools for web-crawling as well as human users.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 4

03/30/2021

Privacidade digital como direito do cidadao: o caso dos grupos indigenas do Brasil

The article presents a brief review of the Brazilian legislation that im...
04/18/2021

Harvesting data revolution for transmission electron microscopy (TEM) using signal processing

TEM (Transmission Electron Microscopy) is a powerful tool for imaging ma...
03/16/2022

Towards Formalizing HRI Data Collection Processes

Within the human-robot interaction (HRI) community, many researchers hav...
05/28/2021

Are Privacy Dashboards Good for End Users? Evaluating User Perceptions and Reactions to Google's My Activity (Extended Version)

Privacy dashboards and transparency tools help users review and manage t...
11/05/2020

Measuring Data Collection Quality for Community Healthcare

Machine learning has tremendous potential to provide targeted interventi...
08/24/2021

Sharing Practices for Datasets Related to Accessibility and Aging

Datasets sourced from people with disabilities and older adults play an ...
12/01/2021

Learning to automate cryo-electron microscopy data collection with Ptolemy

Over the past decade, cryogenic electron microscopy (cryo-EM) has emerge...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.