BotGraph: Web Bot Detection Based on Sitemap

03/19/2019
by   Yang Luo, et al.
0

The web bots have been blamed for consuming large amount of Internet traffic and undermining the interest of the scraped sites for years. Traditional bot detection studies focus mainly on signature-based solution, but advanced bots usually forge their identities to bypass such detection. With increasing cloud migration, cloud providers provide new opportunities for an effective bot detection based on big data to solve this issue. In this paper, we present a behavior-based bot detection scheme called BotGraph that combines sitemap and convolutional neural network (CNN) to detect inner behavior of bots. Experimental results show that BotGraph achieves 95 35-day production data traces from different customers including the Bing search engine and several sites.

READ FULL TEXT
research
09/22/2019

LuNet: A Deep Neural Network for Network Intrusion Detection

Network attack is a significant security issue for modern society. From ...
research
11/19/2017

A systematic framework to discover pattern for web spam classification

Web spam is a big problem for search engine users in World Wide Web. The...
research
04/07/2023

Carrot Cure: A CNN based Application to Detect Carrot Disease

Carrot is a famous nutritional vegetable and developed all over the worl...
research
04/09/2020

The Web is Still Small After More Than a Decade

Understanding web co-location is essential for various reasons. For inst...
research
08/09/2022

Doppler: Automated SKU Recommendation in Migrating SQL Workloads to the Cloud

Selecting the optimal cloud target to migrate SQL estates from on-premis...
research
05/19/2021

Analyzing Machine Learning Approaches for Online Malware Detection in Cloud

The variety of services and functionality offered by various cloud servi...
research
12/21/2020

Design Rule Checking with a CNN Based Feature Extractor

Design rule checking (DRC) is getting increasingly complex in advanced n...

Please sign up or login with your details

Forgot password? Click here to reset