An accurate IoT Intrusion Detection Framework using Apache Spark

02/21/2022
by   Mohamed Abushwereb, et al.
0

The internet has caused tremendous changes since its appearance in the 1980s, and now, the Internet of Things (IoT) seems to be doing the same. The potential of IoT has made it the center of attention for many people, but, where some see an opportunity to contribute, others may see IoT networks as a target to be exploited. The high number of IoT devices makes them the perfect setup for staging denial-of-service attacks (DoS) that can have devastating consequences. This renders the need for cybersecurity measures such as intrusion detection systems (IDSs) evident. The aim of this paper is to build an IDS using the big data platform, Apache Spark. Apache Spark was used along with its ML library (MLlib) and the BoT-IoT dataset. The IDS was then tested and evaluated based on F-Measure (f1), as was the standard when evaluating imbalanced data. Two rounds of tests were performed, a partial dataset for minimizing bias, and the full BoT-IoT dataset for exploring big data and ML capabilities in a security setting. For the partial dataset, the Random Forest algorithm had the highest performance for binary classification at an average f1 measure of 99.7 well as 99.6 category classification. As for the complete dataset, the Decision Tree algorithm scored the highest f1 measures for all conducted tests; 97.9 binary classification, 79 category classification.

READ FULL TEXT
research
08/02/2023

IIDS: Design of Intelligent Intrusion Detection System for Internet-of-Things Applications

With rapid technological growth, security attacks are drastically increa...
research
01/10/2021

An Experimental Analysis of Attack Classification Using Machine Learning in IoT Networks

In recent years, there has been a massive increase in the amount of Inte...
research
01/30/2023

Towards Adversarial Realism and Robust Learning for IoT Intrusion Detection and Classification

The Internet of Things (IoT) faces tremendous security challenges. Machi...
research
04/20/2021

Voting Classifier-based Intrusion Detection for IoT Networks

Internet of Things (IoT) is transforming human lives by paving the way f...
research
12/10/2022

Performance Evaluation of Apache Spark MLlib Algorithms on an Intrusion Detection Dataset

The increase in the use of the Internet and web services and the advent ...
research
11/02/2018

Towards the Development of Realistic Botnet Dataset in the Internet of Things for Network Forensic Analytics: Bot-IoT Dataset

The proliferation of IoT systems, has seen them targeted by malicious th...
research
12/15/2022

Balanced Datasets for IoT IDS

As the Internet of Things (IoT) continues to grow, cyberattacks are beco...

Please sign up or login with your details

Forgot password? Click here to reset