A Framework for Verifiable and Auditable Federated Anomaly Detection

03/15/2022
by   Gabriele Santin, et al.
0

Federated Leaning is an emerging approach to manage cooperation between a group of agents for the solution of Machine Learning tasks, with the goal of improving each agent's performance without disclosing any data. In this paper we present a novel algorithmic architecture that tackle this problem in the particular case of Anomaly Detection (or classification or rare events), a setting where typical applications often comprise data with sensible information, but where the scarcity of anomalous examples encourages collaboration. We show how Random Forests can be used as a tool for the development of accurate classifiers with an effective insight-sharing mechanism that does not break the data integrity. Moreover, we explain how the new architecture can be readily integrated in a blockchain infrastructure to ensure the verifiable and auditable execution of the algorithm. Furthermore, we discuss how this work may set the basis for a more general approach for the design of federated ensemble-learning methods beyond the specific task and architecture discussed in this paper.

READ FULL TEXT
research
05/16/2022

Federated Anomaly Detection over Distributed Data Streams

Sharing of telecommunication network data, for example, even at high agg...
research
10/12/2022

Anomaly Detection via Federated Learning

Machine learning has helped advance the field of anomaly detection by in...
research
06/29/2022

Framing Algorithmic Recourse for Anomaly Detection

The problem of algorithmic recourse has been explored for supervised mac...
research
03/13/2023

Network Anomaly Detection Using Federated Learning

Due to the veracity and heterogeneity in network traffic, detecting anom...
research
02/14/2023

Lessons from the Development of an Anomaly Detection Interface on the Mars Perseverance Rover using the ISHMAP Framework

While anomaly detection stands among the most important and valuable pro...
research
06/28/2019

Deep Multi-Task Learning for Anomalous Driving Detection Using CAN Bus Scalar Sensor Data

Corner cases are the main bottlenecks when applying Artificial Intellige...
research
10/25/2020

On synthetic data generation for anomaly detection in complex social networks

This paper studies the feasibility of synthetic data generation for miss...

Please sign up or login with your details

Forgot password? Click here to reset