Multimodal Multiple Federated Feature Construction Method for IoT Environments

by   Afsaneh Mahanipour, et al.

The fast development of Internet-of-Things (IoT) devices and applications has led to vast data collection, potentially containing irrelevant, noisy, or redundant features that degrade learning model performance. These collected data can be processed on either end-user devices (clients) or edge/cloud server. Feature construction is a pre-processing technique that can generate discriminative features and reveal hidden relationships between original features within a dataset, leading to improved performance and reduced computational complexity of learning models. Moreover, the communication cost between clients and edge/cloud server can be minimized in situations where a dataset needs to be transmitted for further processing. In this paper, the first federated feature construction (FFC) method called multimodal multiple FFC (MMFFC) is proposed by using multimodal optimization and gravitational search programming algorithm. This is a collaborative method for constructing multiple high-level features without sharing clients' datasets to enhance the trade-off between accuracy of the trained model and overall communication cost of the system, while also reducing computational complexity of the learning model. We analyze and compare the accuracy-cost trade-off of two scenarios, namely, 1) MMFFC federated learning (FL), using vanilla FL with pre-processed datasets on clients and 2) MMFFC centralized learning, transferring pre-processed datasets to an edge server and using centralized learning model. The results on three datasets for the first scenario and eight datasets for the second one demonstrate that the proposed method can reduce the size of datasets for about 60%, thereby reducing communication cost and improving accuracy of the learning models tested on almost all datasets.


FedNS: Improving Federated Learning for collaborative image classification on mobile clients

Federated Learning (FL) is a paradigm that aims to support loosely conne...

Hybrid Federated and Centralized Learning

Many of the machine learning (ML) tasks are focused on centralized learn...

Knowledge-Enhanced Semi-Supervised Federated Learning for Aggregating Heterogeneous Lightweight Clients in IoT

Federated learning (FL) enables multiple clients to train models collabo...

Exploiting Features and Logits in Heterogeneous Federated Learning

Due to the rapid growth of IoT and artificial intelligence, deploying ne...

Learner Referral for Cost-Effective Federated Learning Over Hierarchical IoT Networks

The paradigm of federated learning (FL) to address data privacy concerns...

Federated Learning with Additional Mechanisms on Clients to Reduce Communication Costs

Federated learning (FL) enables on-device training over distributed netw...

Federated Feature Selection for Cyber-Physical Systems of Systems

Autonomous systems generate a huge amount of multimodal data that are co...

Please sign up or login with your details

Forgot password? Click here to reset