Efficient Training of Large-scale Industrial Fault Diagnostic Models through Federated Opportunistic Block Dropout

02/22/2023
by   Yuanyuan Chen, et al.
0

Artificial intelligence (AI)-empowered industrial fault diagnostics is important in ensuring the safe operation of industrial applications. Since complex industrial systems often involve multiple industrial plants (possibly belonging to different companies or subsidiaries) with sensitive data collected and stored in a distributed manner, collaborative fault diagnostic model training often needs to leverage federated learning (FL). As the scale of the industrial fault diagnostic models are often large and communication channels in such systems are often not exclusively used for FL model training, existing deployed FL model training frameworks cannot train such models efficiently across multiple institutions. In this paper, we report our experience developing and deploying the Federated Opportunistic Block Dropout (FEDOBD) approach for industrial fault diagnostic model training. By decomposing large-scale models into semantic blocks and enabling FL participants to opportunistically upload selected important blocks in a quantized manner, it significantly reduces the communication overhead while maintaining model performance. Since its deployment in ENN Group in February 2022, FEDOBD has served two coal chemical plants across two cities in China to build industrial fault prediction models. It helped the company reduce the training communication overhead by over 70 maintaining model performance at over 85 is the first successfully deployed dropout-based FL approach.

READ FULL TEXT

page 3

page 7

research
08/10/2022

FedOBD: Opportunistic Block Dropout for Efficiently Training Large-scale Neural Networks through Federated Learning

Large-scale neural networks possess considerable expressive power. They ...
research
05/16/2023

Keep It Simple: Fault Tolerance Evaluation of Federated Learning with Unreliable Clients

Federated learning (FL), as an emerging artificial intelligence (AI) app...
research
12/24/2019

A Communication Efficient Vertical Federated Learning Framework

One critical challenge for applying today's Artificial Intelligence (AI)...
research
05/31/2021

Federated Learning for Industrial Internet of Things in Future Industries

The Industrial Internet of Things (IIoT) offers promising opportunities ...
research
11/18/2021

Advancing COVID-19 Diagnosis with Privacy-Preserving Collaboration in Artificial Intelligence

Artificial intelligence (AI) provides a promising substitution for strea...
research
11/07/2022

HFedMS: Heterogeneous Federated Learning with Memorable Data Semantics in Industrial Metaverse

Federated Learning (FL), as a rapidly evolving privacy-preserving collab...
research
08/14/2020

Distillation-Based Semi-Supervised Federated Learning for Communication-Efficient Collaborative Training with Non-IID Private Data

This study develops a federated learning (FL) framework overcoming large...

Please sign up or login with your details

Forgot password? Click here to reset