DeepAI AI Chat
Log In Sign Up

Prune2Edge: A Multi-Phase Pruning Pipelines to Deep Ensemble Learning in IIoT

04/09/2020
by   Besher Alhalabi, et al.
0

Most recently, with the proliferation of IoT devices, computational nodes in manufacturing systems IIoT(Industrial-Internet-of-things) and the lunch of 5G networks, there will be millions of connected devices generating a massive amount of data. In such an environment, the controlling systems need to be intelligent enough to deal with a vast amount of data to detect defects in a real-time process. Driven by such a need, artificial intelligence models such as deep learning have to be deployed into IIoT systems. However, learning and using deep learning models are computationally expensive, so an IoT device with limited computational power could not run such models. To tackle this issue, edge intelligence had emerged as a new paradigm towards running Artificial Intelligence models on edge devices. Although a considerable amount of studies have been proposed in this area, the research is still in the early stages. In this paper, we propose a novel edge-based multi-phase pruning pipelines to ensemble learning on IIoT devices. In the first phase, we generate a diverse ensemble of pruned models, then we apply integer quantisation, next we prune the generated ensemble using a clustering-based technique. Finally, we choose the best representative from each generated cluster to be deployed to a distributed IoT environment. On CIFAR-100 and CIFAR-10, our proposed approach was able to outperform the predictability levels of a baseline model (up to 7 reduction in the model size) that minimise the required computational capabilities to make an inference on the resource-constraint devices.

READ FULL TEXT

page 1

page 6

05/04/2021

Pervasive AI for IoT Applications: Resource-efficient Distributed Artificial Intelligence

Artificial intelligence (AI) has witnessed a substantial breakthrough in...
09/02/2018

Towards an Intelligent Edge: Wireless Communication Meets Machine Learning

The recent revival of artificial intelligence (AI) is revolutionizing al...
07/22/2019

EnSyth: A Pruning Approach to Synthesis of Deep Learning Ensembles

Deep neural networks have achieved state-of-art performance in many doma...
10/15/2022

Variant Parallelism: Lightweight Deep Convolutional Models for Distributed Inference on IoT Devices

Two major techniques are commonly used to meet real-time inference limit...
10/28/2021

Computational Intelligence and Deep Learning for Next-Generation Edge-Enabled Industrial IoT

In this paper, we investigate how to deploy computational intelligence a...
05/04/2021

The Synergy of Complex Event Processing and Tiny Machine Learning in Industrial IoT

Focusing on comprehensive networking, big data, and artificial intellige...
09/02/2022

Tweak: Towards Portable Deep Learning Models for Domain-Agnostic LoRa Device Authentication

Deep learning based device fingerprinting has emerged as a key method of...