Knowledge is at the Edge! How to Search in Distributed Machine Learning Models

10/13/2017
by   Thomas Bach, et al.
0

With the advent of the Internet of Things and Industry 4.0 an enormous amount of data is produced at the edge of the network. Due to a lack of computing power, this data is currently send to the cloud where centralized machine learning models are trained to derive higher level knowledge. With the recent development of specialized machine learning hardware for mobile devices, a new era of distributed learning is about to begin that raises a new research question: How can we search in distributed machine learning models? Machine learning at the edge of the network has many benefits, such as low-latency inference and increased privacy. Such distributed machine learning models can also learn personalized for a human user, a specific context, or application scenario. As training data stays on the devices, control over possibly sensitive data is preserved as it is not shared with a third party. This new form of distributed learning leads to the partitioning of knowledge between many devices which makes access difficult. In this paper we tackle the problem of finding specific knowledge by forwarding a search request (query) to a device that can answer it best. To that end, we use a entropy based quality metric that takes the context of a query and the learning quality of a device into account. We show that our forwarding strategy can achieve over 95 accuracy in a urban mobility scenario where we use data from 30 000 people commuting in the city of Trento, Italy.

READ FULL TEXT

page 13

page 14

research
11/03/2021

Communication-Efficient Separable Neural Network for Distributed Inference on Edge Devices

The inference of Neural Networks is usually restricted by the resources ...
research
01/28/2020

D2D-Enabled Data Sharing for Distributed Machine Learning at Wireless Network Edge

Mobile edge learning is an emerging technique that enables distributed e...
research
06/07/2023

Git-Theta: A Git Extension for Collaborative Development of Machine Learning Models

Currently, most machine learning models are trained by centralized teams...
research
07/31/2019

Machine Learning at the Network Edge: A Survey

Devices comprising the Internet of Things, such as sensors and small cam...
research
04/14/2018

When Edge Meets Learning: Adaptive Control for Resource-Constrained Distributed Machine Learning

Emerging technologies and applications including Internet of Things (IoT...
research
12/30/2018

Broadband Analog Aggregation for Low-Latency Federated Edge Learning

The popularity of mobile devices results in the availability of enormous...
research
06/23/2022

Device-centric Federated Analytics At Ease

Nowadays, high-volume and privacy-sensitive data are generated by mobile...

Please sign up or login with your details

Forgot password? Click here to reset