Collaborative and continual learning for classification tasks in a society of devices

06/12/2020
by   Fernando E. Casado, et al.
0

Today we live in a context in which devices are increasingly interconnected and sensorized and are almost ubiquitous. Deep learning has become in recent years a popular way to extract knowledge from the huge amount of data that these devices are able to collect. Nevertheless, state-of-the-art learning methods have a number of drawbacks when facing real distributed problems, in which the available information is usually partial, biased and evolving over time. Moreover, if there is something that characterizes this society of devices is its high heterogeneity and dynamism, both in terms of users and the hardware itself. Therefore, against the tendency to centralize learning, in this work we want to present a new paradigm of learning in society, where devices get certain prominence back, having to learn in real time, locally, continuously, autonomously and from users, but also improving models globally, in the cloud, combining what is learned locally, in the devices. Hence, learning is carried out in a cyclical process of global consensus and local adaptation that can be repeated indefinitely over time. In this work we present a first architecture for this paradigm, which we call "glocal" learning. In order to test our proposal, we have applied it in a heterogeneous community of smartphone users to solve the problem of walking recognition. The results show the advantages that "glocal" learning provides with respect to other state-of-the-art methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/24/2021

Continual Learning at the Edge: Real-Time Training on Smartphone Devices

On-device training for personalized learning is a challenging research p...
research
12/04/2022

FedKNOW: Federated Continual Learning with Signature Task Knowledge Integration at Edge

Deep Neural Networks (DNNs) have been ubiquitously adopted in internet o...
research
09/18/2019

Distributed Machine Learning on Mobile Devices: A Survey

In recent years, mobile devices have gained increasingly development wit...
research
05/27/2021

Concept drift detection and adaptation for federated and continual learning

Smart devices, such as smartphones, wearables, robots, and others, can c...
research
10/21/2020

What is Wrong with Continual Learning in Medical Image Segmentation?

Continual learning protocols are attracting increasing attention from th...
research
03/01/2019

Web-Based 3D and Haptic Interactive Environments for e-Learning, Simulation, and Training

Knowledge creation occurs in the process of social interaction. As our s...

Please sign up or login with your details

Forgot password? Click here to reset