Structural Self-adaptation for Decentralized Pervasive Intelligence

04/21/2019
by   Jovan Nikiloc, et al.
0

Communication structure plays a key role in the learning capability of decentralized systems. Structural self-adaptation, by means of self-organization, changes the order as well as the input information of the agents' collective decision-making. This paper studies the role of agents' repositioning on the same communication structure, i.e. a tree, as the means to expand the learning capacity in complex combinatorial optimization problems, for instance, load-balancing power demand to prevent blackouts or efficient utilization of bike sharing stations. The optimality of structural self-adaptations is rigorously studied by constructing a novel large-scale benchmark that consists of 4000 agents with synthetic and real-world data performing 4 million structural self-adaptations during which almost 320 billion learning messages are exchanged. Based on this benchmark dataset, 124 deterministic structural criteria, applied as learning meta-features, are systematically evaluated as well as two online structural self-adaptation strategies designed to expand learning capacity. Experimental evaluation identifies metrics that capture agents with influential information and their optimal positioning. Significant gain in learning performance is observed for the two strategies especially under low-performing initialization. Strikingly, the strategy that triggers structural self-adaptation in a more exploratory fashion is the most cost-effective.

READ FULL TEXT

page 1

page 9

research
05/07/2018

Holarchic Structures for Decentralized Deep Learning - A Performance Analysis

Structure plays a key role in learning performance. In centralized compu...
research
04/04/2022

Lifelong Self-Adaptation: Self-Adaptation Meets Lifelong Machine Learning

In the past years, machine learning (ML) has become a popular approach t...
research
10/08/2021

When to Call Your Neighbor? Strategic Communication in Cooperative Stochastic Bandits

In cooperative bandits, a framework that captures essential features of ...
research
09/13/2017

A Study of AI Population Dynamics with Million-agent Reinforcement Learning

We conduct an empirical study on discovering the ordered collective dyna...
research
06/02/2018

Hybrid Data-Sharing and Compression Strategy for Downlink Cloud Radio Access Network

This paper studies transmission strategies for the downlink of a cloud r...
research
02/06/2020

Decentralized Socio-technical Services and Applications for the Internet of Things – A Testbed Self-Integration

The Internet of Things comes along with new challenges for experimenting...
research
05/18/2023

DClEVerNet: Deep Combinatorial Learning for Efficient EV Charging Scheduling in Large-scale Networked Facilities

With the electrification of transportation, the rising uptake of electri...

Please sign up or login with your details

Forgot password? Click here to reset