Semantic and Effective Communication for Remote Control Tasks with Dynamic Feature Compression

01/14/2023
by   Pietro Talli, et al.
0

The coordination of robotic swarms and the remote wireless control of industrial systems are among the major use cases for 5G and beyond systems: in these cases, the massive amounts of sensory information that needs to be shared over the wireless medium can overload even high-capacity connections. Consequently, solving the effective communication problem by optimizing the transmission strategy to discard irrelevant information can provide a significant advantage, but is often a very complex task. In this work, we consider a prototypal system in which an observer must communicate its sensory data to an actor controlling a task (e.g., a mobile robot in a factory). We then model it as a remote Partially Observable Markov Decision Process (POMDP), considering the effect of adopting semantic and effective communication-oriented solutions on the overall system performance. We split the communication problem by considering an ensemble Vector Quantized Variational Autoencoder (VQ-VAE) encoding, and train a Deep Reinforcement Learning (DRL) agent to dynamically adapt the quantization level, considering both the current state of the environment and the memory of past messages. We tested the proposed approach on the well-known CartPole reference control problem, obtaining a significant performance increase over traditional approaches

READ FULL TEXT
research
03/30/2022

One-Step Two-Critic Deep Reinforcement Learning for Inverter-based Volt-Var Control in Active Distribution Networks

A one-step two-critic deep reinforcement learning (OSTC-DRL) approach fo...
research
08/22/2022

Exploring Task-oriented Communication in Multi-agent System: A Deep Reinforcement Learning Approach

The multi-agent system (MAS) enables the sharing of capabilities among a...
research
09/03/2020

Remote Joint Strong Coordination and Reliable Communication

We consider a three-node network, in which two agents wish to communicat...
research
06/22/2023

Decentralized Multi-Agent Reinforcement Learning with Global State Prediction

Deep reinforcement learning (DRL) has seen remarkable success in the con...
research
02/28/2023

Multi-Agent Reinforcement Learning for Pragmatic Communication and Control

The automation of factories and manufacturing processes has been acceler...
research
05/28/2020

Task-Based Information Compression for Multi-Agent Communication Problems with Channel Rate Constraints

A collaborative task is assigned to a multiagent system (MAS) in which a...
research
04/16/2021

Split Learning Meets Koopman Theory for Wireless Remote Monitoring and Prediction

Remote state monitoring over wireless is envisaged to play a pivotal rol...

Please sign up or login with your details

Forgot password? Click here to reset