Digital Twin-Based Multiple Access Optimization and Monitoring via Model-Driven Bayesian Learning

10/11/2022
by   Clement Ruah, et al.
0

Commonly adopted in the manufacturing and aerospace sectors, digital twin (DT) platforms are increasingly seen as a promising paradigm to control and monitor software-based, "open", communication systems, which play the role of the physical twin (PT). In the general framework presented in this work, the DT builds a Bayesian model of the communication system, which is leveraged to enable core DT functionalities such as control via multi-agent reinforcement learning (MARL) and monitoring of the PT for anomaly detection. We specifically investigate the application of the proposed framework to a simple case-study system encompassing multiple sensing devices that report to a common receiver. The Bayesian model trained at the DT has the key advantage of capturing epistemic uncertainty regarding the communication system, e.g., regarding current traffic conditions, which arise from limited PT-to-DT data transfer. Experimental results validate the effectiveness of the proposed Bayesian framework as compared to standard frequentist model-based solutions.

READ FULL TEXT
research
12/02/2022

A Bayesian Framework for Digital Twin-Based Control, Monitoring, and Data Collection in Wireless Systems

Commonly adopted in the manufacturing and aerospace sectors, digital twi...
research
02/25/2022

Bayesian autoencoders with uncertainty quantification: Towards trustworthy anomaly detection

Despite numerous studies of deep autoencoders (AEs) for unsupervised ano...
research
09/18/2023

Ontology-Based Feedback to Improve Runtime Control for Multi-Agent Manufacturing Systems

Improving the overall equipment effectiveness (OEE) of machines on the s...
research
11/21/2022

TinyQMIX: Distributed Access Control for mMTC via Multi-agent Reinforcement Learning

Distributed access control is a crucial component for massive machine ty...
research
01/10/2022

Opportunities of Hybrid Model-based Reinforcement Learning for Cell Therapy Manufacturing Process Development and Control

Driven by the key challenges of cell therapy manufacturing, including hi...
research
12/02/2020

Multi-Objective Optimization of the Textile Manufacturing Process Using Deep-Q-Network Based Multi-Agent Reinforcement Learning

Multi-objective optimization of the textile manufacturing process is an ...
research
05/01/2020

Information-Collection in Robotic Process Monitoring: An Active Perception Approach

Active perception systems maximizing information gain to support both mo...

Please sign up or login with your details

Forgot password? Click here to reset