Log In Sign Up

Real-Time Scheduling via Reinforcement Learning

by   Robert Glaubius, et al.

Cyber-physical systems, such as mobile robots, must respond adaptively to dynamic operating conditions. Effective operation of these systems requires that sensing and actuation tasks are performed in a timely manner. Additionally, execution of mission specific tasks such as imaging a room must be balanced against the need to perform more general tasks such as obstacle avoidance. This problem has been addressed by maintaining relative utilization of shared resources among tasks near a user-specified target level. Producing optimal scheduling strategies requires complete prior knowledge of task behavior, which is unlikely to be available in practice. Instead, suitable scheduling strategies must be learned online through interaction with the system. We consider the sample complexity of reinforcement learning in this domain, and demonstrate that while the problem state space is countably infinite, we may leverage the problem's structure to guarantee efficient learning.


On Ordering Multi-Robot Task Executions within a Cyber Physical System

With robots entering the world of Cyber Physical Systems (CPS), ordering...

Scheduling of Missions with Constrained Tasks for Heterogeneous Robot Systems

We present a formal tasK AllocatioN and scheduling apprOAch for multi-ro...

Optimal Scheduling for Maximizing Information Freshness System Performance in Industrial Cyber-Physical Systems

Age of Information is a newly introduced metric, getting vivid attention...

Reinforcement Learning based Condition-oriented Maintenance Scheduling for Flow Line Systems

Maintenance scheduling is a complex decision-making problem in the produ...

Time-aware Test Case Execution Scheduling for Cyber-Physical Systems

Testing cyber-physical systems involves the execution of test cases on t...

Detecting Ransomware Execution in a Timely Manner

Ransomware has been an ongoing issue since the early 1990s. In recent ti...

Robustness Analysis for Battery Supported Cyber-Physical Systems

This paper establishes a novel analytical approach to quantify robustnes...