Safe Hierarchical Reinforcement Learning for CubeSat Task Scheduling Based on Energy Consumption

by   Mahya Ramezani, et al.

This paper presents a Hierarchical Reinforcement Learning methodology tailored for optimizing CubeSat task scheduling in Low Earth Orbits (LEO). Incorporating a high-level policy for global task distribution and a low-level policy for real-time adaptations as a safety mechanism, our approach integrates the Similarity Attention-based Encoder (SABE) for task prioritization and an MLP estimator for energy consumption forecasting. Integrating this mechanism creates a safe and fault-tolerant system for CubeSat task scheduling. Simulation results validate the Hierarchical Reinforcement Learning superior convergence and task success rate, outperforming both the MADDPG model and traditional random scheduling across multiple CubeSat configurations.


Hierarchical Decision Transformer

Sequence models in reinforcement learning require task knowledge to esti...

A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learning

Autonomous vehicles need to handle various traffic conditions and make s...

Carbon-Neutralized Task Scheduling for Green Computing Networks

Climate change due to increasing carbon emissions by human activities ha...

Scheduling under dynamic speed-scaling for minimizing weighted completion time and energy consumption

Since a few years there is an increasing interest in minimizing the ener...

Spatially and Seamlessly Hierarchical Reinforcement Learning for State Space and Policy space in Autonomous Driving

Despite advances in hierarchical reinforcement learning, its application...

Safe multi-agent deep reinforcement learning for joint bidding and maintenance scheduling of generation units

This paper proposes a safe reinforcement learning algorithm for generati...

Dynamic Measurement Scheduling for Event Forecasting using Deep RL

Current clinical practice for monitoring patients' health follows either...

Please sign up or login with your details

Forgot password? Click here to reset