DeepAI AI Chat
Log In Sign Up

RISCLESS: A Reinforcement Learning Strategy to Exploit Unused Cloud Resources

by   Sidahmed Yalles, et al.

One of the main objectives of Cloud Providers (CP) is to guarantee the Service-Level Agreement (SLA) of customers while reducing operating costs. To achieve this goal, CPs have built large-scale datacenters. This leads, however, to underutilized resources and an increase in costs. A way to improve the utilization of resources is to reclaim the unused parts and resell them at a lower price. Providing SLA guarantees to customers on reclaimed resources is a challenge due to their high volatility. Some state-of-the-art solutions consider keeping a proportion of resources free to absorb sudden variation in workloads. Others consider stable resources on top of the volatile ones to fill in for the lost resources. However, these strategies either reduce the amount of reclaimable resources or operate on less volatile ones such as Amazon Spot instance. In this paper, we proposed RISCLESS, a Reinforcement Learning strategy to exploit unused Cloud resources. Our approach consists of using a small proportion of stable on-demand resources alongside the ephemeral ones in order to guarantee customers SLA and reduce the overall costs. The approach decides when and how much stable resources to allocate in order to fulfill customers' demands. RISCLESS improved the CPs' profits by an average of 15.9 compared to state-of-the-art strategies. It also reduced the SLA violation time by an average of 36.7 by 19.5


ReLeaSER: A Reinforcement Learning Strategy for Optimizing Utilization Of Ephemeral Cloud Resources

Cloud data center capacities are over-provisioned to handle demand peaks...

Managing Cold-start in The Serverless Cloud with Temporal Convolutional Networks

Serverless cloud is an innovative cloud service model that frees custome...

Cloud Provider Capacity Augmentation Through Automated Resource Bartering

Growing interest in Cloud Computing places a heavy workload on cloud pro...

A Comparison of Reinforcement Learning Techniques for Fuzzy Cloud Auto-Scaling

A goal of cloud service management is to design self-adaptable auto-scal...

Hedge Your Bets: Optimizing Long-term Cloud Costs by Mixing VM Purchasing Options

Cloud platforms offer the same VMs under many purchasing options that sp...

Learning a Partitioning Advisor with Deep Reinforcement Learning

Commercial data analytics products such as Microsoft Azure SQL Data Ware...

Temporal Overbooking of Lambda Functions in the Cloud

We consider the problem of scheduling "serverless computing" instances s...