DeepAI AI Chat
Log In Sign Up

Energy-Efficient Job-Assignment Policy with Asymptotically Guaranteed Performance Deviation

by   Jing Fu, et al.

We study a job-assignment problem in a large-scale server farm system with geographically deployed servers as abstracted computer components (e.g., storage, network links, and processors) that are potentially diverse. We aim to maximize the energy efficiency of the entire system by effectively controlling carried load on networked servers. A scalable, near-optimal job-assignment policy is proposed. The optimality is gauged as, roughly speaking, energy cost per job. Our key result is an upper bound on the deviation between the proposed policy and the asymptotically optimal energy efficiency, when job sizes are exponentially distributed and blocking probabilities are positive. Relying on Whittle relaxation and the asymptotic optimality theorem of Weber and Weiss, this bound is shown to decrease exponentially as the number of servers and the arrival rates of jobs increase arbitrarily and in proportion. In consequence, the proposed policy is asymptotically optimal and, more importantly, approaches asymptotic optimality quickly (exponentially). This suggests that the proposed policy is close to optimal even for relatively small systems (and indeed any larger systems), and this is consistent with the results of our simulations. Simulations indicate that the policy is effective, and robust to variations in job-size distributions.


A Restless Bandit Model for Energy-Efficient Job Assignments in Server Farms

We aim to maximize the energy efficiency, gauged as average energy cost ...

On the Performance of Large Loss Systems with Adaptive Multiserver Jobs

In this paper, we study systems where each job or request can be split i...

Power-of-d-Choices with Memory: Fluid Limit and Optimality

In multi-server distributed queueing systems, the access of stochastical...

Achieving Zero Asymptotic Queueing Delay for Parallel Jobs

Zero queueing delay is highly desirable in large-scale computing systems...

Sharp Waiting-Time Bounds for Multiserver Jobs

Multiserver jobs, which are jobs that occupy multiple servers simultaneo...

Near-Optimal Stochastic Bin-Packing in Large Service Systems with Time-Varying Item Sizes

Motivated by the virtual machine scheduling problem in today's computing...

Non-Asymptotic Performance Analysis of Size-Based Routing Policies

We investigate the performance of two size-based routing policies: the S...