Decision-Focused Evaluation: Analyzing Performance of Deployed Restless Multi-Arm Bandits

by   Paritosh Verma, et al.

Restless multi-arm bandits (RMABs) is a popular decision-theoretic framework that has been used to model real-world sequential decision making problems in public health, wildlife conservation, communication systems, and beyond. Deployed RMAB systems typically operate in two stages: the first predicts the unknown parameters defining the RMAB instance, and the second employs an optimization algorithm to solve the constructed RMAB instance. In this work we provide and analyze the results from a first-of-its-kind deployment of an RMAB system in public health domain, aimed at improving maternal and child health. Our analysis is focused towards understanding the relationship between prediction accuracy and overall performance of deployed RMAB systems. This is crucial for determining the value of investing in improving predictive accuracy towards improving the final system performance, and is useful for diagnosing, monitoring deployed RMAB systems. Using real-world data from our deployed RMAB system, we demonstrate that an improvement in overall prediction accuracy may even be accompanied by a degradation in the performance of RMAB system – a broad investment of resources to improve overall prediction accuracy may not yield expected results. Following this, we develop decision-focused evaluation metrics to evaluate the predictive component and show that it is better at explaining (both empirically and theoretically) the overall performance of a deployed RMAB system.


page 1

page 2

page 3

page 4


Sensor Deployment for Air Pollution Monitoring Using Public Transportation System

Air pollution monitoring is a very popular research topic and many monit...

Predictive Bandits

We introduce and study a new class of stochastic bandit problems, referr...

Model Cascading: Towards Jointly Improving Efficiency and Accuracy of NLP Systems

Do all instances need inference through the big models for a correct pre...

Power-Constrained Bandits

Contextual bandits often provide simple and effective personalization in...

Efficient Resource Allocation with Fairness Constraints in Restless Multi-Armed Bandits

Restless Multi-Armed Bandits (RMAB) is an apt model to represent decisio...

Causality Refined Diagnostic Prediction

Applying machine learning in the health care domain has shown promising ...

Please sign up or login with your details

Forgot password? Click here to reset