Asymptotically Optimal Sampling Policy for Quickest Change Detection with Observation-Switching Cost

12/25/2019
by   Tze Siong Lau, et al.
0

We consider the problem of quickest change detection (QCD) in a signal where its observations are obtained using a set of actions, and switching from one action to another comes with a cost. The objective is to design a stopping rule consisting of a sampling policy to determine the sequence of actions used to observe the signal and a stopping time to quickly detect for the change, subject to a constraint on the average observation-switching cost. We propose a sampling policy of finite window size and a generalized likelihood ratio (GLR) Cumulative Sum (CuSum) stopping time for the QCD problem. We show that the GLR CuSum stopping time is asymptotically optimal with a properly designed sampling policy and formulate the design of this sampling policy as a quadratic programming problem. We prove that it is sufficient to consider policies of window size not more than one when designing policies of finite window length and propose several algorithms that solve this optimization problem with theoretical guarantees. Finally, we apply our approach to the problem of QCD of a partially observed graph signal.

READ FULL TEXT
research
02/09/2019

Quickest Change Detection in the Presence of a Nuisance Change

In the quickest change detection problem in which both nuisance and crit...
research
09/18/2020

Quickest Change Detection with Privacy Constraint

This paper considers Lorden's minimax quickest change detection (QCD) pr...
research
02/27/2023

Real-time Reconstruction of Markov Sources and Remote Actuation over Wireless Channels

In this work, we study the real-time tracking and reconstruction of an i...
research
07/25/2020

Sequential Multi-hypothesis Testing in Multi-armed Bandit Problems:An Approach for Asymptotic Optimality

We consider a multi-hypothesis testing problem involving a K-armed bandi...
research
03/08/2023

An CUSUM Test with Observation-Adjusted Control Limits in Change Detection

In this paper, we not only propose an new optimal sequential test of sum...
research
03/25/2022

Randomized Policy Optimization for Optimal Stopping

Optimal stopping is the problem of determining when to stop a stochastic...
research
12/18/2018

Interpretable Optimal Stopping

Optimal stopping is the problem of deciding when to stop a stochastic sy...

Please sign up or login with your details

Forgot password? Click here to reset