# Second-Order Asymptotically Optimal Universal Outlying Sequence Detection with Reject Option

Motivated by practical machine learning applications, we revisit the outlying sequence detection problem (Li et al., TIT 2014) and derive fundamental limits of optimal detection when the reject option is allowed for outlying sequences. In outlying sequence detection (OSD) one is given multiple observed sequences, where most sequences are generated i.i.d. from a nominal distribution. The task is to discern the set of outlying sequences that are generated according to anomalous distributions. In OSD, the nominal and anomalous distributions are unknown. In this paper, we consider the case where there is a reject option for the OSD, i.e., reject the samples as insufficient for reliable outlying sequence detection (cf. Bartlett et al., JMLR 2008). We study the tradeoff among the probabilities of misclassification error, false alarm and false reject for tests that satisfy weak conditions on the rate of decrease of these error probabilities as a function of sequence length. We propose a second-order asymptotically optimal test which provides a finite sample approximation. We first consider the case of at most one outlying sequence and then generalize our results to multiple outlying sequences where each outlying sequence can follow a different anomalous distribution.

## Authors

• 17 publications
• 3 publications
• 27 publications
• ### Second-Order Asymptotically Optimal Statistical Classification

Motivated by real-world machine learning applications, we analyze approx...
06/03/2018 ∙ by Lin Zhou, et al. ∙ 0

• ### Nonparametric Detection of Anomalous Data Streams

A nonparametric anomalous hypothesis testing problem is investigated, in...
04/25/2014 ∙ by Shaofeng Zou, et al. ∙ 0

• ### Sequential Classification with Empirically Observed Statistics

Motivated by real-world machine learning applications, we consider a sta...
12/03/2019 ∙ by Mahdi Haghifam, et al. ∙ 0

• ### Improper vs finitely additive distributions as limits of countably additive probabilities

In Bayesian statistics, improper distributions and finitely additive pro...
06/18/2019 ∙ by Pierre Druilhet, et al. ∙ 0

• ### Linear-Complexity Exponentially-Consistent Tests for Universal Outlying Sequence Detection

The problem of universal outlying sequence detection is studied, where t...
01/21/2017 ∙ by Yuheng Bu, et al. ∙ 0

• ### A Kernel-Based Nonparametric Test for Anomaly Detection over Line Networks

The nonparametric problem of detecting existence of an anomalous interva...
04/01/2014 ∙ by Shaofeng Zou, et al. ∙ 0