Post hoc false discovery proportion inference under a Hidden Markov Model

05/01/2021
by   Marie Perrot-Dockès, et al.
0

We address the multiple testing problem under the assumption that the true/false hypotheses are driven by a Hidden Markov Model (HMM), which is recognized as a fundamental setting to model multiple testing under dependence since the seminal work of <cit.>. While previous work has concentrated on deriving specific procedures with a controlled False Discovery Rate (FDR) under this model, following a recent trend in selective inference, we consider the problem of establishing confidence bounds on the false discovery proportion (FDP), for a user-selected set of hypotheses that can depend on the observed data in an arbitrary way. We develop a methodology to construct such confidence bounds first when the HMM model is known, then when its parameters are unknown and estimated, including the data distribution under the null and the alternative, using a nonparametric approach. In the latter case, we propose a bootstrap-based methodology to take into account the effect of parameter estimation error. We show that taking advantage of the assumed HMM structure allows for a substantial improvement of confidence bound sharpness over existing agnostic (structure-free) methods, as witnessed both via numerical experiments and real data examples.

READ FULL TEXT

page 3

page 35

research
06/13/2023

False discovery proportion envelopes with consistency

We provide new false discovery proportion (FDP) confidence envelopes in ...
research
07/04/2018

Post hoc false positive control for spatially structured hypotheses

In a high dimensional multiple testing framework, we present new confide...
research
03/19/2018

Towards "simultaneous selective inference": post-hoc bounds on the false discovery proportion

Some pitfalls of the false discovery rate (FDR) as an error criterion fo...
research
08/16/2018

Permutation-based simultaneous confidence bounds for the false discovery proportion

When multiple hypotheses are tested, interest is often in ensuring that ...
research
08/29/2022

FDP control in multivariate linear models using the bootstrap

In this article we develop a method for performing post hoc inference of...
research
07/30/2020

Localizing differences in smooths with simultaneous confidence bounds on the true discovery proportion

We demonstrate a method for localizing where two smooths differ using a ...
research
04/22/2022

Notip: Non-parametric True Discovery Proportion estimation for brain imaging

Cluster-level inference procedures are widely used for brain mapping. Th...

Please sign up or login with your details

Forgot password? Click here to reset