DeepAI AI Chat
Log In Sign Up

BONuS: Multiple multivariate testing with a data-adaptivetest statistic

by   Chiao-Yu Yang, et al.

We propose a new adaptive empirical Bayes framework, the Bag-Of-Null-Statistics (BONuS) procedure, for multiple testing where each hypothesis testing problem is itself multivariate or nonparametric. BONuS is an adaptive and interactive knockoff-type method that helps improve the testing power while controlling the false discovery rate (FDR), and is closely connected to the "counting knockoffs" procedure analyzed in Weinstein et al. (2017). Contrary to procedures that start with a p-value for each hypothesis, our method analyzes the entire data set to adaptively estimate an optimal p-value transform based on an empirical Bayes model. Despite the extra adaptivity, our method controls FDR in finite samples even if the empirical Bayes model is incorrect or the estimation is poor. An extension, the Double BONuS procedure, validates the empirical Bayes model to guard against power loss due to model misspecification.


page 1

page 2

page 3

page 4


Dimension constraints improve hypothesis testing for large-scale, graph-associated, brain-image data

For large-scale testing with graph-associated data, we present an empiri...

Simultaneous Hypothesis Testing Using Internal Negative Controls with An Application to Proteomics

Negative control is a common technique in scientific investigations and ...

Multiple Testing in Nonparametric Hidden Markov Models: An Empirical Bayes Approach

Given a nonparametric Hidden Markov Model (HMM) with two states, the que...

The edge of discovery: Controlling the local false discovery rate at the margin

Despite the popularity of the false discovery rate (FDR) as an error con...

Powerful Spatial Multiple Testing via Borrowing Neighboring Information

Clustered effects are often encountered in multiple hypothesis testing o...

Constrained empirical Bayes priors on regression coefficients

In the context of model uncertainty and selection, empirical Bayes proce...

Knockoffs with Side Information

We consider the problem of assessing the importance of multiple variable...