Dual Control of Testing Errors in High-Dimensional Data Analysis

by   X. Jessie Jeng, et al.
NC State University

False negative errors are of major concern in applications where missing a high proportion of true signals may cause serious consequences. False negative control, however, raises a bottleneck challenge in high-dimensional inference when signals are not identifiable at individual level. We propose a Dual Control of Errors (DCOE) method that regulates not only false positive but also false negative errors in measures that are highly relevant to high-dimensional data analysis. DCOE is developed under general covariance dependence with a new calibration procedure to measure the dependence effect. We specify how dependence co-acts with signal sparsity to determine the difficulty level of the dual control task and prove that DCOE is effective in retaining true signals that are not identifiable at individual level. Simulation studies are conducted to compare the new method with existing methods that focus on only one type of error. DCOE is shown to be more powerful than FDR methods and less aggressive than existing false negative control methods. DCOE is applied to a fMRI dataset to identify voxels that are functionally relevant to saccadic eye movements. The new method exhibits a nice balance in retaining signal voxels and avoiding excessive noise voxels.


Weak Signal Inclusion Under Dependence and Applications in Genome-wide Association Study

Motivated by the inquiries of weak signals in underpowered genome-wide a...

Adaptive Signal Inclusion With Genomic Applications

This paper addresses the challenge of efficiently capturing a high propo...

Exploratory Mediation Analysis with Many Potential Mediators

Social and behavioral scientists are increasingly employing technologies...

ProgPermute: Progressive permutation for a dynamic representation of the robustness of microbiome discoveries

Identification of significant features is a critical task in microbiome ...

A Two-stage Online Monitoring Procedure for High-Dimensional Data Streams

Advanced computing and data acquisition technologies have made possible ...

Analytical approach to network inference: Investigating degree distribution

When the network is reconstructed, two types of errors can occur: false ...

Iterative procedure for network inference

When a network is reconstructed from data, two types of errors can occur...

Please sign up or login with your details

Forgot password? Click here to reset