Dual Control of Testing Errors in High-Dimensional Data Analysis

06/28/2020
by   X. Jessie Jeng, et al.
0

False negative errors are of major concern in applications where missing a high proportion of true signals may cause serious consequences. False negative control, however, raises a bottleneck challenge in high-dimensional inference when signals are not identifiable at individual level. We propose a Dual Control of Errors (DCOE) method that regulates not only false positive but also false negative errors in measures that are highly relevant to high-dimensional data analysis. DCOE is developed under general covariance dependence with a new calibration procedure to measure the dependence effect. We specify how dependence co-acts with signal sparsity to determine the difficulty level of the dual control task and prove that DCOE is effective in retaining true signals that are not identifiable at individual level. Simulation studies are conducted to compare the new method with existing methods that focus on only one type of error. DCOE is shown to be more powerful than FDR methods and less aggressive than existing false negative control methods. DCOE is applied to a fMRI dataset to identify voxels that are functionally relevant to saccadic eye movements. The new method exhibits a nice balance in retaining signal voxels and avoiding excessive noise voxels.

READ FULL TEXT
research
12/27/2022

Weak Signal Inclusion Under Dependence and Applications in Genome-wide Association Study

Motivated by the inquiries of weak signals in underpowered genome-wide a...
research
05/27/2018

Adaptive Signal Inclusion With Genomic Applications

This paper addresses the challenge of efficiently capturing a high propo...
research
10/15/2018

Exploratory Mediation Analysis with Many Potential Mediators

Social and behavioral scientists are increasingly employing technologies...
research
05/03/2020

ProgPermute: Progressive permutation for a dynamic representation of the robustness of microbiome discoveries

Identification of significant features is a critical task in microbiome ...
research
12/14/2017

A Two-stage Online Monitoring Procedure for High-Dimensional Data Streams

Advanced computing and data acquisition technologies have made possible ...
research
07/17/2018

Analytical approach to network inference: Investigating degree distribution

When the network is reconstructed, two types of errors can occur: false ...
research
10/15/2019

Iterative procedure for network inference

When a network is reconstructed from data, two types of errors can occur...

Please sign up or login with your details

Forgot password? Click here to reset