Approximating high-dimensional infinite-order U-statistics: statistical and computational guarantees

01/04/2019
by   Yanglei Song, et al.
0

We study the problem of distributional approximations to high-dimensional non-degenerate U-statistics with random kernels of diverging orders. Infinite-order U-statistics (IOUS) is a useful tool for constructing simultaneous prediction intervals that quantify the uncertainty of ensemble methods such as subbagging and random forests. A major obstacle in using the IOUS is their computational intractability when the sample size, dimensionality, and order, are all large. In this article, we derive non-asymptotic Gaussian approximation error bounds for an incomplete version of the IOUS with a random kernel. We also study data-driven inferential methods for the incomplete IOUS via bootstraps with statistical and computational guarantees.

READ FULL TEXT
research
12/03/2017

Randomized incomplete U-statistics in high dimensions

This paper studies inference for the mean vector of a high-dimensional U...
research
02/18/2022

On Variance Estimation of Random Forests

Ensemble methods, such as random forests, are popular in applications du...
research
12/29/2021

On the consistency of incomplete U-statistics under infinite second-order moments

We derive a consistency result, in the L_1-sense, for incomplete U-stati...
research
09/04/2023

Gaussian and Bootstrap Approximations for Suprema of Empirical Processes

In this paper we develop non-asymptotic Gaussian approximation results f...
research
05/10/2023

Bounds for distributional approximation in the multivariate delta method by Stein's method

We obtain bounds to quantify the distributional approximation in the del...
research
05/30/2018

U-statistical inference for hierarchical clustering

Clustering methods are a valuable tool for the identification of pattern...
research
10/01/2022

Yurinskii's Coupling for Martingales

Yurinskii's coupling is a popular tool for finite-sample distributional ...

Please sign up or login with your details

Forgot password? Click here to reset