Custom Orthogonal Weight functions (COWs) for Event Classification

12/08/2021
by   Hans Dembinski, et al.
0

A common problem in data analysis is the separation of signal and background. We revisit and generalise the so-called sWeights method, which allows one to calculate an empirical estimate of the signal density of a control variable using a fit of a mixed signal and background model to a discriminating variable. We show that sWeights are a special case of a larger class of Custom Orthogonal Weight functions (COWs), which can be applied to a more general class of problems in which the discriminating and control variables are not necessarily independent and still achieve close to optimal performance. We also investigate the properties of parameters estimated from fits of statistical models to sWeights and provide closed formulas for the asymptotic covariance matrix of the fitted parameters. To illustrate our findings, we discuss several practical applications of these techniques.

READ FULL TEXT
research
08/03/2018

Covariance Matrix Estimation from Correlated Samples

Covariance matrix estimation concerns the problem of estimating the cova...
research
12/20/2020

Asymptotic distribution of certain degenerate V- and U-statistics with estimated parameters

The asymptotic distribution of a wide class of V- and U-statistics with ...
research
05/04/2023

The envelope of a complex Gaussian random variable

This article explicitly characterizes the distribution of the envelope o...
research
07/08/2023

Linear approximation to the statistical significance autocovariance matrix in the asymptotic regime

Approximating significance scans of searches for new particles in high-e...
research
12/24/2021

Optimal Variable Clustering for High-Dimensional Matrix Valued Data

Matrix valued data has become increasingly prevalent in many application...
research
03/15/2022

Optimal denoising of rotationally invariant rectangular matrices

In this manuscript we consider denoising of large rectangular matrices: ...

Please sign up or login with your details

Forgot password? Click here to reset