Interaction Measures, Partition Lattices and Kernel Tests for High-Order Interactions

06/01/2023
by   Zhaolu Liu, et al.
0

Models that rely solely on pairwise relationships often fail to capture the complete statistical structure of the complex multivariate data found in diverse domains, such as socio-economic, ecological, or biomedical systems. Non-trivial dependencies between groups of more than two variables can play a significant role in the analysis and modelling of such systems, yet extracting such high-order interactions from data remains challenging. Here, we introduce a hierarchy of d-order (d ≥ 2) interaction measures, increasingly inclusive of possible factorisations of the joint probability distribution, and define non-parametric, kernel-based tests to establish systematically the statistical significance of d-order interactions. We also establish mathematical links with lattice theory, which elucidate the derivation of the interaction measures and their composite permutation tests; clarify the connection of simplicial complexes with kernel matrix centring; and provide a means to enhance computational efficiency. We illustrate our results numerically with validations on synthetic data, and through an application to neuroimaging data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/15/2023

Kernel-based Joint Independence Tests for Multivariate Stationary and Non-stationary Time Series

Multivariate time series data that capture the temporal evolution of int...
research
06/09/2021

Fast and More Powerful Selective Inference for Sparse High-order Interaction Model

Automated high-stake decision-making such as medical diagnosis requires ...
research
05/28/2021

Generalized Permutation Framework for Testing Model Variable Significance

A common problem in machine learning is determining if a variable signif...
research
06/10/2020

Higher-order interactions in statistical physics and machine learning: A non-parametric solution to the inverse problem

We propose a model-independent definition of n-point interaction within ...
research
03/07/2022

Arbitrarily high-order energy-conserving methods for Hamiltonian problems with quadratic holonomic constraints

In this paper, we define arbitrarily high-order energy-conserving method...
research
07/30/2015

Information-theoretical analysis of the statistical dependencies among three variables: Applications to written language

We develop the information-theoretical concepts required to study the st...
research
07/08/2022

Nonparametric Embeddings of Sparse High-Order Interaction Events

High-order interaction events are common in real-world applications. Lea...

Please sign up or login with your details

Forgot password? Click here to reset