Intrinsic dimension and its application to association rules

05/15/2018
by   Tom Hanika, et al.
0

The curse of dimensionality in the realm of association rules is twofold. Firstly, we have the well known exponential increase in computational complexity with increasing item set size. Secondly, there is a related curse concerned with the distribution of (spare) data itself in high dimension. The former problem is often coped with by projection, i.e., feature selection, whereas the best known strategy for the latter is avoidance. This work summarizes the first attempt to provide a computationally feasible method for measuring the extent of dimension curse present in a data set with respect to a particular class machine of learning procedures. This recent development enables the application of various other methods from geometric analysis to be investigated and applied in machine learning procedures in the presence of high dimension.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/24/2018

Intrinsic dimension of concept lattices

Geometric analysis is a very capable theory to understand the influence ...
research
07/25/2022

Pinned Distance Sets Using Effective Dimension

In this paper, we use algorithmic tools, effective dimension and Kolmogo...
research
04/10/2021

Discovering Categorical Main and Interaction Effects Based on Association Rule Mining

With the growing size of data sets, feature selection becomes increasing...
research
12/06/2021

Piano Timbre Development Analysis using Machine Learning

A data set of recorded single played tones of a concert grand piano is i...
research
10/11/2022

Intrinsic Dimension for Large-Scale Geometric Learning

The concept of dimension is essential to grasp the complexity of data. A...
research
10/27/2018

Monitoring the shape of weather, soundscapes, and dynamical systems: a new statistic for dimension-driven data analysis on large data sets

Dimensionality-reduction methods are a fundamental tool in the analysis ...
research
07/20/2018

Optimal Bounds on the VC-dimension

The VC-dimension of a set system is a way to capture its complexity and ...

Please sign up or login with your details

Forgot password? Click here to reset