Probably the Best Itemsets

02/07/2019
by   Nikolaj Tatti, et al.
0

One of the main current challenges in itemset mining is to discover a small set of high-quality itemsets. In this paper we propose a new and general approach for measuring the quality of itemsets. The method is solidly founded in Bayesian statistics and decreases monotonically, allowing for efficient discovery of all interesting itemsets. The measure is defined by connecting statistical models and collections of itemsets. This allows us to score individual itemsets with the probability of them occuring in random models built on the data. As a concrete example of this framework we use exponential models. This class of models possesses many desirable properties. Most importantly, Occam's razor in Bayesian model selection provides a defence for the pattern explosion. As general exponential models are infeasible in practice, we use decomposable models; a large sub-class for which the measure is solvable. For the actual computation of the score we sample models from the posterior distribution using an MCMC approach. Experimentation on our method demonstrates the measure works in practice and results in interpretable and insightful itemsets for both synthetic and real-world data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/24/2020

Robust and Reproducible Model Selection Using Bagged Posteriors

Bayesian model selection is premised on the assumption that the data are...
research
01/16/2013

Being Bayesian about Network Structure

In many domains, we are interested in analyzing the structure of the und...
research
04/21/2023

Machine Learning and the Future of Bayesian Computation

Bayesian models are a powerful tool for studying complex data, allowing ...
research
10/28/2015

Flexibly Mining Better Subgroups

In subgroup discovery, also known as supervised pattern mining, discover...
research
05/15/2022

Large Data and (Not Even Very) Complex Ecological Models: When Worlds Collide

We consider the challenges that arise when fitting complex ecological mo...
research
05/20/2016

Coresets for Scalable Bayesian Logistic Regression

The use of Bayesian methods in large-scale data settings is attractive b...
research
11/22/2022

Reinforcement Causal Structure Learning on Order Graph

Learning directed acyclic graph (DAG) that describes the causality of ob...

Please sign up or login with your details

Forgot password? Click here to reset