Non-exchangeable feature allocation models with sublinear growth of the feature sizes

03/30/2020
by   Giuseppe Di Benedetto, et al.
1

Feature allocation models are popular models used in different applications such as unsupervised learning or network modeling. In particular, the Indian buffet process is a flexible and simple one-parameter feature allocation model where the number of features grows unboundedly with the number of objects. The Indian buffet process, like most feature allocation models, satisfies a symmetry property of exchangeability: the distribution is invariant under permutation of the objects. While this property is desirable in some cases, it has some strong implications. Importantly, the number of objects sharing a particular feature grows linearly with the number of objects. In this article, we describe a class of non-exchangeable feature allocation models where the number of objects sharing a given feature grows sublinearly, where the rate can be controlled by a tuning parameter. We derive the asymptotic properties of the model, and show that such model provides a better fit and better predictive performances on various datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/20/2017

Non-exchangeable random partition models for microclustering

Many popular random partition models, such as the Chinese restaurant pro...
research
05/14/2023

Diagonals-parameter symmetry model and its property for square contingency tables with ordinal categories

Previously, the diagonals-parameter symmetry model based on f-divergence...
research
12/08/2015

Gibbs-type Indian buffet processes

We investigate a class of feature allocation models that generalize the ...
research
02/27/2017

Equivariance Through Parameter-Sharing

We propose to study equivariance in deep neural networks through paramet...
research
06/09/2021

The Attraction Indian Buffet Distribution

We propose the attraction Indian buffet distribution (AIBD), a distribut...
research
10/24/2022

Occam learning

We discuss probabilistic neural network models for unsupervised learning...
research
07/07/2016

A characterization of product-form exchangeable feature probability functions

We characterize the class of exchangeable feature allocations assigning ...

Please sign up or login with your details

Forgot password? Click here to reset