Dimension-Grouped Mixed Membership Models for Multivariate Categorical Data

09/24/2021
by   Yuqi Gu, et al.
0

Mixed Membership Models (MMMs) are a popular family of latent structure models for complex multivariate data. Instead of forcing each subject to belong to a single cluster, MMMs incorporate a vector of subject-specific weights characterizing partial membership across clusters. With this flexibility come challenges in uniquely identifying, estimating, and interpreting the parameters. In this article, we propose a new class of Dimension-Grouped MMMs (Gro-M^3s) for multivariate categorical data, which improve parsimony and interpretability. In Gro-M^3s, observed variables are partitioned into groups such that the latent membership is constant across variables within a group but can differ across groups. Traditional latent class models are obtained when all variables are in one group, while traditional MMMs are obtained when each variable is in its own group. The new model corresponds to a novel decomposition of probability tensors. Theoretically, we propose transparent identifiability conditions for both the unknown grouping structure and the associated model parameters in general settings. Methodologically, we propose a Bayesian approach for Dirichlet Gro-M^3s to inferring the variable grouping structure and estimating model parameters. Simulation results demonstrate good computational performance and empirically confirm the identifiability results. We illustrate the new methodology through an application to a functional disability dataset.

READ FULL TEXT

page 9

page 31

research
05/04/2023

A Spectral Method for Identifiable Grade of Membership Analysis with Binary Responses

Grade of Membership (GoM) models are popular individual-level mixture mo...
research
01/16/2019

Multivariate mixed membership modeling: Inferring domain-specific risk profiles

Characterizing shared membership of individuals in two or more categorie...
research
06/24/2022

Functional Partial Membership Models

Partial membership models, or mixed membership models, are a flexible un...
research
05/18/2022

Dependent Latent Class Models

Latent Class Models (LCMs) are used to cluster multivariate categorical ...
research
04/03/2020

Composite mixture of log-linear models for categorical data

Multivariate categorical data are routinely collected in many applicatio...
research
04/12/2023

Dynamic Mixed Membership Stochastic Block Model for Weighted Labeled Networks

Most real-world networks evolve over time. Existing literature proposes ...
research
12/13/2022

Flexible Regularized Estimation in High-Dimensional Mixed Membership Models

Mixed membership models are an extension of finite mixture models, where...

Please sign up or login with your details

Forgot password? Click here to reset