Sparse Covariance Estimation in Logit Mixture Models

01/14/2020
by   Youssef M Aboutaleb, et al.
22

This paper introduces a new data-driven methodology for estimating sparse covariance matrices of the random coefficients in logit mixture models. Researchers typically specify covariance matrices in logit mixture models under one of two extreme assumptions: either an unrestricted full covariance matrix (allowing correlations between all random coefficients), or a restricted diagonal matrix (allowing no correlations at all). Our objective is to find optimal subsets of correlated coefficients for which we estimate covariances. We propose a new estimator, called MISC, that uses a mixed-integer optimization (MIO) program to find an optimal block diagonal structure specification for the covariance matrix, corresponding to subsets of correlated coefficients, for any desired sparsity level using Markov Chain Monte Carlo (MCMC) posterior draws from the unrestricted full covariance matrix. The optimal sparsity level of the covariance matrix is determined using out-of-sample validation. We demonstrate the ability of MISC to correctly recover the true covariance structure from synthetic data. In an empirical illustration using a stated preference survey on modes of transportation, we use MISC to obtain a sparse covariance matrix indicating how preferences for attributes are related to one another.

READ FULL TEXT

page 20

page 23

page 24

research
07/30/2019

Block-diagonal covariance estimation and application to the Shapley effects in sensitivity analysis

In this paper, we aim to estimate block-diagonal covariance matrices for...
research
08/18/2020

Learning Structure in Nested Logit Models

This paper introduces a new data-driven methodology for nested logit str...
research
03/23/2020

JPEG Steganography and Synchronization of DCT Coefficients for a Given Development Pipeline

This short paper proposes to use the statistical analysis of the correla...
research
11/04/2021

Covariance Structure Estimation with Laplace Approximation

Gaussian covariance graph model is a popular model in revealing underlyi...
research
09/10/2020

A Family of Mixture Models for Biclustering

Biclustering is used for simultaneous clustering of the observations and...
research
01/08/2020

Natural Steganography in JPEG Domain with a Linear Development Pipeline

In order to achieve high practical security, Natural Steganography (NS) ...
research
12/14/2021

Euclid: Covariance of weak lensing pseudo-C_ℓ estimates. Calculation, comparison to simulations, and dependence on survey geometry

An accurate covariance matrix is essential for obtaining reliable cosmol...

Please sign up or login with your details

Forgot password? Click here to reset