Spectral Methods for Nonparametric Models

03/31/2017
by   Hsiao-Yu Fish Tung, et al.
0

Nonparametric models are versatile, albeit computationally expensive, tool for modeling mixture models. In this paper, we introduce spectral methods for the two most popular nonparametric models: the Indian Buffet Process (IBP) and the Hierarchical Dirichlet Process (HDP). We show that using spectral methods for the inference of nonparametric models are computationally and statistically efficient. In particular, we derive the lower-order moments of the IBP and the HDP, propose spectral algorithms for both models, and provide reconstruction guarantees for the algorithms. For the HDP, we further show that applying hierarchical models on dataset with hierarchical structure, which can be solved with the generalized spectral HDP, produces better solutions to that of flat models regarding likelihood performance.

READ FULL TEXT

page 25

page 26

research
11/29/2012

Exact and Efficient Parallel Inference for Nonparametric Mixture Models

Nonparametric mixture models based on the Dirichlet process are an elega...
research
12/31/2014

Detailed Derivations of Small-Variance Asymptotics for some Hierarchical Bayesian Nonparametric Models

In this note we provide detailed derivations of two versions of small-va...
research
06/19/2019

Importance conditional sampling for Bayesian nonparametric mixtures

Nonparametric mixture models based on the Pitman-Yor process represent a...
research
05/26/2023

Fast and Order-invariant Inference in Bayesian VARs with Non-Parametric Shocks

The shocks which hit macroeconomic models such as Vector Autoregressions...
research
12/10/2013

Guaranteed Model Order Estimation and Sample Complexity Bounds for LDA

The question of how to determine the number of independent latent factor...
research
01/27/2023

On Excess Mass Behavior in Gaussian Mixture Models with Orlicz-Wasserstein Distances

Dirichlet Process mixture models (DPMM) in combination with Gaussian ker...
research
02/11/2016

Unified Statistical Theory of Spectral Graph Analysis

The goal of this paper is to show that there exists a simple, yet univer...

Please sign up or login with your details

Forgot password? Click here to reset