DeepAI AI Chat
Log In Sign Up

Nearest Neighbor Dirichlet Process

03/17/2020
by   Shounak Chattopadhyay, et al.
14

There is a rich literature on Bayesian nonparametric methods for unknown densities. The most popular approach relies on Dirichlet process mixture models. These models characterize the unknown density as a kernel convolution with an unknown almost surely discrete mixing measure, which is given a Dirichlet process prior. Such models are very flexible and have good performance in many settings, but posterior computation relies on Markov chain Monte Carlo algorithms that can be complex and inefficient. As a simple and general alternative, we propose a class of nearest neighbor-Dirichlet processes. The approach starts by grouping the data into neighborhoods based on standard algorithms. Within each neighborhood, the density is characterized via a Bayesian parametric model, such as a Gaussian with unknown parameters. Assigning a Dirichlet prior to the weights on these local kernels, we obtain a simple pseudo-posterior for the weights and kernel parameters. A simple and embarrassingly parallel Monte Carlo algorithm is proposed to sample from the resulting pseudo-posterior for the unknown density. Desirable asymptotic properties are shown, and the methods are evaluated in simulation studies and applied to a motivating dataset in the context of classification.

READ FULL TEXT

page 1

page 2

page 3

page 4

11/27/2020

Comparison of Bayesian Nonparametric Density Estimation Methods

In this paper, we propose a nonparametric Bayesian approach for Lindsey ...
06/18/2022

IID Sampling from Posterior Dirichlet Process Mixtures

The influence of Dirichlet process mixture is ubiquitous in the Bayesian...
10/28/2014

Abrupt Motion Tracking via Nearest Neighbor Field Driven Stochastic Sampling

Stochastic sampling based trackers have shown good performance for abrup...
12/20/2021

Bayesian nonparametric model based clustering with intractable distributions: an ABC approach

Bayesian nonparametric mixture models offer a rich framework for model b...
11/30/2020

Use of Bayesian Nonparametric methods for Estimating the Measurements in High Clutter

Robust tracking of a target in a clutter environment is an important and...
03/26/2022

Model Selection for Maternal Hypertensive Disorders with Symmetric Hierarchical Dirichlet Processes

Hypertensive disorders of pregnancy occur in about 10 around the world. ...
02/23/2021

Brain Waves Analysis Via a Non-parametric Bayesian Mixture of Autoregressive Kernels

The standard approach to analyzing brain electrical activity is to exami...

Code Repositories

NN-DP

Nearest Neighbor-Dirichlet Process Codes (in R and Rcpp)


view repo