Polynomial methods in statistical inference: theory and practice

by   Yihong Wu, et al.

This survey provides an exposition of a suite of techniques based on the theory of polynomials, collectively referred to as polynomial methods, which have recently been applied to address several challenging problems in statistical inference successfully. Topics including polynomial approximation, polynomial interpolation and majorization, moment space and positive polynomials, orthogonal polynomials and Gaussian quadrature are discussed, with their major probabilistic and statistical applications in property estimation on large domains and learning mixture models. These techniques provide useful tools not only for the design of highly practical algorithms with provable optimality, but also for establishing the fundamental limits of the inference problems through the method of moment matching. The effectiveness of the polynomial method is demonstrated in concrete problems such as entropy and support size estimation, distinct elements problem, and learning Gaussian mixture models.


page 1

page 2

page 3

page 4


Estimating Gaussian mixtures using sparse polynomial moment systems

The method of moments is a statistical technique for density estimation ...

Tensor Moments of Gaussian Mixture Models: Theory and Applications

Gaussian mixture models (GMM) are fundamental tools in statistical and d...

Estimating Mixture Models via Mixtures of Polynomials

Mixture modeling is a general technique for making any simple model more...

On a convergence property of a geometrical algorithm for statistical manifolds

In this paper, we examine a geometrical projection algorithm for statist...

Optimal estimation of Gaussian mixtures via denoised method of moments

The Method of Moments [Pea94] is one of the most widely used methods in ...

Statistical Problems with Planted Structures: Information-Theoretical and Computational Limits

Over the past few years, insights from computer science, statistical phy...

Sorting out typicality with the inverse moment matrix SOS polynomial

We study a surprising phenomenon related to the representation of a clou...