Polynomial methods in statistical inference: theory and practice

04/15/2021
by   Yihong Wu, et al.
0

This survey provides an exposition of a suite of techniques based on the theory of polynomials, collectively referred to as polynomial methods, which have recently been applied to address several challenging problems in statistical inference successfully. Topics including polynomial approximation, polynomial interpolation and majorization, moment space and positive polynomials, orthogonal polynomials and Gaussian quadrature are discussed, with their major probabilistic and statistical applications in property estimation on large domains and learning mixture models. These techniques provide useful tools not only for the design of highly practical algorithms with provable optimality, but also for establishing the fundamental limits of the inference problems through the method of moment matching. The effectiveness of the polynomial method is demonstrated in concrete problems such as entropy and support size estimation, distinct elements problem, and learning Gaussian mixture models.

READ FULL TEXT

page 1

page 2

page 3

page 4

06/29/2021

Estimating Gaussian mixtures using sparse polynomial moment systems

The method of moments is a statistical technique for density estimation ...
02/14/2022

Tensor Moments of Gaussian Mixture Models: Theory and Applications

Gaussian mixture models (GMM) are fundamental tools in statistical and d...
03/28/2016

Estimating Mixture Models via Mixtures of Polynomials

Mixture modeling is a general technique for making any simple model more...
09/27/2019

On a convergence property of a geometrical algorithm for statistical manifolds

In this paper, we examine a geometrical projection algorithm for statist...
07/19/2018

Optimal estimation of Gaussian mixtures via denoised method of moments

The Method of Moments [Pea94] is one of the most widely used methods in ...
05/31/2018

Statistical Problems with Planted Structures: Information-Theoretical and Computational Limits

Over the past few years, insights from computer science, statistical phy...
03/04/2020

Sorting out typicality with the inverse moment matrix SOS polynomial

We study a surprising phenomenon related to the representation of a clou...