Rapid and deterministic estimation of probability densities using scale-free field theories

12/23/2013
by   Justin B. Kinney, et al.
0

The question of how best to estimate a continuous probability density from finite data is an intriguing open problem at the interface of statistics and physics. Previous work has argued that this problem can be addressed in a natural way using methods from statistical field theory. Here I describe new results that allow this field-theoretic approach to be rapidly and deterministically computed in low dimensions, making it practical for use in day-to-day data analysis. Importantly, this approach does not impose a privileged length scale for smoothness of the inferred probability density, but rather learns a natural length scale from the data due to the tradeoff between goodness-of-fit and an Occam factor. Open source software implementing this method in one and two dimensions is provided.

READ FULL TEXT
research
11/19/2014

Unification of field theory and maximum entropy methods for learning probability densities

The need to estimate smooth probability distributions (a.k.a. probabilit...
research
08/22/2020

Approximation of probability density functions via location-scale finite mixtures in Lebesgue spaces

The class of location-scale finite mixtures is of enduring interest both...
research
04/12/2020

At the Interface of Algebra and Statistics

This thesis takes inspiration from quantum physics to investigate mathem...
research
06/08/2022

Sequential Density Estimation via NCWFAs Sequential Density Estimation via Nonlinear Continuous Weighted Finite Automata

Weighted finite automata (WFAs) have been widely applied in many fields....
research
08/29/2023

Two ways game-theoretic probability can improve data analysis

When testing a statistical hypothesis, is it legitimate to deliberate on...
research
08/04/2018

Bounded Statistics

If two probability density functions (PDFs) have values for their first ...

Please sign up or login with your details

Forgot password? Click here to reset