On the Normalizing Constant of the Continuous Categorical Distribution

04/28/2022
by   Elliott Gordon-Rodriguez, et al.
0

Probability distributions supported on the simplex enjoy a wide range of applications across statistics and machine learning. Recently, a novel family of such distributions has been discovered: the continuous categorical. This family enjoys remarkable mathematical simplicity; its density function resembles that of the Dirichlet distribution, but with a normalizing constant that can be written in closed form using elementary functions only. In spite of this mathematical simplicity, our understanding of the normalizing constant remains far from complete. In this work, we characterize the numerical behavior of the normalizing constant and we present theoretical and methodological advances that can, in turn, help to enable broader applications of the continuous categorical distribution. Our code is available at https://github.com/cunningham-lab/cb_and_cc/.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/20/2020

The continuous categorical: a novel simplex-valued exponential family

Simplex-valued data appear throughout statistics and machine learning, f...
research
05/22/2023

Squared Neural Families: A New Class of Tractable Density Models

Flexible models for probability distributions are an essential ingredien...
research
12/02/2022

A Tractable Probability Distribution with Applications in Three-Dimensional Statistics

A new family of continuous probability distributions is highlighted in t...
research
08/04/2023

Intensity-free Integral-based Learning of Marked Temporal Point Processes

In the marked temporal point processes (MTPP), a core problem is to para...
research
06/27/2019

Efficient algorithms for modifying and sampling from a categorical distribution

Probabilistic programming languages and other machine learning applicati...
research
10/26/2022

Categorical SDEs with Simplex Diffusion

Diffusion models typically operate in the standard framework of generati...
research
11/28/2020

Batch Normalization with Enhanced Linear Transformation

Batch normalization (BN) is a fundamental unit in modern deep networks, ...

Please sign up or login with your details

Forgot password? Click here to reset