DeepAI AI Chat
Log In Sign Up

Maximum likelihood estimation of the Fisher-Bingham distribution via efficient calculation of its normalizing constant

by   Yici Chen, et al.
The University of Tokyo

This paper proposes an efficient numerical integration formula to compute the normalizing constant of Fisher–Bingham distributions. This formula uses a numerical integration formula with the continuous Euler transform to a Fourier-type integral representation of the normalizing constant. As this method is fast and accurate, it can be applied to the calculation of the normalizing constant of high-dimensional Fisher–Bingham distributions. More precisely, the error decays exponentially with an increase in the integration points, and the computation cost increases linearly with the dimensions. In addition, this formula is useful for calculating the gradient and Hessian matrix of the normalizing constant. Therefore, we apply this formula to efficiently calculate the maximum likelihood estimation (MLE) of high-dimensional data. Finally, we apply the MLE to the hyperspherical variational auto-encoder (S-VAE), a deep-learning-based generative model that restricts the latent space to a unit hypersphere. We use the S-VAE trained with images of handwritten numbers to estimate the distributions of each label. This application is useful for adding new labels to the models.


page 12

page 13


High-dimensional Location Estimation via Norm Concentration for Subgamma Vectors

In location estimation, we are given n samples from a known distribution...

Exact Calculation of Normalized Maximum Likelihood Code Length Using Fourier Analysis

The normalized maximum likelihood code length has been widely used in mo...

Unbiased Gradient Estimation for Variational Auto-Encoders using Coupled Markov Chains

The variational auto-encoder (VAE) is a deep latent variable model that ...

GM-VAE: Representation Learning with VAE on Gaussian Manifold

We propose a Gaussian manifold variational auto-encoder (GM-VAE) whose l...

Algebraic Analysis of Rotation Data

We develop algebraic tools for statistical inference from samples of rot...

Blind Channel Equalization using Variational Autoencoders

A new maximum likelihood estimation approach for blind channel equalizat...

Dances between continuous and discrete: Euler's summation formula

Leonhard Euler likely developed his summation formula in 1732, and soon ...