Maximum likelihood estimation of the Fisher-Bingham distribution via efficient calculation of its normalizing constant

04/30/2020
by   Yici Chen, et al.
1

This paper proposes an efficient numerical integration formula to compute the normalizing constant of Fisher–Bingham distributions. This formula uses a numerical integration formula with the continuous Euler transform to a Fourier-type integral representation of the normalizing constant. As this method is fast and accurate, it can be applied to the calculation of the normalizing constant of high-dimensional Fisher–Bingham distributions. More precisely, the error decays exponentially with an increase in the integration points, and the computation cost increases linearly with the dimensions. In addition, this formula is useful for calculating the gradient and Hessian matrix of the normalizing constant. Therefore, we apply this formula to efficiently calculate the maximum likelihood estimation (MLE) of high-dimensional data. Finally, we apply the MLE to the hyperspherical variational auto-encoder (S-VAE), a deep-learning-based generative model that restricts the latent space to a unit hypersphere. We use the S-VAE trained with images of handwritten numbers to estimate the distributions of each label. This application is useful for adding new labels to the models.

READ FULL TEXT

page 12

page 13

research
02/05/2023

High-dimensional Location Estimation via Norm Concentration for Subgamma Vectors

In location estimation, we are given n samples from a known distribution...
research
01/11/2018

Exact Calculation of Normalized Maximum Likelihood Code Length Using Fourier Analysis

The normalized maximum likelihood code length has been widely used in mo...
research
10/05/2020

Unbiased Gradient Estimation for Variational Auto-Encoders using Coupled Markov Chains

The variational auto-encoder (VAE) is a deep latent variable model that ...
research
09/30/2022

GM-VAE: Representation Learning with VAE on Gaussian Manifold

We propose a Gaussian manifold variational auto-encoder (GM-VAE) whose l...
research
12/01/2019

Algebraic Analysis of Rotation Data

We develop algebraic tools for statistical inference from samples of rot...
research
03/05/2018

Blind Channel Equalization using Variational Autoencoders

A new maximum likelihood estimation approach for blind channel equalizat...
research
12/07/2019

Dances between continuous and discrete: Euler's summation formula

Leonhard Euler likely developed his summation formula in 1732, and soon ...

Please sign up or login with your details

Forgot password? Click here to reset