Exact Calculation of Normalized Maximum Likelihood Code Length Using Fourier Analysis

01/11/2018
by   Atsushi Suzuki, et al.
0

The normalized maximum likelihood code length has been widely used in model selection, and its favorable properties, such as its consistency and the upper bound of its statistical risk, have been demonstrated. This paper proposes a novel methodology for calculating the normalized maximum likelihood code length on the basis of Fourier analysis. Our methodology provides an efficient non-asymptotic calculation formula for exponential family models and an asymptotic calculation formula for general parametric models with a weaker assumption compared to that in previous work.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/28/2014

Bayesian Properties of Normalized Maximum Likelihood and its Fast Computation

The normalized maximized likelihood (NML) provides the minimax regret so...
research
04/30/2020

Maximum likelihood estimation of the Fisher-Bingham distribution via efficient calculation of its normalizing constant

This paper proposes an efficient numerical integration formula to comput...
research
08/29/2020

Statistical Analysis of Multi-Relational Network Recovery

In this paper, we develop asymptotic theories for a class of latent vari...
research
04/26/2018

High-dimensional Penalty Selection via Minimum Description Length Principle

We tackle the problem of penalty selection of regularization on the basi...
research
05/15/2019

Information criteria for non-normalized models

Many statistical models are given in the form of non-normalized densitie...
research
05/09/2022

Asymptotic comparison of identifying constraints for Bradley-Terry models

The Bradley-Terry model is widely used for pairwise comparison data anal...
research
10/20/2018

Renormalized Normalized Maximum Likelihood and Three-Part Code Criteria For Learning Gaussian Networks

Score based learning (SBL) is a promising approach for learning Bayesian...

Please sign up or login with your details

Forgot password? Click here to reset