The De-Biased Whittle Likelihood

05/22/2016
by   Adam M. Sykulski, et al.
0

The Whittle likelihood is a widely used and computationally efficient pseudo-likelihood. However, it is known to produce biased parameter estimates for large classes of models. We propose a method for de-biasing Whittle estimates for second-order stationary stochastic processes. The de-biased Whittle likelihood can be computed in the same O(n n) operations as the standard approach. We demonstrate the superior performance of the method in simulation studies and in application to a large-scale oceanographic dataset, where in both cases the de-biased approach reduces bias by up to two orders of magnitude, achieving estimates that are close to exact maximum likelihood, at a fraction of the computational cost. We prove that the method yields estimates that are consistent at an optimal convergence rate of n^-1/2, under weaker assumptions than standard theory, where we do not require that the power spectral density is continuous in frequency. We describe how the method can be easily combined with standard methods of bias reduction, such as tapering and differencing, to further reduce bias in parameter estimates.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/03/2020

Fixing Bias in Zipf's Law Estimators Using Approximate Bayesian Computation

The prevailing Bayesian maximum likelihood estimators for inferring powe...
research
01/18/2021

Bias Reduction as a Remedy to the Consequences of Infinite Estimates in Poisson and Tobit Regression

Data separation is a well-studied phenomenon that can cause problems in ...
research
11/01/2020

Fast Network Community Detection with Profile-Pseudo Likelihood Methods

The stochastic block model is one of the most studied network models for...
research
07/02/2020

Debiasing Distributed Second Order Optimization with Surrogate Sketching and Scaled Regularization

In distributed second order optimization, a standard strategy is to aver...
research
08/02/2019

Exact joint likelihood of pseudo-C_ℓ estimates from correlated Gaussian cosmological fields

We present the exact joint likelihood of pseudo-C_ℓ power spectrum estim...
research
10/17/2019

Consistency of the Buckley-Osthus model and the hierarchical preferential attachment model

This paper is concerned with statistical estimation of two preferential ...
research
11/16/2020

Estimating the correlation in network disturbance models

The Network Disturbance Model of Doreian (1989) expresses the dependency...

Please sign up or login with your details

Forgot password? Click here to reset