Minimax Optimal Additive Functional Estimation with Discrete Distribution

11/28/2018
by   Kazuto Fukuchi, et al.
0

This paper addresses a problem of estimating an additive functional given n i.i.d. samples drawn from a discrete distribution P=(p_1,...,p_k) with alphabet size k. The additive functional is defined as θ(P;ϕ)=∑_i=1^kϕ(p_i) for a function ϕ, which covers the most of the entropy-like criteria. The minimax optimal risk of this problem has been already known for some specific ϕ, such as ϕ(p)=p^α and ϕ(p)=-p p. However, there is no generic methodology to derive the minimax optimal risk for the additive function estimation problem. In this paper, we reveal the property of ϕ that characterizes the minimax optimal risk of the additive functional estimation problem; this analysis is applicable to general ϕ. More precisely, we reveal that the minimax optimal risk of this problem is characterized by the divergence speed of the function ϕ.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/12/2018

Minimax Optimal Additive Functional Estimation with Discrete Distribution: Slow Divergence Speed Case

This paper addresses an estimation problem of an additive functional of ...
research
08/29/2019

Minimax optimal estimators for general additive functional estimation

In this paper, we observe a sparse mean vector through Gaussian noise an...
research
05/13/2023

On Semi-Supervised Estimation of Distributions

We study the problem of estimating the joint probability mass function (...
research
04/27/2020

Minimax testing and quadratic functional estimation for circular convolution

In a circular convolution model, we aim to infer on the density of a cir...
research
02/23/2018

Local moment matching: A unified methodology for symmetric functional estimation and distribution estimation under Wasserstein distance

We present Local Moment Matching (LMM), a unified methodology for symmet...
research
04/19/2023

Minimax Signal Detection in Sparse Additive Models

Sparse additive models are an attractive choice in circumstances calling...
research
05/29/2023

The minimax risk in testing the histogram of discrete distributions for uniformity under missing ball alternatives

We consider the problem of testing the fit of a discrete sample of items...

Please sign up or login with your details

Forgot password? Click here to reset