Variance Reduction for Better Sampling in Continuous Domains

04/24/2020
by   Laurent Meunier, et al.
0

Design of experiments, random search, initialization of population-based methods, or sampling inside an epoch of an evolutionary algorithm use a sample drawn according to some probability distribution for approximating the location of an optimum. Recent papers have shown that the optimal search distribution, used for the sampling, might be more peaked around the center of the distribution than the prior distribution modelling our uncertainty about the location of the optimum. We confirm this statement, provide explicit values for this reshaping of the search distribution depending on the population size λ and the dimension d, and validate our results experimentally.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/08/2019

Unbiased estimators for random design regression

In linear regression we wish to estimate the optimum linear least square...
research
07/01/2022

Some observations on the distribution of order statistics under simple-random-sampling without replacement

This paper examines the distribution of order statistics from simple-ran...
research
01/03/2021

Better understanding of the multivariate hypergeometric distribution with implications in design-based survey sampling

Multivariate hypergeometric distribution arises frequently in elementary...
research
10/20/2021

Sampling from Arbitrary Functions via PSD Models

In many areas of applied statistics and machine learning, generating an ...
research
10/18/2019

Fully Parallel Hyperparameter Search: Reshaped Space-Filling

Space-filling designs such as scrambled-Hammersley, Latin Hypercube Samp...
research
10/04/2018

Correcting the bias in least squares regression with volume-rescaled sampling

Consider linear regression where the examples are generated by an unknow...
research
08/23/2005

Search Process and Probabilistic Bifix Approach

An analytical approach to a search process is a mathematical prerequisit...

Please sign up or login with your details

Forgot password? Click here to reset