Recent Results on No-Free-Lunch Theorems for Optimization

03/31/2003
by   Christian Igel, et al.
0

The sharpened No-Free-Lunch-theorem (NFL-theorem) states that the performance of all optimization algorithms averaged over any finite set F of functions is equal if and only if F is closed under permutation (c.u.p.) and each target function in F is equally likely. In this paper, we first summarize some consequences of this theorem, which have been proven recently: The average number of evaluations needed to find a desirable (e.g., optimal) solution can be calculated; the number of subsets c.u.p. can be neglected compared to the overall number of possible subsets; and problem classes relevant in practice are not likely to be c.u.p. Second, as the main result, the NFL-theorem is extended. Necessary and sufficient conditions for NFL-results to hold are given for arbitrary, non-uniform distributions of target functions. This yields the most general NFL-theorem for optimization presented so far.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/21/2001

On Classes of Functions for which No Free Lunch Results Hold

In a recent paper it was shown that No Free Lunch results hold for any s...
research
02/06/2015

A Generalization of the Borkar-Meyn Theorem for Stochastic Recursive Inclusions

In this paper the stability theorem of Borkar and Meyn is extended to in...
research
07/09/2009

Beyond No Free Lunch: Realistic Algorithms for Arbitrary Problem Classes

We show how the necessary and sufficient conditions for the NFL to apply...
research
02/11/2019

All those EPPA classes (Strengthenings of the Herwig-Lascar theorem)

In this paper we prove a general theorem showing the extension property ...
research
03/16/2019

Nerve Theorem on a Positive Reach set

We provide sufficient conditions under which any non-empty intersection ...
research
06/07/2019

When and Why Metaheuristics Researchers Can Ignore "No Free Lunch" Theorems

The No Free Lunch (NFL) theorem for search and optimisation states that ...
research
09/19/2022

A Generalized Argmax Theorem with Applications

The argmax theorem is a useful result for deriving the limiting distribu...

Please sign up or login with your details

Forgot password? Click here to reset