DeepAI AI Chat
Log In Sign Up

Can Evolutionary Sampling Improve Bagged Ensembles?

10/03/2016
by   Harsh Nisar, et al.
0

Perturb and Combine (P&C) group of methods generate multiple versions of the predictor by perturbing the training set or construction and then combining them into a single predictor (Breiman, 1996b). The motive is to improve the accuracy in unstable classification and regression methods. One of the most well known method in this group is Bagging. Arcing or Adaptive Resampling and Combining methods like AdaBoost are smarter variants of P&C methods. In this extended abstract, we lay the groundwork for a new family of methods under the P&C umbrella, known as Evolutionary Sampling (ES). We employ Evolutionary algorithms to suggest smarter sampling in both the feature space (sub-spaces) as well as training samples. We discuss multiple fitness functions to assess ensembles and empirically compare our performance against randomized sampling of training data and feature sub-spaces.

READ FULL TEXT

page 1

page 2

page 3

12/27/2012

Group theory, group actions, evolutionary algorithms, and global optimization

In this paper we use group, action and orbit to understand how evolution...
03/30/2020

Re-purposing Heterogeneous Generative Ensembles with Evolutionary Computation

Generative Adversarial Networks (GANs) are popular tools for generative ...
05/08/2021

A Crossover That Matches Diverse Parents Together in Evolutionary Algorithms

Crossover and mutation are the two main operators that lead to new solut...
08/19/2016

Haploid-Diploid Evolutionary Algorithms

This paper uses the recent idea that the fundamental haploid-diploid lif...
07/28/2019

On the Robustness of Median Sampling in Noisy Evolutionary Optimization

In real-world optimization tasks, the objective (i.e., fitness) function...