A metaheuristic multi-objective interaction-aware feature selection method

11/10/2022
by   Motahare Namakin, et al.
0

Multi-objective feature selection is one of the most significant issues in the field of pattern recognition. It is challenging because it maximizes the classification performance and, at the same time, minimizes the number of selected features, and the mentioned two objectives are usually conflicting. To achieve a better Pareto optimal solution, metaheuristic optimization methods are widely used in many studies. However, the main drawback is the exploration of a large search space. Another problem with multi-objective feature selection approaches is the interaction between features. Selecting correlated features has negative effect on classification performance. To tackle these problems, we present a novel multi-objective feature selection method that has several advantages. Firstly, it considers the interaction between features using an advanced probability scheme. Secondly, it is based on the Pareto Archived Evolution Strategy (PAES) method that has several advantages such as simplicity and its speed in exploring the solution space. However, we improve the structure of PAES in such a way that generates the offsprings, intelligently. Thus, the proposed method utilizes the introduced probability scheme to produce more promising offsprings. Finally, it is equipped with a novel strategy that guides it to find the optimum number of features through the process of evolution. The experimental results show a significant improvement in finding the optimal Pareto front compared to state-of-the-art methods on different real-world datasets.

READ FULL TEXT
research
10/16/2021

An Evolutionary Correlation-aware Feature Selection Method for Classification Problems

The population-based optimization algorithms have provided promising res...
research
07/09/2018

Automatic multi-objective based feature selection for classification

Accurately classifying malignancy of lesions detected in a screening sca...
research
07/04/2016

Multi-Objective Design of State Feedback Controllers Using Reinforced Quantum-Behaved Particle Swarm Optimization

In this paper, a novel and generic multi-objective design paradigm is pr...
research
05/29/2020

Unsupervised Feature Selection via Multi-step Markov Transition Probability

Feature selection is a widely used dimension reduction technique to sele...
research
09/15/2017

ε-Lexicase selection: a probabilistic and multi-objective analysis of lexicase selection in continuous domains

Lexicase selection is a parent selection method that considers training ...
research
07/17/2023

Multi-Objective Optimization of Performance and Interpretability of Tabular Supervised Machine Learning Models

We present a model-agnostic framework for jointly optimizing the predict...
research
01/26/2023

Optimizing Feature Set for Click-Through Rate Prediction

Click-through prediction (CTR) models transform features into latent vec...

Please sign up or login with your details

Forgot password? Click here to reset