Applications of Nature-Inspired Algorithms for Dimension Reduction: Enabling Efficient Data Analytics

08/22/2019
by   Farid Ghareh Mohammadi, et al.
29

In [1], we have explored the theoretical aspects of feature selection and evolutionary algorithms. In this chapter, we focus on optimization algorithms for enhancing data analytic process, i.e., we propose to explore applications of nature-inspired algorithms in data science. Feature selection optimization is a hybrid approach leveraging feature selection techniques and evolutionary algorithms process to optimize the selected features. Prior works solve this problem iteratively to converge to an optimal feature subset. Feature selection optimization is a non-specific domain approach. Data scientists mainly attempt to find an advanced way to analyze data n with high computational efficiency and low time complexity, leading to efficient data analytics. Thus, by increasing generated/measured/sensed data from various sources, analysis, manipulation and illustration of data grow exponentially. Due to the large scale data sets, Curse of dimensionality (CoD) is one of the NP-hard problems in data science. Hence, several efforts have been focused on leveraging evolutionary algorithms (EAs) to address the complex issues in large scale data analytics problems. Dimension reduction, together with EAs, lends itself to solve CoD and solve complex problems, in terms of time complexity, efficiently. In this chapter, we first provide a brief overview of previous studies that focused on solving CoD using feature extraction optimization process. We then discuss practical examples of research studies are successfully tackled some application domains, such as image processing, sentiment analysis, network traffics / anomalies analysis, credit score analysis and other benchmark functions/data sets analysis.

READ FULL TEXT
research
08/16/2019

Evolutionary Computation, Optimization and Learning Algorithms for Data Science

A large number of engineering, science and computational problems have y...
research
07/23/2019

ISEA: Image Steganalysis using Evolutionary Algorithms

NP-hard problems always have been attracting scientists' attentions, and...
research
10/27/2021

A Self-adaptive Weighted Differential Evolution Approach for Large-scale Feature Selection

Recently, many evolutionary computation methods have been developed to s...
research
12/11/2017

Feature Extraction and Feature Selection: Reducing Data Complexity with Apache Spark

Feature extraction and feature selection are the first tasks in pre-proc...
research
07/04/2017

Kernel Feature Selection via Conditional Covariance Minimization

We propose a framework for feature selection that employs kernel-based m...
research
11/22/2017

Relief-Based Feature Selection: Introduction and Review

Feature selection plays a critical role in data mining, driven by increa...
research
02/15/2016

Towards reducing the multidimensionality of OLAP cubes using the Evolutionary Algorithms and Factor Analysis Methods

Data Warehouses are structures with large amount of data collected from ...

Please sign up or login with your details

Forgot password? Click here to reset