Automation of Feature Engineering for IoT Analytics

07/13/2017
by   Snehasis Banerjee, et al.
0

This paper presents an approach for automation of interpretable feature selection for Internet Of Things Analytics (IoTA) using machine learning (ML) techniques. Authors have conducted a survey over different people involved in different IoTA based application development tasks. The survey reveals that feature selection is the most time consuming and niche skill demanding part of the entire workflow. This paper shows how feature selection is successfully automated without sacrificing the decision making accuracy and thereby reducing the project completion time and cost of hiring expensive resources. Several pattern recognition principles and state of art (SoA) ML techniques are followed to design the overall approach for the proposed automation. Three data sets are considered to establish the proof-of-concept. Experimental results show that the proposed automation is able to reduce the time for feature selection to 2 days instead of 4-6 months which would have been required in absence of the automation. This reduction in time is achieved without any sacrifice in the accuracy of the decision making process. Proposed method is also compared against Multi Layer Perceptron (MLP) model as most of the state of the art works on IoTA uses MLP based Deep Learning. Moreover the feature selection method is compared against SoA feature reduction technique namely Principal Component Analysis (PCA) and its variants. The results obtained show that the proposed method is effective.

READ FULL TEXT

page 2

page 4

research
09/06/2022

Handcrafted Feature Selection Techniques for Pattern Recognition: A Survey

The accuracy of a classifier, when performing Pattern recognition, is mo...
research
11/06/2017

Interpretable Feature Recommendation for Signal Analytics

This paper presents an automated approach for interpretable feature reco...
research
02/10/2019

Machine Learning With Feature Selection Using Principal Component Analysis for Malware Detection: A Case Study

Cyber security threats have been growing significantly in both volume an...
research
11/25/2020

Feature Selection based on Principal Component Analysis for Underwater Source Localization by Deep Learning

In this paper, we propose an interpretable feature selection method base...
research
12/11/2017

Feature Extraction and Feature Selection: Reducing Data Complexity with Apache Spark

Feature extraction and feature selection are the first tasks in pre-proc...
research
10/28/2020

Dynamic Bayesian Approach for decision-making in Ego-Things

This paper presents a novel approach to detect abnormalities in dynamic ...
research
09/18/2019

Corporate IT-support Help-Desk Process Hybrid-Automation Solution with Machine Learning Approach

Comprehensive IT support teams in large scale organizations require more...

Please sign up or login with your details

Forgot password? Click here to reset