Feature Engineering for Predictive Modeling using Reinforcement Learning

09/21/2017
by   Udayan Khurana, et al.
0

Feature engineering is a crucial step in the process of predictive modeling. It involves the transformation of given feature space, typically using mathematical functions, with the objective of reducing the modeling error for a given target. However, there is no well-defined basis for performing effective feature engineering. It involves domain knowledge, intuition, and most of all, a lengthy process of trial and error. The human attention involved in overseeing this process significantly influences the cost of model generation. We present a new framework to automate feature engineering. It is based on performance driven exploration of a transformation graph, which systematically and compactly enumerates the space of given options. A highly efficient exploration strategy is derived through reinforcement learning on past examples.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/14/2000

Modeling the Uncertainty in Complex Engineering Systems

Existing procedures for model validation have been deemed inadequate for...
research
03/02/2019

Automating Predictive Modeling Process using Reinforcement Learning

Building a good predictive model requires an array of activities such as...
research
09/16/2022

Self-Optimizing Feature Transformation

Feature transformation aims to extract a good representation (feature) s...
research
12/27/2022

Traceable Automatic Feature Transformation via Cascading Actor-Critic Agents

Feature transformation for AI is an essential task to boost the effectiv...
research
05/26/2023

A Knowledge Engineering Primer

The aim of this primer is to introduce the subject of knowledge engineer...
research
05/28/2022

Group-wise Reinforcement Feature Generation for Optimal and Explainable Representation Space Reconstruction

Representation (feature) space is an environment where data points are v...
research
06/29/2023

Traceable Group-Wise Self-Optimizing Feature Transformation Learning: A Dual Optimization Perspective

Feature transformation aims to reconstruct an effective representation s...

Please sign up or login with your details

Forgot password? Click here to reset