Parameter Selection Algorithm For Continuous Variables

01/19/2017
by   Peyman Tavallali, et al.
0

In this article, we propose a new algorithm for supervised learning methods, by which one can both capture the non-linearity in data and also find the best subset model. To produce an enhanced subset of the original variables, an ideal selection method should have the potential of adding a supplementary level of regression analysis that would capture complex relationships in the data via mathematical transformation of the predictors and exploration of synergistic effects of combined variables. The method that we present here has the potential to produce an optimal subset of variables, rendering the overall process of model selection to be more efficient. The core objective of this paper is to introduce a new estimation technique for the classical least square regression framework. This new automatic variable transformation and model selection method could offer an optimal and stable model that minimizes the mean square error and variability, while combining all possible subset selection methodology and including variable transformations and interaction. Moreover, this novel method controls multicollinearity, leading to an optimal set of explanatory variables.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/04/2020

Information Complexity Criterion for Model Selection in Robust Regression Using A New Robust Penalty Term

Model selection is basically a process of finding the best model from th...
research
03/28/2012

A Multi-objective Exploratory Procedure for Regression Model Selection

Variable selection is recognized as one of the most critical steps in st...
research
12/12/2021

Learning with Subset Stacking

We propose a new algorithm that learns from a set of input-output pairs....
research
12/06/2017

On overfitting and post-selection uncertainty assessments

In a regression context, when the relevant subset of explanatory variabl...
research
09/12/2023

A Consistent and Scalable Algorithm for Best Subset Selection in Single Index Models

Analysis of high-dimensional data has led to increased interest in both ...
research
12/12/2017

A Mathematical Programming Approach for Integrated Multiple Linear Regression Subset Selection and Validation

Subset selection for multiple linear regression aims to construct a regr...
research
09/19/2017

BeSS: An R Package for Best Subset Selection in Linear, Logistic and CoxPH Models

We introduce a new R package, BeSS, for solving the best subset selectio...

Please sign up or login with your details

Forgot password? Click here to reset