DeepAI AI Chat
Log In Sign Up

Soft Rule Ensembles for Statistical Learning

05/21/2012
by   Deniz Akdemir, et al.
cornell university
0

In this article supervised learning problems are solved using soft rule ensembles. We first review the importance sampling learning ensembles (ISLE) approach that is useful for generating hard rules. The soft rules are then obtained with logistic regression from the corresponding hard rules. In order to deal with the perfect separation problem related to the logistic regression, Firth's bias corrected likelihood is used. Various examples and simulation results show that soft rule ensembles can improve predictive performance over hard rule ensembles.

READ FULL TEXT
08/24/2017

Logistic Regression as Soft Perceptron Learning

We comment on the fact that gradient ascent for logistic regression has ...
01/21/2021

Better Short than Greedy: Interpretable Models through Optimal Rule Boosting

Rule ensembles are designed to provide a useful trade-off between predic...
04/30/2021

Forming Ensembles at Runtime: A Machine Learning Approach

Smart system applications (SSAs) built on top of cyber-physical and soci...
11/19/2014

Large-Margin Classification with Multiple Decision Rules

Binary classification is a common statistical learning problem in which ...
12/11/2018

Identification of Cancer - Mesothelioma Disease Using Logistic Regression and Association Rule

Malignant Pleural Mesothelioma (MPM) or malignant mesothelioma (MM) is a...
06/05/2019

Generalized Linear Rule Models

This paper considers generalized linear models using rule-based features...
07/17/2012

Ensemble Clustering with Logic Rules

In this article, the logic rule ensembles approach to supervised learnin...