Developing and Improving Risk Models using Machine-learning Based Algorithms

09/09/2020
by   Yan Wang, et al.
0

The objective of this study is to develop a good risk model for classifying business delinquency by simultaneously exploring several machine learning based methods including regularization, hyper-parameter optimization, and model ensembling algorithms. The rationale under the analyses is firstly to obtain good base binary classifiers (include Logistic Regression (LR), K-Nearest Neighbors (KNN), Decision Tree (DT), and Artificial Neural Networks (ANN)) via regularization and appropriate settings of hyper-parameters. Then two model ensembling algorithms including bagging and boosting are performed on the good base classifiers for further model improvement. The models are evaluated using accuracy, Area Under the Receiver Operating Characteristic Curve (AUC of ROC), recall, and F1 score via repeating 10-fold cross-validation 10 times. The results show the optimal base classifiers along with the hyper-parameter settings are LR without regularization, KNN by using 9 nearest neighbors, DT by setting the maximum level of the tree to be 7, and ANN with three hidden layers. Bagging on KNN with K valued 9 is the optimal model we can get for risk classification as it reaches the average accuracy, AUC, recall, and F1 score valued 0.90, 0.93, 0.82, and 0.89, respectively.

READ FULL TEXT

Authors

page 1

page 2

03/13/2019

Predicting class-imbalanced business risk using resampling, regularization, and model ensembling algorithms

We aim at developing and improving the imbalanced business risk modeling...
01/24/2019

A XGBoost risk model via feature selection and Bayesian hyper-parameter optimization

This paper aims to explore models based on the extreme gradient boosting...
02/14/2021

New methods for metastimuli: architecture, embeddings, and neural network optimization

Six significant new methodological developments of the previously-presen...
03/21/2021

Deep ROC Analysis and AUC as Balanced Average Accuracy to Improve Model Selection, Understanding and Interpretation

Optimal performance is critical for decision-making tasks from medicine ...
06/03/2021

Machine Learning Based Texture Analysis of Patella from X-Rays for Detecting Patellofemoral Osteoarthritis

Objective is to assess the ability of texture features for detecting rad...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.