Credit scoring using neural networks and SURE posterior probability calibration

07/15/2021
by   Matthieu Garcin, et al.
0

In this article we compare the performances of a logistic regression and a feed forward neural network for credit scoring purposes. Our results show that the logistic regression gives quite good results on the dataset and the neural network can improve a little the performance. We also consider different sets of features in order to assess their importance in terms of prediction accuracy. We found that temporal features (i.e. repeated measures over time) can be an important source of information resulting in an increase in the overall model accuracy. Finally, we introduce a new technique for the calibration of predicted probabilities based on Stein's unbiased risk estimate (SURE). This calibration technique can be applied to very general calibration functions. In particular, we detail this method for the sigmoid function as well as for the Kumaraswamy function, which includes the identity as a particular case. We show that stacking the SURE calibration technique with the classical Platt method can improve the calibration of predicted probabilities.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/24/2017

Calibration of Machine Learning Classifiers for Probability of Default Modelling

Binary classification is highly used in credit scoring in the estimation...
research
08/25/2023

Calibration plots for multistate risk predictions models: an overview and simulation comparing novel approaches

Introduction. There is currently no guidance on how to assess the calibr...
research
02/25/2022

Model Comparison and Calibration Assessment: User Guide for Consistent Scoring Functions in Machine Learning and Actuarial Practice

One of the main tasks of actuaries and data scientists is to build good ...
research
03/21/2019

Feature quantization for parsimonious and interpretable predictive models

For regulatory and interpretability reasons, logistic regression is stil...
research
07/30/2013

Likelihood-ratio calibration using prior-weighted proper scoring rules

Prior-weighted logistic regression has become a standard tool for calibr...
research
09/21/2022

Monotonic Neural Additive Models: Pursuing Regulated Machine Learning Models for Credit Scoring

The forecasting of credit default risk has been an active research field...
research
12/06/2018

A two-stage hybrid model by using artificial neural networks as feature construction algorithms

We propose a two-stage hybrid approach with neural networks as the new f...

Please sign up or login with your details

Forgot password? Click here to reset