Original Research

Integrating traditional and non-traditional model risk frameworks in credit scoring

Hendrik A. du Toit, Willem D. Schutte, Helgard Raubenheimer
South African Journal of Economic and Management Sciences | Vol 27, No 1 | a5786 | DOI: https://doi.org/10.4102/sajems.v27i1.5786 | © 2024 Hendrik A. du Toit, Willem D. Schutte, Helgard Raubenheimer | This work is licensed under CC Attribution 4.0
Submitted: 10 June 2024 | Published: 08 October 2024

About the author(s)

Hendrik A. du Toit, Centre for Business Mathematics and Informatics, Faculty of Natural and Agricultural Sciences, North-West University, Potchefstroom, South Africa
Willem D. Schutte, Centre for Business Mathematics and Informatics, Faculty of Natural and Agricultural Sciences, North-West University, Potchefstroom, South Africa; and, National Institute for Theoretical and Computational Sciences (NITheCS), Pretoria, South Africa
Helgard Raubenheimer, Centre for Business Mathematics and Informatics, Faculty of Natural and Agricultural Sciences, North-West University, Potchefstroom, South Africa; and, National Institute for Theoretical and Computational Sciences (NITheCS), Pretoria, South Africa

Abstract

Background: An improved understanding of the reasoning behind model decisions can enhance the use of machine learning (ML) models in credit scoring. Although ML models are widely regarded as highly accurate, the use of these models in settings that require explanation of model decisions has been limited because of the lack of transparency. Especially in the banking sector, model risk frameworks frequently require a significant level of model interpretability.

Aim: The aim of the article is to evaluate traditional model risk frameworks to determine their appropriateness when validating ML models in credit scoring and enhance the use of ML models in regulated environments by introducing a ML interpretability technique in model validation frameworks.

Setting: The research considers model risk frameworks and regulatory guidelines from various international institutions.

Method: The research is qualitative in nature and shows how through integrating traditional and non-traditional model risk frameworks, the practitioner can leverage trusted techniques and extend traditional frameworks to address key principles such as transparency.

Results: The article proposes a model risk framework that utilises Shapley values to improve the explainability of ML models in credit scoring. Practical validation tests are proposed to enable transparency of model input variables in the validation process of ML models.

Conclusion: Our results show that one can formulate a comprehensive validation process by integrating traditional and non-traditional frameworks.

Contribution: This study contributes to existing model risk literature by proposing a new model validation framework that utilises Shapley values to explain ML model predictions in credit scoring.


Keywords

machine learning models; credit scoring; model risk frameworks; model interpretability; model validation; Shapley values; model transparency

JEL Codes

C15: Statistical Simulation Methods: General; C51: Model Construction and Estimation; C52: Model Evaluation, Validation, and Selection; C53: Forecasting and Prediction Methods • Simulation Methods; E51: Money Supply • Credit • Money Multipliers; E58: Central Banks and Their Policies

Sustainable Development Goal

Goal 9: Industry, innovation and infrastructure

Metrics

Total abstract views: 62
Total article views: 49


Crossref Citations

No related citations found.