Development and comparison of payment behaviour prediction models for two South African state departments

Abstract

Background: No credit rating methodology currently exists for any of South Africa’s sub nationals. Aim: To develop a generic, quantitative credit rating methodology for the Department of Health and the Department of Education combined, as well as specific quantitative credit rating methodologies, for each department, individually. Setting: A comparison between generic and specific subnational credit rating methodologies to assess which fits the South African subnational environment best. Studies and results obtained from other nations were used to construct the approach. Methods: In a typical credit rating methodology, both quantitative and qualitative information is considered. In South Africa (as a developing economy), the quantitative information equates to a smaller portion of the final credit rating. A generic quantitative credit rating methodology, as well as specific credit rating methodologies, was developed. The appropriateness of these generic and specific models was tested with regards to prediction accuracies using Red, Amber or Green (RAG) statuses on a traffic light series. An illustration of the predicted versus actual ranks is provided, as well as an example to illustrate how model-predicted RAG statuses, based on quantitative information, may be overlaid with more recent qualitative information to derive a final ranking. Results: A generic, quantitative credit rating methodology for the Departments of Health and the Department of Education combined was developed, as well as specific credit rating methodologies for each department separately. The specific subnational credit rating methodology outperformed the generic methodology considerably; more precisely, the generic models predicted a maximum of 50% of the new cases correctly as opposed to the specific Health and Education models’ 78%. Conclusion: The primary contribution of this study was to develop and compare generic and specific subnational credit rating methodologies. A further contribution was to test the appropriateness of these models’ prediction accuracies using RAG statutes. The specific subnational credit rating methodology was found to outperform the generic methodology considerably