Utilizing data sampling techniques on algorithmic fairness for customer churn prediction with data imbalance problems


Maw, Maw and Haw, Su Cheng and Ho, Chin Kuan (2022) Utilizing data sampling techniques on algorithmic fairness for customer churn prediction with data imbalance problems. F1000Research, 10. p. 988. ISSN 2046-1402

[img] Text
5.pdf - Published Version
Restricted to Repository staff only

Download (1MB)


Customer churn prediction (CCP) refers to detecting which customers are likely to cancel the services provided by a service provider, for example, internet services. The class imbalance problem (CIP) in machine learning occurs when there is a huge difference in the samples of the positive class compared to the negative class. It is one of the major obstacles in CCP as it deteriorates performance in the classification process. Utilizing data sampling techniques (DSTs) helps to resolve the CIP to some extent. Methods: In this paper, we review the effect of using DSTs on algorithmic fairness, i.e., to investigate whether the results pose any discrimination between male and female groups and compare the results before and after using DSTs. Three real-world datasets with unequal balancing rates were prepared and four ubiquitous DSTs were applied to them. Six popular classification techniques were utilized in the classification process. Both classifier’s performance and algorithmic fairness are evaluated with notable metrics. Results: The results indicated that the Random Forest classifier outperforms other classifiers in all three datasets and, that using SMOTE and ADASYN techniques causes more discrimination in the female group. The rate of unintentional discrimination seems to be higher in the original data of extremely unbalanced datasets under the following classifiers: Logistics Regression, LightGBM, and XGBoost. Conclusions: Algorithmic fairness has become a broadly studied area in recent years, yet there is very little systematic study on the effect of using DSTs on algorithmic fairness. This study presents important findings to further the use of algorithmic fairness in CCP research.

Item Type: Article
Uncontrolled Keywords: Customer churn prediction, Data sampling techniques, Algorithmic fairness, Class imbalance problem
Subjects: Q Science > QA Mathematics > QA273-280 Probabilities. Mathematical statistics
Divisions: Faculty of Computing and Informatics (FCI)
Depositing User: Ms Nurul Iqtiani Ahmad
Date Deposited: 02 Nov 2022 01:43
Last Modified: 02 Nov 2022 01:43
URII: http://shdl.mmu.edu.my/id/eprint/10607


Downloads per month over past year

View ItemEdit (login required)