Citation

Chong, KaiSiang and Packier Mohammad, Nathar Shah (2022) Comparison of Naive Bayes and SVM Classification in Grid-Search Hyperparameter Tuned and Non-Hyperparameter Tuned Healthcare Stock Market Sentiment Analysis. International Journal of Advanced Computer Science and Applications, 13 (12). ISSN 2158-107X

Text 27.pdf - Published Version Restricted to Repository staff only Download (419kB)

Abstract

This paper compares the performance of Naive Bayes and SVM classifiers classification based on sentiment analysis of healthcare companies' stock comments in Bursa Malaysia. Differing from other studies which focus on the performance of the classifier models, this paper focuses on identifying the hyperparameters of the classifier models that are significant for sentiment analysis and the optimization potential of the models. Grid Search technique is used for the hyperparameters tuning process. The performance such as precision, recall, f1-score, and accuracy of Naive Bayes and SVM before and after hyperparameter tuning are compared. The results show that the important hyperparameters for Naive Bayes are alpha and fit_prior, while the important hyperparameters for SVM are C, kernel, and gamma. After performing hyperparameters tuning, SVM gave a better performance with an accuracy of 85.65% than Naive Bayes with an accuracy of 68.70%. It also proves that hyperparameter tuning is able to improve the performance of both models, and SVM has a better optimization potential than Naive Bayes.

Item Type:	Article
Uncontrolled Keywords:	Machine learning; sentiment analysis; opinion mining; Naïve Bayes; SVM Classifier; grid search technique; hyperparameter tuning
Subjects:	Q Science > Q Science (General) > Q300-390 Cybernetics
Divisions:	Faculty of Computing and Informatics (FCI)
Depositing User:	Ms Nurul Iqtiani Ahmad
Date Deposited:	07 Mar 2023 02:21
Last Modified:	07 Mar 2023 02:21
URII:	http://shdl.mmu.edu.my/id/eprint/11208

Downloads

Edit (login required)