Citation

Foo, Lee Kien and Chua, Sook Ling and Ibrahim, Neveen (2022) Attribute weighted naïve bayes classifier. Computers, Materials & Continua, 71 (1). pp. 1945-1957. ISSN 1546-2226

Text Attribute weighted naive bayes classifier.pdf Restricted to Repository staff only Download (753kB)

Abstract

The naïve Bayes classifier is one of the commonly used data mining methods for classification. Despite its simplicity, naïve Bayes is effective and computationally efficient. Although the strong attribute independence assumption in the naïve Bayes classifier makes it a tractable method for learning, this assumption may not hold in real-world applications. Many enhancements to the basic algorithm have been proposed in order to alleviate the violation of attribute independence assumption. While these methods improve the classification performance, they do not necessarily retain the mathematical structure of the naïve Bayes model and some at the expense of computational time. One approach to reduce the naïveté of the classifier is to incorporate attribute weights in the conditional probability. In this paper, we proposed a method to incorporate attribute weights to naïve Bayes. To evaluate the performance of our method, we used the public benchmark datasets. We compared our method with the standard naïve Bayes and baseline attribute weighting methods. Experimental results show that our method to incorporate attribute weights improves the classification performance compared to both standard naïve Bayes and baseline attribute weighting methods in terms of classification accuracy and F1, especially when the independence assumption is strongly violated, which was validated using the Chi-square test of independence.

Item Type:	Article
Uncontrolled Keywords:	Bayesian statistics, attribute weighting, Kullback-Leibler, information gain, classification
Subjects:	Q Science > QA Mathematics > QA273-280 Probabilities. Mathematical statistics
Divisions:	Faculty of Computing and Informatics (FCI)
Depositing User:	Ms Nurul Iqtiani Ahmad
Date Deposited:	03 Feb 2022 02:29
Last Modified:	03 Feb 2022 02:29
URII:	http://shdl.mmu.edu.my/id/eprint/9945

Downloads

Edit (login required)