Citation

Che Yayah, Fauzy and Ghouth, Khairil Imran and Choo, Yee Ting (2020) Parallel Classification and Optimization of Telco Trouble Ticket Dataset. Telecommunication, Computing, Electronics and Control (TELKOMNIKA), 19 (3). pp. 872-885. ISSN 1693-6930

Text Pe.pdf - Published Version Restricted to Repository staff only Download (1MB)

Abstract

In the Big Data age, extracting applicable information using traditional machine learning methodology is very challenging. This problem emerges from the restricted design of existing traditional machine learning algorithms, which do not entirely support large datasets and distributed processing. The large volume of data nowadays demands an efficient method of building machine-learning classifiers to classify big data. New research is proposed to solve problems by converting traditional machine learning classification into a parallel capable. Apache Spark is recommended as the primary data processing framework for the research activities. The dataset used in this research is related to the telco trouble ticket, identified as one of the large volume datasets. The study aims to solve the data classification problem in asingle machine using traditional classifiers such as W-J48. The proposed solution is to enablea conventional classifier to execute the classification method using big data platforms such as Hadoop. This study’s significant contribution is the output matrix evaluation, such as accuracy and computational time taken from bothways resulting from hyper-parameter tuning and improvement of W-J48 classification accuracy for the telco trouble ticket dataset. Additional optimization and estimation techniques have been incorporated into the study, such as Grid Search and Cross-Validation method, which significantly improves classification accuracy by 22.62% and reduces the classification time by 21.1% in parallel execution inside the big data environment.

Item Type:	Article
Uncontrolled Keywords:	Trouble ticket; optimization; spark; classification; hadoop;
Subjects:	Q Science > QA Mathematics > QA71-90 Instruments and machines > QA75-76.95 Calculating machines
Divisions:	Faculty of Computing and Informatics (FCI)
Depositing User:	Ms Rosnani Abd Wahab
Date Deposited:	30 Sep 2021 08:43
Last Modified:	30 Sep 2021 08:43
URII:	http://shdl.mmu.edu.my/id/eprint/8449

Downloads

Edit (login required)