Citation

Ng, Hu and Chia, Glenn Jun Weng and Yap, Timothy Tzen Vun and Goh, Vik Tor (2022) Modelling sentiments based on objectivity and subjectivity with self-attention mechanisms. F1000Research, 10. p. 1001. ISSN 2046-1402

Text 17.pdf - Published Version Restricted to Repository staff only Download (1MB)

Abstract

The proliferation of digital commerce has allowed merchants to reach out to a wider customer base, prompting a study of customer reviews to gauge service and product quality through sentiment analysis. Sentiment analysis can be enhanced through subjectivity and objectivity classification with attention mechanisms. Methods: This research includes input corpora of contrasting levels of subjectivity and objectivity from different databases to perform sentiment analysis on user reviews, incorporating attention mechanisms at the aspect level. Three large corpora are chosen as the subjectivity and objectivity datasets, the Shopee user review dataset (ShopeeRD) for subjectivity, together with the Wikipedia English dataset (Wiki-en) and Internet Movie Database (IMDb) for objectivity. Word embeddings are created using Word2Vec with Skip-Gram. Then, a bidirectional LSTM with an attention layer (LSTM-ATT) imposed on word vectors. The performance of the model is evaluated and benchmarked against classification models of Logistics Regression (LR) and Linear SVC (L-SVC). Three models are trained with subjectivity (70% of ShopeeRD) and the objectivity (Wiki-en) embeddings, with ten-fold cross-validation. Next, the three models are evaluated against two datasets (IMDb and 20% of ShopeeRD). The experiments are based on benchmark comparisons, embedding comparison and model comparison with 70-10-20 train-validation-test splits. Data augmentation using AUG-BERT is performed and selected models incorporating AUG-BERT, are compared.

Item Type:	Article
Uncontrolled Keywords:	Sentiment analysis, subjectivity, objectivity, attention mechanism, neural nets
Subjects:	Q Science > Q Science (General) > Q300-390 Cybernetics
Divisions:	Faculty of Computing and Informatics (FCI) Faculty of Engineering (FOE)
Depositing User:	Ms Nurul Iqtiani Ahmad
Date Deposited:	02 Aug 2022 00:33
Last Modified:	02 Aug 2022 00:33
URII:	http://shdl.mmu.edu.my/id/eprint/10274

Downloads

Edit (login required)