Citation

Tan, Kian Long and Lee, Chin Poo and Lim, Kian Ming and Sonai Muthu Anbananthen, Kalaiarasi (2022) Sentiment Analysis With Ensemble Hybrid Deep Learning Model. IEEE Access, 10. pp. 103694-103704. ISSN 2169-3536

Text 19.pdf - Published Version Restricted to Repository staff only Download (1MB)

Abstract

The rapid development of mobile technologies has made social media a vital platform for people to express their feelings and opinions. Understanding the public opinions can be beneficial for business and political entities in making strategic decisions. In light of this, sentiment analysis plays an important role to understand the polarity of the public opinions. This paper presents an ensemble hybrid deep learning model for sentiment analysis. The proposed ensemble model comprises three hybrid deep learning models which are the combination of Robustly optimized Bidirectional Encoder Representations from Transformers approach (RoBERTa), Long Short-Term Memory (LSTM), Bidirectional Long Short-Term Memory (BiLSTM) and Gated Recurrent Unit (GRU). In the hybrid deep learning model, RoBERTa is responsible for projecting the textual input sequence into a representative embedding space. Thereafter, the LSTM, BiLSTM and GRU capture the long-range dependencies in the embedding given the class. The predictions by the hybrid deep learning model are then amalgamated by averaging ensemble and majority voting, further improving the overall performance in sentiment analysis. In addition to that, the data augmentation with GloVe pre-trained word embedding has also been applied to alleviate the imbalanced dataset problems. The experimental results show that the proposed ensemble hybrid deep learning model outshines the state-of-the-art methods with the accuracy of 94.9%, 91.77%, and 89.81% on IMDb, Twitter US Airline Sentiment dataset and Sentiment140 dataset, respectively.

Item Type:	Article
Uncontrolled Keywords:	Sentiment analysis, transformers, RoBERTa, LSTM, BiLSTM, GRU, ensemble learning
Subjects:	H Social Sciences > HM Sociology > HM711-806 Groups and organizations Q Science > Q Science (General) > Q300-390 Cybernetics
Divisions:	Faculty of Information Science and Technology (FIST)
Depositing User:	Ms Nurul Iqtiani Ahmad
Date Deposited:	02 Nov 2022 02:50
Last Modified:	27 Apr 2023 13:19
URII:	http://shdl.mmu.edu.my/id/eprint/10601

Downloads

Edit (login required)