Citation

Patel, Moteechand and Shukla, Abhinav and Malakar, Pritendra Kumar and Ramasamy, R. Kanesaraj and Dubey, Parul (2026) Graph-Enhanced Transformer for Cross-Domain Sentiment Analysis: Integrating RoBERTa with Graph Attention Networks. Future Internet, 18 (7). p. 341. ISSN 1999-5903

Text Graph-Enhanced Transformer for Cross-Domain Sentiment Analysis_ Integrating RoBERTa with Graph Attention Networks.pdf - Published Version Restricted to Repository staff only Download (8MB)

Abstract

Sentiment analysis has become a critical task in natural language processing for extracting subjective insights from large-scale textual data across domains such as social media, ecommerce, and online reviews. However, existing methods often fail to simultaneously capture contextual semantics and structural relationships, particularly in cross-domain settings. This study proposes a hybrid RoBERTa–graph attention network (GAT) framework that integrates transformer-based contextual embeddings with graph-based relational learning. The methodology involves encoding text using RoBERTa, constructing tokenlevel dependency graphs, and applying multi-head graph attention to model inter-token relationships. The model is evaluated on multiple benchmark datasets, including Twitter, Amazon, and IMDB reviews. The cross-domain results refer only to binary-harmonized positive/negative sentiment transfer and should not be interpreted as full three-class sentiment transfer, including the neutral class. The experimental results show that the proposed approach achieves consistent improvements over the selected baseline models in terms of accuracy, F1-score, MCC, and AUC. Statistical robustness analysis further supports the stability of these improvements across repeated runs. The findings highlight the effectiveness of combining semantic and structural learning, making the proposed framework suitable for robust cross-domain sentiment analysis applications.

Item Type:	Article
Uncontrolled Keywords:	sentiment analysis, RoBERTa, graph attention network (GAT)
Subjects:	Q Science > QA Mathematics > QA71-90 Instruments and machines > QA75.5-76.95 Electronic computers. Computer science
Divisions:	Faculty of Computing and Informatics (FCI)
Depositing User:	Ms Rosnani Abd Wahab
Date Deposited:	04 Sep 2026 02:18
Last Modified:	04 Sep 2026 02:18
URII:	http://shdl.mmu.edu.my/id/eprint/16681

Downloads

Edit (login required)