Multitask Learning and BERT Embedding: A Comprehensive Approach to Subjectivity Detection and Aspect-Based Sentiment Analysis

Citation

Chong, Wing Kin and Ng, Hu and Yap, Timothy Tzen Vun and Tan, Ian K. T. and Goh, Vik Tor and Wong, Lai Kuan and Cher, Dong Theng (2026) Multitask Learning and BERT Embedding: A Comprehensive Approach to Subjectivity Detection and Aspect-Based Sentiment Analysis. International Journal of Computational Intelligence Systems, 19 (1). ISSN 1875-6883

[img] Text
s44196-026-01153-x.pdf - Published Version
Restricted to Repository staff only

Download (1MB)

Abstract

The proliferation of online platforms has intensified the need for fine-grained sentiment analysis of customer reviews. While traditional Aspect-based Sentiment Analysis (ABSA) focuses on sentiment classification, it often overlooks the crucial distinction between subjective opinions and objective statements. This paper introduces the Subjectivity Multitask Aspect-based Sentiment Analysis framework, which integrates Subjectivity Detection as an auxiliary task with Aspect Sentiment Classification through a unified multitask learning architecture. The model leverages BERT embeddings, a Bidirectional LSTM, a self-attention mechanism, and a Neural Tensor Network to effectively model the interplay between subjectivity and sentiment. Crucially, our experimental results on the comprehensive MEMD multi-domain dataset demonstrate the framework’s effectiveness, achieving a state-of-the-art F1-score of 87.26%. This represents a significant 26.89 percentage point improvement over the previous baseline, showcasing superior performance in both precision-recall balance and cross-domain stability. Key contributions include: (1) manual annotation of aspect-level subjectivity labels for a large-scale multi-domain dataset, (2) development of an integrated multitask framework that addresses precision-recall imbalance in ABSA, and (3) empirical validation showing consistent improvements across diverse domains. Results confirm that joint optimization of related tasks enhances sentiment classification accuracy while maintaining computational efficiency.

Item Type: Article
Uncontrolled Keywords: Aspect-based sentiment analysis, BERT, Multitask learning, Natural language processing, Subjectivity detection
Subjects: L Education > LB Theory and practice of education > LB1060 Learning
Divisions: Faculty of Computing and Informatics (FCI)
Depositing User: Ms Suzilawati Abu Samah
Date Deposited: 03 Mar 2026 04:19
Last Modified: 03 Mar 2026 04:19
URII: http://shdl.mmu.edu.my/id/eprint/15447

Downloads

Downloads per month over past year

View ItemEdit (login required)