Citation

Sharmila, P. and Sonai Muthu Anbananthen, Kalaiarasi and Chelliah, Deisy and Parthasarathy, Sudhaman and Kannan, Subarmaniam (2022) PDHS: Pattern-Based Deep Hate Speech Detection With Improved Tweet Representation. IEEE Access, 10. pp. 105366-105376. ISSN 2169-3536

Text PDHS_Pattern-Based_Deep.pdf - Published Version Restricted to Repository staff only Download (2MB)

Abstract

Automatic hate speech identification in unstructured Twitter is significantly more difficult to analyze, posing a significant challenge. Existing models heavily depend on feature engineering, which increases the time complexity of detecting hate speech. This work aims to classify and detect hate speech using a linguistic pattern-based approach as pre-trained transformer language models. As a result, a novel Pattern-based Deep Hate Speech (PDHS) detection model was proposed to detect the presence of hate speech using a cross-attention encoder with a dual-level attention mechanism. Instead of concatenating the features, our model computes dot product attention for better representation by reducing the irrelevant features. The first level of Attention is extracting aspect terms using predefined parts-of-speech tagging. The second level of Attention is extracting the sentiment polarity to form a pattern. Our proposed model trains the extracted patterns with term frequency, parts-of-speech tag, and Sentiment Scores. The experimental results on Twitter Dataset can learn effective features to enhance the performance with minimum training time and attained 88%F1Score.

Item Type:	Article
Uncontrolled Keywords:	Attention mechanism, transformer, BERT, sequence modeling, hate speech , natural language processing
Subjects:	Q Science > QA Mathematics > QA71-90 Instruments and machines > QA75-76.95 Calculating machines
Divisions:	Faculty of Information Science and Technology (FIST)
Depositing User:	Ms Nurul Iqtiani Ahmad
Date Deposited:	01 Nov 2022 03:05
Last Modified:	27 Apr 2023 13:17
URII:	http://shdl.mmu.edu.my/id/eprint/10597

Downloads

Edit (login required)