Citation

Tan, Jun Chen and Ong, Lee Yeng and Leow, Meng Chew (2025) A bilingual Malay-English social media dataset for binary hate speech detection. Data in Brief, 63. p. 112153. ISSN 2352-3409

Text 1-s2.0-S2352340925008741-main.pdf - Published Version Restricted to Repository staff only Download (299kB)

Abstract

In recent years, online hate speech has posed a growing threat to user safety, social harmony, and community cohesion especially on social media platforms. However, most existing hate speech datasets are monolingual and resource-rich, which leave Southeast Asia languages such as Malay underrepresented in natural language processing research. The aim of this dataset is to handle this gap by providing a balanced and quality-controlled resource that supports machine learning applications in multilingual settings. Binary classification is selected as a foundation task because it simplifies practical deployment in real-world and early-stage detection systems. It is beneficial in low-resource languages where detailed or multi-label annotations are always unavailable or inconsistent. This dataset presents 26,985 bilingual Malay-English social media texts curated from five public sources for binary hate speech detection. It combines human-annotated and filtered through controlled pseudo-labelling to retain only high-confidence, quality-controlled texts. The dataset is provided in UTF-8 encoded CSV format with 13,609 English and 13,376 Malay-language texts. Each entry includes the social media post, binary label (0 = non-hate, 1 = hate), language identifier (en or ms), and data source information. The dataset meets clear practical demands, including training multilingual transformer-based classifiers, benchmarking cross-lingual NLP models, and developing effective hate speech detection systems and educational NLP resources for English and Malay-speaking communities.

Item Type:	Article
Uncontrolled Keywords:	Hate speech detection, low-resource languages, Malay-English bilingual data, Pseudo-labelling
Subjects:	Q Science > QA Mathematics > QA71-90 Instruments and machines > QA75.5-76.95 Electronic computers. Computer science
Divisions:	Faculty of Information Science and Technology (FIST)
Depositing User:	Nor Afiqah Mohd Adnan
Date Deposited:	01 Dec 2025 09:26
Last Modified:	12 Dec 2025 00:56
URII:	http://shdl.mmu.edu.my/id/eprint/14927

Downloads

Edit (login required)