Citation

Bannah, Hasanul and Ahmad Fauzi, Mohammad Faizal and Mansor, Sarina and Khan, Md. Shoukhin and Halimatul Munirah Wan Ahmad, Wan Siti and Wan Ahmad, Munirah and Nabi, Md Serajun and Chiew, Seow Fan and Cheah, Phaik Leng and Looi, Lai Meng (2025) Automated Nuclei Segmentation in PR-IHC Breast Cancer Images Using the Cellpose Deep Learning Model. In: 2025 IEEE Region 10 Conference, TENCON 2025, 27 October 2025 - 30 October 2025, Kota Kinabalu, Malaysia.

Text IEEE Xplore Full-Text PDF_16.pdf - Published Version Restricted to Repository staff only Download (4MB)

Abstract

In digital pathology, precise nuclei segmentation in immunohistochemical-stained tissue sections is essential for clinical decision-making and subsequent quantification of biomarkers. This task is particularly important for the analysis of hormone receptors in breast cancer, where the status of the progesterone receptor (PR) plays a key role in determining the response to treatment. However, because of differences in nuclear morphology, staining intensity, and overlapping structures, nucleus segmentation in PR-IHC images is still difficult. In order to separate PR-expressing nuclei from high-resolution breast cancer histopathology images, we present an automated instance segmentation frame-work in this work that is based on the Cellpose deep learning model, supported by an entirely novel ground truth (GT) dataset produced by a hybrid pipeline. In order to create the GT, 250 high-resolution PR-IHC images with trustworthy binary nuclei masks were combined with automated segmentation (StarDist), extensive manual corrections, and multiround pathological validation. On the test set, our Cellpose-based approach consistently performs properly, achieving an average F 1 score of 0.8535, precision of 0.8882, recall of 0.8215, and IoU of 0.7445. Strong segmentation of extracted and overlapping nuclei is confirmed by visual results. This study offers a useful resource for future research in hormone receptor quantification and computational pathology, as well as the first automated segmentation benchmark for the PR-IHC dataset.

Item Type:	Conference or Workshop Item (Paper)
Uncontrolled Keywords:	Deep learning, breast cancer
Subjects:	R Medicine > R Medicine (General) > R858-859.7 Computer applications to medicine. Medical informatics
Divisions:	Faculty of Artificial Intelligence & Engineering (FAIE)
Depositing User:	Ms Rosnani Abd Wahab
Date Deposited:	20 Apr 2026 03:50
Last Modified:	20 Apr 2026 03:50
URII:	http://shdl.mmu.edu.my/id/eprint/15776

Downloads

Edit (login required)