Citation

Khan, Tehmina Karamat and Karamat, Taimur and Tanveer, Mohsan and Jhanjhi, N. Z. and Mehmood, Raja Majid and Ahmed, Husham M. and Wyne, Ibrahim Shuaib (2026) Reinforcement learning-assisted time-to-boundary mobility control with selective DAPS for QoS-aware handover in dense HetNets. Discover Computing, 29 (667). ISSN 2948-2992

Text s10791-026-10578-z.pdf - Published Version Restricted to Repository staff only Download (9MB)

Abstract

This paper presents a hybrid rule-constrained and reinforcement learning-assisted Time-to-Boundary (TTB)-guided mobility-control framework with selective Dual Active Protocol Stack (DAPS) activation for energy-efficient QoS-aware handover in dense heterogeneous networks. The proposed one-dimensional (1-D) boundary-crossing model uses predicted boundary arrival time, radio-link condition, handover margin, and queue-risk indicators to suppress unnecessary measurement signaling and activate DAPS or handover only when mobility or QoS risk is detected. The controller combines rule-based feasibility masks, safety overrides, handover confirmation, and post-handover lockout with a lightweight tabular Q-learning policy. The rule-based layer restricts unsafe or infeasible actions, while the RL layer selects among feasible idle, measurement, selective-DAPS, and handover actions according to the current radio, boundary, and queue state. The proposed scheme is evaluated against conventional A3-Time-to-Trigger (A3-TTT), optimized A3-TTT, persistent-DAPS A3-TTT, and conditional handover schemes using paired multi-seed simulations with confidence intervals and statistical testing. Results show that OURS-RL-QTAB provides a favorable QoS–energy–signaling trade-off under the controlled simulation setting by reducing mean delay, 95th-percentile delay, packet loss, signaling load, and normalized energy cost per delivered Mbit while maintaining comparable throughput and utilization. Persistent-DAPS achieves the lowest jitter, but at substantially higher energy cost and much higher signaling load than the proposed talk-less controller. Sensitivity, generalization, and ablation analyses further confirm that the proposed performance is not dependent on a single parameter setting and that TTB prediction, talk-less operation, selective DAPS, queue-risk awareness, safety triggering, reinforcement learning action selection, and handover lockout each contribute to the final performance. Within the controlled single-UE 1-D boundary-crossing model, the results indicate a favorable overall QoS–energy–signaling trade-off for selective risk-aware DAPS activation with hybrid rule-constrained and RL-assisted control.

Item Type:	Article
Uncontrolled Keywords:	Handover, Mobility management, Dual active protocol stack (DAPS), Timeto-Boundary, Reinforcement learning, QoS-aware handover, Energy efficiency, 5G/6G HetNets 1 Introductio
Subjects:	Q Science > QA Mathematics > QA71-90 Instruments and machines
Divisions:	Faculty of Computing and Informatics (FCI)
Depositing User:	Ms Suzilawati Abu Samah
Date Deposited:	29 Oct 2026 03:08
Last Modified:	29 Oct 2026 03:08
URII:	http://shdl.mmu.edu.my/id/eprint/16984

Downloads

Edit (login required)