Citation

Ramalingam, Umamaheswari and S, Navaneethan and Chan, Kah Yoong and Lee, Lini (2026) Energy-efficient FPGA acceleration of reinforcement learning algorithms using high-level synthesis. International Review of Applied Sciences and Engineering. ISSN 2062-0810

Text IRASE-2026.01404_proof 1..10.pdf - Published Version Restricted to Repository staff only Download (1MB)

Abstract

Low latency and energy-efficient design are important requirements for Reinforcement Learning (RL) algorithms deployed on embedded and edge computing systems. Software based Q-learning shows increased power consumption as well as the overhead of sequential execution. The paper shows an energy-efficient FPGA architecture for the Q-learning update based on High Level Synthesis (HLS). An FPGA accelerator targeting the device platform Xilinx Zynq-7000 (xc7z020clg400-1) has been designed and implemented. Loop pipelining and precision fine-tuning design techniques were applied to optimize the architecture. This improvement was achieved by 50 percent as a baseline architecture got a latency of 14 cycles, which was reduced to 7 cycles when the architecture was pipelined with loops. A relative comparison of fixed point (ap_fixed<16,8>) and floating point implementations has shown that the floating point arithmetic increases the number of LUTs used by 4 times, the number of DSPs used by more than 2 times, and the delay by 29 cycles. Post implementation power analysis for fixedpoint architecture shows that its energy consumption is about 4 times less per Q-update operation than a floating-point design. The results show that pipelined fixed-point FPGA architectures are a good solution to speed up the reinforcement learning process in resource-limited embedded systems.

Item Type:	Article
Uncontrolled Keywords:	Reinforcement learning, Q-learning, high level synthesis
Subjects:	T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800-8360 Electronics > TK7885-7895 Computer engineering. Computer hardware
Divisions:	Faculty of Artificial Intelligence & Engineering (FAIE)
Depositing User:	Ms Rosnani Abd Wahab
Date Deposited:	02 Oct 2026 03:31
Last Modified:	02 Oct 2026 03:31
URII:	http://shdl.mmu.edu.my/id/eprint/16830

Downloads

Edit (login required)