Citation

Mohammed, Marwan Qaid and Kwek, Lee Chung and Chua, Shing Chyi (2020) Pick and Place Objects in a Cluttered Scene Using Deep Reinforcement Learning. International Journal of Mechanical and Mechatronics Engineering, 20 (4). pp. 50-56. ISSN 2077-124X, 2227-2771

Text 58.pdf - Published Version Restricted to Repository staff only Download (1MB)

Abstract

This paper presents a robotic grasp-to-place system that has the capability of grasping objects in sparse and cluttered environments. The key feature of the system is that it handles both primitive actions of picking and placing of objects with an explicit framework using raw RGB-D images. Thus, the contribution of this paper is to model such a complete manipulation system with reasonable computational complexity. To achieve this, the camera captured RGB images of the scene, and 3d point cloud information are used to generate heightmaps at the robot grasp-workspace. The heightmap is rotated by 36 different angles before feeding into the network in order to generate a set of 36 pixel-wise Q-value maps, which is then passed into a Dense Network (DenseNet) to generate predictions of Q-values. Q-values are a measure of future expected reward in the formula of Q-learning from reinforcement learning. This effectively gives us values for predictions for 36 different grasping angles for every visible location in the robot grasp-workspace. In the simulation, exhaustive experimental results demonstrate that our framework successfully grasp objects with a grasp success rate and grasp efficiency, at almost 80~95% for both. As for place task, our framework successfully placed objects with a place success rate to at least 90 % through all test-cases.

Item Type:	Article
Uncontrolled Keywords:	Robotic grasp-to-place system, pixel-wise Qvalue, Deep Reinforcement Learning (DRL), Q-learning, DenseNet.
Subjects:	T Technology > TJ Mechanical Engineering and Machinery > TJ210.2-211.47 Mechanical devices and figures. Automata. Ingenious mechanisms. Robots (General)
Divisions:	Faculty of Engineering and Technology (FET)
Depositing User:	Ms Rosnani Abd Wahab
Date Deposited:	23 Sep 2021 12:20
Last Modified:	23 Sep 2021 12:20
URII:	http://shdl.mmu.edu.my/id/eprint/8379

Downloads

Edit (login required)