Deep Reinforcement Learning-Based Robotic Grasping in Clutter and Occlusion

Citation

Mohammed, Marwan Qaid and Kwek, Lee Chung and Chua, Shing Chyi and Aljaloud, Abdulaziz Salamah and Al-Dhaqm, Arafat and Al-Mekhlafi, Zeyad Ghaleb and Mohammed, Badiea Abdulkarem (2021) Deep Reinforcement Learning-Based Robotic Grasping in Clutter and Occlusion. Sustainability, 13 (24). p. 13686. ISSN 2071-1050

[img] Text
Deep reinforcement learning‐based robotic grasping....pdf
Restricted to Repository staff only

Download (41MB)

Abstract

In robotic manipulation, object grasping is a basic yet challenging task. Dexterous grasping necessitates intelligent visual observation of the target objects by emphasizing the importance of spatial equivariance to learn the grasping policy. In this paper, two significant challenges associated with robotic grasping in both clutter and occlusion scenarios are addressed. The first challenge is the coordination of push and grasp actions, in which the robot may occasionally fail to disrupt the arrangement of the objects in a well-ordered object scenario. On the other hand, when employed in a randomly cluttered object scenario, the pushing behavior may be less efficient, as many objects are more likely to be pushed out of the workspace. The second challenge is the avoidance of occlusion that occurs when the camera itself is entirely or partially occluded during a grasping action. This paper proposes a multi-view change observation-based approach (MV-COBA) to overcome these two problems. The proposed approach is divided into two parts: 1) using multiple cameras to set up multiple views to address the occlusion issue; and 2) using visual change observation on the basis of the pixel depth difference to address the challenge of coordinating push and grasp actions. According to experimental simulation findings, the proposed approach achieved an average grasp success rate of 83.6%, 86.3%, and 97.8% in the cluttered, well-ordered object, and occlusion scenarios, respectively.

Item Type: Article
Uncontrolled Keywords: Robotics, Depth difference, multi-view, change observation
Subjects: T Technology > TJ Mechanical Engineering and Machinery > TJ210.2-211.47 Mechanical devices and figures. Automata. Ingenious mechanisms. Robots (General)
Divisions: Faculty of Engineering and Technology (FET)
Depositing User: Ms Nurul Iqtiani Ahmad
Date Deposited: 17 Jan 2022 08:45
Last Modified: 17 Jan 2022 08:45
URII: http://shdl.mmu.edu.my/id/eprint/9842

Downloads

Downloads per month over past year

View ItemEdit (login required)