Deep Learning-Based Segmentation of 3D Volumetric Image and Microstructural Analysis

Citation

Mahmud, Bahar Uddin and Hong, Guan Yue and Al Mamun, Abdullah Sarwar and Em, Poh Ping and Wu, Qingliu (2023) Deep Learning-Based Segmentation of 3D Volumetric Image and Microstructural Analysis. Sensors, 23 (5). p. 2640. ISSN 1424-8220

[img] Text
18.pdf - Published Version
Restricted to Repository staff only

Download (1MB)

Abstract

As a fundamental but difficult topic in computer vision, 3D object segmentation has various applications in medical image analysis, autonomous vehicles, robotics, virtual reality, lithium battery image analysis, etc. In the past, 3D segmentation was performed using hand-made features and design techniques, but these techniques could not generalize to vast amounts of data or reach acceptable accuracy. Deep learning techniques have lately emerged as the preferred method for 3D segmentation jobs as a result of their extraordinary performance in 2D computer vision. Our proposed method used a CNN-based architecture called 3D UNET, which is inspired by the famous 2D UNET that has been used to segment volumetric image data. To see the internal changes of composite materials, for instance, in a lithium battery image, it is necessary to see the flow of different materials and follow the directions analyzing the inside properties. In this paper, a combination of 3D UNET and VGG19 has been used to conduct a multiclass segmentation of publicly available sandstone datasets to analyze their microstructures using image data based on four different objects in the samples of volumetric data. In our image sample, there are a total of 448 2D images, which are then aggregated as one 3D volume to examine the 3D volumetric data. The solution involves the segmentation of each object in the volume data and further analysis of each object to find its average size, area percentage, total area, etc. The open-source image processing package IMAGEJ is used for further analysis of individual particles. In this study, it was demonstrated that convolutional neural networks can be trained to recognize sandstone microstructure traits with an accuracy of 96.78% and an IOU of 91.12%. According to our knowledge, many prior works have applied 3D UNET for segmentation, but very few papers extend it further to show the details of particles in the sample. The proposed solution offers a computational insight for real-time implementation and is discovered to be superior to the current state-of-the-art methods. The result has importance for the creation of an approximately similar model for the microstructural analysis of volumetric data.

Item Type: Article
Uncontrolled Keywords: image segmentation; 3D image; 3D UNET-VGG19; image microstructure; particle analysis; image reconstruction
Subjects: T Technology > TA Engineering (General). Civil engineering (General) > TA1501-1820 Applied optics. Photonics
Divisions: Faculty of Engineering and Technology (FET)
Depositing User: Ms Nurul Iqtiani Ahmad
Date Deposited: 11 Apr 2023 01:24
Last Modified: 11 Apr 2023 01:24
URII: http://shdl.mmu.edu.my/id/eprint/11313

Downloads

Downloads per month over past year

View ItemEdit (login required)