Citation

Ajayi, Ebenezer Akinyemi and Lim, Kian Ming and Chong, Siew Chin and Lee, Chin Poo (2023) Three-dimensional shape generation via variational autoencoder generative adversarial network with signed distance function. International Journal of Electrical and Computer Engineering (IJECE), 13 (4). p. 4009. ISSN 2088-8708

Text 28867-62293-1-PB.pdf - Published Version Restricted to Repository staff only Download (512kB)

Abstract

Mesh-based 3-dimensional (3D) shape generation from a 2-dimensional (2D) image using a convolution neural network (CNN) framework is an open problem in the computer graphics and vision domains. Most existing CNN-based frameworks lack robust algorithms that can scale well without combining different shape parts. Also, most CNN-based algorithms lack suitable 3D data representations that can fit into CNN without modification(s) to produce high-quality 3D shapes. This paper presents an approach that integrates a variational autoencoder (VAE) and a generative adversarial network (GAN) called 3 dimensional variational autoencoder signed distance function generative adversarial network (3D-VAE-SDFGAN) to create a 3D shape from a 2D image that considerably improves scalability and visual quality. The proposed method only feeds a single 2D image into the network to produce a mesh-based 3D shape. The network encodes a 2D image of the 3D object into the latent representations, and implicit surface representations of 3D objects corresponding to those 2D images are subsequently generated. Hence, a signed distance function (SDF) is proposed to maintain object inside-outside information in the implicit surface representation. Polygon mesh surfaces are then produced using the marching cubes algorithm. The ShapeNet dataset was used in the experiments to evaluate the proposed 3D-VAE-SDFGAN. The experimental results show that 3D-VAE-SDFGAN outperforms other state-of-the-art models.

Item Type:	Article
Uncontrolled Keywords:	3D shape generation; convolution neural network; generative adversarial network; signed distance function; variational autoencoder
Subjects:	Q Science > QA Mathematics > QA71-90 Instruments and machines > QA75-76.95 Calculating machines
Divisions:	Faculty of Information Science and Technology (FIST)
Depositing User:	Ms Nurul Iqtiani Ahmad
Date Deposited:	03 May 2023 00:38
Last Modified:	03 May 2023 00:38
URII:	http://shdl.mmu.edu.my/id/eprint/11402

Downloads

Edit (login required)