Enhanced Text-to-Image Synthesis Conditional Generative Adversarial Networks

Citation

Tan, Yong Xuan and Lee, Chin Poo and Neo, Mai and Lim, Kian Ming and Lim, Jit Yan (2022) Enhanced Text-to-Image Synthesis Conditional Generative Adversarial Networks. IAENG International Journal of Computer Science, 14 (1). pp. 1-7. ISSN 1819-9224

Full text not available from this repository.

Abstract

The text-to-image synthesis aims to synthesize an image based on a given text description, which is especially useful for applications in image editing, graphic design, etc. The main challenges of text-to-image synthesis are to generate images that are visually realistic and semantically consistent with the given text description. In this paper, we proposed some enhancements to the conditional generative model that is widely used for text-to-image synthesis. The enhancements include text conditioning augmentation, feature matching, and LI distance loss function. The text conditioning augmentation expands the text embedding feature space to improve the semantic consistency of the model. The feature matching motivates the model to synthesize more photo-realistic images and enrich the image content variations. Apart from that, the LI distance loss allows the model to generate images that have high visual resemblance to the real images. The empirical results on the CUB-200-2011 dataset demonstrate that the text-to-image synthesis conditional generative model with the proposed enhancements yield the highest Inception score and Structural Similarity Index.

Item Type: Article
Uncontrolled Keywords: Text-to-Image Synthesis, Conditional Generative Adversarial Networks, Generative Adversarial Networks, GANs, cGANs
Subjects: T Technology > TA Engineering (General). Civil engineering (General) > TA1501-1820 Applied optics. Photonics
Divisions: Faculty of Creative Multimedia (FCM)
Faculty of Information Science and Technology (FIST)
Depositing User: Ms Nurul Iqtiani Ahmad
Date Deposited: 22 Jul 2022 01:27
Last Modified: 31 Oct 2023 03:25
URII: http://shdl.mmu.edu.my/id/eprint/10172

Downloads

Downloads per month over past year

View ItemEdit (login required)