Recent Advances in Text-to-Image Synthesis: Approaches, Datasets and Future Research Prospects

Citation

Tan, Yong Xuan and Lee, Chin Poo and Neo, Mai and Lim, Kian Ming and Lim, Jit Yan and Alqahtani, Ali (2023) Recent Advances in Text-to-Image Synthesis: Approaches, Datasets and Future Research Prospects. IEEE Access, 11. pp. 88099-88115. ISSN 2169-3536

[img] Text
1.pdf - Published Version
Restricted to Repository staff only

Download (3MB)

Abstract

Text-to-image synthesis is a fascinating area of research that aims to generate images based on textual descriptions. The main goal of this field is to generate images that match the given textual description in terms of both semantic consistency and image realism. While text-to-image synthesis has shown remarkable progress in recent years, it still faces several challenges, mainly related to the level of image realism and semantic consistency. To address these challenges, various approaches have been proposed, which mainly rely on Generative Adversarial Networks (GANs) for optimal performance. This paper provides a review of the existing text-to-image synthesis approaches, which are categorized into four groups: image realism, multiple scene, semantic enhancement, and style transfer. In addition to discussing the existing approaches, this paper also reviews the widely used datasets for text-to-image synthesis, including Oxford-102, CUB-200-2011, and COCO. The evaluation metrics used in this field are also discussed, including Inception Score, Fréchet Inception Distance, Structural Similarity Index, R-precision, Visual-Semantic Similarity, and Semantic Object Accuracy. The paper also offers a compilation of the performance of existing works in the field.

Item Type: Article
Uncontrolled Keywords: Text-to-image synthesis, generative model, GAN, generative adversarial networks, review, survey.
Subjects: Q Science > QC Physics > QC350-467 Optics. Light
Divisions: Faculty of Creative Multimedia (FCM)
Faculty of Information Science and Technology (FIST)
Depositing User: Ms Nurul Iqtiani Ahmad
Date Deposited: 05 Oct 2023 06:59
Last Modified: 31 Oct 2023 03:27
URII: http://shdl.mmu.edu.my/id/eprint/11751

Downloads

Downloads per month over past year

View ItemEdit (login required)