CFP last date
20 May 2024
Reseach Article

A Survey of Text Generation Models

by Mayuresh Muley, Pruthav Sanwatsarkar, Vrushali Kulkarni
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 184 - Number 21
Year of Publication: 2022
Authors: Mayuresh Muley, Pruthav Sanwatsarkar, Vrushali Kulkarni
10.5120/ijca2022922247

Mayuresh Muley, Pruthav Sanwatsarkar, Vrushali Kulkarni . A Survey of Text Generation Models. International Journal of Computer Applications. 184, 21 ( Jul 2022), 65-71. DOI=10.5120/ijca2022922247

@article{ 10.5120/ijca2022922247,
author = { Mayuresh Muley, Pruthav Sanwatsarkar, Vrushali Kulkarni },
title = { A Survey of Text Generation Models },
journal = { International Journal of Computer Applications },
issue_date = { Jul 2022 },
volume = { 184 },
number = { 21 },
month = { Jul },
year = { 2022 },
issn = { 0975-8887 },
pages = { 65-71 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume184/number21/32444-2022922247/ },
doi = { 10.5120/ijca2022922247 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-07T01:22:05.302074+05:30
%A Mayuresh Muley
%A Pruthav Sanwatsarkar
%A Vrushali Kulkarni
%T A Survey of Text Generation Models
%J International Journal of Computer Applications
%@ 0975-8887
%V 184
%N 21
%P 65-71
%D 2022
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Natural language processing (NLP)is a field of linguistics and computer science which focuses on the interaction of humans and computers. The main aim of natural language processing is to make sure that a computer can understand what a human says and possibly get key insights from the auditory data. Natural language text production is a well-known sub-part of NLP which focuses on converting auditory data from spoken languages into text. This survey aims to shed some light on crucial details about the past, present and the future of text production algorithms along with an aim to provide a comprehensive overview of how different machine learning techniques are being investigated and studied for different NLP applications. Finally, some important research gaps which were found out through the review are highlighted as the study is drawn to a close. This study also aims to synthesize a guide for beginners in this field and to point them towards related research and popular practices.

References
  1. Akkaradamrongrat, S., Kachamas, P., & Sinthupinyo, S. (2019). Text Generation for Imbalanced Text Classification. 2019 16th International Joint Conference on Computer Science and Software Engineering (JCSSE).
  2. Y. Park and S. Kang, "Natural Language Generation Using Dependency Tree Decoding for Spoken Dialog Systems," in IEEE Access, vol. 7, pp. 7250-7258, 2019
  3. Shuohua Zhou, (2020) “ Research on the Application of Deep Learning in Text Generation” , in School of Information, Renmin University of China, BeiJing.
  4. Chenhan Yuan, Yi-chin Huang, Cheng-Hung Tsai, (2020) “Efficient text generation of user-defined topics using generative adversarial networks”, in CC-NLG 2019 (Workshop on Computational Creativity in Natural Language Generation).
  5. WENHAO YU, CHENGUANG ZHU, HENG JI, (2021) “A Survey of Knowledge-Enhanced Text Generation”, inarXiv:2010.04389.
  6. Lei Sha, Lili Mou, Tianyu Liu, Pascal Poupart, Sujian Li Baobao Chang, Zhifang Sui “Order- planning Neural Text Generation From Structured Data” Sep 2017
  7. Prasad Kawthekar, Suvrat Bhooshan, (2020) “EvaluatingGenerative Models for Text Generation” Department of Computer Science Stanford University
  8. Sidi Lu, Yaoming Zhu, Yong Yu,(2018) “ Neural Text Generation: Past, Present and Beyond”, arXiv preprint.
  9. Preksha Nema, Shreyas Shetty, Parag Jain, Anirban Laha, Karthik Sankaranarayanan, Mitesh M. Khapra, ”Generating Descriptions from Structured Data Using a Bifocal Attention Mechanism and Gated Orthogonalization”,arXiv:1804.07789v1 [cs.CL] 20 Apr 2018.
  10. Junyi Li and his team (2020) “Pretrained Language Models for Text Generation: A Survey”, arXiv preprint arXiv:2105.10311
  11. Sheikh Abujar, Mahmudul Hasan, (2019) “Bengali Text generation Using Bi-directional RNN”, in 10th International Conference on Computing, Communication and Networking Technologies (ICCCNT).
  12. Zhiqiang Ma, Chunyu Wang (2020) “A Context-Aware Variational Auto-Encoder Model for Text Generation ” in IEEE Intl Conf on Parallel & Distributed Processing with Applications, Big Data & Cloud Computing, Sustainable Computing & Communications, Social Computing & Networking.
  13. Iqbal and S. Qureshi, (2020) “The survey: Text generation models in deep learning”, Journal of King Saud University – Computer andInformation Sciences
  14. P. P. Barmana, A. Boruaha, “A RNN based Approach for next word prediction in Assamese Phonetic Transcription,” In Procedia Computer Science, Volume 143, Pages 117- 123, 2018.
  15. Asli Celikyilmaz, Elizabeth Clark (2018) Evaluation of Text Generation: A Survey, arXiv:2006.14799v2
  16. Stanislau Semeniuta, Aliaksei Severyn (2019) On Accurate Evaluation of GANs for Language Generation arXiv:1806.04936v3
  17. Guy Tevet, Jonathan Berant (2021) Evaluating the Evaluation of Diversity in Natural Language Generation Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics.
  18. Fatima, N., Imran, A S., Kastrati, Z., Daudpota, S M., Soomro, A. (2022) A Systematic Literature Review on Text Generation Using Deep Neural Network Models IEEE Access, 10: 53490-53503
Index Terms

Computer Science
Information Sciences

Keywords

Text generation Markov chains LSTM NLP Deep learning techniques