{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T04:53:52Z","timestamp":1777697632332,"version":"3.51.4"},"reference-count":34,"publisher":"SAGE Publications","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IDT"],"published-print":{"date-parts":[[2024,2,20]]},"abstract":"<jats:p>This research explores the potential of Long Short-Term Memory (LSTM) and Natural Language Processing (NLP) for automated essay generation. The goal of the study is to create a model that can produce high-quality essays that are not only grammatically correct but also semantically meaningful and contextually relevant. The rise of NLP and Deep Learning has made it possible to generate text that is coherent and semantically sound. In this research, there is an advantage by leveraging the ability of LSTMs to capture long-term dependencies and context within the text, and combining it with NLP techniques, such as word embeddings, to process and encode textual data. The results of experiments show that the proposed model can effectively generate essays that are coherent, contextually relevant, and semantically meaningful. This is a significant advancement in the field of text generation and has potential applications in areas such as education, content creation, and language translation. In education, for example, the model could be used to generate essays for language proficiency tests or as a writing aid for students. In content creation, it could be used to generate articles, blog posts, and other written content. In language translation, the model could be used to generate essays in the target language that are semantically and contextually equivalent to the source language essay. The findings of this study contribute to the advancement of NLP and deep learning techniques in the area of text generation and open up new avenues for future research. Short after the proposed model was deployed, it was discovered that it outscored Multi-Topic Aware LSTM (MTA-LSTM), Topic-Attention LSTM (TAT-LSTM), and Topic-Averaged LSTM (TAV-LSTM) in human evaluation by 6.84 percent, 25.40 percent, and 34.94 percent, respectively. Furthermore, it enhanced automatic BLEU score evaluation scores by 11.68 percent, 26.23 percent, and 54.11 percent in MTA-LSTM, TAT-LSTM, and TAV- LSTM, respectively.<\/jats:p>","DOI":"10.3233\/idt-230424","type":"journal-article","created":{"date-parts":[[2024,1,9]],"date-time":"2024-01-09T12:03:41Z","timestamp":1704801821000},"page":"571-584","source":"Crossref","is-referenced-by-count":2,"title":["Integrating LSTM and NLP techniques for essay generation"],"prefix":"10.1177","volume":"18","author":[{"given":"Aditi","family":"Chauhan","sequence":"first","affiliation":[{"name":"Department of Computer Science and Engineering, Bharati Vidyapeeth\u2019s College of Engineering, New Delhi, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yashika","family":"Kukkar","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Bharati Vidyapeeth\u2019s College of Engineering, New Delhi, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Preeti","family":"Nagrath","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Bharati Vidyapeeth\u2019s College of Engineering, New Delhi, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kirti","family":"Gupta","sequence":"additional","affiliation":[{"name":"Department of Electronics and Communications Engineering, Bharati Vidyapeeth\u2019s College of Engineering, New Delhi, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jude D.","family":"Hemanth","sequence":"additional","affiliation":[{"name":"Department of Electronics and Communications Engineering, Karunya University, Coimbatore, India"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"key":"10.3233\/IDT-230424_ref1","doi-asserted-by":"crossref","unstructured":"Hashimoto TB, Zhang H, Liang P. Unifying human and statistical evaluation for natural language generation. arXiv preprint arXiv1904.02792. 2019.","DOI":"10.18653\/v1\/N19-1169"},{"key":"10.3233\/IDT-230424_ref2","doi-asserted-by":"crossref","first-page":"935","DOI":"10.1016\/j.artint.2011.01.005","article-title":"Artificial Intelligence: A Modern Approach, Third Edition","volume":"175","author":"Sabharwal","year":"2011","journal-title":"Artificial Intelligence."},{"key":"10.3233\/IDT-230424_ref3","doi-asserted-by":"crossref","unstructured":"Pennington J, Socher R, Manning CD. Glove: Global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 2014 Oct; pp. 1532-1543.","DOI":"10.3115\/v1\/D14-1162"},{"key":"10.3233\/IDT-230424_ref4","doi-asserted-by":"crossref","unstructured":"Church KW. Word2Vec. Natural Language Engineering. 2017; 23(1): 155-162.","DOI":"10.1017\/S1351324916000334"},{"key":"10.3233\/IDT-230424_ref5","unstructured":"Rong X. Word2Vec parameter learning explained. arXiv preprint arXiv1411.2738. 2014 Nov 11."},{"key":"10.3233\/IDT-230424_ref6","unstructured":"Herremans D, Chuan CH. Modelling musical context with Word2Vec. arXiv preprint arXiv1706.09088. 2017 Jun 28."},{"key":"10.3233\/IDT-230424_ref7","doi-asserted-by":"crossref","unstructured":"Firat O, Cho K, Bengio Y. Multi-way, multilingual neural machine translation with a shared attention mechanism. arXiv preprint arXiv1601.01073. 2016.","DOI":"10.18653\/v1\/N16-1101"},{"key":"10.3233\/IDT-230424_ref8","unstructured":"Bahdanau D, Cho K, Bengio Y. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv1409.0473. 2014."},{"key":"10.3233\/IDT-230424_ref9","doi-asserted-by":"crossref","unstructured":"Zitouni I, editor. Natural language processing of Semitic languages. Berlin: Springer; 2014, pp. 299-334.","DOI":"10.1007\/978-3-642-45358-8"},{"key":"10.3233\/IDT-230424_ref10","doi-asserted-by":"crossref","unstructured":"Kiddon C, Zettlemoyer L, Choi Y. Globally coherent text generation with neural checklist models. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. 2016 Nov; pp. 329-339.","DOI":"10.18653\/v1\/D16-1032"},{"key":"10.3233\/IDT-230424_ref11","unstructured":"Welleck S, Kulikov I, Roller S, Dinan E, Cho K, Weston J. Neural text generation with unlikelihood training. arXiv preprint arXiv1908.04319. 2019."},{"key":"10.3233\/IDT-230424_ref12","doi-asserted-by":"crossref","unstructured":"Feng X, Liu M, Liu J, Qin B, Sun Y, Liu T. Topic-to-Essay Generation with Neural Networks. In: IJCAI, 2018 Jul; pp. 4078-4084.","DOI":"10.24963\/ijcai.2018\/567"},{"key":"10.3233\/IDT-230424_ref14","first-page":"5","article-title":"Recurrent neural networks","author":"Medsker","year":"2001","journal-title":"Design and Applications."},{"issue":"1","key":"10.3233\/IDT-230424_ref15","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1080\/095400999116340","article-title":"A recurrent neural network that learns to count","volume":"11","author":"Rodriguez","year":"1999","journal-title":"Connection Science."},{"key":"10.3233\/IDT-230424_ref16","doi-asserted-by":"crossref","unstructured":"Dey R, Salemt FM. Gate-variants of gated recurrent unit (GRU) neural networks. In: 2017 IEEE 60th international Midwest symposium on circuits and systems (MWSCAS). IEEE. 2017 Aug; pp.\u00a01597-1600.","DOI":"10.1109\/MWSCAS.2017.8053243"},{"key":"10.3233\/IDT-230424_ref17","unstructured":"Chung J, Gulcehre C, Cho K, Bengio Y. Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv1412.3555. 2014 Dec 11."},{"issue":"8","key":"10.3233\/IDT-230424_ref18","first-page":"3168","article-title":"PC-SAN: Pretraining-Based Contextual Self-Attention Model for Topic Essay Generation","volume":"14","author":"Lin","year":"2020","journal-title":"KSII Transactions on Internet and Information Systems (TIIS)."},{"key":"10.3233\/IDT-230424_ref19","unstructured":"Zhang T, Kishore V, Wu F, Weinberger KQ, Artzi Y. Bertscore: Evaluating text generation with BERT. arXiv preprint arXiv1904.09675. 2019."},{"key":"10.3233\/IDT-230424_ref20","doi-asserted-by":"crossref","unstructured":"Tenney I, Das D, Pavlick E. BERT rediscovers the classical NLP pipeline. arXiv preprint arXiv1905.05950. 2019 May 15.","DOI":"10.18653\/v1\/P19-1452"},{"key":"10.3233\/IDT-230424_ref21","doi-asserted-by":"crossref","unstructured":"Zhao W, Peyrard M, Liu F, Gao Y, Meyer CM, Eger S. Moverscore: Text generation evaluating with contextualized embeddings and earth mover distance. arXiv preprint arXiv1909.02622. 2019.","DOI":"10.18653\/v1\/D19-1053"},{"key":"10.3233\/IDT-230424_ref22","doi-asserted-by":"crossref","unstructured":"Fan H, Wang J, Zhuang B, Wang S, Xiao J. A hierarchical attention-based seq2seq model for Chinese lyrics generation. In: Pacific Rim International Conference on Artificial Intelligence. Springer, Cham. 2019 Aug; pp. 279-288.","DOI":"10.1007\/978-3-030-29894-4_23"},{"key":"10.3233\/IDT-230424_ref23","unstructured":"Yu M, Gormley M, Dredze M. Factor-based compositional embedding models. In: NIPS Workshop on Learning Semantics. 2014 Dec; pp. 95-101."},{"key":"10.3233\/IDT-230424_ref24","unstructured":"Santoro A, Raposo D, Barrett DG, Malinowski M, Pascanu R, Battaglia P, Lillicrap T. A simple neural network module for relational reasoning. arXiv preprint arXiv1706.01427. 2017."},{"key":"10.3233\/IDT-230424_ref25","doi-asserted-by":"crossref","unstructured":"Fu Z, Bing L, Lam W. Open domain event text generation. In: Proceedings of the AAAI Conference on Artificial Intelligence. 2020 Apr; Vol. 34(5); pp. 7748-7755.","DOI":"10.1609\/aaai.v34i05.6278"},{"key":"10.3233\/IDT-230424_ref26","unstructured":"Dathathri S, Madotto A, Lan J, Hung J, Frank E, Molino P, Liu R. Plug and play language models: A simple approach to controlled text generation. arXiv preprint arXiv1912.02164. 2019."},{"issue":"1-4","key":"10.3233\/IDT-230424_ref27","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1007\/s13042-010-0001-0","article-title":"Understanding bag-of-words model: a statistical framework","volume":"1","author":"Zhang","year":"2010","journal-title":"International Journal of Machine Learning and Cybernetics."},{"key":"10.3233\/IDT-230424_ref28","unstructured":"Xia C, Zhang C, Nguyen H, Zhang J, Yu P. Cg-bert: Conditional text generation with BERT for generalized few-shot intent detection. arXiv preprint arXiv2004.01881. 2020."},{"key":"10.3233\/IDT-230424_ref29","doi-asserted-by":"crossref","unstructured":"Sellam T, Das D, Parikh AP. BLEURT: Learning robust metrics for text generation. arXiv preprint arXiv2004.04696. 2020.","DOI":"10.18653\/v1\/2020.acl-main.704"},{"key":"10.3233\/IDT-230424_ref31","unstructured":"Rahutomo F, Kitasuka T, Aritsugi M. Semantic cosine similarity. In: The 7th International Student Conference on Advanced Science and Technology (ICAST). 2012 Oct; Vol. 4(1); p. 1."},{"key":"10.3233\/IDT-230424_ref32","unstructured":"Sirignano J, Spiliopoulos K. Scaling Limit of Neural Networks with the Xavier Initialization and Convergence to a Global Minimum. arXiv preprint arXiv1907.04108. 2019."},{"key":"10.3233\/IDT-230424_ref33","unstructured":"Kingma DP, Ba J. Adam: A method for stochastic optimization. arXiv preprint arXiv1412.6980. 2014."},{"key":"10.3233\/IDT-230424_ref34","doi-asserted-by":"crossref","unstructured":"Papineni K, Roukos S, Ward T, Zhu WJ. BLEU: A method for automatic evaluation of machine translation. In: Proceedings of the 40th annual meeting of the Association for Computational Linguistics. 2002 Jul; pp. 311-318.","DOI":"10.3115\/1073083.1073135"},{"key":"10.3233\/IDT-230424_ref35","unstructured":"He X, Deng L. Maximum expected BLEU training of phrase and lexicon translation models. In: Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2012 Jul; pp. 292-301."},{"key":"10.3233\/IDT-230424_ref36","unstructured":"Gaur M, Arora M, Prakash V, Kumar Y, Gupta K, Nagrath P. Analyzing Natural Language Essay Generator Models Using Long Short-Term Memory Neural Networks. AISC, volume 1394."}],"container-title":["Intelligent Decision Technologies"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/IDT-230424","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:23:49Z","timestamp":1777454629000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/IDT-230424"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,20]]},"references-count":34,"journal-issue":{"issue":"1"},"URL":"https:\/\/doi.org\/10.3233\/idt-230424","relation":{},"ISSN":["1872-4981","1875-8843"],"issn-type":[{"value":"1872-4981","type":"print"},{"value":"1875-8843","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,20]]}}}