{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,23]],"date-time":"2026-07-23T15:00:36Z","timestamp":1784818836603,"version":"3.55.0"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,10,28]],"date-time":"2023-10-28T00:00:00Z","timestamp":1698451200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,10,28]],"date-time":"2023-10-28T00:00:00Z","timestamp":1698451200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Humanit Soc Sci Commun"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    ChatGPT-3.5, an AI language model capable of text generation, translation, summarization, and question-answering, has recently been released for public use. Studies have shown it can generate abstracts, research papers, and dissertations, and create quality essays on different topics. This led to ethical issues in using ChatGPT in academic writing, AI authorship, and evaluating students\u2019 essays. However, it is still unknown how ChatGPT performs in students\u2019 environments as a writing assistant tool and if it enhances students\u2019 essay-writing performance. In the present study, we examined students\u2019 essay-writing performances with or without ChatGPT as an essay-writing assistance tool. The average essay grade was C for both control (traditional essay-writing,\n                    <jats:italic>n<\/jats:italic>\n                    \u2009=\u20099) and experimental (ChatGPT-assisted essay-writing,\n                    <jats:italic>n<\/jats:italic>\n                    \u2009=\u20099) groups. None of the predictors affected essay scores: group, writing duration, study module, and GPA. The text unauthenticity was slightly higher in the experimental group, but the similarity among essays was generally low in the overall sample. In the experimental group, the AI classifier recognized more potential AI-generated texts. Our results demonstrate that the ChatGPT group did not perform better in either of the indicators; the students did not deliver higher quality content, did not write faster, nor had a higher degree of authentic text. We anticipate that these results can relieve some concerns about this tool\u2019s usage in academic writing. ChatGPT-assisted writing could depend on the previous knowledge and skills of the user, which might, in certain instances, lead to confusion in inexperienced users and result in poorer essay writing performance.\n                  <\/jats:p>","DOI":"10.1057\/s41599-023-02269-7","type":"journal-article","created":{"date-parts":[[2023,10,28]],"date-time":"2023-10-28T10:02:35Z","timestamp":1698487355000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":103,"title":["ChatGPT-3.5 as writing assistance in students\u2019 essays"],"prefix":"10.1057","volume":"10","author":[{"given":"\u017deljana","family":"Ba\u0161i\u0107","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ana","family":"Banovac","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ivana","family":"Kru\u017ei\u0107","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ivan","family":"Jerkovi\u0107","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,10,28]]},"reference":[{"key":"2269_CR1","unstructured":"Agomuoh F (2023) ChatGPT: how to use the viral AI chatbot that took the world by storm. Digital Trends. https:\/\/www.digitaltrends.com\/computing\/how-to-use-openai-chatgpt-text-generation-chatbot\/. Accessed 10 Oct 2023"},{"issue":"1","key":"2269_CR2","doi-asserted-by":"publisher","first-page":"62","DOI":"10.52866\/20ijcsm.2023.01.01.0018","volume":"4","author":"M Aljanabi","year":"2023","unstructured":"Aljanabi M, Ghazi M, Ali AH et al. (2023) ChatGpt: Open Possibilities. Iraqi J Comput Sci Math 4(1):62\u201364. https:\/\/doi.org\/10.52866\/20ijcsm.2023.01.01.0018","journal-title":"Iraqi J Comput Sci Math"},{"key":"2269_CR3","doi-asserted-by":"publisher","first-page":"22","DOI":"10.2139\/ssrn.4308687","volume":"2","author":"\u00d6 Aydin","year":"2022","unstructured":"Aydin \u00d6, Karaarslan E (2022) OpenAI ChatGPT generated literature review: digital twin in healthcare. Emerg Comput Technol 2:22\u201331. https:\/\/doi.org\/10.2139\/ssrn.4308687","journal-title":"Emerg Comput Technol"},{"key":"2269_CR4","doi-asserted-by":"publisher","unstructured":"Banihashem SK, Noroozi O, den Brok P et al. (2023a) Identifying student profiles based on their attitudes and beliefs towards online education and exploring relations with their experiences and background. Innov Educ Teach Int 1\u201315. https:\/\/doi.org\/10.1080\/14703297.2023.2227616","DOI":"10.1080\/14703297.2023.2227616"},{"issue":"2","key":"2269_CR5","doi-asserted-by":"publisher","first-page":"100803","DOI":"10.1016\/j.ijme.2023.100803","volume":"21","author":"SK Banihashem","year":"2023","unstructured":"Banihashem SK, Noroozi O, den Brok P et al. (2023b) Modeling teachers\u2019 and students\u2019 attitudes, emotions, and perceptions in blended education: Towards post-pandemic education. Int J Manag Educ 21(2):100803. https:\/\/doi.org\/10.1016\/j.ijme.2023.100803","journal-title":"Int J Manag Educ"},{"key":"2269_CR6","doi-asserted-by":"publisher","unstructured":"Bishop LA (2023) Computer wrote this paper: what ChatGPT means for education, research, and writing. Res Writ. https:\/\/doi.org\/10.2139\/ssrn.4338981","DOI":"10.2139\/ssrn.4338981"},{"key":"2269_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/14703297.2023.2190148","volume":"00","author":"DRE Cotton","year":"2023","unstructured":"Cotton DRE, Cotton PA, Shipway JR (2023) Chatting and cheating: ensuring academic integrity in the era of ChatGPT. Innov Educ Teach Int 00:1\u201312. https:\/\/doi.org\/10.1080\/14703297.2023.2190148","journal-title":"Innov Educ Teach Int"},{"key":"2269_CR8","unstructured":"Debut L, Kim JW, Wu J (2023) RoBERTa-based GPT-2 Output Detector from OpenAI. https:\/\/openai-openai-detector.hf.space\/. Accessed 10 Oct 2023"},{"key":"2269_CR9","doi-asserted-by":"publisher","unstructured":"Farrokhnia M, Banihashem SK, Noroozi O et al. (2023) A SWOT analysis of ChatGPT: implications for educational practice and research. Innov Educ Teach Int 1\u201315. https:\/\/doi.org\/10.1080\/14703297.2023.2195846","DOI":"10.1080\/14703297.2023.2195846"},{"key":"2269_CR10","doi-asserted-by":"publisher","first-page":"1395","DOI":"10.17613\/0h18-5p41","volume":"38","author":"P Fyfe","year":"2022","unstructured":"Fyfe P (2022) How to cheat on your final paper: assigning AI for student writing. AI Soc 38:1395\u20131405. https:\/\/doi.org\/10.17613\/0h18-5p41","journal-title":"AI Soc"},{"key":"2269_CR11","doi-asserted-by":"publisher","unstructured":"Gao CA, Howard FM, Markov NS et al. (2023) Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. NPJ Digit Med. https:\/\/doi.org\/10.1038\/s41746-023-00819-6","DOI":"10.1038\/s41746-023-00819-6"},{"key":"2269_CR12","unstructured":"Goal D, ChatGPT (2023) GPT3 content detector. https:\/\/detector.dng.ai\/. Accessed 10 Oct 2023"},{"issue":"1","key":"2269_CR13","doi-asserted-by":"publisher","first-page":"878","DOI":"10.1021\/acsenergylett.2c02828","volume":"8","author":"G Grimaldi","year":"2023","unstructured":"Grimaldi G, Ehrler B (2023) AI et al.: machines are about to change scientific publishing forever. ACS Energy Lett 8(1):878\u2013880. https:\/\/doi.org\/10.1021\/acsenergylett.2c02828","journal-title":"ACS Energy Lett"},{"issue":"18","key":"2269_CR14","doi-asserted-by":"publisher","first-page":"3148","DOI":"10.1080\/09500693.2014.962644","volume":"36","author":"P Heitmann","year":"2014","unstructured":"Heitmann P, Hecht M, Schwanewedel J et al. (2014) Students\u2019argumentative writing skills in science and first-language education: Commonalities and differences. Int J Sci Educ 36(18):3148\u20133170. https:\/\/doi.org\/10.1080\/09500693.2014.962644","journal-title":"Int J Sci Educ"},{"key":"2269_CR15","doi-asserted-by":"crossref","unstructured":"Hoang G (2023) Academic writing and AI: Day-5 experiment with cultural additivity. https:\/\/osf.io\/u3cjx\/download","DOI":"10.31219\/osf.io\/u3cjx"},{"key":"2269_CR16","doi-asserted-by":"crossref","unstructured":"Hoang G, Nguyen M, Le T (2023) Academic writing and AI: Day-3 experiment with environmental semi-conducting principle. https:\/\/osf.io\/2qbea\/download","DOI":"10.31219\/osf.io\/2qbea"},{"key":"2269_CR17","doi-asserted-by":"publisher","unstructured":"Kerman NT, Banihashem SK, Noroozi O (2023) The relationship among students\u2019 attitude towards peer feedback, peer feedback performance, and uptake. in the power of peer learning: fostering students\u2019 learning processes and outcomes. Springer, p. 347\u2013371. https:\/\/doi.org\/10.1007\/978-3-031-29411-2_16","DOI":"10.1007\/978-3-031-29411-2_16"},{"key":"2269_CR18","doi-asserted-by":"publisher","unstructured":"Kung TH, Cheatham M, Medenilla A et al. (2023) Performance of ChatGPT on USMLE: potential for AI-assisted medical education using large language models. PLOS Digit Health. https:\/\/doi.org\/10.1371\/journal.pdig.0000198","DOI":"10.1371\/journal.pdig.0000198"},{"key":"2269_CR19","doi-asserted-by":"publisher","first-page":"768","DOI":"10.1111\/bjet.13054","volume":"52","author":"S Latifi","year":"2021","unstructured":"Latifi S, Noroozi O, Talaee E (2021) Peer feedback or peer feedforward? Enhancing students\u2019 argumentative peer learning processes and outcomes. Br J Educ Technol 52:768\u2013784. https:\/\/doi.org\/10.1111\/bjet.13054","journal-title":"Br J Educ Technol"},{"issue":"4","key":"2269_CR20","doi-asserted-by":"publisher","first-page":"410","DOI":"10.3390\/educsci13040410","volume":"13","author":"CK Lo","year":"2023","unstructured":"Lo CK (2023) What is the impact of ChatGPT on education? A rapid review of the literature. Educ Sci 13(4):410. https:\/\/doi.org\/10.3390\/educsci13040410","journal-title":"Educ Sci"},{"key":"2269_CR21","doi-asserted-by":"publisher","unstructured":"Ma Y, Liu J, Yi F (2023) Is this abstract generated by AI? A research for the gap between AI-generated scientific text and human-written scientific text. Preprint at arXiv. https:\/\/doi.org\/10.48550\/arXiv.2301.10416","DOI":"10.48550\/arXiv.2301.10416"},{"key":"2269_CR22","unstructured":"Mullen L (2015) Package \u2018textreuse\u2019. https:\/\/mran.revolutionanalytics.com\/snapshot\/2016-03-22\/web\/packages\/textreuse\/textreuse.pdf. Accessed 10 Oct 2023"},{"key":"2269_CR23","doi-asserted-by":"crossref","unstructured":"Nguyen M, Le T (2023a) Academic writing and AI: Day-2 experiment with Bayesian Mindsponge Framework. https:\/\/osf.io\/kr29c\/download. Accessed 10 Oct 2023","DOI":"10.31219\/osf.io\/kr29c"},{"key":"2269_CR24","doi-asserted-by":"crossref","unstructured":"Nguyen M, Le T (2023b) Academic writing and AI: Day-1 experiment. https:\/\/osf.io\/kr29c\/download. Accessed 10 Oct 2023","DOI":"10.31219\/osf.io\/xgqu5"},{"key":"2269_CR25","unstructured":"Nguyen Q, La V (2023) Academic writing and AI: Day-4 experiment with mindsponge theory. OSF Prepr awysc, Cent Open Sci. https:\/\/osf.io\/download\/63c551a4774ea80319ad67ba\/. Accessed 10 Oct 2023"},{"key":"2269_CR26","unstructured":"OpenAI (2022) Optimizing language models for dialogue. https:\/\/openai.com\/blog\/chatgpt\/. Accessed 10 Oct 2023"},{"key":"2269_CR27","unstructured":"OpenAI (2023) AI text classifier. https:\/\/platform.openai.com\/ai-text-classifier. Accessed 10 Oct 2023"},{"key":"2269_CR38","unstructured":"PlagScan (2022) http:\/\/www.plagscan.com\/plagiarism-check\/. Accessed 10 Oct 2023"},{"issue":"1","key":"2269_CR28","first-page":"435","volume":"16","author":"MA Pourhoseingholi","year":"2023","unstructured":"Pourhoseingholi MA, Hatamnejad MR, Solhpour A (2023) Does chatGPT (or any other artificial intelligence language tools) deserve to be included in authorship list? chatGPT and authorship. Gastroenterol Hepatol Bed Bench 16(1):435\u2013437","journal-title":"Gastroenterol Hepatol Bed Bench"},{"key":"2269_CR29","doi-asserted-by":"publisher","first-page":"434","DOI":"10.46328\/ijte.460","volume":"6","author":"F Ranjbaran","year":"2023","unstructured":"Ranjbaran F, Babaee M, Akhteh Khaneh MP et al. (2023) Students\u2019 argumentation performance in online learning environments: Bridging culture and gender. Int J Technol Educ 6:434\u2013454. https:\/\/doi.org\/10.46328\/ijte.460","journal-title":"Int J Technol Educ"},{"key":"2269_CR30","doi-asserted-by":"publisher","unstructured":"Sallam M (2023) ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns. Healthcare. https:\/\/doi.org\/10.3390\/healthcare11060887","DOI":"10.3390\/healthcare11060887"},{"key":"2269_CR31","unstructured":"Schreyer Institute for Teaching Excellence. Writing rubric example. http:\/\/www.schreyerinstitute.psu.edu\/pdf\/suanne_general_resource_WritingRubric.pdf. Accessed 10 Oct 2023"},{"key":"2269_CR32","doi-asserted-by":"publisher","unstructured":"Stokel-Walker C (2022) AI bot ChatGPT writes smart essays\u2014should professors worry? Nature. https:\/\/doi.org\/10.1038\/d41586-022-04397-7","DOI":"10.1038\/d41586-022-04397-7"},{"key":"2269_CR33","doi-asserted-by":"publisher","unstructured":"Susnjak T (2023) ChatGPT: the end of online exam integrity? Preprint at arXiv. https:\/\/doi.org\/10.48550\/arXiv.2212.09292","DOI":"10.48550\/arXiv.2212.09292"},{"issue":"1","key":"2269_CR34","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1080\/10720537.2020.1734995","volume":"135","author":"A Valero Haro","year":"2022","unstructured":"Valero Haro A, Noroozi A, Biemans O et al. (2022) Argumentation Competence: students\u2019 argumentation knowledge, behavior and attitude and their relationships with domain-specific knowledge acquisition. J Constr Psychol 135(1):123\u2013145. https:\/\/doi.org\/10.1080\/10720537.2020.1734995","journal-title":"J Constr Psychol"},{"key":"2269_CR35","unstructured":"Whitford E (2022) Here\u2019s how Forbes got the ChatGPT AI to write 2 college essays in 20\u2009min Forbes. https:\/\/www.forbes.com\/sites\/emmawhitford\/2022\/12\/09\/heres-how-forbes-got-the-chatgpt-ai-to-write-2-college-essays-in-20-minutes\/?sh=7be402d956ad. Accessed 10 Oct 2023"},{"key":"2269_CR36","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1007\/s40319-022-01269-5","volume":"54","author":"Y Xiao","year":"2023","unstructured":"Xiao Y (2023) Decoding authorship: is there really no place for an algorithmic author under copyright law? International Rev Intellect Prop Compet Law 54:5\u201325. https:\/\/doi.org\/10.1007\/s40319-022-01269-5","journal-title":"International Rev Intellect Prop Compet Law"},{"issue":"3","key":"2269_CR37","doi-asserted-by":"publisher","first-page":"035027.","DOI":"10.1088\/1361-6552\/acc5cf","volume":"58","author":"W Yeadon","year":"2023","unstructured":"Yeadon W, Inyang O, Mizouri A et al. (2023) The death of the short-form physics essay in the coming AI revolution. Phys Educ 58(3):035027. https:\/\/doi.org\/10.1088\/1361-6552\/acc5cf","journal-title":"Phys Educ"}],"container-title":["Humanities and Social Sciences Communications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41599-023-02269-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41599-023-02269-7","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41599-023-02269-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,28]],"date-time":"2023-10-28T10:03:24Z","timestamp":1698487404000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41599-023-02269-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,28]]},"references-count":38,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["2269"],"URL":"https:\/\/doi.org\/10.1057\/s41599-023-02269-7","relation":{"has-preprint":[{"id-type":"doi","id":"10.35542\/osf.io\/n5m7s","asserted-by":"object"}]},"ISSN":["2662-9992"],"issn-type":[{"value":"2662-9992","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,28]]},"assertion":[{"value":"23 February 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 October 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 October 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"The study was retrospectively approved by the Ethical Committee of the University Department of Forensic Sciences, University of Split, Croatia (053-01\/23-01\/12; 1, 3\/8\/2023). The research was performed in accordance with the principles of the Declaration of Helsinki. Research participants were not subjected to harm in any way whatsoever. Respect for the dignity of research participants was prioritized.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Full consent was obtained from the participants. Before the study participants signed the informed consent and were given a separate sheet to write their names and password, which enabled anonymity while grading essays and further analysis of student-specific variables. The protection of the privacy of research participants has been ensured.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}}],"article-number":"750"}}