{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,26]],"date-time":"2025-07-26T08:48:42Z","timestamp":1753519722255,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":52,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,12,16]],"date-time":"2024-12-16T00:00:00Z","timestamp":1734307200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012320","name":"Otto von Guericke University Magdeburg","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100012320","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,12,16]]},"DOI":"10.1145\/3677389.3702508","type":"proceedings-article","created":{"date-parts":[[2025,3,13]],"date-time":"2025-03-13T16:53:52Z","timestamp":1741884832000},"page":"1-6","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["The Impact of AI Language Models on Scientific Writing and Scientific Peer Reviews: A Systematic Literature Review"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0112-5430","authenticated-orcid":false,"given":"Rand","family":"Alchokr","sequence":"first","affiliation":[{"name":"DBSE, Otto von Guericke University, Magdeburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-1367-777X","authenticated-orcid":false,"given":"Evelyn","family":"Starzew","sequence":"additional","affiliation":[{"name":"Otto von Guericke University, Magdeburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9576-8474","authenticated-orcid":false,"given":"Gunter","family":"Saake","sequence":"additional","affiliation":[{"name":"DBSE, Otto von Guericke University, Magdeburg, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9580-7728","authenticated-orcid":false,"given":"Thomas","family":"Leich","sequence":"additional","affiliation":[{"name":"Harz University of Applied Sciences, Wernigerode, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0283-248X","authenticated-orcid":false,"given":"Jacob","family":"Kr\u00fcger","sequence":"additional","affiliation":[{"name":"Mathematics and Computer Science, Eindhoven University of Technology, Eindhoven, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,3,13]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.3389\/fvets.2023.1272755"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.2196\/49459"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1111\/liv.15580"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/3530019.3530026"},{"key":"e_1_3_2_1_5_1","unstructured":"H Anwar. 2024. ChatGPT Celebrates Record 80M Daily User Milestone Amid Rumors Of A Possible Search Product Launch. https:\/\/www.digitalinformationworld.com\/2024\/05\/chatgpt-celebrates-record-80m-daily.html"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1111\/1742-6723.14233"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397271.3401190"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.59249\/SKDH9286"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","unstructured":"A. Bond D. Cilliers F. Retief R. Alberts C. Roos and J. Moolman. 2024. Using an artificial intelligence chatbot to critically review the scientific literature on the use of artificial intelligence in environmental impact assessment. Impact Assessment and Project Appraisal (2024). 10.1080\/14615517.2024.2320591","DOI":"10.1080\/14615517.2024.2320591"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","unstructured":"D. Carabantes J.L. Gonz\u00e1lez-Geraldo and G. Jover. 2023. ChatGPT could be the reviewer of your next scientific paper. Evidence on the limits of Al-assisted academic reviews. Profesional de la Informacion 32 5 (2023). 10.3145\/epi.2023.sep.16","DOI":"10.3145\/epi.2023.sep.16"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.21037\/jmai-23-13"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5114\/BIOLSPORT.2023.125623"},{"key":"e_1_3_2_1_13_1","first-page":"1","article-title":"A comparison of cover letters written by ChatGPT-4 or humans","volume":"186","author":"Deveci C.D.","year":"2024","unstructured":"C.D. Deveci, J.J. Baker, B. Sikander, and J. Rosenberg. 2024. A comparison of cover letters written by ChatGPT-4 or humans. Ugeskrift for Laeger 186, 1 (2024), 1--1.","journal-title":"Ugeskrift for Laeger"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00701-024-05908-3"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpharm.2023.123741"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","unstructured":"C.A. Gao F.M. Howard N.S. Markov E.C. Dyer S. Ramesh Y. Luo and A.T. Pearson. 2023. Comparing scientific abstracts generated by ChatGPT to real abstracts with detectors and blinded human reviewers. npj Digital Medicine 6 1 (2023) 75. 10.1038\/s41746-023-00819-6","DOI":"10.1038\/s41746-023-00819-6"},{"key":"e_1_3_2_1_17_1","unstructured":"The Guardian. 2023. ChatGPT reaches 100 million users two months after launch. https:\/\/www.theguardian.com\/technology\/2023\/feb\/02\/chatgpt-100-million-users-open-ai-fastest-growing-app"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.3855\/jidc.18738"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","unstructured":"B.N. Hryciw A.J.E. Seely and K. Kyeremanteng. 2023. Guiding principles and proposed classification system for the responsible adoption of artificial intelligence in scientific writing in medicine. Frontiers in Artificial Intelligence 6 10.3389\/frai.2023.1283353","DOI":"10.3389\/frai.2023.1283353"},{"key":"e_1_3_2_1_20_1","unstructured":"J. Huang and M. Tan. 2023. The role of ChatGPT in scientific communication: writing better scientific review articles. American Journal of Cancer Research 13 4 (2023) 1148--1154. https:\/\/api.semanticscholar.org\/CorpusID:258638310"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","unstructured":"I.A. Huespe J. Echeverri A. Khalid I. Carboni Bisso C.G. Musso S. Surani V. Bansal and R. Kashyap. 2023. Clinical research with large language models generated writing - clinical research with AI-assisted writing (CRAW) study. Critical Care Explorations 5 10 (2023). 10.1097\/CCE.0000000000000975","DOI":"10.1097\/CCE.0000000000000975"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.lindif.2023.102274"},{"key":"e_1_3_2_1_23_1","volume-title":"CEUR Workshop Proceedings","volume":"3502","author":"Kassem K.","year":"2023","unstructured":"K. Kassem and F. Michahelles. 2023. Etmachina: exploring the use of conversational agents such as ChatGPT in scientific writing. In CEUR Workshop Proceedings (2023), Vol. 3502."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","unstructured":"Q. Khraisha S. Put J. Kappenberg A. Warraitch and K. Hadfield. 2024. Can large language models replace humans in systematic reviews? Evaluating GPT-4's efficacy in screening and extracting data from peer-reviewed and grey literature in multiple languages. Research Synthesis Methods (2024). 10.1002\/jrsm.1715","DOI":"10.1002\/jrsm.1715"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.infsof.2008.09.009"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-019-09763-0"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.3390\/surgeries5010006"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","unstructured":"J. Lambert and M. Stevens. 2023. ChatGPT and generative AI technology: a mixed bag of concerns and new opportunities. Computers in the Schools (2023) 1--25. 10.1080\/07380569.2023.2256710","DOI":"10.1080\/07380569.2023.2256710"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1002\/rcs.2621"},{"key":"e_1_3_2_1_30_1","unstructured":"W. Liang Z. Izzo Y. Zhang H. Lepp H. Cao X. Zhao L. Chen H. Ye S. Liu Z. Huang D.A. McFarland and J.Y. Zou. 2024. Monitoring AI-modified content at scale: a case study on the impact of ChatGPT on AI conference peer reviews. arXiv:2403.07183 [cs] http:\/\/arxiv.org\/abs\/2403.07183"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"crossref","unstructured":"W. Liang Y. Zhang H. Cao B. Wang D. Ding X. Yang K. Vodrahalli S. He D. Smith Y. Yin D. McFarland and J. Zou. 2023. Can large language models provide useful feedback on research papers? A large-scale empirical analysis. arXiv:2310.01783 [cs] http:\/\/arxiv.org\/abs\/2310.01783","DOI":"10.1056\/AIoa2400196"},{"key":"e_1_3_2_1_32_1","unstructured":"W. Liang Y. Zhang Z. Wu H. Lepp W. Ji X. Zhao H. Cao S. Liu S. He Z. Huang D. Yang C. Potts C.D. Manning and J.Y. Zou. 2024. Mapping the increasing use of LLMs in scientific papers. arXiv:2404.01268 [cs] http:\/\/arxiv.org\/abs\/2404.01268"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.3390\/fi15100336"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.7189\/JOGH.13.01003"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","unstructured":"R. Megawati H. Listiani N. Pranoto M. Akobiarek and Ruth S. 2023. Role of GPT chat in writing scientific articles: a systematic literature review. Jurnal Penelitian Pendidikan IPA 9 (11 2023) 1078--1084. 10.29303\/jppipa.v9i11.5559","DOI":"10.29303\/jppipa.v9i11.5559"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","unstructured":"J.G. Meyer R.J. Urbanowicz P.C.N. Martin K. O'Connor R. Li P.-C. Peng T.J. Bright N. Tatonetti K.J. Won G. Gonzalez-Hernandez and J.H. Moore. 2023. ChatGPT and large language models in academia: opportunities and challenges. BioData Mining 16 1 (2023). 10.1186\/s13040-023-00339-9","DOI":"10.1186\/s13040-023-00339-9"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.2196\/46924"},{"key":"e_1_3_2_1_38_1","unstructured":"H. Naveed A.U. Khan S. Qiu M. Saqib S. Anwar M. Usman N. Akhtar N. Barnes and A.l Mian. 2024. A comprehensive overview of large language models. arXiv:2307.06435 [cs] http:\/\/arxiv.org\/abs\/2307.06435"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.19186\/BC_2023.025"},{"key":"e_1_3_2_1_40_1","unstructured":"OpenAI. 2024. ChatGPT (October 2023 version). https:\/\/openai.com. Accessed: 2024-10-01."},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-97-0903-8_30"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","unstructured":"M. Perkins and J. Roe. 2024. Academic publisher guidelines on AI usage: a ChatGPT supported thematic analysis. F1000Research 12 (2024). 10.12688\/f1000research.142411.2","DOI":"10.12688\/f1000research.142411.2"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.3390\/publications9010012"},{"key":"e_1_3_2_1_44_1","unstructured":"K. Quach. 2024. Researchers warned against using AI to peer review academic papers. https:\/\/www.semafor.com\/article\/05\/08\/2024\/researchers-warned-against-using-ai-to-peer-review-academic-papers"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.dsx.2024.102946"},{"key":"e_1_3_2_1_46_1","doi-asserted-by":"publisher","unstructured":"M. Safrai and K.E. Orwig. 2024. Utilizing artificial intelligence in academic writing: an in-depth evaluation of a scientific review on fertility preservation written by ChatGPT-4. Journal of Assisted Reproduction and Genetics (2024). 10.1007\/s10815-024-03089-7","DOI":"10.1007\/s10815-024-03089-7"},{"key":"e_1_3_2_1_47_1","unstructured":"C. Stokel-Walker. 2024. AI Chatbots Have Thoroughly Infiltrated Scientific Publishing. https:\/\/www.scientificamerican.com\/article\/chatbots-have-thoroughly-infiltrated-scientific-publishing\/"},{"key":"e_1_3_2_1_48_1","volume-title":"Proceedings of the Annual Meeting of the Association for Computational Linguistics","author":"Su X.","year":"2023","unstructured":"X. Su, T. Wambsganss, R. Rietsche, S.P. Neshaei, and T. K\u00e4ser. 2023. Reviewriter: AI-generated instructions for peer review writing. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (2023). 57--71."},{"key":"e_1_3_2_1_49_1","unstructured":"A. Vaswani N. Shazeer N. Parmar J. Uszkoreit L. Jones A.N. Gomez L. Kaiser and I. Polosukhin. 2023. Attention is all you need. arXiv:1706.03762 [cs] http:\/\/arxiv.org\/abs\/1706.03762"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.90230"},{"key":"e_1_3_2_1_51_1","first-page":"452","article-title":"Publishing your work in a journal: understanding the peer review process","volume":"7","author":"Voight M.L.","year":"2012","unstructured":"M.L. Voight and B.J. Hoogenboom. 2012. Publishing your work in a journal: understanding the peer review process. International Journal of Sports Physical Therapy 7, 5 (2012), 452--460.","journal-title":"International Journal of Sports Physical Therapy"},{"key":"e_1_3_2_1_52_1","unstructured":"W.X. Zhao K. Zhou J. Li T. Tang X. Wang Y. Hou Y. Min B. Zhang J. Zhang Z. Dong Y. Du C. Yang Y. Chen Z. Chen J. Jiang R. Ren Y. Li X. Tang Z. Liu P. Liu J.-Y. Nie and J.-R. Wen. [n. d.]. A survey of large language models. arXiv:2303.18223 [cs] http:\/\/arxiv.org\/abs\/2303.18223"}],"event":{"name":"JCDL '24: 24th ACM\/IEEE Joint Conference on Digital Libraries","sponsor":["SIGIR ACM Special Interest Group on Information Retrieval","SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","IEEE TCDL"],"location":"Hong Kong China","acronym":"JCDL '24"},"container-title":["Proceedings of the 24th ACM\/IEEE Joint Conference on Digital Libraries"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3677389.3702508","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3677389.3702508","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:19:07Z","timestamp":1750295947000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3677389.3702508"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,16]]},"references-count":52,"alternative-id":["10.1145\/3677389.3702508","10.1145\/3677389"],"URL":"https:\/\/doi.org\/10.1145\/3677389.3702508","relation":{},"subject":[],"published":{"date-parts":[[2024,12,16]]},"assertion":[{"value":"2025-03-13","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}