{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,18]],"date-time":"2025-12-18T14:27:39Z","timestamp":1766068059316,"version":"build-2065373602"},"reference-count":22,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2024,10,11]],"date-time":"2024-10-11T00:00:00Z","timestamp":1728604800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","award":["R35GM130354"],"award-info":[{"award-number":["R35GM130354"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BDCC"],"abstract":"<jats:p>We assessed 19,000 scientific introductions to measure the level of undisclosed use of ChatGPT in scientific papers published in 2023 and early 2024. We applied a \u201cstylistics\u201d approach that has previously been shown to be effective at differentiating AI-generated text from human-written text in a variety of venues. Ten different MDPI journals were selected for this study, and the rate of use of undisclosed AI writing in these journals was fairly consistent across the journals. We estimate that ChatGPT was used for writing or significant editing in about 1 to 3% of the introductions tested. This analysis is the first systematic study of detecting undisclosed ChatGPT in published manuscripts in cases where obvious indicators, such as phrases like \u201cregenerate response\u201d, are not present. The work demonstrates that generative AI is not polluting mainstream journals to any appreciable extent and that the overwhelming majority of scientists remain hesitant to embrace this tool for late-stage writing and editing.<\/jats:p>","DOI":"10.3390\/bdcc8100133","type":"journal-article","created":{"date-parts":[[2024,10,11]],"date-time":"2024-10-11T03:53:47Z","timestamp":1728618827000},"page":"133","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Almost Nobody Is Using ChatGPT to Write Academic Science Papers (Yet)"],"prefix":"10.3390","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2181-0112","authenticated-orcid":false,"given":"Heather","family":"Desaire","sequence":"first","affiliation":[{"name":"Department of Chemistry, University of Kansas, Lawrence, KS 66045, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8533-9246","authenticated-orcid":false,"given":"Madeline","family":"Isom","sequence":"additional","affiliation":[{"name":"Department of Chemistry, University of Kansas, Lawrence, KS 66045, USA"}]},{"given":"David","family":"Hua","sequence":"additional","affiliation":[{"name":"Department of Chemistry, University of Kansas, Lawrence, KS 66045, USA"}]}],"member":"1968","published-online":{"date-parts":[[2024,10,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"878","DOI":"10.1021\/acsenergylett.2c02828","article-title":"AI et al.: Machines are about to change scientific publishing forever","volume":"8","author":"Grimaldi","year":"2023","journal-title":"ACS Energy Lett."},{"key":"ref_2","unstructured":"Petiska, E. (2023). ChatGPT cites the most-cited articles and journals, relying solely on Google Scholar\u2019s citations counts. As a result, AI may amplify the Matthew Effect in environmental science. arXiv."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2103","DOI":"10.1007\/s10439-023-03247-5","article-title":"ChatGPT: Detection in academic journals is editors\u2019 and publishers\u2019 responsibilities","volume":"51","year":"2023","journal-title":"Ann. Biomed. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"100796","DOI":"10.1016\/j.patter.2023.100796","article-title":"Why technical solutions for detecting AI-generated content in research and education are insufficient","volume":"4","author":"Otterbacher","year":"2023","journal-title":"Patterns"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"672","DOI":"10.1038\/d41586-023-02980-0","article-title":"AI and science: What 1,600 researchers think","volume":"621","author":"Perkel","year":"2023","journal-title":"Nature"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"637","DOI":"10.1001\/jama.2023.1344","article-title":"Nonhuman \u201cauthors\u201d and Implications for the integrity of scientific publication and medical knowledge","volume":"329","author":"Flanagin","year":"2023","journal-title":"JAMA"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1543","DOI":"10.1016\/j.jacc.2023.02.030","article-title":"JACC journals\u2019 pathway forward with AI tools: The future is now","volume":"81","author":"Fuster","year":"2023","journal-title":"JACC"},{"key":"ref_8","unstructured":"(2024, June 10). Google search exposes academics using ChatGPT in research papers. Available online: https:\/\/cybernews.com\/news\/academic-cheating-chatgpt-openai\/."},{"key":"ref_9","unstructured":"Cabanac, G. (2022). Decontamination of the scientific literature. arXiv."},{"key":"ref_10","unstructured":"(2024, June 10). Retraction Watch. Available online: https:\/\/retractionwatch.com\/papers-and-peer-reviews-with-evidence-of-chatgpt-writing\/."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"101426","DOI":"10.1016\/j.xcrp.2023.101426","article-title":"Distinguishing academic science writing from humans or ChatGPT with over 99% accuracy using off-the-shelf machine learning tools","volume":"4","author":"Desaire","year":"2023","journal-title":"Cell Rep. Phys. Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"101672","DOI":"10.1016\/j.xcrp.2023.101672","article-title":"Accurately detecting AI text when ChatGPT is told to write like a chemist","volume":"4","author":"Desaire","year":"2023","journal-title":"Cell Rep. Phys. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zaitsu, W., and Jin, M. (2023). Distinguishing ChatGPT(-3.5,-4)-generated and human-written papers through Japanese stylometric analysis. PLoS ONE, 18.","DOI":"10.1371\/journal.pone.0288453"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zaitsu, W., Jin, M., Ishihara, S., Tsuge, S., and Inaba, M. (2024). Can we spot fake public comments generated by ChatGPT (-3.5,-4)?: Japanese stylometric analysis expose emulation created by one-shot learning. PLoS ONE, 19.","DOI":"10.1371\/journal.pone.0299031"},{"key":"ref_15","unstructured":"Rosenfeld, A., and Lazebnik, T. (2024). Whose LLM is it Anyway? Linguistic Comparison and LLM Attribution for GPT-3.5, GPT-4 and Bard. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Kim, M.-G., and Desaire, H. (2024). Detecting the Use of ChatGPT in University Newspapers by Analyzing Stylistic Differences with Machine Learning. Information, 15.","DOI":"10.3390\/info15060307"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1093\/reseval\/rvab020","article-title":"Journal citation reports and the definition of a predatory journal: The case of the Multidisciplinary Digital Publishing Institute (MDPI)","volume":"30","year":"2021","journal-title":"Res. Eval."},{"key":"ref_18","unstructured":"(2024, June 10). Comment on: \u201cJournal Citation Reports and the Definition of a Predatory Journal: The Case of the Multidisciplinary Digital Publishing Institute (MDPI)\u201d from Oviedo-Garc\u00eda. Available online: https:\/\/www.mdpi.com\/about\/announcements\/2979."},{"key":"ref_19","unstructured":"Hubert, G., Cabanac, G., and Labb\u00e9, C. (2024, June 10). Bad Smells in Reviewers\u2019 Reports? Text-Mining the MDPI Open Peer Review Corpus. hal-04311568. Available online: https:\/\/hal.science\/hal-04311568v1."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"110787","DOI":"10.1016\/j.microc.2024.110787","article-title":"Applicability of ChatGPT 3.5 in the development of new analytical procedures","volume":"203","author":"Kalyniukova","year":"2024","journal-title":"Microchem. J."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"655","DOI":"10.1038\/d41586-023-03235-8","article-title":"How ChatGPT is transforming the postdoc experience","volume":"622","author":"Nordling","year":"2023","journal-title":"Nature"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1186\/s13054-023-04393-x","article-title":"Large language models and the perils of their hallucinations","volume":"27","author":"Azamfirei","year":"2023","journal-title":"Crit. Care"}],"container-title":["Big Data and Cognitive Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-2289\/8\/10\/133\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:11:00Z","timestamp":1760112660000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-2289\/8\/10\/133"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,11]]},"references-count":22,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2024,10]]}},"alternative-id":["bdcc8100133"],"URL":"https:\/\/doi.org\/10.3390\/bdcc8100133","relation":{},"ISSN":["2504-2289"],"issn-type":[{"type":"electronic","value":"2504-2289"}],"subject":[],"published":{"date-parts":[[2024,10,11]]}}}