{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,5]],"date-time":"2026-10-05T08:00:13Z","timestamp":1791187213905,"version":"4.1.0"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,9,7]],"date-time":"2023-09-07T00:00:00Z","timestamp":1694044800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,9,7]],"date-time":"2023-09-07T00:00:00Z","timestamp":1694044800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Although chatbots such as ChatGPT can facilitate cost-effective text generation and editing, factually incorrect responses (hallucinations) limit their utility. This study evaluates one particular type of hallucination: fabricated bibliographic citations that do not represent actual scholarly works. We used ChatGPT-3.5 and ChatGPT-4 to produce short literature reviews on 42 multidisciplinary topics, compiling data on the 636 bibliographic citations (references) found in the 84 papers. We then searched multiple databases and websites to determine the prevalence of fabricated citations, to identify errors in the citations to non-fabricated papers, and to evaluate adherence to APA citation format. Within this set of documents, 55% of the GPT-3.5 citations but just 18% of the GPT-4 citations are fabricated. Likewise, 43% of the real (non-fabricated) GPT-3.5 citations but just 24% of the real GPT-4 citations include substantive citation errors. Although GPT-4 is a major improvement over GPT-3.5, problems remain.<\/jats:p>","DOI":"10.1038\/s41598-023-41032-5","type":"journal-article","created":{"date-parts":[[2023,9,7]],"date-time":"2023-09-07T06:04:29Z","timestamp":1694066669000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":442,"title":["Fabrication and errors in the bibliographic citations generated by ChatGPT"],"prefix":"10.1038","volume":"13","author":[{"given":"William H.","family":"Walters","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Esther Isabelle","family":"Wilder","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,9,7]]},"reference":[{"key":"41032_CR1","unstructured":"OpenAI. Documentation. https:\/\/platform.openai.com\/docs\/introduction (2023)."},{"key":"41032_CR2","unstructured":"D\u2019Agostino, S. Designing assignments in the ChatGPT era. Inside Higher Ed. https:\/\/www.insidehighered.com\/news\/2023\/01\/31\/chatgpt-sparks-debate-how-design-student-assignments-now (2023)."},{"key":"41032_CR3","unstructured":"DePeau-Wilson, M. Peer-reviewed journal publishes paper written almost entirely by ChatGPT. MedPage Today. https:\/\/www.medpagetoday.com\/special-reports\/exclusives\/102960 (2023)."},{"key":"41032_CR4","doi-asserted-by":"publisher","first-page":"570","DOI":"10.1002\/asi.24750","volume":"74","author":"BD Lund","year":"2023","unstructured":"Lund, B. D. et al. ChatGPT and a new academic reality: Artificial Intelligence-written research papers and the ethics of the large language models in scholarly publishing. J. Assoc. Inf. Sci. Technol. 74, 570\u2013581 (2023).","journal-title":"J. Assoc. Inf. Sci. Technol."},{"key":"41032_CR5","unstructured":"McMurtrie, B. AI and the future of undergraduate writing. Chron. High. Educ. https:\/\/www.chronicle.com\/article\/ai-and-the-future-of-undergraduate-writing (2022)."},{"key":"41032_CR6","unstructured":"Tools such as ChatGPT threaten transparent science. Here are our ground rules for their use. Nature. https:\/\/www.nature.com\/articles\/d41586-023-00191-1 (2023)."},{"key":"41032_CR7","unstructured":"Rigolino, R. E. With ChatGPT, we\u2019re all editors now. Inside Higher Ed. https:\/\/www.insidehighered.com\/views\/2023\/01\/31\/chatgpt-we-must-teach-students-be-editors-opinion (2023)."},{"key":"41032_CR8","doi-asserted-by":"crossref","unstructured":"Stokel-Walker, C. AI bot ChatGPT writes smart essays\u2014Should professors worry? Nature. https:\/\/www.nature.com\/articles\/d41586-022-04397-7 (2022).","DOI":"10.1038\/d41586-022-04397-7"},{"key":"41032_CR9","unstructured":"Terry, O. K. I'm a student. You have no idea how much we're using ChatGPT. Chron. High. Educ. https:\/\/www.chronicle.com\/article\/im-a-student-you-have-no-idea-how-much-were-using-chatgpt (2023)."},{"key":"41032_CR10","unstructured":"Chiang, T. ChatGPT is a blurry jpeg of the Web. New Yorker. https:\/\/www.newyorker.com\/tech\/annals-of-technology\/chatgpt-is-a-blurry-jpeg-of-the-web (2023)."},{"key":"41032_CR11","unstructured":"Heaven, W. D. Chatbots could one day replace search engines; Here\u2019s why that\u2019s a terrible idea. MIT Technol. Rev. https:\/\/www.technologyreview.com\/2022\/03\/29\/1048439\/chatbots-replace-search-engine-terrible-idea\/ (2022)."},{"key":"41032_CR12","doi-asserted-by":"publisher","first-page":"e35179","DOI":"10.7759\/cureus.35179","volume":"15","author":"H Alkaissi","year":"2023","unstructured":"Alkaissi, H. & McFarlane, S. I. Artificial hallucinations in ChatGPT: Implications in scientific writing. Cureus 15, e35179. https:\/\/doi.org\/10.7759\/cureus.35179 (2023).","journal-title":"Cureus"},{"key":"41032_CR13","doi-asserted-by":"publisher","DOI":"10.1101\/2023.03.16.23286914(24Mar","author":"J Gravel","year":"2023","unstructured":"Gravel, J., D\u2019Amours-Gravel, M. & Osmanlliu, E. Learning to fake it: Limited responses and fabricated references provided by ChatGPT for medical questions. Mayo Clin. Proc. Digit. Health https:\/\/doi.org\/10.1101\/2023.03.16.23286914(24Mar (2023).","journal-title":"Mayo Clin. Proc. Digit. Health"},{"key":"41032_CR14","unstructured":"OpenAI. GPT-4 technical report. https:\/\/paperswithcode.com\/paper\/gpt-4-technical-report-1 (2023)."},{"key":"41032_CR15","doi-asserted-by":"publisher","DOI":"10.1177\/08465371231171125","author":"MW Wagner","year":"2023","unstructured":"Wagner, M. W. & Ertl-Wagner, B. B. Accuracy of information and references using ChatGPT-3 for retrieval of clinical radiological information. Can. Assoc. Radiol. J. https:\/\/doi.org\/10.1177\/08465371231171125 (2023).","journal-title":"Can. Assoc. Radiol. J."},{"key":"41032_CR16","doi-asserted-by":"publisher","first-page":"e46885","DOI":"10.2196\/46885","volume":"9","author":"G Eysenbach","year":"2023","unstructured":"Eysenbach, G. The role of ChatGPT, generative language models, and artificial intelligence in medical education: A conversation with ChatGPT and a call for papers. JMIR Med. Educ. 9, e46885. https:\/\/doi.org\/10.2196\/46885 (2023).","journal-title":"JMIR Med. Educ."},{"key":"41032_CR17","unstructured":"Fried, E. I. Using GPT-3 to search for scientific \u201creferences\u201d. https:\/\/eiko-fried.com\/using-gpt-3-to-search-scientific-references\/ (2023)."},{"key":"41032_CR18","doi-asserted-by":"publisher","DOI":"10.1007\/s10439-023-03248-4","author":"A Frosolini","year":"2023","unstructured":"Frosolini, A., Gennaro, P., Cascino, F. & Gabriele, G. In reference to \u201cRole of ChatGPT in public health\u201d, to highlight the AI\u2019s incorrect reference generation. Ann. Biomed. Eng. https:\/\/doi.org\/10.1007\/s10439-023-03248-4 (2023).","journal-title":"Ann. Biomed. Eng."},{"key":"41032_CR19","doi-asserted-by":"publisher","first-page":"ep421","DOI":"10.30935\/cedtech\/13036","volume":"15","author":"M Halaweh","year":"2023","unstructured":"Halaweh, M. ChatGPT in education: Strategies for responsible implementation. Contemp. Educ. Technol. 15, ep421. https:\/\/doi.org\/10.30935\/cedtech\/13036 (2023).","journal-title":"Contemp. Educ. Technol."},{"key":"41032_CR20","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1186\/s40902-023-00381-x","volume":"45","author":"SG Kim","year":"2023","unstructured":"Kim, S. G. Using ChatGPT for language editing in scientific articles. Maxillofac. Plast. Reconstr. Surg. 45, 13. https:\/\/doi.org\/10.1186\/s40902-023-00381-x (2023).","journal-title":"Maxillofac. Plast. Reconstr. Surg."},{"key":"41032_CR21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s12195-022-00754-8","volume":"16","author":"MR King","year":"2023","unstructured":"King, M. R. A conversation on artificial intelligence, chatbots, and plagiarism in higher education. Cell. Mol. Bioeng. 16, 1\u20132 (2023).","journal-title":"Cell. Mol. Bioeng."},{"key":"41032_CR22","doi-asserted-by":"publisher","DOI":"10.1016\/j.ajog.2023.04.004","author":"L Sanchez-Ramos","year":"2023","unstructured":"Sanchez-Ramos, L., Lin, L. & Romero, R. Beware of references when using ChatGPT as a source of information to write scientific articles. Am. J. Obstet. Gynecol. https:\/\/doi.org\/10.1016\/j.ajog.2023.04.004 (2023).","journal-title":"Am. J. Obstet. Gynecol."},{"key":"41032_CR23","doi-asserted-by":"publisher","first-page":"4879","DOI":"10.3390\/s23104879","volume":"23","author":"Z Tafferner","year":"2023","unstructured":"Tafferner, Z., Bal\u00e1zs, I., Krammer, O. & G\u00e9czy, O. Can ChatGPT help in electronics research and development? A case study with applied sensors. Sensors (Basel) 23, 4879. https:\/\/doi.org\/10.3390\/s23104879 (2023).","journal-title":"Sensors (Basel)"},{"key":"41032_CR24","unstructured":"Weiser, B. Here\u2019s what happens when your lawyer uses ChatGPT. N.Y. Times Web. https:\/\/www.nytimes.com\/2023\/05\/27\/nyregion\/avianca-airline-lawsuit-chatgpt.html (2023)."},{"key":"41032_CR25","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.4334162","author":"J Willems","year":"2023","unstructured":"Willems, J. ChatGPT at universities\u2014The least of our concerns. SSRN J. https:\/\/doi.org\/10.2139\/ssrn.4334162 (2023).","journal-title":"SSRN J."},{"key":"41032_CR26","doi-asserted-by":"publisher","first-page":"e37432","DOI":"10.7759\/cureus.37432","volume":"15","author":"SA Athaluri","year":"2023","unstructured":"Athaluri, S. A. et al. Exploring the boundaries of reality: Investigating the phenomenon of artificial intelligence hallucination in scientific writing through ChatGPT references. Cureus 15, e37432. https:\/\/doi.org\/10.7759\/cureus.37432 (2023).","journal-title":"Cureus"},{"key":"41032_CR27","doi-asserted-by":"publisher","first-page":"e39238","DOI":"10.7759\/cureus.39238","volume":"15","author":"M Bhattacharyya","year":"2023","unstructured":"Bhattacharyya, M., Miller, V. M., Bhattacharyya, D. & Miller, L. E. High rates of fabricated and inaccurate references in ChatGPT-generated medical content. Cureus 15, e39238. https:\/\/doi.org\/10.7759\/cureus.39238 (2023).","journal-title":"Cureus"},{"key":"41032_CR28","doi-asserted-by":"publisher","DOI":"10.1080\/00330124.2023.2190373","author":"T Day","year":"2023","unstructured":"Day, T. A preliminary investigation of fake peer-reviewed citations and references generated by ChatGPT. Prof. Geogr. https:\/\/doi.org\/10.1080\/00330124.2023.2190373 (2023).","journal-title":"Prof. Geogr."},{"key":"41032_CR29","doi-asserted-by":"publisher","first-page":"e003248","DOI":"10.1136\/rmdopen-2023-003248","volume":"9","author":"AJ Hueber","year":"2023","unstructured":"Hueber, A. J. & Kleyer, A. Quality of citation data using the natural language processing tool ChatGPT in rheumatology: Creation of false references. RMD Open 9, e003248. https:\/\/doi.org\/10.1136\/rmdopen-2023-003248 (2023).","journal-title":"RMD Open"},{"key":"41032_CR30","unstructured":"Atlas, S. Chatbot Prompting: A Guide for Students, Educators, and an AI-Augmented Workforce (S. Atlas, 2023). https:\/\/www.researchgate.net\/publication\/367464129_Chatbot_Prompting_A_guide_for_students_educators_and_an_AI-augmented_workforce."},{"key":"41032_CR31","doi-asserted-by":"publisher","first-page":"1553","DOI":"10.1016\/j.ipm.2006.03.019","volume":"42","author":"J Bar-Ilan","year":"2006","unstructured":"Bar-Ilan, J. An ego-centric citation analysis of the works of Michael O. Rabin based on multiple citation indexes. Inf. Process. Manag. 42, 1553\u20131566 (2006).","journal-title":"Inf. Process. Manag."},{"key":"41032_CR32","first-page":"1537","volume":"89","author":"P Jacs\u00f3","year":"2005","unstructured":"Jacs\u00f3, P. As we may search: Comparison of major features of the Web of Science, Scopus, and Google Scholar citation-based and citation-enhanced databases. Curr. Sci. 89, 1537\u20131547 (2005).","journal-title":"Curr. Sci."},{"key":"41032_CR33","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1108\/14684520610675816","volume":"30","author":"P Jacs\u00f3","year":"2006","unstructured":"Jacs\u00f3, P. Deflated, inflated and phantom citation counts. Online Inf. Rev. 30, 297\u2013309 (2006).","journal-title":"Online Inf. Rev."},{"key":"41032_CR34","unstructured":"Beall, J. Beall's list of potential predatory journals and publishers. https:\/\/beallslist.net\/ (2023)."},{"key":"41032_CR35","doi-asserted-by":"publisher","first-page":"5351","DOI":"10.1007\/s11192-023-04804-4","volume":"128","author":"E Ordu\u00f1a-Malea","year":"2023","unstructured":"Ordu\u00f1a-Malea, E. & Cabezas-Clavijo, \u00c1. ChatGPT and the potential growing of ghost bibliographic references. Scientometrics 128, 5351\u20135355 (2023).","journal-title":"Scientometrics"},{"key":"41032_CR36","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2304.02819","author":"W Liang","year":"2023","unstructured":"Liang, W., Yuksekgonul, M., Mao, Y., Wu, E. & Zou, J. GPT detectors are biased against non-native English writers. Patterns https:\/\/doi.org\/10.48550\/arXiv.2304.02819 (2023).","journal-title":"Patterns"},{"key":"41032_CR37","doi-asserted-by":"publisher","unstructured":"Pegoraro, A., Kumari, K., Fereidooni, H. & Sadeghi, A.-R. To ChatGPT, or not to ChatGPT: That is the question! https:\/\/doi.org\/10.48550\/arXiv.2304.01487 (2023).","DOI":"10.48550\/arXiv.2304.01487"},{"key":"41032_CR38","doi-asserted-by":"crossref","unstructured":"Walters, W. H. The effectiveness of software designed to detect AI-generated writing: A comparison of 16 AI text detectors. https:\/\/www.researchgate.net\/publication\/372767498_The_effectiveness_of_software_designed_to_detect_AI-generated_writing_A_comparison_of_16_AI_text_detectors (2023).","DOI":"10.1515\/opis-2022-0158"},{"key":"41032_CR39","doi-asserted-by":"publisher","unstructured":"Wang, J., Liu, S., Xie, X. & Li, Y. Evaluating AIGC detectors on code content. https:\/\/doi.org\/10.48550\/arXiv.2304.05193 (2023).","DOI":"10.48550\/arXiv.2304.05193"},{"key":"41032_CR40","doi-asserted-by":"publisher","unstructured":"Weber-Wulff, D. et al. Testing of detection tools for AI-generated text. https:\/\/doi.org\/10.48550\/arXiv.2306.15666 (2023).","DOI":"10.48550\/arXiv.2306.15666"},{"key":"41032_CR41","unstructured":"Ouyang, L. et al. Training language models to follow instructions with human feedback, in Advances in Neural Information Processing Systems 35: 36th Conference on Neural Information Processing Systems (NeurIPS 2022) (ed. Koyejo. S. et al.) (Neural Information Processing Systems Foundation, 2022); https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2022\/hash\/b1efde53be364a73914f58805a001731-Abstract-Conference.html."},{"key":"41032_CR42","unstructured":"Ramponi, M. How ChatGPT actually works. AssemblyAI. https:\/\/www.assemblyai.com\/blog\/how-chatgpt-actually-works\/ (2022)."},{"key":"41032_CR43","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1111\/j.1467-7687.2009.00906.x","volume":"13","author":"SAJ Birch","year":"2010","unstructured":"Birch, S. A. J., Akmal, N. & Frampton, K. L. Two-year-olds are vigilant of others\u2019 non-verbal cues to credibility. Dev. Sci. 13, 363\u2013369 (2010).","journal-title":"Dev. Sci."},{"key":"41032_CR44","doi-asserted-by":"publisher","first-page":"346","DOI":"10.1207\/s15327957pspr0104_5","volume":"1","author":"BM DePaulo","year":"1997","unstructured":"DePaulo, B. M., Charlton, K., Cooper, H., Lindsay, J. J. & Muhlenbruck, L. The accuracy-confidence correlation in the detection of deception. Pers. Soc. Psychol. Rev. 1, 346\u2013357 (1997).","journal-title":"Pers. Soc. Psychol. Rev."},{"key":"41032_CR45","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1002\/bdm.460","volume":"17","author":"PC Price","year":"2004","unstructured":"Price, P. C. & Stone, E. R. Intuitive evaluation of likelihood judgment producers: Evidence for a confidence heuristic. J. Behav. Decis. Mak. 17, 39\u201357 (2004).","journal-title":"J. Behav. Decis. Mak."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-41032-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-41032-5","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-41032-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,19]],"date-time":"2023-11-19T08:14:09Z","timestamp":1700381649000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-41032-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,7]]},"references-count":45,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["41032"],"URL":"https:\/\/doi.org\/10.1038\/s41598-023-41032-5","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,7]]},"assertion":[{"value":"11 July 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 August 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 September 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"14045"}}