{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,10]],"date-time":"2026-10-10T01:50:34Z","timestamp":1791597034112,"version":"4.3.4"},"reference-count":24,"publisher":"Georg Thieme Verlag KG","issue":"04","license":[{"start":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T00:00:00Z","timestamp":1791504000000},"content-version":"vor","delay-in-days":8,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Neurol Surg Rep"],"published-print":{"date-parts":[[2026,10]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Objectives Increasing manuscript volume has strained peer review, prompting interest in artificial intelligence (AI) as a supportive tool. We evaluated DeepSeek R1 as a structured peer reviewer of neurosurgical case-based manuscripts and compared its scoring patterns with those of an experienced editor and student reviewers.<\/jats:p>\n                  <jats:p>Design Exploratory, cross-sectional comparative study using a convenience sample of consecutively submitted manuscripts.<\/jats:p>\n                  <jats:p>Setting Single skull-base neurosurgical journal during a 6-month submission window (January\u2013June 2025).<\/jats:p>\n                  <jats:p>Participants Three reviewer groups independently assessed 11 de-identified, unpublished neurosurgical manuscripts: first-year medical students (n = 154; each randomly assigned one manuscript after a course in biostatistics, epidemiology, and critical appraisal), the journal\u2019s Editor-in-Chief (Experienced Reviewer), and DeepSeek R1.<\/jats:p>\n                  <jats:p>Main Outcome Measures Each manuscript was rated on a 3-point Likert scale (1 = low, 2 = intermediate, 3 = high) across five domains: Study Objective, Novelty, Study Design, Thoroughness, and Clarity.<\/jats:p>\n                  <jats:p>Results Significant between-group differences were found in four of five domains: Study Objective (H = 8.31, p = 0.02), Novelty (H = 9.74, p = 0.008), Thoroughness (H = 10.49, p = 0.005), and Clarity (H = 8.13, p = 0.02); Study Design did not differ (H = 1.45, p = 0.483). DeepSeek scored significantly higher than the Experienced Reviewer for Study Objective (p = 0.015) and higher than both human groups for Novelty.<\/jats:p>\n                  <jats:p>Conclusions DeepSeek showed consistency in structured domains but systematically inflated subjective ratings, particularly Novelty. A human-in-the-loop model integrating AI efficiency with expert judgment may optimize peer review.<\/jats:p>","DOI":"10.1055\/a-2964-9336","type":"journal-article","created":{"date-parts":[[2026,10,10]],"date-time":"2026-10-10T01:18:07Z","timestamp":1791595087000},"page":"e192-e201","source":"Crossref","is-referenced-by-count":0,"title":["Comparison of DeepSeek AI and Human Reviewers in Structured Evaluation of Neurosurgical Manuscripts: A Pilot Study"],"prefix":"10.1055","volume":"87","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7271-7022","authenticated-orcid":false,"given":"Kishore","family":"Balasubramanian","sequence":"additional","affiliation":[{"name":"The University of Oklahoma College of Medicine, Oklahoma, United States","place":["Oklahoma City"],"department":["Department of Neurosurgery"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"O\u2019Connor","sequence":"additional","affiliation":[{"name":"The University of Oklahoma College of Medicine, Oklahoma, United States","place":["Oklahoma City"],"department":["Department of Neurosurgery"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Beste","family":"G\u00fclsuna","sequence":"additional","affiliation":[{"name":"The University of Oklahoma College of Medicine, Oklahoma, United States","place":["Oklahoma City"],"department":["Department of Neurosurgery"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Visish M.","family":"Srinivasan","sequence":"additional","affiliation":[{"name":"University of Pennsylvania Perelman School of Medicine, Pennsylvania, United States","place":["Philadelphia"],"department":["Department of Neurosurgery"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel A.","family":"Donoho","sequence":"additional","affiliation":[{"name":"Children\u2019s National Medical Center, District of Columbia, United States","place":["Washington"],"department":["Division of Neurosurgery"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicholas","family":"Sader","sequence":"additional","affiliation":[{"name":"The University of Oklahoma College of Medicine, Oklahoma, United States","place":["Oklahoma City"],"department":["Department of Neurosurgery"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5314-1067","authenticated-orcid":false,"given":"Christopher S.","family":"Graffeo","sequence":"additional","affiliation":[{"name":"University of Oklahoma Health Sciences Center, Oklahoma, United States","place":["Oklahoma City"],"department":["Department of Neurosurgery"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"194","published-online":{"date-parts":[[2026,10,9]]},"reference":[{"key":"ref1","doi-asserted-by":"crossref","first-page":"12054","DOI":"10.3389\/bjbs.2024.12054","article-title":"The peer review process: past, present, and future","volume":"81","author":"J A Drozdz","year":"2024","journal-title":"Br J Biomed Sci"},{"issue":"07","key":"ref2","doi-asserted-by":"crossref","first-page":"510","DOI":"10.1096\/fba.2021-00011","article-title":"Health professions education scholarship: the emergence, current status, and future of a discipline in its own right","volume":"3","author":"O Ten Cate","year":"2021","journal-title":"FASEB Bioadv"},{"issue":"01","key":"ref3","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1186\/s12909-019-1755-z","article-title":"The utilization of peer feedback during collaborative learning in undergraduate medical education: a systematic review","volume":"19","author":"S Lerchenfeldt","year":"2019","journal-title":"BMC Med Educ"},{"issue":"02","key":"ref4","doi-asserted-by":"crossref","first-page":"102946","DOI":"10.1016\/j.dsx.2024.102946","article-title":"Exploring the potential of ChatGPT in the peer review process: an observational study","volume":"18","author":"A Saad","year":"2024","journal-title":"Diabetes Metab Syndr"},{"issue":"7972","key":"ref5","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1038\/s41586-023-06221-2","article-title":"Scientific discovery in the age of artificial intelligence","volume":"620","author":"H Wang","year":"2023","journal-title":"Nature"},{"issue":"04","key":"ref6","first-page":"441","article-title":"AI-assisted academia: navigating the nuances of peer review with ChatGPT 4","volume":"29","author":"S S Biswas","year":"2024","journal-title":"J Pediatr Pharmacol Ther"},{"issue":"01","key":"ref7","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1007\/s00701-025-06515-6","article-title":"Employing large language models safely and effectively as a practicing neurosurgeon","volume":"167","author":"A Patil","year":"2025","journal-title":"Acta Neurochir"},{"key":"ref8","doi-asserted-by":"crossref","first-page":"104791","DOI":"10.1016\/j.jbi.2025.104791","article-title":"From GPT to DeepSeek: significant gaps remain in realizing AI in healthcare","volume":"163","author":"Y Peng","year":"2025","journal-title":"J Biomed Inform"},{"issue":"08","key":"ref9","doi-asserted-by":"crossref","first-page":"2546","DOI":"10.1038\/s41591-025-03727-2","article-title":"Benchmark evaluation of DeepSeek large language models in clinical decision-making","volume":"31","author":"S Sandmann","year":"2025","journal-title":"Nat Med"},{"key":"ref10","doi-asserted-by":"crossref","first-page":"e51584","DOI":"10.2196\/51584","article-title":"Best practices for using AI tools as an author, peer reviewer, or editor","volume":"25","author":"T I Leung","year":"2023","journal-title":"J Med Internet Res"},{"issue":"01","key":"ref11","doi-asserted-by":"crossref","first-page":"89","DOI":"10.3390\/clinpract14010008","article-title":"Ethical dilemmas in using AI for academic writing and an example framework for peer review in nephrology academia: a narrative review","volume":"14","author":"J Miao","year":"2023","journal-title":"Clin Pract"},{"key":"ref12","doi-asserted-by":"crossref","first-page":"e56537","DOI":"10.2196\/56537","article-title":"Evaluating literature reviews conducted by humans versus ChatGPT: comparative study","volume":"3","author":"M Mostafapour","year":"2024","journal-title":"JMIR AI"},{"key":"ref13","doi-asserted-by":"crossref","first-page":"103183","DOI":"10.1016\/j.jcot.2025.103183","article-title":"Navigating the AI frontier: balancing efficiency and integrity in orthopaedic peer review","volume":"69","author":"R Vaishya","year":"2025","journal-title":"J Clin Orthop Trauma"},{"key":"ref14","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1016\/j.jss.2023.05.030","article-title":"Modeling the adoption of 5760 clinical studies into practice across 5 surgical specialties","volume":"294","author":"M Abdalla","year":"2024","journal-title":"J Surg Res"},{"issue":"03","key":"ref15","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1002\/leap.1544","article-title":"How to improve scientific peer review: four schools of thought","volume":"36","author":"L Waltman","year":"2023","journal-title":"Learn Publ"},{"issue":"01","key":"ref16","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1186\/s41073-021-00115-5","article-title":"Individual versus general structured feedback to improve agreement in grant peer review: a randomized controlled trial","volume":"6","author":"J O Hesselberg","year":"2021","journal-title":"Res Integr Peer Rev"},{"issue":"03","key":"ref17","doi-asserted-by":"crossref","first-page":"e0318322","DOI":"10.1128\/mbio.03183-22","article-title":"Problems with peer review shine a light on gaps in scientific training","volume":"14","author":"D M Proctor","year":"2023","journal-title":"MBio"},{"issue":"05","key":"ref19","doi-asserted-by":"crossref","first-page":"2589","DOI":"10.1007\/s00330-024-11107-6","article-title":"Large language models for structured reporting in radiology: past, present, and future","volume":"35","author":"F Busch","year":"2025","journal-title":"Eur Radiol"},{"issue":"05","key":"ref20","first-page":"qxae058","article-title":"Use of artificial intelligence and the future of peer review","volume":"2","author":"H Bauchner","year":"2024","journal-title":"Health Aff Sch"},{"issue":"01","key":"ref21","doi-asserted-by":"crossref","first-page":"2","DOI":"10.5469\/neuroint.2022.00493","article-title":"Recent issues in medical journal publishing and editing policies: adoption of artificial intelligence, preprints, open peer review, model text recycling policies, best practice in scholarly publishing 4th version, and country names in titles","volume":"18","author":"S Huh","year":"2023","journal-title":"Neurointervention"},{"issue":"01","key":"ref22","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1186\/s13054-024-04933-z","article-title":"Generative artificial intelligence is infiltrating peer review process","volume":"28","author":"K Cheng","year":"2024","journal-title":"Crit Care"},{"issue":"7982","key":"ref24","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1038\/d41586-023-03144-w","article-title":"How ChatGPT and other AI tools could disrupt scientific publishing","volume":"622","author":"G Conroy","year":"2023","journal-title":"Nature"},{"issue":"10","key":"ref25","doi-asserted-by":"crossref","first-page":"1715","DOI":"10.1007\/s00134-024-07559-5","article-title":"Beyond peer review: rethinking scientific publishing with artificial intelligence","volume":"50","author":"M Al Barajraji","year":"2024","journal-title":"Intensive Care Med"},{"issue":"02","key":"ref26","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1007\/s10439-023-03299-7","article-title":"Using AI tools in writing peer review reports: should academic journals embrace the use of ChatGPT?","volume":"52","author":"M B Garcia","year":"2024","journal-title":"Ann Biomed Eng"}],"container-title":["Journal of Neurological Surgery Reports"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.thieme-connect.de\/products\/ejournals\/pdf\/10.1055\/a-2964-9336.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,10]],"date-time":"2026-10-10T01:18:10Z","timestamp":1791595090000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.thieme-connect.de\/DOI\/DOI?10.1055\/a-2964-9336"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10]]},"references-count":24,"journal-issue":{"issue":"04","published-online":{"date-parts":[[2026,10,6]]},"published-print":{"date-parts":[[2026,10]]}},"URL":"https:\/\/doi.org\/10.1055\/a-2964-9336","archive":["Portico","CLOCKSS"],"relation":{},"ISSN":["2193-6358","2193-6366"],"issn-type":[{"value":"2193-6358","type":"print"},{"value":"2193-6366","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10]]}}}