{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T18:03:46Z","timestamp":1790013826170,"version":"4.0.1"},"reference-count":40,"publisher":"The Korean Spinal Neurosurgery Society","issue":"1","license":[{"start":{"date-parts":[[2024,3,31]],"date-time":"2024-03-31T00:00:00Z","timestamp":1711843200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":["e-neurospine.org"],"crossmark-restriction":true},"short-container-title":["Neurospine"],"published-print":{"date-parts":[[2024,3,31]]},"abstract":"<jats:p>Objective: Large language models, such as chat generative pre-trained transformer (ChatGPT), have great potential for streamlining medical processes and assisting physicians in clinical decision-making. This study aimed to assess the potential of ChatGPT\u2019s 2 models (GPT-3.5 and GPT-4.0) to support clinical decision-making by comparing its responses for antibiotic prophylaxis in spine surgery to accepted clinical guidelines.Methods: ChatGPT models were prompted with questions from the North American Spine Society (NASS) Evidence-based Clinical Guidelines for Multidisciplinary Spine Care for Antibiotic Prophylaxis in Spine Surgery (2013). Its responses were then compared and assessed for accuracy.Results: Of the 16 NASS guideline questions concerning antibiotic prophylaxis, 10 responses (62.5%) were accurate in ChatGPT\u2019s GPT-3.5 model and 13 (81%) were accurate in GPT-4.0. Twenty-five percent of GPT-3.5 answers were deemed as overly confident while 62.5% of GPT-4.0 answers directly used the NASS guideline as evidence for its response.Conclusion: ChatGPT demonstrated an impressive ability to accurately answer clinical questions. GPT-3.5 model\u2019s performance was limited by its tendency to give overly confident responses and its inability to identify the most significant elements in its responses. GPT-4.0 model\u2019s responses had higher accuracy and cited the NASS guideline as direct evidence many times. While GPT-4.0 is still far from perfect, it has shown an exceptional ability to extract the most relevant research available compared to GPT-3.5. Thus, while ChatGPT has shown far-reaching potential, scrutiny should still be exercised regarding its clinical use at this time.<\/jats:p>","DOI":"10.14245\/ns.2347310.655","type":"journal-article","created":{"date-parts":[[2024,3,28]],"date-time":"2024-03-28T03:08:11Z","timestamp":1711595291000},"page":"128-146","update-policy":"https:\/\/doi.org\/10.14245\/crossmark_policy","source":"Crossref","is-referenced-by-count":36,"title":["Performance of a Large Language Model in the Generation of Clinical Guidelines for Antibiotic Prophylaxis in Spine Surgery"],"prefix":"10.14245","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8823-720X","authenticated-orcid":true,"given":"Bashar","family":"Zaidat","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0314-7748","authenticated-orcid":true,"given":"Nancy","family":"Shrestha","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9029-445X","authenticated-orcid":true,"given":"Ashley M.","family":"Rosenberg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-0904-1891","authenticated-orcid":true,"given":"Wasil","family":"Ahmed","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-2990-7874","authenticated-orcid":true,"given":"Rami","family":"Rajjoub","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3012-3461","authenticated-orcid":true,"given":"Timothy","family":"Hoang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-0457-3308","authenticated-orcid":true,"given":"Mateo Restrepo","family":"Mejia","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0308-0512","authenticated-orcid":true,"given":"Akiro H.","family":"Duey","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4544-3262","authenticated-orcid":true,"given":"Justin E.","family":"Tang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6114-2673","authenticated-orcid":true,"given":"Jun S.","family":"Kim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7511-2486","authenticated-orcid":true,"given":"Samuel K.","family":"Cho","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"5355","reference":[{"key":"ref1","volume-title":""},{"key":"ref2","doi-asserted-by":"publisher","DOI":"10.1177\/21925682231164935"},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.1177\/21925682211062831"},{"key":"ref4","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2018.5097"},{"key":"ref5","doi-asserted-by":"publisher","DOI":"10.3414\/me17-01-0024"},{"key":"ref6","doi-asserted-by":"publisher","DOI":"10.1007\/s11606-019-05035-1"},{"key":"ref7","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pdig.0000198"},{"key":"ref8","doi-asserted-by":"publisher","DOI":"10.2196\/45312"},{"key":"ref9","doi-asserted-by":"publisher","DOI":"10.1016\/s1473-3099(23)00113-5"},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.1016\/j.spinee.2013.06.030"},{"key":"ref11","doi-asserted-by":"publisher","DOI":"10.3171\/2020.11.spine201891"},{"key":"ref12","first-page":"1919","volume-title":"Cefuroxime prophylaxis is effective in noninstrumented spine surgery: a double-blind, placebo-controlled study","author":"Petignat","year":"2008"},{"key":"ref13","doi-asserted-by":"publisher","DOI":"10.1051\/sicotj\/2021029"},{"key":"ref14","first-page":"208","volume-title":"Incidence of surgical site infection after spine surgery: a systematic review and meta-analysis","author":"Zhou","year":"2020"},{"key":"ref15","doi-asserted-by":"publisher","DOI":"10.1007\/s11999-009-0740-y"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.1097\/brs.0000000000000608"},{"key":"ref17","doi-asserted-by":"publisher","DOI":"10.1007\/s11999-013-3346-3"},{"key":"ref18","doi-asserted-by":"publisher","DOI":"10.1097\/brs.0000000000000435"},{"key":"ref19","first-page":"1652","volume-title":"2012 Young investigator award winner: the distribution of body mass as a significant risk factor for lumbar spinal fusion postoperative infections","author":"Mehta","year":"2012"},{"key":"ref20","doi-asserted-by":"publisher","DOI":"10.1016\/j.jocn.2018.03.023"},{"key":"ref21","doi-asserted-by":"publisher","DOI":"10.4184\/asj.2013.7.3.196"},{"key":"ref22","doi-asserted-by":"publisher","DOI":"10.1016\/j.surneu.2007.08.017"},{"key":"ref23","doi-asserted-by":"publisher","DOI":"10.1007\/s00776-008-1296-5"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.4184\/asj.2016.10.6.1018"},{"key":"ref25","doi-asserted-by":"publisher","DOI":"10.4184\/asj.2010.4.2.71"},{"key":"ref26","first-page":"50","volume-title":"Prophylactic antibiotics in elective orthopedic surgery: a prospective study of 1,591 cases","author":"Pavel","year":"1977"},{"key":"ref27","doi-asserted-by":"publisher","DOI":"10.3171\/spi.2007.6.4.7"},{"key":"ref28","first-page":"979","volume-title":"Appropriateness of twenty-four-hour antibiotic prophylaxis after spinal surgery in which a drain is utilized: a prospective randomized study","author":"Takemoto","year":"2015"},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.1016\/j.spinee.2015.12.009"},{"key":"ref30","doi-asserted-by":"publisher","DOI":"10.1016\/j.jocn.2015.03.065"},{"key":"ref31","doi-asserted-by":"publisher","DOI":"10.21037\/atm.2019.01.35"},{"key":"ref32","doi-asserted-by":"publisher","DOI":"10.1016\/j.spinee.2019.05.592"},{"key":"ref33","doi-asserted-by":"publisher","DOI":"10.1530\/eor-21-0077"},{"key":"ref34","doi-asserted-by":"publisher","DOI":"10.1097\/bsd.0000000000001396"},{"key":"ref35","doi-asserted-by":"publisher","DOI":"10.1016\/j.spinee.2021.07.008"},{"key":"ref36","doi-asserted-by":"publisher","DOI":"10.1016\/j.spinee.2019.01.002"},{"key":"ref37","first-page":"2084","volume-title":"Intrawound application of vancomycin for prophylaxis in instrumented thoracolumbar fusions: efficacy, drug levels, and patient outcomes","author":"Sweet","year":"2011"},{"key":"ref38","doi-asserted-by":"publisher","DOI":"10.1227\/00006123-199309000-00010"},{"key":"ref39","doi-asserted-by":"publisher","DOI":"10.1007\/s10143-005-0404-7"},{"key":"ref40","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.35179"}],"container-title":["Neurospine"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/e-neurospine.org\/upload\/pdf\/ns-2347310-655.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/e-neurospine.org\/journal\/view.php?doi=10.14245\/ns.2347310.655","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/e-neurospine.org\/upload\/pdf\/ns-2347310-655.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,28]],"date-time":"2024-03-28T22:01:24Z","timestamp":1711663284000},"score":1,"resource":{"primary":{"URL":"http:\/\/e-neurospine.org\/journal\/view.php?doi=10.14245\/ns.2347310.655"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,31]]},"references-count":40,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,3]]}},"URL":"https:\/\/doi.org\/10.14245\/ns.2347310.655","relation":{},"ISSN":["2586-6583","2586-6591"],"issn-type":[{"value":"2586-6583","type":"print"},{"value":"2586-6591","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,31]]},"assertion":[{"value":"2023-12-10","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-02-17","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-03-31","order":2,"name":"published","label":"Published online","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-03-31","order":3,"name":"published","label":"Print publication","group":{"name":"publication_history","label":"Publication History"}}]}}