{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,16]],"date-time":"2026-11-16T04:25:33Z","timestamp":1794803133414,"version":"4.9.1"},"reference-count":26,"publisher":"Springer Science and Business Media LLC","issue":"9","license":[{"start":{"date-parts":[[2025,6,25]],"date-time":"2025-06-25T00:00:00Z","timestamp":1750809600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,6,25]],"date-time":"2025-06-25T00:00:00Z","timestamp":1750809600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100008891","name":"Loma Linda University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100008891","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Eur Spine J"],"published-print":{"date-parts":[[2025,9]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Purpose<\/jats:title>\n            <jats:p>This study analyzed responses and readability of generative artificial intelligence (AI) models to questions and recommendations from the 2014 Journal of Neurosurgery: Spine (JNS) guidelines for fusion procedures in the treatment of degenerative lumbar spine disease.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Methods<\/jats:title>\n            <jats:p>Twenty-four questions were generated from JNS guidelines and asked to ChatGPT 4o, Perplexity, Microsoft Copilot, and Gemini. Answers were \u201cconcordant\u201d if the response highlighted all points from the JNS guidelines; otherwise, answers were considered \u201cnon-concordant\u201d and further sub-categorized as either \u201cinsufficient\u201d or \u201coverconclusive.\u201d Responses were evaluated for readability via the Flesch\u2013Kincaid Grade Level, Gunning Fog Index, Simple Measure of Gobbledygook (SMOG) Index, and Flesch Reading Ease test.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>ChatGPT 4o had the highest concordance rate at 66.67%, with non-concordant responses distributed at 16.67% for both insufficient and over-conclusive classifications. Perplexity displayed a 58.33% concordance rate, with 25% insufficient and 16.67% over-conclusive responses. Copilot showed 50% concordance, with 37.5% over-conclusive and 16.67% insufficient responses. Gemini demonstrated 54.17% concordance, with 20.83% insufficient and 25% over-conclusive responses. The Flesch\u2013Kincaid Grade Level scores ranged from 14.03 (Copilot) to 15.66 (Perplexity). The Gunning Fog Index scores varied between 15.15 (Copilot) and 18.13 (Perplexity). The SMOG Index scores ranged from 14.69 (Copilot) to 16.49 (Perplexity). The Flesch Reading Ease scores were low across all models, with Copilot showing the highest score of 20.71.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusions<\/jats:title>\n            <jats:p>ChatGPT 4.0 emerged as the best-performing model in terms of concordance, while Perplexity displayed the highest complexity in text readability. AI can be a valuable adjunct in clinical decision-making but cannot replace clinician judgment.<\/jats:p>\n          <\/jats:sec>","DOI":"10.1007\/s00586-025-09052-z","type":"journal-article","created":{"date-parts":[[2025,6,25]],"date-time":"2025-06-25T12:33:37Z","timestamp":1750854817000},"page":"3901-3910","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["The role of generative artificial intelligence in deciding fusion treatment of lumbar degeneration: a comparative analysis and narrative review"],"prefix":"10.1007","volume":"34","author":[{"given":"Taha M.","family":"Taka","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher E.","family":"Collins","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew","family":"Miner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Isaac","family":"Overfield","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Shin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lauren","family":"Seo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Olumide","family":"Danisa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,6,25]]},"reference":[{"issue":"7","key":"9052_CR1","doi-asserted-by":"publisher","first-page":"998","DOI":"10.1016\/j.spinee.2020.04.006","volume":"20","author":"DS Kreiner","year":"2020","unstructured":"Kreiner DS, Matz P, Bono CM et al (2020) Guideline summary review: an evidence-based clinical guideline for the diagnosis and treatment of low back pain. Spine J 20(7):998\u20131024. https:\/\/doi.org\/10.1016\/j.spinee.2020.04.006","journal-title":"Spine J"},{"issue":"1","key":"9052_CR2","doi-asserted-by":"publisher","first-page":"2","DOI":"10.3171\/2014.4.SPINE14257","volume":"21","author":"MG Kaiser","year":"2014","unstructured":"Kaiser MG, Eck JC, Groff MW et al (2014) Guideline update for the performance of fusion procedures for degenerative disease of the lumbar spine. Part 1: introduction and methodology. J Neurosurg Spine 21(1):2\u20136. https:\/\/doi.org\/10.3171\/2014.4.SPINE14257","journal-title":"J Neurosurg Spine"},{"issue":"1","key":"9052_CR3","doi-asserted-by":"publisher","first-page":"7","DOI":"10.3171\/2014.4.SPINE14258","volume":"21","author":"Z Ghogawala","year":"2014","unstructured":"Ghogawala Z, Resnick DK, Watters WC et al (2014) Guideline update for the performance of fusion procedures for degenerative disease of the lumbar spine. Part 2: assessment of functional outcome following lumbar fusion. J Neurosurg Spine 21(1):7\u201313. https:\/\/doi.org\/10.3171\/2014.4.SPINE14258","journal-title":"J Neurosurg Spine"},{"issue":"1","key":"9052_CR4","doi-asserted-by":"publisher","first-page":"14","DOI":"10.3171\/2014.4.SPINE14259","volume":"21","author":"Z Ghogawala","year":"2014","unstructured":"Ghogawala Z, Whitmore RG, Watters WC et al (2014) Guideline update for the performance of fusion procedures for degenerative disease of the lumbar spine. Part 3: assessment of economic outcome. J Neurosurg Spine 21(1):14\u201322. https:\/\/doi.org\/10.3171\/2014.4.SPINE14259","journal-title":"J Neurosurg Spine"},{"issue":"3","key":"9052_CR5","doi-asserted-by":"publisher","first-page":"341","DOI":"10.1080\/10790268.2023.2198926","volume":"46","author":"C Murphy","year":"2023","unstructured":"Murphy C, Thomas FP (2023) Generative AI in spinal cord injury research and care: opportunities and challenges ahead. J Spinal Cord Med 46(3):341\u2013342. https:\/\/doi.org\/10.1080\/10790268.2023.2198926","journal-title":"J Spinal Cord Med"},{"key":"9052_CR6","doi-asserted-by":"publisher","unstructured":"Rajjoub R, Arroyave JS, Zaidat B, Ahmed W, Mejia MR, Tang J, Kim JS, Cho SK (2024) ChatGPT and its role in the decision-making for the diagnosis and treatment of lumbar spinal stenosis: a comparative analysis and narrative review. https:\/\/doi.org\/10.1177\/21925682231195783","DOI":"10.1177\/21925682231195783"},{"issue":"10","key":"9052_CR7","doi-asserted-by":"publisher","first-page":"1437","DOI":"10.1001\/jamaoncol.2023.2947","volume":"9","author":"A Pan","year":"2023","unstructured":"Pan A, Musheyev D, Bockelman D, Loeb S, Kabarriti AE (2023) Assessment of artificial intelligence Chatbot responses to top searched queries about cancer. JAMA Oncol 9(10):1437\u20131440. https:\/\/doi.org\/10.1001\/jamaoncol.2023.2947","journal-title":"JAMA Oncol"},{"issue":"9","key":"9052_CR8","doi-asserted-by":"publisher","first-page":"640","DOI":"10.1097\/BRS.0000000000004915","volume":"49","author":"N Shrestha","year":"2024","unstructured":"Shrestha N, Shen Z, Zaidat B et al (2024) Performance of ChatGPT on NASS clinical guidelines for the diagnosis and treatment of low back pain: a comparison study. Spine 49(9):640\u2013651. https:\/\/doi.org\/10.1097\/BRS.0000000000004915","journal-title":"Spine"},{"issue":"3","key":"9052_CR9","doi-asserted-by":"publisher","first-page":"276","DOI":"10.11613\/BM.2012.031","volume":"22","author":"ML McHugh","year":"2012","unstructured":"McHugh ML (2012) Interrater reliability: the kappa statistic. Biochem Medica 22(3):276\u2013282","journal-title":"Biochem Medica"},{"issue":"1","key":"9052_CR10","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","volume":"33","author":"JR Landis","year":"1977","unstructured":"Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33(1):159\u2013174","journal-title":"Biometrics"},{"issue":"20","key":"9052_CR11","doi-asserted-by":"publisher","first-page":"e177","DOI":"10.2106\/JBJS.M.01228","volume":"96","author":"GH Garcia","year":"2014","unstructured":"Garcia GH, Taylor SA, Dy CJ, Christ A, Patel RM, Dines JS (2014) Online resources for shoulder instability: what are patients reading? J Bone Joint Surg Am 96(20):e177. https:\/\/doi.org\/10.2106\/JBJS.M.01228","journal-title":"J Bone Joint Surg Am"},{"key":"9052_CR12","doi-asserted-by":"publisher","DOI":"10.1177\/2374373521998847","author":"MK Rooney","year":"2021","unstructured":"Rooney MK, Santiago G, Perni S et al (2021) Readability of patient education materials from high-impact medical journals: a 20-year analysis. J Patient Exp. https:\/\/doi.org\/10.1177\/2374373521998847","journal-title":"J Patient Exp"},{"issue":"10","key":"9052_CR13","doi-asserted-by":"publisher","first-page":"e470","DOI":"10.1097\/MAO.0000000000001565","volume":"38","author":"H Spiers","year":"2017","unstructured":"Spiers H, Amin N, Lakhani R, Martin AJ, Patel PM (2017) Assessing readability and reliability of online patient information regarding vestibular schwannoma. Otol Neurotol 38(10):e470\u2013e475. https:\/\/doi.org\/10.1097\/MAO.0000000000001565","journal-title":"Otol Neurotol"},{"issue":"8","key":"9052_CR14","first-page":"639","volume":"12","author":"GH McLaughlin","year":"1969","unstructured":"McLaughlin GH (1969) SMOG grading\u2014a new readability formula. J Read 12(8):639-646","journal-title":"J Read"},{"issue":"5","key":"9052_CR15","doi-asserted-by":"publisher","first-page":"394","DOI":"10.1308\/rcsann.2022.0024","volume":"105","author":"M Shazil Jamal","year":"2023","unstructured":"Shazil Jamal M, Hurley ET, Davey MS, Asad H, Gaafar M, Mullett H (2023) Evaluation of the quality of information online for arthroscopic Bankart repair. Ann R Coll Surg Engl 105(5):394\u2013399. https:\/\/doi.org\/10.1308\/rcsann.2022.0024","journal-title":"Ann R Coll Surg Engl"},{"issue":"7","key":"9052_CR16","doi-asserted-by":"publisher","first-page":"232596712210899","DOI":"10.1177\/23259671221089977","volume":"10","author":"B Gao","year":"2022","unstructured":"Gao B, Shamrock AG, Gulbrandsen TR et al (2022) Can patients read, understand, and act on online resources for anterior cruciate ligament surgery? Orthop J Sports Med 10(7):23259671221089976. https:\/\/doi.org\/10.1177\/23259671221089977","journal-title":"Orthop J Sports Med"},{"issue":"2","key":"9052_CR17","doi-asserted-by":"publisher","first-page":"e024582","DOI":"10.1136\/bmjopen-2018-024582","volume":"9","author":"M Oliffe","year":"2019","unstructured":"Oliffe M, Thompson E, Johnston J, Freeman D, Bagga H, Wong PKK (2019) Assessing the readability and patient comprehension of rheumatology medicine information sheets: a cross-sectional Health Literacy Study. BMJ Open 9(2):e024582. https:\/\/doi.org\/10.1136\/bmjopen-2018-024582","journal-title":"BMJ Open"},{"issue":"8","key":"9052_CR18","doi-asserted-by":"publisher","first-page":"713","DOI":"10.1001\/jamaoto.2024.1569","volume":"150","author":"M Armache","year":"2024","unstructured":"Armache M, Assi S, Wu R et al (2024) Readability of patient education materials in head and neck cancer: a systematic review. JAMA Otolaryngol Head Neck Surg 150(8):713\u2013724. https:\/\/doi.org\/10.1001\/jamaoto.2024.1569","journal-title":"JAMA Otolaryngol Head Neck Surg"},{"key":"9052_CR19","doi-asserted-by":"publisher","first-page":"e46346","DOI":"10.2196\/46346","volume":"25","author":"A Nattam","year":"2023","unstructured":"Nattam A, Vithala T, Wu TC et al (2023) Assessing the readability of online patient education materials in obstetrics and gynecology using traditional measures: comparative analysis and limitations. J Med Internet Res 25:e46346. https:\/\/doi.org\/10.2196\/46346","journal-title":"J Med Internet Res"},{"issue":"4","key":"9052_CR20","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1080\/10749357.2023.2259177","volume":"31","author":"AB Ahn","year":"2024","unstructured":"Ahn AB, Kulhari S, Karimi A, Sundararajan S, Sajatovic M (2024) Readability of patient education material in stroke: a systematic literature review. Top Stroke Rehabil 31(4):345\u2013360. https:\/\/doi.org\/10.1080\/10749357.2023.2259177","journal-title":"Top Stroke Rehabil"},{"key":"9052_CR21","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1016\/j.jpeds.2019.04.052","volume":"214","author":"AF Glick","year":"2019","unstructured":"Glick AF, Farkas JS, Mendelsohn AL et al (2019) Discharge instruction comprehension and adherence errors: interrelationship between plan complexity and parent health literacy. J Pediatr 214:193-200.e3. https:\/\/doi.org\/10.1016\/j.jpeds.2019.04.052","journal-title":"J Pediatr"},{"issue":"1","key":"9052_CR22","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1007\/s40119-023-00347-0","volume":"13","author":"AD Rouhi","year":"2024","unstructured":"Rouhi AD, Ghanem YK, Yolchieva L et al (2024) Can artificial intelligence improve the readability of patient education materials on aortic stenosis? A pilot study. Cardiol Ther 13(1):137\u2013147. https:\/\/doi.org\/10.1007\/s40119-023-00347-0","journal-title":"Cardiol Ther"},{"issue":"11","key":"9052_CR23","doi-asserted-by":"publisher","first-page":"6147","DOI":"10.1007\/s00405-024-08598-w","volume":"281","author":"M Abou-Abdallah","year":"2024","unstructured":"Abou-Abdallah M, Dar T, Mahmudzade Y, Michaels J, Talwar R, Tornari C (2024) The quality and readability of patient information provided by ChatGPT: can AI reliably explain common ENT operations? Eur Arch Oto-Rhino-Laryngol 281(11):6147\u20136153. https:\/\/doi.org\/10.1007\/s00405-024-08598-w","journal-title":"Eur Arch Oto-Rhino-Laryngol"},{"issue":"11","key":"9052_CR24","doi-asserted-by":"publisher","first-page":"2260","DOI":"10.1097\/CORR.0000000000002668","volume":"481","author":"GJ Kirchner","year":"2023","unstructured":"Kirchner GJ, Kim RY, Weddle JB, Bible JE (2023) Can artificial intelligence improve the readability of patient education materials? Clin Orthop 481(11):2260\u20132267. https:\/\/doi.org\/10.1097\/CORR.0000000000002668","journal-title":"Clin Orthop"},{"issue":"11","key":"9052_CR25","doi-asserted-by":"publisher","first-page":"1122","DOI":"10.1016\/j.jhsa.2023.08.003","volume":"48","author":"BS Crook","year":"2023","unstructured":"Crook BS, Park CN, Hurley ET, Richard MJ, Pidgeon TS (2023) Evaluation of online artificial intelligence-generated information on common hand procedures. J Hand Surg 48(11):1122\u20131127. https:\/\/doi.org\/10.1016\/j.jhsa.2023.08.003","journal-title":"J Hand Surg"},{"issue":"5","key":"9052_CR26","doi-asserted-by":"publisher","first-page":"719","DOI":"10.1053\/j.semnuclmed.2023.04.008","volume":"53","author":"GM Currie","year":"2023","unstructured":"Currie GM (2023) Academic integrity and artificial intelligence: is ChatGPT hype, hero or heresy? Semin Nucl Med 53(5):719\u2013730. https:\/\/doi.org\/10.1053\/j.semnuclmed.2023.04.008","journal-title":"Semin Nucl Med"}],"container-title":["European Spine Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00586-025-09052-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00586-025-09052-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00586-025-09052-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,15]],"date-time":"2025-09-15T16:18:47Z","timestamp":1757953127000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00586-025-09052-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,25]]},"references-count":26,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2025,9]]}},"alternative-id":["9052"],"URL":"https:\/\/doi.org\/10.1007\/s00586-025-09052-z","relation":{},"ISSN":["0940-6719","1432-0932"],"issn-type":[{"value":"0940-6719","type":"print"},{"value":"1432-0932","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,25]]},"assertion":[{"value":"17 November 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 May 2025","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 June 2025","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 June 2025","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}