{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,1]],"date-time":"2025-12-01T18:04:28Z","timestamp":1764612268745,"version":"3.46.0"},"reference-count":34,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"10","content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,12]]},"abstract":"<jats:sec>\n                    <jats:title>Study Design:<\/jats:title>\n                    <jats:p>Prospective survey study.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective:<\/jats:title>\n                    <jats:p>To address a gap that exists concerning ChatGPT\u2019s ability to respond to various types of questions regarding cervical surgery.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Summary of Background Data:<\/jats:title>\n                    <jats:p>Artificial Intelligence (AI) and machine learning have been creating great change in the landscape of scientific research. Chat Generative Pre-trained Transformer(ChatGPT), an online AI language model, has emerged as a powerful tool in clinical medicine and surgery. Previous studies have demonstrated appropriate and reliable responses from ChatGPT concerning patient questions regarding total joint arthroplasty, distal radius fractures, and lumbar laminectomy. However, there is a gap that exists in examining how accurate and reliable ChatGPT responses are to common questions related to cervical surgery.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and Methods:<\/jats:title>\n                    <jats:p>Twenty questions regarding cervical surgery were presented to the online ChatGPT-3.5 web application 3 separate times, creating 60 responses. Responses were then analyzed by 3 fellowship-trained spine surgeons across 2 institutions using a modified Global Quality Scale (1\u20135 rating) to evaluate accuracy and utility. Descriptive statistics were reported based on responses, and intraclass correlation coefficients were then calculated to assess the consistency of response quality.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>Out of all questions proposed to the AI platform, the average score was 3.17 (95% CI, 2.92, 3.42), with 66.7% of responses being recorded to be of at least \u201cmoderate\u201d quality by 1 reviewer. Nine (45%) questions yielded responses that were graded at least \u201cmoderate\u201d quality by all 3 reviewers. The test-retest reliability was poor with the intraclass correlation coefficient (ICC) calculated as 0.0941 (\u22120.222, 0.135).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion:<\/jats:title>\n                    <jats:p>This study demonstrated that ChatGPT can answer common patient questions concerning cervical surgery with moderate quality during the majority of responses. Further research within AI is necessary to increase response.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1097\/bsd.0000000000001768","type":"journal-article","created":{"date-parts":[[2025,2,10]],"date-time":"2025-02-10T11:04:15Z","timestamp":1739185455000},"page":"498-505","update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":0,"title":["Appropriateness and Consistency of an Online Artificial Intelligence System\u2019s Response to Common Questions Regarding Cervical Fusion"],"prefix":"10.1097","volume":"38","author":[{"given":"Mark","family":"Miller","sequence":"first","affiliation":[{"name":"Jefferson Health\u2013New Jersey, Stratford"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"William T.","family":"DiCiurcio","sequence":"additional","affiliation":[{"name":"Jefferson Health\u2013New Jersey, Stratford"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matthew","family":"Meade","sequence":"additional","affiliation":[{"name":"Jefferson Health\u2013New Jersey, Stratford"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Levi","family":"Buchan","sequence":"additional","affiliation":[{"name":"Jefferson Health\u2013New Jersey, Stratford"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jeffrey","family":"Gleimer","sequence":"additional","affiliation":[{"name":"Regional Orthopaedics, Cherry Hill, NJ"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Barrett","family":"Woods","sequence":"additional","affiliation":[{"name":"Rothman Orthopaedic Institute, Philadelphia, PA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christopher","family":"Kepler","sequence":"additional","affiliation":[{"name":"Rothman Orthopaedic Institute, Philadelphia, PA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"276","published-online":{"date-parts":[[2025,2,10]]},"reference":[{"key":"R1-20251201","doi-asserted-by":"crossref","first-page":"120","DOI":"10.12669\/pjms.39.2.7653","article-title":"ChatGPT - reshaping medical education and clinical management","volume":"39","author":"Khan","year":"2023","journal-title":"Pak J Med Sci"},{"key":"R2-20251201","doi-asserted-by":"crossref","first-page":"1187","DOI":"10.1007\/s00167-023-07355-6","article-title":"Artificial intelligence bot ChatGPT in medical research: the potential game changer as a double-edged sword","volume":"31","author":"Dahmen","year":"2023","journal-title":"Knee Surg Sports Traumatol Arthrosc"},{"key":"R3-20251201","doi-asserted-by":"crossref","first-page":"637","DOI":"10.1001\/jama.2023.1344","article-title":"Nonhuman \u201cauthors\u201d and implications for the integrity of scientific publication and medical knowledge","volume":"329","author":"Flanagin","year":"2023","journal-title":"JAMA"},{"key":"R4-20251201","doi-asserted-by":"crossref","first-page":"e45312","DOI":"10.2196\/45312","article-title":"How does ChatGPT perform on the United States Medical Licensing Examination? The Implications of large language models for medical education and knowledge assessment","volume":"9","author":"Gilson","year":"2023","journal-title":"JMIR Med Educ"},{"key":"R5-20251201","first-page":"12","article-title":"A proposal for the Dartmouth Summer Research Project on Artificial Intelligence, August 31, 1955","volume":"27","author":"McCarthy","year":"2006","journal-title":"AI Magazine"},{"key":"R6-20251201","doi-asserted-by":"crossref","first-page":"100893","DOI":"10.1016\/j.asmr.2024.100893","article-title":"ChatGPT can offer satisfactory responses to common patient questions regarding elbow ulnar collateral ligament reconstruction","volume":"6","author":"Johns","year":"2024","journal-title":"Arthrosc Sports Med Rehabil"},{"key":"R7-20251201","doi-asserted-by":"crossref","first-page":"75","DOI":"10.3389\/fbioe.2018.00075","article-title":"Machine learning in orthopedics: a literature review","volume":"6","author":"Cabitza","year":"2018","journal-title":"Front Bioeng Biotechnol"},{"key":"R8-20251201","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1016\/j.iotcps.2023.04.003","article-title":"ChatGPT: a comprehensive review on background, applications, key challenges, bias, ethics, limitations and future scope","volume":"3","author":"Ray","year":"2023","journal-title":"Internet of Things and Cyber-Physical Systems"},{"key":"R10-20251201","doi-asserted-by":"crossref","first-page":"887","DOI":"10.3390\/healthcare11060887","article-title":"ChatGPT utility in healthcare education, research, and practice: systematic review on the promising perspectives and valid concerns","volume":"11","author":"Sallam","year":"2023","journal-title":"Healthcare (Basel)"},{"key":"R11-20251201","doi-asserted-by":"crossref","first-page":"1930","DOI":"10.1038\/s41591-023-02448-8","article-title":"Large language models in medicine","volume":"29","author":"Thirunavukarasu","year":"2023","journal-title":"Nat Med"},{"key":"R12-20251201","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1007\/s10916-023-01925-4","article-title":"Evaluating the feasibility of ChatGPT in healthcare: an analysis of multiple clinical and research scenarios","volume":"47","author":"Cascella","year":"2023","journal-title":"J Med Syst"},{"key":"R14-20251201","doi-asserted-by":"crossref","first-page":"1740","DOI":"10.3390\/healthcare9121740","article-title":"Online health information seeking behavior: a systematic review","volume":"9","author":"Jia","year":"2021","journal-title":"Healthcare (Basel)"},{"key":"R15-20251201","doi-asserted-by":"crossref","first-page":"2309","DOI":"10.2147\/JMDH.S419847","article-title":"Impact of ChatGPT on teleconsultants in healthcare: perceptions of healthcare experts in Saudi Arabia","volume":"16","author":"Alanzi","year":"2023","journal-title":"J Multidiscip Healthc"},{"key":"R16-20251201","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.jhsa.2023.10.019","article-title":"Appropriateness and reliability of an online artificial intelligence platform\u2019s responses to common questions regarding distal radius fractures","volume":"49","author":"Christy","year":"2024","journal-title":"J Hand Surg Am"},{"key":"R17-20251201","doi-asserted-by":"crossref","first-page":"1519","DOI":"10.2106\/JBJS.23.00209","article-title":"Assessing ChatGPT responses to common patient questions regarding total hip arthroplasty","volume":"105","author":"Mika","year":"2023","journal-title":"J Bone Joint Surg Am"},{"key":"R18-20251201","doi-asserted-by":"crossref","first-page":"842","DOI":"10.1001\/jama.2023.1044","article-title":"Appropriateness of cardiovascular disease prevention recommendations obtained from a popular online chat-based artificial intelligence model","volume":"329","author":"Sarraju","year":"2023","journal-title":"JAMA"},{"key":"R19-20251201","doi-asserted-by":"crossref","first-page":"1649","DOI":"10.2106\/JBJS.23.00043","article-title":"Using artificial intelligence to answer common patient-focused questions in minimally invasive spine surgery","volume":"105","author":"Subramanian","year":"2023","journal-title":"J Bone Joint Surg Am"},{"key":"R20-20251201","first-page":"100214","article-title":"Modern internet search analytics and spine: what are patients asking and reading online?","volume":"14","author":"Kasthuri","year":"2023","journal-title":"North Am Spine Soc J"},{"key":"R21-20251201","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1007\/s40979-023-00137-0","article-title":"Evaluating the authenticity of ChatGPT responses: a study on text-matching capabilities","volume":"19","author":"Elkhatat","year":"2023","journal-title":"Int J Educ Integr"},{"key":"R22-20251201","doi-asserted-by":"crossref","first-page":"2070","DOI":"10.1111\/j.1572-0241.2007.01325.x","article-title":"A systematic review of patient inflammatory bowel disease information resources on the World Wide Web","volume":"102","author":"Bernard","year":"2007","journal-title":"Am J Gastroenterol"},{"key":"R23-20251201","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","article-title":"A guideline of selecting and reporting intraclass correlation coefficients for reliability research","volume":"15","author":"Koo","year":"2016","journal-title":"J Chiropractic Med"},{"key":"R24-20251201","doi-asserted-by":"crossref","first-page":"e0219854","DOI":"10.1371\/journal.pone.0219854","article-title":"Intraclass correlation \u2013 a discussion and demonstration of basic features","volume":"14","author":"Liljequist","year":"2019","journal-title":"PLoS ONE"},{"key":"R25-20251201","first-page":"13","article-title":"Foot and ankle patient education materials and artificial intelligence chatbots: a comparative analysis","volume":"3","author":"Parekh","year":"2024","journal-title":"Foot Ankle Specialist"},{"key":"R26-20251201","doi-asserted-by":"crossref","first-page":"937","DOI":"10.1007\/s00268-022-06884-4","article-title":"Impact of preoperative patient education on postoperative recovery in abdominal surgery: a systematic review","volume":"47","author":"Brodersen","year":"2023","journal-title":"World J Surg"},{"key":"R27-20251201","doi-asserted-by":"crossref","first-page":"2495","DOI":"10.1002\/nop2.1270","article-title":"Patients\u2019 expectations and experiences of provided surgery-related patient education: a descriptive longitudinal study","volume":"9","author":"Bl\u00f6ndal","year":"2022","journal-title":"Nurs Open"},{"key":"R28-20251201","doi-asserted-by":"crossref","first-page":"302","DOI":"10.21037\/jss.2020.01.14","article-title":"Complications of anterior cervical spine surgery: a systematic review of the literature","volume":"6","author":"Yee","year":"2020","journal-title":"J Spine Surg"},{"key":"R29-20251201","doi-asserted-by":"crossref","first-page":"323","DOI":"10.21037\/jss.2019.11.01","article-title":"Complications following posterior cervical decompression and fusion: a review of incidence, risk factors, and prevention strategies","volume":"6","author":"Badiee","year":"2020","journal-title":"J Spine Surg"},{"key":"R30-20251201","doi-asserted-by":"crossref","first-page":"1195","DOI":"10.1016\/j.arth.2023.04.007","article-title":"Using a Google Web search analysis to assess the utility of ChatGPT in total joint arthroplasty","volume":"38","author":"Dubin","year":"2023","journal-title":"J Arthroplasty"},{"key":"R31-20251201","doi-asserted-by":"crossref","first-page":"e59","DOI":"10.1016\/j.jhsa.2015.12.031","article-title":"Health literacy and time spent with a hand surgeon","volume":"41","author":"Menendez","year":"2016","journal-title":"J Hand Surg Am"},{"key":"R32-20251201","doi-asserted-by":"crossref","first-page":"1823","DOI":"10.1016\/j.pec.2018.05.021","article-title":"Health literacy and surgery expectations in total hip and knee arthroplasty patients","volume":"101","author":"Hadden","year":"2018","journal-title":"Patient Educ Couns"},{"key":"R33-20251201","doi-asserted-by":"crossref","first-page":"385","DOI":"10.4184\/asj.2016.10.2.385","article-title":"Complications of anterior and posterior cervical spine surgery","volume":"10","author":"Cheung","year":"2016","journal-title":"Asian Spine J"},{"key":"R34-20251201","doi-asserted-by":"crossref","first-page":"2050312118766199","DOI":"10.1177\/2050312118766199","article-title":"Anterior versus posterior approach to treat cervical spondylotic myelopathy, clinical and radiological results with long period of follow-up","volume":"6","author":"Audat","year":"2018","journal-title":"SAGE Open Med"},{"key":"R35-20251201","doi-asserted-by":"crossref","first-page":"E394","DOI":"10.1097\/BSD.0000000000001582","article-title":"ChatGPT as a source of patient information for lumbar spinal fusion and laminectomy: a comparative analysis against Google Web Search","volume":"37","author":"Nian","year":"2024","journal-title":"Clin Spine Surg"},{"key":"R36-20251201","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1126\/science.aaa8415","article-title":"Machine learning: trends, perspectives, and prospects","volume":"349","author":"Jordan","year":"2015","journal-title":"Science"}],"container-title":["Clinical Spine Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.lww.com\/10.1097\/BSD.0000000000001768","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,1]],"date-time":"2025-12-01T18:02:04Z","timestamp":1764612124000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.lww.com\/10.1097\/BSD.0000000000001768"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,10]]},"references-count":34,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2025]]}},"URL":"https:\/\/doi.org\/10.1097\/bsd.0000000000001768","relation":{},"ISSN":["2380-0186","2380-0194"],"issn-type":[{"type":"print","value":"2380-0186"},{"type":"electronic","value":"2380-0194"}],"subject":[],"published":{"date-parts":[[2025,2,10]]},"assertion":[{"value":"2024-07-11","name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-01-20","name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}}]}}