{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,15]],"date-time":"2026-09-15T17:06:12Z","timestamp":1789491972020,"version":"build-2803163510"},"reference-count":50,"publisher":"Wiley","issue":"3","license":[{"start":{"date-parts":[[2024,6,13]],"date-time":"2024-06-13T00:00:00Z","timestamp":1718236800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2024,6,13]],"date-time":"2024-06-13T00:00:00Z","timestamp":1718236800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["esskajournals.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["J. exp. orthop."],"published-print":{"date-parts":[[2024,7]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Purpose<\/jats:title>\n                    <jats:p>Since its release in November 2022, Chat Generative Pre\u2010Trained Transformer 3.5 (ChatGPT), a complex machine learning model, has garnered more than 100 million users worldwide. The aim of this study is to determine how well ChatGPT can generate novel systematic review ideas on topics within spine surgery.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>ChatGPT was instructed to give ten novel systematic review ideas for five popular topics in spine surgery literature: microdiscectomy, laminectomy, spinal fusion, kyphoplasty and disc replacement. A comprehensive literature search was conducted in PubMed, CINAHL, EMBASE and Cochrane. The number of nonsystematic review articles and number of systematic review papers that had been published on each ChatGPT\u2010generated idea were recorded.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Overall, ChatGPT had a 68% accuracy rate in creating novel systematic review ideas. More specifically, the accuracy rates were 80%, 80%, 40%, 70% and 70% for microdiscectomy, laminectomy, spinal fusion, kyphoplasty and disc replacement, respectively. However, there was a 32% rate of ChatGPT generating ideas for which there were 0 nonsystematic review articles published. There was a 71.4%, 50%, 22.2%, 50%, 62.5% and 51.2% success rate of generating novel systematic review ideas, for which there were also nonsystematic reviews published, for microdiscectomy, laminectomy, spinal fusion, kyphoplasty, disc replacement and overall, respectively.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>ChatGPT generated novel systematic review ideas at an overall rate of 68%. ChatGPT can help identify knowledge gaps in spine research that warrant further investigation, when used under supervision of an experienced spine specialist. This technology can be erroneous and lacks intrinsic logic; so, it should never be used in isolation.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Level of Evidence<\/jats:title>\n                    <jats:p>Not applicable.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1002\/jeo2.12057","type":"journal-article","created":{"date-parts":[[2024,6,13]],"date-time":"2024-06-13T07:12:36Z","timestamp":1718262756000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Assessing the potential role of ChatGPT in spine surgery research"],"prefix":"10.1002","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7491-5746","authenticated-orcid":false,"given":"Isabel","family":"Herzog","sequence":"first","affiliation":[{"name":"Rutgers New Jersey Medical School Newark New Jersey USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dhruv","family":"Mendiratta","sequence":"additional","affiliation":[{"name":"Rutgers New Jersey Medical School Newark New Jersey USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ashok","family":"Para","sequence":"additional","affiliation":[{"name":"Rutgers New Jersey Medical School Newark New Jersey USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ari","family":"Berg","sequence":"additional","affiliation":[{"name":"Rutgers New Jersey Medical School Newark New Jersey USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Neil","family":"Kaushal","sequence":"additional","affiliation":[{"name":"Rutgers New Jersey Medical School Newark New Jersey USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Vives","sequence":"additional","affiliation":[{"name":"Rutgers New Jersey Medical School Newark New Jersey USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2024,6,13]]},"reference":[{"key":"e_1_2_11_2_1","doi-asserted-by":"publisher","DOI":"10.3171\/2009.6.SPINE08669"},{"key":"e_1_2_11_3_1","doi-asserted-by":"publisher","DOI":"10.1097\/BRS.0b013e3182518859"},{"key":"e_1_2_11_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.wneu.2018.02.156"},{"key":"e_1_2_11_5_1","unstructured":"Open AI(2022) ChatGPT: optimizing language models for dialogue. Available from:https:\/\/openai.com\/blog\/chatgpt\/"},{"key":"e_1_2_11_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00264-022-05517-8"},{"key":"e_1_2_11_7_1","unstructured":"Bergquist S.L. Brooks G.A. Keating N.L. Landrum M.B.&Rose S.(2017) Classifying lung cancer severity with ensemble machine learning in health care claims data. Paper presented at: Machine Learning for Healthcare Conference. Available from:https:\/\/stacks.cdc.gov\/pdfjs\/web\/viewer.html?file=https:\/\/stacks.cdc.gov\/view\/cdc\/61402\/cdc_61402_DS1.pdf"},{"key":"e_1_2_11_8_1","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2005.14165"},{"key":"e_1_2_11_9_1","doi-asserted-by":"publisher","DOI":"10.1177\/2192568220973190"},{"key":"e_1_2_11_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.otsr.2022.103456"},{"key":"e_1_2_11_11_1","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMp1702071"},{"key":"e_1_2_11_12_1","doi-asserted-by":"publisher","DOI":"10.1097\/BRS.0b013e31822ef89e"},{"key":"e_1_2_11_13_1","doi-asserted-by":"publisher","DOI":"10.1097\/BRS.0b013e3182982f8e"},{"key":"e_1_2_11_14_1","doi-asserted-by":"publisher","DOI":"10.1136\/ebn.2011.0049"},{"key":"e_1_2_11_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00167-023-07355-6"},{"key":"e_1_2_11_16_1","doi-asserted-by":"publisher","DOI":"10.1038\/d41586-023-00056-7"},{"key":"e_1_2_11_17_1","doi-asserted-by":"publisher","DOI":"10.14444\/8297"},{"key":"e_1_2_11_18_1","doi-asserted-by":"publisher","DOI":"10.1177\/21925682221098362"},{"key":"e_1_2_11_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.spinee.2021.03.018"},{"key":"e_1_2_11_20_1","doi-asserted-by":"publisher","DOI":"10.2106\/JBJS.RVW.21.00045"},{"key":"e_1_2_11_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.bjps.2023.03.004"},{"key":"e_1_2_11_22_1","doi-asserted-by":"publisher","DOI":"10.1097\/BSD.0000000000001082"},{"key":"e_1_2_11_23_1","doi-asserted-by":"publisher","DOI":"10.2106\/JBJS.RVW.21.00045"},{"key":"e_1_2_11_24_1","doi-asserted-by":"publisher","DOI":"10.1097\/BRS.0000000000000545"},{"key":"e_1_2_11_25_1","doi-asserted-by":"publisher","DOI":"10.1097\/SLA.0000000000002693"},{"key":"e_1_2_11_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10439-023-03206-0"},{"issue":"3","key":"e_1_2_11_27_1","first-page":"1","article-title":"Cervical artificial disc replacement versus fusion for cervical degenerative disc disease: a health technology assessment","volume":"19","author":"Health Quality Ontario","year":"2019","journal-title":"Ontario Health Technology Assessment Series"},{"issue":"11","key":"e_1_2_11_28_1","first-page":"1","article-title":"Vertebral augmentation involving vertebroplasty or kyphoplasty for cancer\u2010related vertebral compression fractures: a systematic review","volume":"16","author":"Health Quality Ontario","year":"2016","journal-title":"Ontario Health Technology Assessment Series"},{"key":"e_1_2_11_29_1","doi-asserted-by":"publisher","DOI":"10.1002\/14651858.CD008326.pub2CD008326"},{"key":"e_1_2_11_30_1","doi-asserted-by":"publisher","DOI":"10.1097\/BSD.0000000000001211"},{"key":"e_1_2_11_31_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pdig.0000198"},{"key":"e_1_2_11_32_1","doi-asserted-by":"publisher","DOI":"10.1097\/01.bsd.0000133064.20466.88"},{"key":"e_1_2_11_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.wneu.2021.07.011"},{"key":"e_1_2_11_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.wneu.2022.11.049"},{"key":"e_1_2_11_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.spinee.2020.04.012"},{"key":"e_1_2_11_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.spinee.2021.06.012"},{"key":"e_1_2_11_37_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.spinee.2009.01.003"},{"key":"e_1_2_11_38_1","doi-asserted-by":"publisher","DOI":"10.1097\/BRS.0b013e3181b77895"},{"key":"e_1_2_11_39_1","doi-asserted-by":"publisher","DOI":"10.1093\/asj\/sjad116"},{"key":"e_1_2_11_40_1","doi-asserted-by":"publisher","DOI":"10.1080\/17453674.2021.1932928"},{"key":"e_1_2_11_41_1","doi-asserted-by":"publisher","DOI":"10.1002\/14651858.CD003007.pub3"},{"key":"e_1_2_11_42_1","unstructured":"OpenAI(2021) GPT\u20103 powers the next generation of apps. Available from:https:\/\/openai.com\/blog\/gpt-3-apps"},{"key":"e_1_2_11_43_1","doi-asserted-by":"publisher","DOI":"10.1177\/21925682211016426"},{"key":"e_1_2_11_44_1","first-page":"256","article-title":"Assessment of outcome following the use of recombinant human bone morphogenetic protein\u20102 for spinal fusion in the elderly population","volume":"60","author":"Shweikeh F.","year":"2016","journal-title":"Journal of Neurosurgical Sciences"},{"key":"e_1_2_11_45_1","first-page":"1164","article-title":"Data\u2010driven temporal prediction of surgical site infection","volume":"2015","author":"Soguero\u2010Ruiz C.","year":"2015","journal-title":"AMIA Annual Symposium Proceedings"},{"key":"e_1_2_11_46_1","unstructured":"Southern M.G.(2023) OpenAI's ChatGPT update brings improved accuracy. Available from:https:\/\/www.searchenginejournal.com\/openai-chatgpt-update\/476116\/#close"},{"key":"e_1_2_11_47_1","doi-asserted-by":"publisher","DOI":"10.1097\/BRS.0000000000004519"},{"key":"e_1_2_11_48_1","doi-asserted-by":"publisher","DOI":"10.1186\/s13643-015-0147-7"},{"key":"e_1_2_11_49_1","article-title":"Comparison of different operative approaches for lumbar disc herniation: a network meta\u2010analysis and systematic review","volume":"24","author":"Wei F.L.","year":"2021","journal-title":"Pain Physician"},{"key":"e_1_2_11_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00266-023-03338-"},{"key":"e_1_2_11_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.wneu.2017.02.098"}],"container-title":["Journal of Experimental Orthopaedics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/esskajournals.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/jeo2.12057","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/esskajournals.onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/jeo2.12057","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/esskajournals.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/jeo2.12057","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,15]],"date-time":"2026-09-15T16:33:49Z","timestamp":1789490029000},"score":1,"resource":{"primary":{"URL":"https:\/\/esskajournals.onlinelibrary.wiley.com\/doi\/10.1002\/jeo2.12057"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,13]]},"references-count":50,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2024,7]]}},"alternative-id":["10.1002\/jeo2.12057"],"URL":"https:\/\/doi.org\/10.1002\/jeo2.12057","archive":["Portico"],"relation":{},"ISSN":["2197-1153","2197-1153"],"issn-type":[{"value":"2197-1153","type":"print"},{"value":"2197-1153","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,13]]},"assertion":[{"value":"2023-12-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-05-28","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-06-13","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e12057"}}