{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,26]],"date-time":"2026-09-26T06:19:26Z","timestamp":1790403566139,"version":"4.1.0"},"reference-count":24,"publisher":"Wiley","issue":"3","license":[{"start":{"date-parts":[[2024,6,25]],"date-time":"2024-06-25T00:00:00Z","timestamp":1719273600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"},{"start":{"date-parts":[[2024,6,25]],"date-time":"2024-06-25T00:00:00Z","timestamp":1719273600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"},{"start":{"date-parts":[[2024,6,25]],"date-time":"2024-06-25T00:00:00Z","timestamp":1719273600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.elsevier.com\/tdm\/userlicense\/1.0\/"},{"start":{"date-parts":[[2024,6,25]],"date-time":"2024-06-25T00:00:00Z","timestamp":1719273600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.elsevier.com\/legal\/tdmrep-license"}],"funder":[{"DOI":"10.13039\/100000959","name":"American Association of Orthopaedic Surgeons","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100000959","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100009026","name":"Smith and Nephew","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100009026","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100008894","name":"Stryker","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100008894","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006338","name":"Zimmer","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100006338","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["clinicalkey.fr","clinicalkey.jp","arthroscopyjournal.org","clinicalkey.es","clinicalkey.com.au","clinicalkey.com","elsevier.com","sciencedirect.com"],"crossmark-restriction":true},"short-container-title":["Arthroscopy"],"published-print":{"date-parts":[[2025,3]]},"abstract":"<jats:sec>\n                    <jats:title>Purpose<\/jats:title>\n                    <jats:p>To assess the ability of ChatGPT\u20104, an automated Chatbot powered by artificial intelligence, to answer common patient questions concerning the Latarjet procedure for patients with anterior shoulder instability and compare this performance with Google Search Engine.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Using previously validated methods, a Google search was first performed using the query \u201cLatarjet.\u201d Subsequently, the top 10 frequently asked questions (FAQs) and associated sources were extracted. ChatGPT\u20104 was then prompted to provide the top 10 FAQs and answers concerning the procedure. This process was repeated to identify additional FAQs requiring discrete\u2010numeric answers to allow for a comparison between ChatGPT\u20104 and Google. Discrete, numeric answers were subsequently assessed for accuracy on the basis of the clinical judgment of 2 fellowship\u2010trained sports medicine surgeons who were blinded to search platform.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Mean (\u00b1 standard deviation) accuracy to numeric\u2010based answers was 2.9 \u00b1 0.9 for ChatGPT\u20104 versus 2.5 \u00b1 1.4 for Google (\n                      <jats:italic>P<\/jats:italic>\n                      \u00a0= .65). ChatGPT\u20104 derived information for answers only from academic sources, which was significantly different from Google Search Engine (\n                      <jats:italic>P<\/jats:italic>\n                      \u00a0= .003), which used only 30% academic sources and websites from individual surgeons (50%) and larger medical practices (20%). For general FAQs, 40% of FAQs were found to be identical when comparing ChatGPT\u20104 and Google Search Engine. In terms of sources used to answer these questions, ChatGPT\u20104 again used 100% academic resources, whereas Google Search Engine used 60% academic resources, 20% surgeon personal websites, and 20% medical practices (\n                      <jats:italic>P<\/jats:italic>\n                      \u00a0= .087).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>ChatGPT\u20104 demonstrated the ability to provide accurate and reliable information about the Latarjet procedure in response to patient queries, using multiple academic sources in all cases. This was in contrast to Google Search Engine, which more frequently used single\u2010surgeon and large medical practice websites.\u00a0Despite differences in the resources accessed to perform information retrieval tasks, the clinical relevance and\u00a0accuracy of information provided did not significantly differ between ChatGPT\u20104 and Google Search Engine.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Clinical Relevance<\/jats:title>\n                    <jats:p>Commercially available large language models (LLMs), such as ChatGPT\u20104, can perform diverse information retrieval tasks on\u2010demand. An important medical information retrieval application for LLMs consists of the ability to provide comprehensive, relevant, and accurate information for various use cases such as investigation about a recently diagnosed medical condition or procedure. Understanding the performance and abilities of LLMs for use cases has important implications for deployment within health care settings.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1016\/j.arthro.2024.05.025","type":"journal-article","created":{"date-parts":[[2024,6,25]],"date-time":"2024-06-25T12:44:33Z","timestamp":1719319473000},"page":"588-597","update-policy":"https:\/\/doi.org\/10.1016\/elsevier_cm_policy","source":"Crossref","is-referenced-by-count":29,"title":["ChatGPT\u20104 Performs Clinical Information Retrieval Tasks Using Consistently More Trustworthy Resources Than Does Google Search for Queries Concerning the Latarjet Procedure"],"prefix":"10.1002","volume":"41","author":[{"given":"Jacob F.","family":"Oeding","sequence":"first","affiliation":[{"name":"School of Medicine Mayo Clinic Alix School of Medicine Rochester Minnesota U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amy Z.","family":"Lu","sequence":"additional","affiliation":[{"name":"Weill Cornell College of Medicine New York New York U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Mazzucco","sequence":"additional","affiliation":[{"name":"Weill Cornell College of Medicine New York New York U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael C.","family":"Fu","sequence":"additional","affiliation":[{"name":"Sports Medicine and Shoulder Service Hospital for Special Surgery New York New York U.S.A."},{"name":"Department of Orthopaedic Surgery Hospital for Special Surgery New York New York U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Samuel A.","family":"Taylor","sequence":"additional","affiliation":[{"name":"Sports Medicine and Shoulder Service Hospital for Special Surgery New York New York U.S.A."},{"name":"Department of Orthopaedic Surgery Hospital for Special Surgery New York New York U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David M.","family":"Dines","sequence":"additional","affiliation":[{"name":"Sports Medicine and Shoulder Service Hospital for Special Surgery New York New York U.S.A."},{"name":"Department of Orthopaedic Surgery Hospital for Special Surgery New York New York U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Russell F.","family":"Warren","sequence":"additional","affiliation":[{"name":"Sports Medicine and Shoulder Service Hospital for Special Surgery New York New York U.S.A."},{"name":"Department of Orthopaedic Surgery Hospital for Special Surgery New York New York U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lawrence V.","family":"Gulotta","sequence":"additional","affiliation":[{"name":"Sports Medicine and Shoulder Service Hospital for Special Surgery New York New York U.S.A."},{"name":"Department of Orthopaedic Surgery Hospital for Special Surgery New York New York U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joshua S.","family":"Dines","sequence":"additional","affiliation":[{"name":"Sports Medicine and Shoulder Service Hospital for Special Surgery New York New York U.S.A."},{"name":"Department of Orthopaedic Surgery Hospital for Special Surgery New York New York U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kyle N.","family":"Kunze","sequence":"additional","affiliation":[{"name":"Sports Medicine and Shoulder Service Hospital for Special Surgery New York New York U.S.A."},{"name":"Department of Orthopaedic Surgery Hospital for Special Surgery New York New York U.S.A."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2024,6,25]]},"reference":[{"key":"e_1_2_3_2_2","unstructured":"S.Fox M.Duggan.Health Online 2013. Pew Research Centerhttps:\/\/www.pewresearch.org\/internet\/2013\/01\/15\/health\u2010online\u20102013\/.2023. Accessed October 3 2023."},{"key":"e_1_2_3_3_2","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.5.3.e17"},{"key":"e_1_2_3_4_2","doi-asserted-by":"publisher","DOI":"10.1097\/JS9.0000000000000552"},{"key":"e_1_2_3_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jse.2024.02.028"},{"key":"e_1_2_3_6_2","article-title":"Readability of online information on the Latarjet procedure","volume":"15","author":"Ahmed A.","year":"2023","journal-title":"Cureus"},{"key":"e_1_2_3_7_2","doi-asserted-by":"publisher","DOI":"10.1080\/00913847.2021.1942286"},{"key":"e_1_2_3_8_2","doi-asserted-by":"publisher","DOI":"10.2106\/JBJS.M.01228"},{"key":"e_1_2_3_9_2","doi-asserted-by":"publisher","DOI":"10.1302\/0301-620X.105B6.BJJ-2023-0156"},{"key":"e_1_2_3_10_2","unstructured":"C.Gordon.ChatGPT is the fastest growing app in the history of web applications. Forbeshttps:\/\/www.forbes.com\/sites\/cindygordon\/2023\/02\/02\/chatgpt\u2010is\u2010the\u2010fastest\u2010growing\u2010ap\u2010in\u2010the\u2010history\u2010of\u2010web\u2010applications\/?sh=1bc69781678c. Accessed August 25 2023."},{"key":"e_1_2_3_11_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00167-023-07529-2"},{"key":"e_1_2_3_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(16)31279-X"},{"key":"e_1_2_3_13_2","unstructured":"Statcounter.Search Engine Market Share Worldwide \u2010 March 2023https:\/\/gs.statcounter.com\/search\u2010engine\u2010market\u2010share. Accessed April 28 2023."},{"key":"e_1_2_3_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.arth.2023.04.007"},{"key":"e_1_2_3_15_2","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.5369"},{"key":"e_1_2_3_16_2","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.328.7441.702"},{"key":"e_1_2_3_17_2","doi-asserted-by":"publisher","DOI":"10.1001\/jamanetworkopen.2023.36483"},{"issue":"20","key":"e_1_2_3_18_2","article-title":"Are ChatGPT's free\u2010text responses on periprosthetic joint infections of the hip and knee reliable and useful?","volume":"12","author":"Draschl A.","year":"2023","journal-title":"J\u00a0Clin Med"},{"key":"e_1_2_3_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ebiom.2023.104770"},{"key":"e_1_2_3_20_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.arthro.2023.07.048"},{"key":"e_1_2_3_21_2","doi-asserted-by":"publisher","DOI":"10.1308\/rcsann.2022.0024"},{"key":"e_1_2_3_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.arthro.2019.07.033"},{"key":"e_1_2_3_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.joca.2018.04.017"},{"key":"e_1_2_3_24_2","unstructured":"Liu P Yuan W Fu J Jiang Z Hayashi H Neubig G. Pretrain prompt and predict: A systematic survey of prompting methods in natural language processing. arXiv; 2107.13586."},{"key":"e_1_2_3_25_2","doi-asserted-by":"publisher","DOI":"10.2106\/JBJS.23.00209"}],"container-title":["Arthroscopy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.elsevier.com\/content\/article\/PII:S0749806324004079?httpAccept=text\/xml","content-type":"text\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/api.elsevier.com\/content\/article\/PII:S0749806324004079?httpAccept=text\/plain","content-type":"text\/plain","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/arthroscopyjournals.onlinelibrary.wiley.com\/doi\/pdf\/10.1016\/j.arthro.2024.05.025","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/arthroscopyjournals.onlinelibrary.wiley.com\/doi\/full-xml\/10.1016\/j.arthro.2024.05.025","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/arthroscopyjournals.onlinelibrary.wiley.com\/doi\/pdf\/10.1016\/j.arthro.2024.05.025","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,15]],"date-time":"2026-03-15T09:01:00Z","timestamp":1773565260000},"score":1,"resource":{"primary":{"URL":"https:\/\/arthroscopyjournals.onlinelibrary.wiley.com\/doi\/10.1016\/j.arthro.2024.05.025"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,25]]},"references-count":24,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,3]]}},"alternative-id":["10.1016\/j.arthro.2024.05.025"],"URL":"https:\/\/doi.org\/10.1016\/j.arthro.2024.05.025","archive":["Portico"],"relation":{},"ISSN":["0749-8063","1526-3231"],"issn-type":[{"value":"0749-8063","type":"print"},{"value":"1526-3231","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,25]]},"assertion":[{"value":"Elsevier","name":"publisher","label":"This article is maintained by"},{"value":"ChatGPT-4 Performs Clinical Information Retrieval Tasks Using Consistently More Trustworthy Resources Than Does Google Search for Queries Concerning the Latarjet Procedure","name":"articletitle","label":"Article Title"},{"value":"Arthroscopy: The Journal of Arthroscopic & Related Surgery","name":"journaltitle","label":"Journal Title"},{"value":"https:\/\/doi.org\/10.1016\/j.arthro.2024.05.025","name":"articlelink","label":"CrossRef DOI link to publisher maintained version"},{"value":"article","name":"content_type","label":"Content Type"},{"value":"\u00a9 2024 by the Arthroscopy Association of North America","name":"copyright","label":"Copyright"}]}}