{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,14]],"date-time":"2026-07-14T04:12:19Z","timestamp":1784002339111,"version":"3.55.0"},"reference-count":22,"publisher":"BMJ","issue":"9","license":[{"start":{"date-parts":[[2024,9,4]],"date-time":"2024-09-04T00:00:00Z","timestamp":1725408000000},"content-version":"unspecified","delay-in-days":3,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000272","name":"NIHR","doi-asserted-by":"crossref","award":["NIHR204982"],"award-info":[{"award-number":["NIHR204982"]}],"id":[{"id":"10.13039\/501100000272","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ Open"],"accepted":{"date-parts":[[2024,8,15]]},"published-print":{"date-parts":[[2024,9]]},"abstract":"\n Introduction<\/jats:title>\n Missed fractures are the most frequent diagnostic error attributed to clinicians in UK emergency departments and a significant cause of patient morbidity. Recently, advances in computer vision have led to artificial intelligence (AI)-enhanced model developments, which can support clinicians in the detection of fractures. Previous research has shown these models to have promising effects on diagnostic performance, but their impact on the diagnostic accuracy of clinicians in the National Health Service (NHS) setting has not yet been fully evaluated.<\/jats:p>\n <\/jats:sec>\n \n Methods and analysis<\/jats:title>\n \n A dataset of 500 plain radiographs derived from Oxford University Hospitals (OUH) NHS Foundation Trust will be collated to include all bones except the skull, facial bones and cervical spine. The dataset will be split evenly between radiographs showing one or more fractures and those without. The reference\n ground truth<\/jats:italic>\n for each image will be established through independent review by two senior musculoskeletal radiologists. A third senior radiologist will resolve disagreements between two primary radiologists. The dataset will be analysed by a commercially available AI tool, BoneView (Gleamer, Paris, France), and its accuracy for detecting fractures will be determined with reference to the ground truth diagnosis. We will undertake a multiple case multiple reader study in which clinicians interpret all images without AI support, then repeat the process with access to AI algorithm output following a 4-week washout. 18 clinicians will be recruited as readers from four hospitals in England, from six distinct clinical groups, each with three levels of seniority (early-stage, mid-stage and later-stage career). Changes in the accuracy, confidence and speed of reporting will be compared with and without AI support. Readers will use a secure web-based DICOM (Digital Imaging and Communications in Medicine) viewer (\n www.raiqc.com<\/jats:ext-link>\n ), allowing radiograph viewing and abnormality identification. Pooled analyses will be reported for overall reader performance as well as for subgroups including clinical role, level of seniority, pathological finding and difficulty of image.\n <\/jats:p>\n <\/jats:sec>\n \n Ethics and dissemination<\/jats:title>\n The study has been approved by the UK Healthcare Research Authority (IRAS 310995, approved on 13 December 2022). The use of anonymised retrospective radiographs has been authorised by OUH NHS Foundation Trust. The results will be presented at relevant conferences and published in a peer-reviewed journal.<\/jats:p>\n <\/jats:sec>\n \n Trial registration numbers<\/jats:title>\n \n This study is registered with ISRCTN (\n ISRCTN19562541<\/jats:ext-link>\n ) and ClinicalTrials.gov (\n NCT06130397<\/jats:ext-link>\n ). The paper reports the results of a substudy of STEDI2 (Simulation Training for Emergency Department Imaging Phase 2).\n <\/jats:p>\n <\/jats:sec>","DOI":"10.1136\/bmjopen-2024-086061","type":"journal-article","created":{"date-parts":[[2024,9,5]],"date-time":"2024-09-05T05:11:44Z","timestamp":1725513104000},"page":"e086061","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":13,"title":["Evaluating the impact of artificial intelligence-assisted image analysis on the diagnostic accuracy of front-line clinicians in detecting fractures on plain X-rays (FRACT-AI): protocol for a prospective observational study"],"prefix":"10.1136","volume":"14","clinical-trial-number":[{"clinical-trial-number":"isrctn19562541","registry":"10.18810\/isrctn"},{"clinical-trial-number":"nct06130397","registry":"10.18810\/clinical-trials-gov"},{"clinical-trial-number":"nct06130397","registry":"10.18810\/clinical-trials-gov"},{"clinical-trial-number":"isrctn19562541","registry":"10.18810\/isrctn"}],"author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5880-8235","authenticated-orcid":false,"given":"Alex","family":"Novak","sequence":"first","affiliation":[{"name":"Emergency Medicine Research Oxford, Oxford University Hospitals NHS Foundation Trust, Oxford, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Max","family":"Hollowday","sequence":"additional","affiliation":[{"name":"Oxford University Hospitals NHS Foundation Trust, Oxford, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0967-3554","authenticated-orcid":false,"given":"Abdala Trinidad","family":"Espinosa Morgado","sequence":"additional","affiliation":[{"name":"Emergency Medicine Research Oxford, Oxford University Hospitals NHS Foundation Trust, Oxford, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jason","family":"Oke","sequence":"additional","affiliation":[{"name":"Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6642-9967","authenticated-orcid":false,"given":"Susan","family":"Shelmerdine","sequence":"additional","affiliation":[{"name":"Clinical Radiology, Great Ormond Street Hospital for Children, London, UK"},{"name":"Radiology, UCL GOSH ICH, London, UK"},{"name":"NIHR Great Ormond Street Hospital Biomedical Research Centre, London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9598-189X","authenticated-orcid":false,"given":"Nick","family":"Woznitza","sequence":"additional","affiliation":[{"name":"Radiology, University College London Hospitals NHS Foundation Trust, London, UK"},{"name":"Canterbury Christ Church University, Canterbury Christ Church University, Canterbury, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Metcalfe","sequence":"additional","affiliation":[{"name":"Oxford University Hospitals NHS Foundation Trust, Oxford, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew L","family":"Costa","sequence":"additional","affiliation":[{"name":"Oxford University Hospitals NHS Foundation Trust, Oxford, UK"},{"name":"Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK"},{"name":"Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences (NDORMS), Oxford Trauma & Emergency Care (OxTEC), University of Oxford, Oxford, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3964-0809","authenticated-orcid":false,"given":"Sarah","family":"Wilson","sequence":"additional","affiliation":[{"name":"Frimley Health NHS Foundation Trust, Frimley, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jian Shen","family":"Kiam","sequence":"additional","affiliation":[{"name":"Oxford University Hospitals NHS Foundation Trust, Oxford, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0513-7220","authenticated-orcid":false,"given":"James","family":"Vaz","sequence":"additional","affiliation":[{"name":"Oxford University Hospitals NHS Foundation Trust, Oxford, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6123-9838","authenticated-orcid":false,"given":"Nattakarn","family":"Limphaibool","sequence":"additional","affiliation":[{"name":"Oxford University Hospitals NHS Foundation Trust, Oxford, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeanne","family":"Ventre","sequence":"additional","affiliation":[{"name":"Gleamer SAS, Paris, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Jones","sequence":"additional","affiliation":[{"name":"Gleamer SAS, Paris, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lois","family":"Greenhalgh","sequence":"additional","affiliation":[{"name":"Patient and Public Involvement Member, Oxford, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fergus","family":"Gleeson","sequence":"additional","affiliation":[{"name":"Department of Oncology, University of Oxford, Oxford, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nick","family":"Welch","sequence":"additional","affiliation":[{"name":"Patient and Public Involvement Member, Oxford, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alpesh","family":"Mistry","sequence":"additional","affiliation":[{"name":"Liverpool University Hospitals NHS Foundation Trust, Liverpool, UK"},{"name":"North West MSK Imaging, Liverpool, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Natasa","family":"Devic","sequence":"additional","affiliation":[{"name":"Oxford University Hospitals NHS Foundation Trust, Oxford, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James","family":"Teh","sequence":"additional","affiliation":[{"name":"Nuffield Orthopaedic Centre, Oxford University Hospitals NHS Foundation Trust, Oxford, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9614-5033","authenticated-orcid":false,"given":"Sarim","family":"Ather","sequence":"additional","affiliation":[{"name":"Oxford University Hospitals NHS Foundation Trust, Oxford, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2024,9,5]]},"reference":[{"key":"2025121220591020000_14.9.e086061.1","doi-asserted-by":"crossref","DOI":"10.1186\/s12873-019-0289-3","article-title":"Diagnostic error in the emergency department: learning from national patient safety incident report analysis","volume":"19","author":"Hussain","year":"2019","journal-title":"BMC Emerg Med"},{"key":"2025121220591020000_14.9.e086061.2","doi-asserted-by":"publisher","DOI":"10.1136\/jech.2006.056622"},{"key":"2025121220591020000_14.9.e086061.3","doi-asserted-by":"crossref","first-page":"2118","DOI":"10.1016\/j.acra.2023.06.016","article-title":"Artificial Intelligence for Detecting Acute Fractures in Patients Admitted to an Emergency Department: Real-Life Performance of Three Commercial Algorithms","volume":"30","author":"Bousson","year":"2023","journal-title":"Acad Radiol"},{"key":"2025121220591020000_14.9.e086061.4","doi-asserted-by":"publisher","DOI":"10.1007\/s00256-022-04070-0"},{"key":"2025121220591020000_14.9.e086061.5","unstructured":"NHS Resolution . Clinical negligence claims in emergency departments in England. Report 2 of 3: missed fractures. 2022. Available: https:\/\/resolution.nhs.uk\/resources\/clinical-negligence-claims-in-emergency-departments-in-england-three-thematic-reviews\/"},{"key":"2025121220591020000_14.9.e086061.6","doi-asserted-by":"publisher","DOI":"10.1136\/emj.18.4.263"},{"key":"2025121220591020000_14.9.e086061.7","article-title":"Radiology Training in Emergency Medicine Residency as a Predictor of Confidence in an Attending","volume":"12","author":"Blazar","year":"2020","journal-title":"Cureus"},{"key":"2025121220591020000_14.9.e086061.8","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.ienj.2013.04.004","article-title":"Emergency department image interpretation accuracy: The influence of immediate reporting by radiology","volume":"22","author":"Snaith","year":"2014","journal-title":"Int Emerg Nurs"},{"key":"2025121220591020000_14.9.e086061.9","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1007\/s00256-019-03317-7","article-title":"Reporting Discrepancy Resolved by Findings and Time in 2947 Emergency Department Ankle X-rays","volume":"49","author":"York","year":"2020","journal-title":"Skeletal Radiol"},{"key":"2025121220591020000_14.9.e086061.10","doi-asserted-by":"publisher","DOI":"10.1007\/s00330-021-07892-z"},{"key":"2025121220591020000_14.9.e086061.11","doi-asserted-by":"publisher","DOI":"10.1007\/s00330-022-08784-6"},{"key":"2025121220591020000_14.9.e086061.12","doi-asserted-by":"crossref","DOI":"10.1186\/s13244-022-01234-3","article-title":"Artificial intelligence for radiological paediatric fracture assessment: a systematic review","volume":"13","author":"Shelmerdine","year":"2022","journal-title":"Insights Imaging"},{"key":"2025121220591020000_14.9.e086061.13","unstructured":"Fracture Study . Fracture study; first reporting using artificial intelligence for children\u2019s traumatic radiology examinations. Available: https:\/\/fracturestudy.com"},{"key":"2025121220591020000_14.9.e086061.14","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.2021203886"},{"key":"2025121220591020000_14.9.e086061.15","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.210937"},{"key":"2025121220591020000_14.9.e086061.16","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2018-008370"},{"key":"2025121220591020000_14.9.e086061.17","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1007\/s11547-020-01197-9","article-title":"Use of CT and artificial intelligence in suspected or COVID-19 positive patients: statement of the Italian Society of Medical and Interventional Radiology","volume":"125","author":"Neri","year":"2020","journal-title":"Radiol Med"},{"key":"2025121220591020000_14.9.e086061.18","doi-asserted-by":"crossref","DOI":"10.1148\/radiol.222176","article-title":"Automation Bias in Mammography: The Impact of Artificial Intelligence BI-RADS Suggestions on Reader Performance","volume":"307","author":"Dratsch","year":"2023","journal-title":"Radiology"},{"key":"2025121220591020000_14.9.e086061.19","doi-asserted-by":"publisher","DOI":"10.1148\/radiol.211785"},{"key":"2025121220591020000_14.9.e086061.20","unstructured":"Hillis S . Power and sample size estimation. 2024. Available: https:\/\/perception.lab.uiowa.edu\/power-sample-size-estimation"},{"key":"2025121220591020000_14.9.e086061.21","doi-asserted-by":"publisher","DOI":"10.1117\/1.JMI.5.1.011018"},{"key":"2025121220591020000_14.9.e086061.22","doi-asserted-by":"publisher","DOI":"10.1016\/j.acra.2007.12.015"}],"container-title":["BMJ Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmjopen-2024-086061","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,13]],"date-time":"2025-12-13T04:59:19Z","timestamp":1765601959000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmjopen.bmj.com\/lookup\/doi\/10.1136\/bmjopen-2024-086061"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9]]},"references-count":22,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2024,9,5]]},"published-print":{"date-parts":[[2024,9]]}},"alternative-id":["10.1136\/bmjopen-2024-086061"],"URL":"https:\/\/doi.org\/10.1136\/bmjopen-2024-086061","relation":{},"ISSN":["2044-6055","2044-6055"],"issn-type":[{"value":"2044-6055","type":"print"},{"value":"2044-6055","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9]]}}}