{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,12]],"date-time":"2026-11-12T14:07:23Z","timestamp":1794492443019,"version":"4.9.1"},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,7,3]],"date-time":"2025-07-03T00:00:00Z","timestamp":1751500800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,7,3]],"date-time":"2025-07-03T00:00:00Z","timestamp":1751500800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Qure.ai","id":[{"id":"https:\/\/ror.org\/02s5q6866","id-type":"ROR","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Insights Imaging"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objectives<\/jats:title>\n                    <jats:p>The aim of this study is to validate the effectiveness of an AI tool trained on Indian data in a Dutch medical center and to assess its ability to classify and localize fractures.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Conventional radiographs acquired between January 2019 and November 2022 were analyzed using a multitask deep neural network. The tool, trained on Indian data, identified and localized fractures in 17 body parts. The reference standard was based on radiology reports resulting from routine clinical workflow and confirmed by an experienced musculoskeletal radiologist. The analysis included both patient-wise and fracture-wise evaluations, employing binary and Intersection over Union (IoU) metrics to assess fracture detection and localization accuracy.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>In total, 14,311 radiographs (median age, 48 years (range 18\u201398), 7265 male) were analyzed and categorized by body parts; clavicle, shoulder, humerus, elbow, forearm, wrist, hand and finger, pelvis, hip, femur, knee, lower leg, ankle, foot and toe. 4156\/14,311 (29%) had fractures. The AI tool demonstrated overall patient-wise sensitivity, specificity, and AUC of 87.1% (95% CI: 86.1\u201388.1%), 87.1% (95% CI: 86.4\u201387.7%), and 0.92 (95% CI: 0.91\u20130.93), respectively. Fracture detection rate was 60% overall, ranging from 7% for rib fractures to 90% for clavicle fractures.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>This study validates a fracture detection AI tool on a Western-European dataset, originally trained on Indian data. While classification performance is robust on real clinical data, fracture-wise analysis reveals variability in localization accuracy, underscoring the need for refinement in fracture localization.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Critical relevance statement<\/jats:title>\n                    <jats:p>AI may provide help by enabling optimal use of limited resources or personnel. This study evaluates an AI tool designed to aid in detecting fractures, possibly reducing reading time or optimization of radiology workflow by prioritizing fracture-positive cases.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Key Points<\/jats:title>\n                    <jats:p>\n                      <jats:list list-type=\"bullet\">\n                        <jats:list-item>\n                          <jats:p>Cross-validation on a consecutive Dutch cohort confirms this AI tool\u2019s clinical robustness.<\/jats:p>\n                        <\/jats:list-item>\n                        <jats:list-item>\n                          <jats:p>The tool detected fractures with 87% sensitivity, 87% specificity, and 0.92 AUC.<\/jats:p>\n                        <\/jats:list-item>\n                        <jats:list-item>\n                          <jats:p>AI localizes 60% of fractures, the highest for clavicle (90%) and lowest for ribs (7%).<\/jats:p>\n                        <\/jats:list-item>\n                      <\/jats:list>\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Graphical Abstract<\/jats:title>\n                  <\/jats:sec>","DOI":"10.1186\/s13244-025-02034-1","type":"journal-article","created":{"date-parts":[[2025,7,3]],"date-time":"2025-07-03T13:53:16Z","timestamp":1751550796000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Cross-validation of an artificial intelligence tool for fracture classification and localization on conventional radiography in Dutch population"],"prefix":"10.1186","volume":"16","author":[{"given":"Huibert C.","family":"Ruitenbeek","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sahil","family":"Sahil","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aradhana","family":"Kumar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ravi Kumar","family":"Kushawaha","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Swetha","family":"Tanamala","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Saigopal","family":"Sathyamurthy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rohitashva","family":"Agrawal","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Subhankar","family":"Chattoraj","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jasika","family":"Paramasamy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Bos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Roshan","family":"Fahimi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Edwin H. G.","family":"Oei","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9935-2097","authenticated-orcid":false,"given":"Jacob J.","family":"Visser","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,7,3]]},"reference":[{"key":"2034_CR1","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1016\/j.hcl.2012.02.001","volume":"28","author":"KW Nellans","year":"2012","unstructured":"Nellans KW, Kowalski E, Chung KC (2012) The epidemiology of distal radius fractures. Hand Clin 28:113\u2013125","journal-title":"Hand Clin"},{"key":"2034_CR2","doi-asserted-by":"publisher","first-page":"e580","DOI":"10.1016\/S2666-7568(21)00172-0","volume":"2","author":"AM Wu","year":"2021","unstructured":"Wu AM, Bisignano C, James SL et al (2021) Global, regional, and national burden of bone fractures in 204 countries and territories, 1990\u20132019: a systematic analysis from the Global Burden of Disease Study 2019. Lancet Healthy Longev 2:e580\u2013e592","journal-title":"Lancet Healthy Longev"},{"key":"2034_CR3","doi-asserted-by":"publisher","first-page":"625","DOI":"10.1007\/s00330-003-2066-6","volume":"14","author":"P Remplik","year":"2004","unstructured":"Remplik P, St\u00e4bler A, Merl T, Roemer F, Bohndorf K (2004) Diagnosis of acute fractures of the extremities: comparison of low-field MRI and conventional radiography. Eur Radiol 14:625\u2013630","journal-title":"Eur Radiol"},{"key":"2034_CR4","doi-asserted-by":"publisher","DOI":"10.1186\/1471-227X-6-4","volume":"6","author":"P Hallas","year":"2006","unstructured":"Hallas P, Ellingsen T (2006) Errors in fracture diagnoses in the emergency department\u2014characteristics of patients and diurnal variation. BMC Emerg Med 6:4","journal-title":"BMC Emerg Med"},{"key":"2034_CR5","doi-asserted-by":"publisher","first-page":"710","DOI":"10.1080\/02841850600806340","volume":"47","author":"CJ Wei","year":"2006","unstructured":"Wei CJ, Tsai WC, Tiu CM, Wu HT, Chiou HJ, Chang CY (2006) Systematic analysis of missed extremity fractures in emergency radiology. Acta Radiol 47:710\u2013717","journal-title":"Acta Radiol"},{"key":"2034_CR6","doi-asserted-by":"crossref","unstructured":"Hautz WE, K\u00e4mmer JE, Hautz SC et al (2019) Diagnostic error increases mortality and length of hospital stay in patients presenting through the emergency room. Scand J Trauma Resusc Emerg Med 27:54","DOI":"10.1186\/s13049-019-0629-z"},{"key":"2034_CR7","doi-asserted-by":"publisher","first-page":"2845","DOI":"10.3390\/ijerph15122845","volume":"15","author":"CL Ekegren","year":"2018","unstructured":"Ekegren CL, Edwards ER, de Steiger R, Gabbe BJ (2018) Incidence, costs and predictors of non-union, delayed union and mal-union following long bone fracture. Int J Environ Res Public Health 15:2845","journal-title":"Int J Environ Res Public Health"},{"key":"2034_CR8","doi-asserted-by":"publisher","first-page":"S3","DOI":"10.1016\/j.injury.2014.04.002","volume":"45","author":"DJ Hak","year":"2014","unstructured":"Hak DJ, Fitzpatrick D, Bishop JA et al (2014) Delayed union and nonunions: epidemiology, clinical issues, and financial aspects. Injury 45:S3\u2013S7","journal-title":"Injury"},{"key":"2034_CR9","doi-asserted-by":"publisher","first-page":"127","DOI":"10.3390\/jimaging6110127","volume":"6","author":"I Kandel","year":"2020","unstructured":"Kandel I, Castelli M, Popovi\u010d A (2020) Musculoskeletal images classification for detection of fractures using transfer learning. J Imaging 6:127","journal-title":"J Imaging"},{"key":"2034_CR10","doi-asserted-by":"publisher","first-page":"2179","DOI":"10.1007\/s11548-023-02907-0","volume":"18","author":"A Suna","year":"2023","unstructured":"Suna A, Davidson A, Weil Y, Joskowicz L (2023) Automated computation of radiographic parameters of distal radial metaphyseal fractures in forearm X-rays. Int J Comput Assist Radiol Surg 18:2179\u20132189","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"2034_CR11","doi-asserted-by":"publisher","first-page":"1057","DOI":"10.1007\/s00068-022-02136-1","volume":"49","author":"J Prijs","year":"2023","unstructured":"Prijs J, Liao Z, To MS et al (2023) Development and external validation of automated detection, classification, and localization of ankle fractures: inside the black box of a convolutional neural network (CNN). Eur J Trauma Emerg Surg 49:1057\u20131069","journal-title":"Eur J Trauma Emerg Surg"},{"key":"2034_CR12","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1148\/radiol.211785","volume":"304","author":"RYL Kuo","year":"2022","unstructured":"Kuo RYL, Harrison C, Curran TA et al (2022) Artificial intelligence in fracture detection: a systematic review and meta-analysis. Radiology 304:50\u201362","journal-title":"Radiology"},{"key":"2034_CR13","doi-asserted-by":"publisher","first-page":"7196","DOI":"10.1007\/s00330-022-08956-4","volume":"32","author":"X Zhang","year":"2022","unstructured":"Zhang X, Yang Y, Shen YW et al (2022) Diagnostic accuracy and potential covariates of artificial intelligence for diagnosing orthopedic fractures: a systematic literature review and meta-analysis. Eur Radiol 32:7196\u20137216","journal-title":"Eur Radiol"},{"key":"2034_CR14","first-page":"tzad005","volume":"6","author":"C Pauling","year":"2024","unstructured":"Pauling C, Kanber B, Arthurs OJ, Shelmerdine SC (2024) Commercially available artificial intelligence tools for fracture detection: the evidence. BJR Open 6:tzad005","journal-title":"BJR Open"},{"key":"2034_CR15","doi-asserted-by":"publisher","first-page":"e0000438","DOI":"10.1371\/journal.pdig.0000438","volume":"3","author":"J Jung","year":"2024","unstructured":"Jung J, Dai J, Liu B, Wu Q (2024) Artificial intelligence in fracture detection with different image modalities and data types: a systematic review and meta-analysis. PLoS Digit Health 3:e0000438","journal-title":"PLoS Digit Health"},{"key":"2034_CR16","doi-asserted-by":"publisher","first-page":"e076954","DOI":"10.1136\/bmjopen-2023-076954","volume":"14","author":"MF Russe","year":"2024","unstructured":"Russe MF, Rebmann P, Tran PH et al (2024) AI-based X-ray fracture analysis of the distal radius: accuracy between representative classification, detection and segmentation deep learning models for clinical practice. BMJ Open 14:e076954","journal-title":"BMJ Open"},{"key":"2034_CR17","doi-asserted-by":"publisher","first-page":"627","DOI":"10.1148\/radiol.210937","volume":"302","author":"A Guermazi","year":"2022","unstructured":"Guermazi A, Tannoury C, Kompel AJ et al (2022) Improving radiographic fracture recognition performance and efficiency using artificial intelligence. Radiology 302:627\u2013636","journal-title":"Radiology"},{"key":"2034_CR18","doi-asserted-by":"publisher","first-page":"594","DOI":"10.1016\/j.diii.2022.06.004","volume":"103","author":"L Canoni-Meynet","year":"2022","unstructured":"Canoni-Meynet L, Verdot P, Danner A, Calame P, Aubry S (2022) Added value of an artificial intelligence solution for fracture detection in the radiologist\u2019s daily trauma emergencies workflow. Diagn Inter Imaging 103:594\u2013600","journal-title":"Diagn Inter Imaging"},{"key":"2034_CR19","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1148\/radiol.2021203886","volume":"300","author":"L Duron","year":"2021","unstructured":"Duron L, Ducarouge A, Gillibert A et al (2021) Assessment of an AI aid in detection of adult appendicular skeletal fractures by emergency physicians and radiologists: a multicenter cross-sectional diagnostic study. Radiology 300:120\u2013129","journal-title":"Radiology"},{"key":"2034_CR20","doi-asserted-by":"publisher","first-page":"596","DOI":"10.3390\/diagnostics14060596","volume":"14","author":"M Meetschen","year":"2024","unstructured":"Meetschen M, Salh\u00f6fer L, Beck N et al (2024) AI-assisted X-ray fracture detection in residency training: evaluation in pediatric and adult trauma patients. Diagnostics (Basel) 14:596","journal-title":"Diagnostics (Basel)"},{"key":"2034_CR21","doi-asserted-by":"publisher","first-page":"1535","DOI":"10.1177\/02841851211043839","volume":"63","author":"X Liu","year":"2022","unstructured":"Liu X, Wu D, Xie H et al (2022) Clinical evaluation of AI software for rib fracture detection and its impact on junior radiologist performance. Acta Radiol 63:1535\u20131545","journal-title":"Acta Radiol"},{"key":"2034_CR22","first-page":"011","volume":"6","author":"R Bachmann","year":"2024","unstructured":"Bachmann R, Gunes G, Hangaard S et al (2024) Improving traumatic fracture detection on radiographs with artificial intelligence support: a multi-reader study. BJR Open 6:011","journal-title":"BJR Open"},{"key":"2034_CR23","doi-asserted-by":"publisher","first-page":"223","DOI":"10.3390\/life13010223","volume":"13","author":"J Oppenheimer","year":"2023","unstructured":"Oppenheimer J, L\u00fcken S, Hamm B, Niehues SM (2023) A prospective approach to integration of AI fracture detection software in radiographs into clinical workflow. Life 13:223","journal-title":"Life"},{"key":"2034_CR24","unstructured":"Sahil S, Singh S, Tanamala S et al (2024) Advanced deep learning technique for classification of musculoskeletal abnormalities: a focus on fractures, lesions, osteopenia, osteoarthritis, and dislocations in radiographic imaging. In: Proceedings of ECR 2024, European Society of Radiology, Vienna"},{"key":"2034_CR25","doi-asserted-by":"publisher","first-page":"1076","DOI":"10.1007\/s00330-024-10969-0","volume":"35","author":"J Paramasamy","year":"2025","unstructured":"Paramasamy J, Mandal S, Blomjous M et al (2025) Validation of a commercially available CAD-system for lung nodule detection and characterization using CT-scans. Eur Radiol 35:1076\u20131088","journal-title":"Eur Radiol"},{"key":"2034_CR26","doi-asserted-by":"publisher","first-page":"3974","DOI":"10.1007\/s00330-022-09349-3","volume":"33","author":"M Cohen","year":"2023","unstructured":"Cohen M, Puntonet J, Sanchez J et al (2023) Artificial intelligence vs. radiologist: accuracy of wrist fracture detection on radiographs. Eur Radiol 33:3974\u20133983","journal-title":"Eur Radiol"},{"key":"2034_CR27","doi-asserted-by":"publisher","first-page":"2118","DOI":"10.1016\/j.acra.2023.06.016","volume":"30","author":"V Bousson","year":"2023","unstructured":"Bousson V, Attan\u00e9 G, Benoist N et al (2023) Artificial intelligence for detecting acute fractures in patients admitted to an emergency department: real-life performance of three commercial algorithms. Acad Radiol 30:2118\u20132139","journal-title":"Acad Radiol"},{"key":"2034_CR28","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1186\/s13244-023-01599-z","volume":"15","author":"BJ Boverhof","year":"2024","unstructured":"Boverhof BJ, Redekop WK, Bos D et al (2024) Radiology AI Deployment and Assessment Rubric (RADAR) to bring value-based AI into radiological practice. Insights Imaging 15:34","journal-title":"Insights Imaging"}],"container-title":["Insights into Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13244-025-02034-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13244-025-02034-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13244-025-02034-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,3]],"date-time":"2025-07-03T13:53:17Z","timestamp":1751550797000},"score":1,"resource":{"primary":{"URL":"https:\/\/insightsimaging.springeropen.com\/articles\/10.1186\/s13244-025-02034-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,3]]},"references-count":28,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["2034"],"URL":"https:\/\/doi.org\/10.1186\/s13244-025-02034-1","relation":{},"ISSN":["1869-4101"],"issn-type":[{"value":"1869-4101","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,3]]},"assertion":[{"value":"4 December 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 June 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 July 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Institutional Review Board approval was not required because the test subjects were not subjected to an action, and no behavior was imposed on them, both as intended in the Dutch Medical Research Involving Human Subjects Act (WMO).","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"The need to collect informed consent was waived because all of the following apply: (1) Explicit consent is impossible or can only be obtained with disproportionate efforts. (2) The research must serve a general (public health) interest. (3) The processing must be necessary for scientific or historical research or statistical purposes. (4) In the execution, safeguards must be provided to ensure that the patient\u2019s personal privacy is not disproportionately affected. (5) The patient has not objected to the use of data.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"Authors S.S., A.K., R.K., S.T., S.Sat., R.A. and S.C. are full-time paid employees of Qure.ai. Author E.O.\u2019s conflict of interest is: Research support and grant, General Electric Healthcare. Author J.V. conflicts of interest are the following: Grant to institution from Qure.ai, Enlitic; consulting fees from Tegus; payment to institution for lectures from Roche; travel grant from Qure.ai; participation on a data safety monitoring board or advisory board from Contextflow, Noaber Foundation, and NLC Ventures; leadership or fiduciary role on the steering committee of the PINPOINT Project (payment to institution from AstraZeneca) and RSNA Common Data Elements Steering Committee (unpaid); phantom shares in Contextflow and Quibim; member editorial board\n                      European Journal of Radiology\n                      (unpaid); chair scientific committee EuSoMII; chair ESR value-based radiology subcommittee. Authors H.R., J.P. and D.B. declare that they have no known competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"150"}}