{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,8]],"date-time":"2026-09-08T10:20:12Z","timestamp":1788862812223,"version":"build-2803163510"},"reference-count":49,"publisher":"Public Library of Science (PLoS)","issue":"9","license":[{"start":{"date-parts":[[2021,9,23]],"date-time":"2021-09-23T00:00:00Z","timestamp":1632355200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"medical research future fund practitioner fellowship","award":["MRF1139686"],"award-info":[{"award-number":["MRF1139686"]}]},{"DOI":"10.13039\/501100000925","name":"national health and medical research council","doi-asserted-by":"publisher","award":["NHMRC- APP2003537"],"award-info":[{"award-number":["NHMRC- APP2003537"]}],"id":[{"id":"10.13039\/501100000925","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001250","name":"transport accident commission","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001250","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:sec id=\"sec001\"><jats:title>Background<\/jats:title><jats:p>Distal radius (wrist) fractures are the second most common fracture admitted to hospital. The anatomical pattern of these types of injuries is diverse, with variation in clinical management, guidelines for management remain inconclusive, and the uptake of findings from clinical trials into routine practice limited. Robust predictive modelling, which considers both the characteristics of the fracture and patient, provides the best opportunity to reduce variation in care and improve patient outcomes. This type of data is housed in unstructured data sources with no particular format or schema. The \u201cPredicting fracture outcomes from clinical Registry data using Artificial Intelligence (AI) Supplemented models for Evidence-informed treatment (PRAISE)\u201d study aims to use AI methods on unstructured data to describe the fracture characteristics and test if using this information improves identification of key fracture characteristics and prediction of patient-reported outcome measures and clinical outcomes following wrist fractures compared to prediction models based on standard registry data.<\/jats:p><\/jats:sec><jats:sec id=\"sec002\"><jats:title>Methods and design<\/jats:title><jats:p>Adult (16+ years) patients presenting to the emergency department, treated in a short stay unit, or admitted to hospital for &gt;24h for management of a wrist fracture in four Victorian hospitals will be included in this study. The study will use routine registry data from the Victorian Orthopaedic Trauma Outcomes Registry (VOTOR), and electronic medical record (EMR) information (e.g. X-rays, surgical reports, radiology reports, images). A multimodal deep learning fracture reasoning system (DLFRS) will be developed that reasons on EMR information. Machine learning prediction models will test the performance with\/without output from the DLFRS.<\/jats:p><\/jats:sec><jats:sec id=\"sec003\"><jats:title>Discussion<\/jats:title><jats:p>The PRAISE study will establish the use of AI techniques to provide enhanced information about fracture characteristics in people with wrist fractures. Prediction models using AI derived characteristics are expected to provide better prediction of clinical and patient-reported outcomes following distal radius fracture.<\/jats:p><\/jats:sec>","DOI":"10.1371\/journal.pone.0257361","type":"journal-article","created":{"date-parts":[[2021,9,24]],"date-time":"2021-09-24T14:41:53Z","timestamp":1632494513000},"page":"e0257361","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":22,"title":["Predicting fracture outcomes from clinical registry data using artificial intelligence supplemented models for evidence-informed treatment (PRAISE) study protocol"],"prefix":"10.1371","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7543-0687","authenticated-orcid":true,"given":"Joanna F.","family":"Dipnall","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard","family":"Page","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9925-0223","authenticated-orcid":true,"given":"Lan","family":"Du","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew","family":"Costa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ronan A.","family":"Lyons","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Cameron","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard","family":"de Steiger","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Raphael","family":"Hau","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew","family":"Bucknill","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew","family":"Oppy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elton","family":"Edwards","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dinesh","family":"Varma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Myong Chol","family":"Jung","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7096-7688","authenticated-orcid":true,"given":"Belinda J.","family":"Gabbe","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2021,9,23]]},"reference":[{"key":"pone.0257361.ref001","volume-title":"Injury research and statistics series no. 95. Cat. no. INJCAT 171","author":"S. Pointer","year":"2015"},{"issue":"2","key":"pone.0257361.ref002","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1016\/j.hcl.2012.02.001","article-title":"The epidemiology of distal radius fractures","volume":"28","author":"KW Nellans","year":"2012","journal-title":"Hand clinics"},{"key":"pone.0257361.ref003","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.bone.2016.03.006","article-title":"Epidemiology of fractures in the United Kingdom 1988\u20132012: variation with age, sex, geography, ethnicity and socioeconomic status","volume":"87","author":"EM Curtis","year":"2016","journal-title":"Bone"},{"issue":"3","key":"pone.0257361.ref004","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1308\/rcsann.2019.0002","article-title":"Fracture admission trends in England over a ten-year period","volume":"101","author":"T Jennison","year":"2019","journal-title":"The Annals of The Royal College of Surgeons of England"},{"issue":"3","key":"pone.0257361.ref005","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1016\/S0895-4356(98)00167-X","article-title":"Fracture risk in the US Medicare population","volume":"52","author":"JA Barrett","year":"1999","journal-title":"Journal of clinical epidemiology"},{"issue":"1","key":"pone.0257361.ref006","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1097\/01.TA.0000038544.45839.3D","article-title":"Number, incidence, and projections of distal forearm fractures admitted to hospital in Australia","volume":"55","author":"AE Wigg","year":"2003","journal-title":"Journal of Trauma and Acute Care Surgery"},{"key":"pone.0257361.ref007","doi-asserted-by":"crossref","DOI":"10.1136\/bmjqs-2019-010513","volume-title":"Best evidence, but does it really change practice?:","author":"RN de Steiger","year":"2020"},{"issue":"12","key":"pone.0257361.ref008","doi-asserted-by":"crossref","first-page":"1550","DOI":"10.1302\/0301-620X.101B12.BJJ-2018-1615.R3","article-title":"Trends in the management of fractures of the distal radius in Ireland: did the Distal Radius Acute Fracture Fixation Trial (DRAFFT) change practice?","volume":"101","author":"R Mc Colgan","year":"2019","journal-title":"The bone & joint journal"},{"issue":"17","key":"pone.0257361.ref009","doi-asserted-by":"crossref","DOI":"10.3310\/hta19170","article-title":"UK DRAFFT: a randomised controlled trial of percutaneous fixation with Kirschner wires versus volar locking-plate fixation in the treatment of adult patients with a dorsally displaced fracture of the distal radius","volume":"19","author":"ML Costa","year":"2015","journal-title":"Health Technology Assessment"},{"issue":"2","key":"pone.0257361.ref010","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1177\/1558944717691133","article-title":"Distal radius fractures: AAOS appropriate use criteria versus actual management at a level I trauma center","volume":"13","author":"JC Kyriakedes","year":"2018","journal-title":"HAND"},{"issue":"13","key":"pone.0257361.ref011","doi-asserted-by":"crossref","first-page":"e596","DOI":"10.5435\/JAAOS-D-18-00424","article-title":"Interventions for distal radius fractures: a network meta-analysis of randomized trials","volume":"27","author":"C Vannabouathong","year":"2019","journal-title":"JAAOS-Journal of the American Academy of Orthopaedic Surgeons"},{"key":"pone.0257361.ref012","unstructured":"Moran C. The patient and the injury: decision making in trauma surgery. Third Edition ed2018. 73\u201382 p."},{"issue":"6","key":"pone.0257361.ref013","doi-asserted-by":"crossref","first-page":"841","DOI":"10.1177\/0269215518754614","article-title":"The impact of wrist fracture, surgical repair and immobilization on patients: a qualitative study","volume":"32","author":"NJ Watson","year":"2018","journal-title":"Clinical rehabilitation"},{"issue":"8","key":"pone.0257361.ref014","doi-asserted-by":"crossref","first-page":"978","DOI":"10.1302\/0301-620X.101B8.BJJ-2018-1285.R1","article-title":"Percutaneous fixation with Kirschner wires versus volar locking-plate fixation in adults with dorsally displaced fracture of distal radius: five-year follow-up of a randomized controlled trial","volume":"101","author":"M Costa","year":"2019","journal-title":"The bone & joint journal"},{"issue":"3","key":"pone.0257361.ref015","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1001\/jamasurg.2020.5672","article-title":"Surgical Plating vs Closed Reduction for Fractures in the Distal Radius in Older Patients: A Randomized Clinical Trial","volume":"156","author":"A Lawson","year":"2021","journal-title":"JAMA surgery"},{"issue":"21","key":"pone.0257361.ref016","doi-asserted-by":"crossref","first-page":"1799","DOI":"10.2106\/JBJS.O.00134","article-title":"Database and registry research in orthopaedic surgery: part 2: clinical registry data","volume":"97","author":"AJ Pugely","year":"2015","journal-title":"JBJS"},{"issue":"2","key":"pone.0257361.ref017","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1016\/j.surg.2014.08.097","article-title":"Clinical registries and quality measurement in surgery: a systematic review","volume":"157","author":"AM Stey","year":"2015","journal-title":"Surgery"},{"key":"pone.0257361.ref018","doi-asserted-by":"crossref","first-page":"66","DOI":"10.3389\/fmed.2019.00066","article-title":"The revival of the notes field: leveraging the unstructured content in electronic health records","volume":"6","author":"M Assale","year":"2019","journal-title":"Frontiers in medicine"},{"issue":"1","key":"pone.0257361.ref019","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12911-018-0623-9","article-title":"CogStack-experiences of deploying integrated information retrieval and extraction services in a large National Health Service Foundation Trust hospital","volume":"18","author":"R Jackson","year":"2018","journal-title":"BMC medical informatics and decision making"},{"issue":"10","key":"pone.0257361.ref020","doi-asserted-by":"crossref","first-page":"e65","DOI":"10.1097\/MLR.0000000000000108","article-title":"Overcoming the Challenges of Unstructured Data in Multi-site, Electronic Medical Record-based Abstraction","volume":"54","author":"B Polnaszek","year":"2016","journal-title":"Medical care"},{"key":"pone.0257361.ref021","doi-asserted-by":"crossref","unstructured":"Tanwar M, Duggal R, Khatri SK, editors. Unravelling unstructured data: A wealth of information in big data. 2015 4th International Conference on Reliability, Infocom Technologies and Optimization (ICRITO)(Trends and Future Directions); 2015: IEEE.","DOI":"10.1109\/ICRITO.2015.7359270"},{"key":"pone.0257361.ref022","unstructured":"Andriole S. Unstructured data: The other side of analytics. Forbes[Online] Available: http:\/\/www.forbes.com\/sites\/steveandriole\/2015\/03\/05\/the-otherside-of-analytics. 2015."},{"issue":"1","key":"pone.0257361.ref023","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12911-020-01297-6","article-title":"Combining structured and unstructured data for predictive models: a deep learning approach","volume":"20","author":"D Zhang","year":"2020","journal-title":"BMC medical informatics and decision making"},{"issue":"3","key":"pone.0257361.ref024","doi-asserted-by":"crossref","first-page":"506","DOI":"10.2214\/AJR.19.21117","article-title":"Artificial intelligence in musculoskeletal imaging: current status and future directions","volume":"213","author":"S Gyftopoulos","year":"2019","journal-title":"American Journal of Roentgenology"},{"issue":"2","key":"pone.0257361.ref025","doi-asserted-by":"crossref","first-page":"e7","DOI":"10.2106\/JBJS.O.00494","article-title":"The evolving role of clinical registries: existing practices and opportunities for orthopaedic surgeons","volume":"98","author":"CJ Dy","year":"2016","journal-title":"JBJS"},{"key":"pone.0257361.ref026","doi-asserted-by":"crossref","first-page":"105279","DOI":"10.1016\/j.aap.2019.105279","article-title":"The road to recovery for vulnerable road users hospitalised for orthopaedic injury following an on-road crash","volume":"132","author":"A Devlin","year":"2019","journal-title":"Accident Analysis & Prevention"},{"issue":"12","key":"pone.0257361.ref027","doi-asserted-by":"crossref","first-page":"2845","DOI":"10.3390\/ijerph15122845","article-title":"Incidence, costs and predictors of non-union, delayed union and mal-union following long bone fracture","volume":"15","author":"CL Ekegren","year":"2018","journal-title":"International journal of environmental research and public health"},{"issue":"4","key":"pone.0257361.ref028","doi-asserted-by":"crossref","first-page":"946","DOI":"10.1016\/j.injury.2016.11.012","article-title":"Patient reported health related quality of life early outcomes at 12 months after surgically managed tibial plafond fracture","volume":"48","author":"LJ Bonato","year":"2017","journal-title":"Injury"},{"issue":"15","key":"pone.0257361.ref029","doi-asserted-by":"crossref","first-page":"1278","DOI":"10.2106\/JBJS.N.01260","article-title":"Database and registry research in orthopaedic surgery: part I: claims-based data","volume":"97","author":"AJ Pugely","year":"2015","journal-title":"JBJS"},{"issue":"4","key":"pone.0257361.ref030","doi-asserted-by":"crossref","first-page":"734","DOI":"10.2214\/AJR.18.19869","article-title":"Automatic disease annotation from radiology reports using artificial intelligence implemented by a recurrent neural network","volume":"212","author":"C Lee","year":"2019","journal-title":"American Journal of Roentgenology"},{"issue":"6","key":"pone.0257361.ref031","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1080\/17453674.2017.1344459","article-title":"Artificial intelligence for analyzing orthopedic trauma radiographs: deep learning algorithms\u2014are they on par with humans for diagnosing fractures?","volume":"88","author":"J Olczak","year":"2017","journal-title":"Acta orthopaedica"},{"issue":"6","key":"pone.0257361.ref032","doi-asserted-by":"crossref","first-page":"696","DOI":"10.1197\/jamia.M1995","article-title":"Identifying wrist fracture patients with high accuracy by automatic categorization of X-ray reports","volume":"13","author":"B de Bruijn","year":"2006","journal-title":"Journal of the American Medical Informatics Association"},{"issue":"4","key":"pone.0257361.ref033","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1080\/17453674.2019.1600125","article-title":"Artificial intelligence detection of distal radius fractures: a comparison between the convolutional neural network and professional assessments","volume":"90","author":"K Gan","year":"2019","journal-title":"Acta orthopaedica"},{"issue":"3","key":"pone.0257361.ref034","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1097\/TA.0b013e3181e5125b","article-title":"Population-based capture of long-term functional and quality of life outcomes after major trauma: the experiences of the Victorian State Trauma Registry","volume":"69","author":"BJ Gabbe","year":"2010","journal-title":"Journal of Trauma and Acute Care Surgery"},{"issue":"10","key":"pone.0257361.ref035","doi-asserted-by":"crossref","first-page":"1396","DOI":"10.1302\/0301-620X.95B10.32134","article-title":"The imaging and classification of severe pelvic ring fractures: experiences from two level 1 trauma centres","volume":"95","author":"BJ Gabbe","year":"2013","journal-title":"The bone & joint journal"},{"issue":"10","key":"pone.0257361.ref036","first-page":"YE01","article-title":"Requirements for minimum sample size for sensitivity and specificity analysis","volume":"10","author":"MA Bujang","year":"2016","journal-title":"Journal of clinical and diagnostic research: JCDR"},{"key":"pone.0257361.ref037","article-title":"Publicly available clinical BERT embeddings","author":"E Alsentzer","year":"2019","journal-title":"arXiv preprint"},{"key":"pone.0257361.ref038","article-title":"Bert: Pre-training of deep bidirectional transformers for language understanding","author":"J Devlin","year":"2018","journal-title":"arXiv preprint"},{"issue":"4","key":"pone.0257361.ref039","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1093\/bioinformatics\/btz682","article-title":"BioBERT: a pre-trained biomedical language representation model for biomedical text mining","volume":"36","author":"J Lee","year":"2020","journal-title":"Bioinformatics"},{"key":"pone.0257361.ref040","article-title":"Very deep convolutional networks for large-scale image recognition.","author":"K Simonyan","year":"2014","journal-title":"arXiv preprint"},{"key":"pone.0257361.ref041","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J, editors. Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition; 2016.","DOI":"10.1109\/CVPR.2016.90"},{"key":"pone.0257361.ref042","doi-asserted-by":"crossref","unstructured":"Yang Z, Yang D, Dyer C, He X, Smola A, Hovy E, editors. Hierarchical attention networks for document classification. Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: human language technologies; 2016.","DOI":"10.18653\/v1\/N16-1174"},{"key":"pone.0257361.ref043","article-title":"Explainable prediction of medical codes from clinical text","author":"J Mullenbach","year":"2018","journal-title":"arXiv preprint"},{"issue":"1","key":"pone.0257361.ref044","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1002\/wics.1282","article-title":"Some recent statistical learning methods for longitudinal high\u2010dimensional data","volume":"6","author":"S Chen","year":"2014","journal-title":"Wiley Interdisciplinary Reviews: Computational Statistics."},{"issue":"2","key":"pone.0257361.ref045","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1080\/10618600.2013.773239","article-title":"Glmmlasso: an algorithm for high-dimensional generalized linear mixed models using \u21131-penalization","volume":"23","author":"J Schelldorfer","year":"2014","journal-title":"Journal of Computational and Graphical Statistics"},{"key":"pone.0257361.ref046","article-title":"LMLFM: Longitudinal Multi-Level Factorization Machines.","author":"J Liang","year":"2019","journal-title":"arXiv preprint"},{"issue":"3","key":"pone.0257361.ref047","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1016\/j.csda.2011.09.008","article-title":"A mixed effects least squares support vector machine model for classification of longitudinal data","volume":"56","author":"J Luts","year":"2012","journal-title":"Computational Statistics & Data Analysis"},{"issue":"6","key":"pone.0257361.ref048","doi-asserted-by":"crossref","first-page":"1313","DOI":"10.1080\/00949655.2012.741599","article-title":"Mixed-effects random forest for clustered data","volume":"84","author":"A Hajjem","year":"2014","journal-title":"Journal of Statistical Computation and Simulation"},{"key":"pone.0257361.ref049","unstructured":"Joshi R. Accuracy, Precision, Recall & F1 Score: Interpretation of Performance Measures; 2020. URL: https:\/\/blog.exsilio.com\/all\/accuracy-precision-recall-f1-score-interpretation-of performance-measures\/(visited on 18\/05\/2020)."}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0257361","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,9]],"date-time":"2023-11-09T09:45:56Z","timestamp":1699523156000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0257361"}},"subtitle":[],"editor":[{"given":"Lucinda","family":"Shen","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2021,9,23]]},"references-count":49,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2021,9,23]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0257361","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,23]]}}}