{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,17]],"date-time":"2026-08-17T23:44:21Z","timestamp":1787010261741,"version":"build-2736575974"},"reference-count":26,"publisher":"Ovid Technologies (Wolters Kluwer Health)","issue":"1","license":[{"start":{"date-parts":[[2024,2,29]],"date-time":"2024-02-29T00:00:00Z","timestamp":1709164800000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["lww.com","ovid.com"],"crossmark-restriction":true},"short-container-title":[],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objectives:<\/jats:title>\n                    <jats:p>The 10th revision of the International Classification of Diseases (ICD-10) coding system may prove useful to orthopaedic trauma researchers to identify and document populations based on comorbidities. However, its use for research first necessitates determination of its reliability. The purpose of this study was to assess the reliability of electronic medical record (EMR) ICD-10 coding of nonorthopaedic diagnoses in orthopaedic trauma patients relative to the gold standard of prospective data collection.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Design:<\/jats:title>\n                    <jats:p>Nonexperimental cross-sectional study.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Setting:<\/jats:title>\n                    <jats:p>Level 1 Trauma Center.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Patients\/Participants:<\/jats:title>\n                    <jats:p>Two hundred sixty-three orthopaedic trauma patients from 2 prior prospective studies from September 2018 to April 2022.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Intervention:<\/jats:title>\n                    <jats:p>Prospectively collected data were compared with EMR ICD-10 code abstraction for components of the Charlson Comorbidity Index (CCI), obesity, alcohol abuse, and tobacco use (retrospective data).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Main Outcome Measurements:<\/jats:title>\n                    <jats:p>Percent agreement and Cohen's kappa reliability.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>Percent agreement ranged from 86.7% to 96.9% for all CCI diagnoses and was as low as 72.6% for the diagnosis \u201coverweight.\u201d Only 2 diagnoses, diabetes without end-organ damage (kappa = 0.794) and AIDS (kappa = 0.798) demonstrated Cohen's kappa values to indicate substantial agreement.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion:<\/jats:title>\n                    <jats:p>EMR diagnostic coding for medical comorbidities in orthopaedic trauma patients demonstrated variable reliability. Researchers may be able to rely on EMR coding to identify patients with diabetes without complications or AIDS. Chart review may still be necessary to confirm diagnoses. Low prevalence of most comorbidities led to high percentage agreement with low reliability.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Level of Evidence:<\/jats:title>\n                    <jats:p>Level 1 diagnostic.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1097\/oi9.0000000000000307","type":"journal-article","created":{"date-parts":[[2024,2,29]],"date-time":"2024-02-29T08:00:28Z","timestamp":1709193628000},"update-policy":"https:\/\/doi.org\/10.1097\/lww.0000000000001000","source":"Crossref","is-referenced-by-count":2,"title":["Can researchers trust ICD-10 coding of medical comorbidities in orthopaedic trauma patients?"],"prefix":"10.1097","volume":"7","author":[{"given":"Rodney","family":"Arthur","sequence":"first","affiliation":[{"name":"University of North Carolina School of Medicine, Chapel Hill, NC"},{"name":"Department of Orthopaedic Surgery, Atrium Health Musculoskeletal Institute, Carolinas Medical Center, Charlotte, NC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"R. Miles","family":"Mayberry","sequence":"additional","affiliation":[{"name":"Wake Forest School of Medicine, Winston-Salem, NC"},{"name":"Department of Orthopaedic Surgery, Atrium Health Musculoskeletal Institute, Carolinas Medical Center, Charlotte, NC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Susan","family":"Odum","sequence":"additional","affiliation":[{"name":"Department of Orthopaedic Surgery, Atrium Health Musculoskeletal Institute, Carolinas Medical Center, Charlotte, NC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Laurence B.","family":"Kempton","sequence":"additional","affiliation":[{"name":"Department of Orthopaedic Surgery, Atrium Health Musculoskeletal Institute, Carolinas Medical Center, Charlotte, NC"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"name":"Evidence-Based Musculoskeletal Injury and Trauma Collaborative (EMIT)","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"276","published-online":{"date-parts":[[2024,3]]},"reference":[{"key":"R3-20250316","doi-asserted-by":"crossref","first-page":"139","DOI":"10.3109\/09286586.2015.1012274","article-title":"Accuracy of the international classification of diseases, ninth revision, clinical modification (ICD-9-CM) as a research tool for identification of patients with uveitis and scleritis","volume":"22","author":"Uchiyama","year":"2015","journal-title":"Ophthalmic Epidemiol."},{"key":"R4-20250316","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1001\/jamaophthalmol.2013.577","article-title":"Accuracy of international classification of diseases, ninth revision, clinical modification billing codes for common ophthalmic conditions","volume":"131","author":"Muir","year":"2013","journal-title":"JAMA Ophthalmol"},{"key":"R5-20250316","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1212\/WNL.49.3.660","article-title":"Inaccuracy of the International Classification of Diseases (ICD-9-CM) in identifying the diagnosis of ischemic cerebrovascular disease","volume":"49","author":"Benesch","year":"1997","journal-title":"Neurology"},{"key":"R6-20250316","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1002\/(SICI)1097-0274(199602)29:2<171::AID-AJIM7>3.0.CO;2-V","article-title":"Lack of concordance between the ICD-9 classification of soft tissue disorders of the neck and upper limb and chart review diagnosis: one steel Mill's experience","volume":"29","author":"Buchbinder","year":"1996","journal-title":"Am J Ind Med."},{"key":"R7-20250316","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1002\/1097-4679(199003)46:2<161::AID-JCLP2270460206>3.0.CO;2-8","article-title":"ICD-9-CM classification coding in psychiatry","volume":"46","author":"Dingemans","year":"1990","journal-title":"J Clin Psychol."},{"key":"R8-20250316","doi-asserted-by":"crossref","first-page":"1143","DOI":"10.2105\/AJPH.85.8_Pt_1.1143","article-title":"Using ICD-9 codes to identify indications for primary and repeat cesarean sections: agreement with clinical records","volume":"85","author":"Henry","year":"1995","journal-title":"Am J Public Health"},{"key":"R9-20250316","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1002\/ajh.10445","article-title":"Accuracy of identification of patients with immune thrombocytopenic purpura through administrative records: a data validation study","volume":"75","author":"Segal","year":"2004","journal-title":"Am J Hematol."},{"key":"R10-20250316","doi-asserted-by":"crossref","first-page":"648","DOI":"10.1002\/art.22682","article-title":"Accuracy of the diagnoses of spondylarthritides in veterans affairs medical center databases","volume":"57","author":"Singh","year":"2007","journal-title":"Arthritis Rheumat"},{"key":"R11-20250316","doi-asserted-by":"crossref","first-page":"801","DOI":"10.1097\/01.mlr.0000132391.59713.0d","article-title":"Validity of procedure codes in international classification of diseases, 9th revision, clinical modification administrative data","volume":"42","author":"Quan","year":"2004","journal-title":"Med Care"},{"key":"R12-20250316","doi-asserted-by":"crossref","first-page":"2053","DOI":"10.1212\/01.wnl.0000247281.98094.e2","article-title":"Accuracy and yield of ICD-9 codes for identifying children with ischemic stroke","volume":"67","author":"Golomb","year":"2006","journal-title":"Neurology"},{"key":"R13-20250316","doi-asserted-by":"crossref","first-page":"1424","DOI":"10.1111\/j.1475-6773.2007.00822.x","article-title":"Assessing validity of ICD-9-CM and ICD-10 administrative data in recording clinical conditions in a unique dually coded database","volume":"43","author":"Quan","year":"2008","journal-title":"Health Serv Res."},{"key":"R14-20250316","first-page":"912","article-title":"Accuracy and completeness of clinical coding using ICD-10 for ambulatory visits","volume":"2017","author":"Horsky","year":"2017","journal-title":"AMIA Annu Symp Proc"},{"key":"R17-20250316","doi-asserted-by":"crossref","first-page":"884","DOI":"10.1197\/j.aem.2005.04.021","article-title":"The accuracy and completeness of data collected by prospective and retrospective methods","volume":"12","author":"Nagurney","year":"2005","journal-title":"Acad Emerg Med."},{"key":"R18-20250316","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1111\/j.1553-2712.2011.01240.x","article-title":"More patients are triaged using the Emergency Severity Index than any other triage acuity system in the United States","volume":"19","author":"McHugh","year":"2012","journal-title":"Acad Emerg Med."},{"key":"R19-20250316","doi-asserted-by":"crossref","first-page":"E87","DOI":"10.3928\/01477447-20200107-02","article-title":"An assessment of international classification of diseases, 10th revision, clinical modification, codes used to describe common pediatric orthopedic conditions","volume":"43","author":"Rabenhorst","year":"2020","journal-title":"Orthopedics"},{"key":"R20-20250316","doi-asserted-by":"crossref","first-page":"752","DOI":"10.1016\/j.injury.2021.10.005","article-title":"ICD-10 codes do not accurately reflect ankle fracture injury patterns","volume":"53","author":"Seltzer","year":"2022","journal-title":"Injury"},{"key":"R21-20250316","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/j.jse.2008.10.005","article-title":"Intraobserver and interobserver agreement of International Classification of Diseases, Ninth Revision codes in classifying shoulder instability","volume":"18","author":"Throckmorton","year":"2009","journal-title":"J Shoulder Elbow Surg"},{"key":"R22-20250316","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1007\/s00198-011-1622-1","article-title":"The impact of subtrochanteric fracture criteria on hip fracture classification","volume":"23","author":"Huang","year":"2012","journal-title":"Osteoporos Int."},{"key":"R23-20250316","doi-asserted-by":"crossref","first-page":"2894","DOI":"10.1177\/0363546518790507","article-title":"Low accuracy of diagnostic codes to identify anterior cruciate ligament tear in orthopaedic database research","volume":"46","author":"Sanders","year":"2018","journal-title":"Am J Sports Med."},{"key":"R24-20250316","doi-asserted-by":"crossref","first-page":"29","DOI":"10.5435\/JAAOS-D-17-00874","article-title":"Reliability of international classification of disease-9 versus international classification of disease-10 coding for proximal femur fractures at a level 1 trauma center","volume":"28","author":"Schneble","year":"2020","journal-title":"J Am Acad Orthop Surg."},{"key":"R25-20250316","first-page":"368","article-title":"Accuracy of ICD-10 coding system for identifying comorbidities and infectious conditions using data from a Thai university hospital administrative database","volume":"99","author":"Rattanaumpawan","year":"2016","journal-title":"J Med Assoc Thai"},{"key":"R26-20250316","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1186\/1471-2288-11-83","article-title":"The predictive value of ICD-10 diagnostic coding used to assess Charlson comorbidity index conditions in the population-based Danish National Registry of Patients","volume":"11","author":"Thygesen","year":"2011","journal-title":"BMC Med Res Methodol."},{"key":"R27-20250316","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1186\/1472-6963-14-70","article-title":"Coding of obesity in administrative hospital discharge abstract data: accuracy and impact for future research studies","volume":"14","author":"Martin","year":"2014","journal-title":"BMC Health Serv Res."},{"key":"R28-20250316","doi-asserted-by":"crossref","first-page":"2623","DOI":"10.1111\/dom.14512","article-title":"Validation of obesity-related diagnosis codes in claims data","volume":"23","author":"Suissa","year":"2021","journal-title":"Diabetes Obes Metab."},{"key":"R29-20250316","first-page":"127","article-title":"Level of agreement between medical record and ICD-10-AM coding of mental health, alcohol and drug conditions in trauma patients","volume":"48","author":"Nguyen","year":"2019","journal-title":"Health Inf Manag."},{"key":"R30-20250316","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1097\/ADM.0000000000000307","article-title":"Accuracy of diagnosis and international classification of diseases; tenth revision coding for alcohol dependence, alcohol withdrawal, and alcohol-withdrawal delirium among inpatients at a university hospital","volume":"11","author":"Wansrisuthon","year":"2017","journal-title":"J Addict Med."}],"container-title":["OTA International"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.lww.com\/10.1097\/OI9.0000000000000307","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,16]],"date-time":"2025-03-16T19:00:46Z","timestamp":1742151646000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.lww.com\/10.1097\/OI9.0000000000000307"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,29]]},"references-count":26,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024]]}},"URL":"https:\/\/doi.org\/10.1097\/oi9.0000000000000307","relation":{},"ISSN":["2574-2167"],"issn-type":[{"value":"2574-2167","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,29]]},"assertion":[{"value":"2023-08-29","name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-12-02","name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}}]}}