{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:47:04Z","timestamp":1782845224931,"version":"3.54.5"},"reference-count":28,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Ment Health"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n Mental, emotional, and behavioral disorders are chronic pediatric conditions, and their prevalence has been on the rise over recent decades. Affected children have long-term health sequelae and a decline in health-related quality of life. Due to the lack of a validated database for pharmacoepidemiological research on selected mental, emotional, and behavioral disorders, there is uncertainty in their reported prevalence in the literature.<\/jats:p>\n <\/jats:sec>\n \n Objectives<\/jats:title>\n \n We aimed to evaluate the accuracy of coding related to pediatric mental, emotional, and behavioral disorders in a large integrated health care system\u2019s electronic health records (EHRs) and compare the coding quality before and after the implementation of the\n International Classification of Diseases, Tenth Revision, Clinical Modification<\/jats:italic>\n (\n ICD-10-CM<\/jats:italic>\n ) coding as well as before and after the COVID-19 pandemic.\n <\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n \n Medical records of 1200 member children aged 2-17 years with at least 1 clinical visit before the COVID-19 pandemic (January 1, 2012, to December 31, 2014, the\n ICD-9-CM<\/jats:italic>\n coding period; and January 1, 2017, to December 31, 2019, the\n ICD-10-CM<\/jats:italic>\n coding period) and after the COVID-19 pandemic (January 1, 2021, to December 31, 2022) were selected with stratified random sampling from EHRs for chart review. Two trained research associates reviewed the EHRs for all potential cases of autism spectrum disorder (ASD), attention-deficit hyperactivity disorder (ADHD), major depression disorder (MDD), anxiety disorder (AD), and disruptive behavior disorders (DBD) in children during the study period. Children were considered cases only if there was a mention of any one of the conditions (yes for diagnosis) in the electronic chart during the corresponding time period. The validity of diagnosis codes was evaluated by directly comparing them with the gold standard of chart abstraction using sensitivity, specificity, positive predictive value, negative predictive value, the summary statistics of the\n F<\/jats:italic>\n -score, and Youden\n J<\/jats:italic>\n statistic. \u03ba statistic for interrater reliability among the 2 abstractors was calculated.\n <\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n \n The overall agreement between the identification of mental, behavioral, and emotional conditions using diagnosis codes compared to medical record abstraction was strong and similar across the\n ICD-9-CM<\/jats:italic>\n and\n ICD-10-CM<\/jats:italic>\n coding periods as well as during the prepandemic and pandemic time periods. The performance of AD coding, while strong, was relatively lower compared to the other conditions. The weighted sensitivity, specificity, positive predictive value, and negative predictive value for each of the 5 conditions were as follows: 100%, 100%, 99.2%, and 100%, respectively, for ASD; 100%, 99.9%, 99.2%, and 100%, respectively, for ADHD; 100%, 100%, 100%, and 100%, respectively for DBD; 87.7%, 100%, 100%, and 99.2%, respectively, for AD; and 100%, 100%, 99.2%, and 100%, respectively, for MDD. The\n F<\/jats:italic>\n -score and Youden\n J<\/jats:italic>\n statistic ranged between 87.7% and 100%. The overall agreement between abstractors was almost perfect (\u03ba=95%).\n <\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n Diagnostic codes are quite reliable for identifying selected childhood mental, behavioral, and emotional conditions. The findings remained similar during the pandemic and after the implementation of the ICD-10-CM coding in the EHR system.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/56812","type":"journal-article","created":{"date-parts":[[2024,4,9]],"date-time":"2024-04-09T07:39:39Z","timestamp":1712648379000},"page":"e56812-e56812","source":"Crossref","is-referenced-by-count":8,"title":["Coding of Childhood Psychiatric and Neurodevelopmental Disorders in Electronic Health Records of a Large Integrated Health Care System: Validation Study"],"prefix":"10.2196","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8397-3729","authenticated-orcid":false,"given":"Jiaxiao M","family":"Shi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0698-6419","authenticated-orcid":false,"given":"Vicki Y","family":"Chiu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1753-5549","authenticated-orcid":false,"given":"Chantal C","family":"Avila","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-8589-6692","authenticated-orcid":false,"given":"Sierra","family":"Lewis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-6189-4106","authenticated-orcid":false,"given":"Daniella","family":"Park","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2350-6990","authenticated-orcid":false,"given":"Morgan R","family":"Peltier","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3610-8841","authenticated-orcid":false,"given":"Darios","family":"Getahun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2024,5,14]]},"reference":[{"key":"R1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpeds.2024.113997","article-title":"Rising trends of childhood attention-deficit\/hyperactivity disorder in a large integrated healthcare delivery system in Southern California, 2010-2021","volume":"269","author":"Khadka","journal-title":"J Pediatr"},{"issue":"7","key":"R2","doi-asserted-by":"publisher","DOI":"10.1001\/jamapediatrics.2022.0056","article-title":"Five-year trends in US children's health and well-being, 2016-2020","volume":"176","author":"Lebrun-Harris","journal-title":"JAMA Pediatr"},{"key":"R3","unstructured":"Natality information. Centers for Disease Control and Prevention. URL: https:\/\/wonder.cdc.gov\/natality.html [Accessed 25-12-2023]"},{"key":"R4","doi-asserted-by":"publisher","DOI":"10.15585\/mmwr.su7102a1","article-title":"Mental health surveillance among children","volume":"71","author":"Bitsko","journal-title":"MMWR"},{"issue":"2","key":"R5","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1111\/j.1475-6773.2004.00234.x","article-title":"Delays in initial treatment contact after first onset of a mental disorder","volume":"39","author":"Wang","journal-title":"Health Serv Res"},{"issue":"1","key":"R6","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1017\/S0033291714000129","article-title":"What is the impact of mental health-related stigma on help-seeking? A systematic review of quantitative and qualitative studies","volume":"45","author":"Clement","journal-title":"Psychol Med"},{"key":"R7","doi-asserted-by":"publisher","DOI":"10.1016\/j.puhip.2021.100204","article-title":"Increasing rate of diagnosed childhood mental illness in the United States: incidence, prevalence and costs","volume":"2","author":"Tkacz","journal-title":"Public Health Pract (Oxf)"},{"key":"R8","unstructured":"AAP-AACAP-CHA declaration of a national emergency in child and adolescent mental health. American Academy of Pediatrics. URL: https:\/\/www.aap.org\/en\/advocacy\/child-and-adolescent-healthy-mental-development\/aap-aacap-cha- declaration-of-a-national-emergency- in-child-and-adolescent-mental-health\/ [Accessed 25-12-2023]"},{"issue":"10","key":"R9","doi-asserted-by":"publisher","first-page":"980","DOI":"10.1016\/j.jaac.2010.05.017","article-title":"Lifetime prevalence of mental disorders in U.S. adolescents: results from the National Comorbidity Survey Replication--Adolescent Supplement (NCS-A)","volume":"49","author":"Merikangas","journal-title":"J Am Acad Child Adolesc Psychiatry"},{"issue":"1","key":"R10","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1016\/j.chc.2021.08.001","article-title":"Social and relational health risks and common mental health problems among US children: the mitigating role of family resilience and connection to promote positive socioemotional and school-related outcomes","volume":"31","author":"Bethell","journal-title":"Child Adolesc Psychiatr Clin N Am"},{"issue":"3","key":"R11","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1111\/jcpp.12381","article-title":"Annual research review: a meta-analysis of the worldwide prevalence of mental disorders in children and adolescents","volume":"56","author":"Polanczyk","journal-title":"J Child Psychol Psychiatry"},{"key":"R12","unstructured":"World Health Organization. ICD-10: International Statistical Classification of Diseases and Related Health Problems: Tenth Revision. 2nded. World Health Organization; 2004. URL: https:\/\/iris.who.int\/handle\/10665\/42980 [Accessed 07-05-2024]"},{"key":"R13","unstructured":"HITECH Act. HIPAA Survival Guide; 2009. URL: https:\/\/www.hipaasurvivalguide.com\/hitech-act-text.php [Accessed 25-12-2023]"},{"issue":"8","key":"R14","doi-asserted-by":"publisher","first-page":"1416","DOI":"10.1377\/hlthaff.2016.1651","article-title":"HITECH Act drove large gains in hospital electronic health record adoption","volume":"36","author":"Adler-Milstein","journal-title":"Health Aff (Millwood)"},{"issue":"3","key":"R15","doi-asserted-by":"publisher","first-page":"37","DOI":"10.7812\/TPP\/12-031","article-title":"Sociodemographic characteristics of members of a large, integrated health care system: comparison with US Census Bureau data","volume":"16","author":"Koebnick","journal-title":"Perm J"},{"issue":"4","key":"R16","doi-asserted-by":"publisher","first-page":"492","DOI":"10.1080\/15374416.2010.486321","article-title":"Mental disorders in five-year-old children with or without developmental delay: focus on ADHD","volume":"39","author":"Baker","journal-title":"J Clin Child Adolesc Psychol"},{"issue":"6","key":"R17","doi-asserted-by":"publisher","first-page":"694","DOI":"10.1001\/archpsyc.63.6.694","article-title":"Autism from 2 to 9 years of age","volume":"63","author":"Lord","journal-title":"Arch Gen Psychiatry"},{"issue":"1-3","key":"R18","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1016\/j.jad.2008.03.026","article-title":"The clinical significance of preschool depression: impairment in functioning and clinical markers of the disorder","volume":"112","author":"Luby","journal-title":"J Affect Disord"},{"issue":"1","key":"R19","doi-asserted-by":"publisher","first-page":"15376","DOI":"10.1038\/s41598-023-42412-7","article-title":"Anxiety and depression from age 3 to 8 years in children with and without ADHD symptoms","volume":"13","author":"Ingeborgrud","journal-title":"Sci Rep"},{"issue":"3","key":"R20","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1055\/s-0036-1597624","article-title":"Association of perinatal risk factors with autism spectrum disorder","volume":"34","author":"Getahun","journal-title":"Am J Perinatol"},{"issue":"3","key":"R21","doi-asserted-by":"publisher","first-page":"282","DOI":"10.1001\/2013.jamapediatrics.401","article-title":"Recent trends in childhood attention-deficit\/hyperactivity disorder","volume":"167","author":"Getahun","journal-title":"JAMA Pediatr"},{"issue":"5","key":"R22","doi-asserted-by":"publisher","first-page":"360","DOI":"10.7326\/M15-2957","article-title":"Screening for depression in children and adolescents: U.S. Preventive Services Task Force recommendation statement","volume":"164","author":"Siu","journal-title":"Ann Intern Med"},{"issue":"1","key":"R23","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1136\/amiajnl-2011-000681","article-title":"Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research","volume":"20","author":"Weiskopf","journal-title":"J Am Med Inform Assoc"},{"issue":"7","key":"R24","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0159621","article-title":"Electronic health record based algorithm to identify patients with autism spectrum disorder","volume":"11","author":"Lingren","journal-title":"PLoS One"},{"issue":"11","key":"R25","doi-asserted-by":"publisher","DOI":"10.2196\/10497","article-title":"Automated extraction of diagnostic criteria from electronic health records for autism spectrum disorders: development, evaluation, and application","volume":"20","author":"Leroy","journal-title":"J Med Internet Res"},{"key":"R26","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-biodatasci-020722-125454","article-title":"A review of and roadmap for data science and machine learning for the neuropsychiatric phenotype of autism","volume":"6","author":"Washington","journal-title":"Annu Rev Biomed Data Sci"},{"issue":"1","key":"R27","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1186\/s11689-022-09447-9","article-title":"An electronic health record (EHR) phenotype algorithm to identify patients with attention deficit hyperactivity disorders (ADHD) and psychiatric comorbidities","volume":"14","author":"Slaby","journal-title":"J Neurodev Disord"},{"issue":"6","key":"R28","doi-asserted-by":"publisher","first-page":"546","DOI":"10.1093\/aje\/kwg016","article-title":"Training, quality assurance, and assessment of medical record abstraction in a multisite study","volume":"157","author":"Reisch","journal-title":"Am J Epidemiol"}],"container-title":["JMIR Mental Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/mental.jmir.org\/2024\/1\/e56812","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T17:46:17Z","timestamp":1782841577000},"score":1,"resource":{"primary":{"URL":"https:\/\/mental.jmir.org\/2024\/1\/e56812"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,14]]},"references-count":28,"URL":"https:\/\/doi.org\/10.2196\/56812","relation":{},"ISSN":["2368-7959"],"issn-type":[{"value":"2368-7959","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,14]]},"article-number":"v11i7e56812"}}