{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,27]],"date-time":"2026-05-27T15:35:56Z","timestamp":1779896156850,"version":"3.53.1"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,4,25]],"date-time":"2020-04-25T00:00:00Z","timestamp":1587772800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2020,4,25]],"date-time":"2020-04-25T00:00:00Z","timestamp":1587772800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000024","name":"Canadian Institutes of Health Research","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000024","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n<jats:title>Background<\/jats:title>\n<jats:p>Data quality assessment presents a challenge for research using coded administrative health data. The objective of this study is to develop and validate a set of coding association rules for coded diagnostic data.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Methods<\/jats:title>\n<jats:p>We used the Canadian re-abstracted hospital discharge abstract data coded in International Classification of Disease, 10th revision (ICD-10) codes. Association rule mining was conducted on the re-abstracted data in four age groups (0\u20134, 20\u201344, 45\u201364; \u2265 65) to extract ICD-10 coding association rules at the three-digit (category of diagnosis) and four-digit levels (category of diagnosis with etiology, anatomy, or severity). The rules were reviewed by a panel of 5 physicians and 2 classification specialists using a modified Delphi rating process. We proposed and defined the variance and bias to assess data quality using the rules.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Results<\/jats:title>\n<jats:p>After the rule mining process and the panel review, 388 rules at the three-digit level and 275 rules at the four-digit level were developed. Half of the rules were from the age group of \u226565. Rules captured meaningful age-specific clinical associations, with rules at the age group of \u226565 being more complex and comprehensive than other age groups. The variance and bias can identify rules with high bias and variance in Alberta data and provides directions for quality improvement.<\/jats:p>\n<\/jats:sec><jats:sec>\n<jats:title>Conclusions<\/jats:title>\n<jats:p>A set of ICD-10 data quality rules were developed and validated by a clinical and classification expert panel. The rules can be used as a tool to assess ICD-coded data, enabling the monitoring and comparison of data quality across institutions, provinces, and countries.<\/jats:p>\n<\/jats:sec>","DOI":"10.1186\/s12911-020-1089-0","type":"journal-article","created":{"date-parts":[[2020,4,25]],"date-time":"2020-04-25T05:03:23Z","timestamp":1587791003000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["Development and validation of data quality rules in administrative health data using association rule mining"],"prefix":"10.1186","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0789-7175","authenticated-orcid":false,"given":"Mingkai","family":"Peng","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sangmin","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adam G.","family":"D\u2019Souza","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chelsea T. A.","family":"Doktorchik","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hude","family":"Quan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,4,25]]},"reference":[{"key":"1089_CR1","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1186\/s12911-015-0196-9","volume":"15","author":"K Lucyk","year":"2015","unstructured":"Lucyk K, Lu M, Sajobi T, Quan H. Administrative health data in Canada: lessons from history. BMC Med Inform Decis Mak. 2015;15:69. https:\/\/doi.org\/10.1186\/s12911-015-0196-9.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"3","key":"1089_CR2","doi-asserted-by":"publisher","first-page":"232","DOI":"10.4212\/cjhp.v68i3.1457","volume":"68","author":"SM Cadarette","year":"2015","unstructured":"Cadarette SM, Wong L. An introduction to health care administrative data. Can J Hosp Pharm. 2015;68(3):232\u20137. https:\/\/doi.org\/10.4212\/cjhp.v68i3.1457.","journal-title":"Can J Hosp Pharm"},{"issue":"1","key":"1089_CR3","doi-asserted-by":"publisher","first-page":"E49","DOI":"10.1503\/cmaj.101863","volume":"184","author":"C Robitaille","year":"2012","unstructured":"Robitaille C, Dai S, Waters C, et al. Diagnosed hypertension in Canada: incidence, prevalence and associated mortality. CMAJ. 2012;184(1):E49\u201356. https:\/\/doi.org\/10.1503\/cmaj.101863.","journal-title":"CMAJ."},{"key":"1089_CR4","doi-asserted-by":"publisher","first-page":"152","DOI":"10.1016\/j.cjca.2012.01.005","volume":"28","author":"H Quan","year":"2012","unstructured":"Quan H, Smith M, Bartlett-Esquilant G, et al. Mining administrative health databases to advance medical science: geographical considerations and untapped potential in Canada. CJCA. 2012;28:152\u20134. https:\/\/doi.org\/10.1016\/j.cjca.2012.01.005.","journal-title":"CJCA."},{"issue":"1","key":"1089_CR5","doi-asserted-by":"crossref","first-page":"31","DOI":"10.24095\/hpcdp.29.1.04","volume":"29","author":"LM Lix","year":"2008","unstructured":"Lix LM, Yogendran MS, Shaw SY, Burchill C, Metge C, Bond R. Population-based data sources for chronic disease surveillance. Chronic Dis Can. 2008;29(1):31\u20138 http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/19036221. Accessed 18 Jan 2019.","journal-title":"Chronic Dis Can"},{"issue":"1 PART 1","key":"1089_CR6","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1111\/j.1475-6773.2011.01290.x","volume":"47","author":"SE Dr\u00f6sler","year":"2012","unstructured":"Dr\u00f6sler SE, Romano PS, Tancredi DJ, Klazinga NS. International comparability of patient safety indicators in 15 OECD member countries: A methodological approach of adjustment by secondary diagnoses. Health Serv Res. 2012;47(1 PART 1):275\u201392. https:\/\/doi.org\/10.1111\/j.1475-6773.2011.01290.x.","journal-title":"Health Serv Res"},{"issue":"4","key":"1089_CR7","doi-asserted-by":"publisher","first-page":"260","DOI":"10.1177\/1460458216647089","volume":"23","author":"M Peng","year":"2017","unstructured":"Peng M, Southern DA, Williamson T, Quan H. Under-coding of secondary conditions in coded hospital health data: impact of co-existing conditions, death status and number of codes in a record. Health Informatics J. 2017;23(4):260\u20137. https:\/\/doi.org\/10.1177\/1460458216647089.","journal-title":"Health Informatics J"},{"issue":"4","key":"1089_CR8","doi-asserted-by":"publisher","first-page":"1424","DOI":"10.1111\/j.1475-6773.2007.00822.x","volume":"43","author":"H Quan","year":"2008","unstructured":"Quan H, Li B, Duncan Saunders L, et al. Assessing validity of ICD-9-CM and ICD-10 administrative data in recording clinical conditions in a unique dually coded database. Health Serv Res. 2008;43(4):1424\u201341. https:\/\/doi.org\/10.1111\/j.1475-6773.2007.00822.x.","journal-title":"Health Serv Res"},{"key":"1089_CR9","unstructured":"Canadian Institute for Health Information. CIHI\u2019s Information Quality Framework. Ottawa; 2017. www.cihi.cacopyright@cihi.ca. Accessed 11 Jan 2019."},{"key":"1089_CR10","doi-asserted-by":"publisher","unstructured":"Juran JM, Godfrey AB. Juran\u2019s quality control handbook: McGraw-Hill; 1998. https:\/\/doi.org\/10.1108\/09684879310045286.","DOI":"10.1108\/09684879310045286"},{"issue":"4","key":"1089_CR11","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1002\/pds.1335","volume":"16","author":"JD Lewis","year":"2007","unstructured":"Lewis JD, Schninnar R, Bilker WB, Wang X, Strom BL. Validation studies of the health improvement network (THIN) database for pharmacoepidemiology research. Pharmacoepidemiol Drug Saf. 2007;16(4):393\u2013401. https:\/\/doi.org\/10.1002\/pds.1335.","journal-title":"Pharmacoepidemiol Drug Saf"},{"issue":"SUPPL.1","key":"1089_CR12","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1007\/s40264-013-0097-8","volume":"36","author":"PB Ryan","year":"2013","unstructured":"Ryan PB, Schuemie MJ, Welebob E, Duke J, Valentine S, Hartzema AG. Defining a reference set to support methodological research in drug safety. Drug Saf. 2013;36(SUPPL.1):33\u201347. https:\/\/doi.org\/10.1007\/s40264-013-0097-8.","journal-title":"Drug Saf"},{"key":"1089_CR13","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1016\/j.jbi.2018.02.001","volume":"79","author":"M Peng","year":"2018","unstructured":"Peng M, Sundararajan V, Williamson T, et al. Exploration of association rule mining for coding consistency and completeness assessment in inpatient administrative health data. J Biomed Inform. 2018;79:41\u20137. https:\/\/doi.org\/10.1016\/j.jbi.2018.02.001.","journal-title":"J Biomed Inform"},{"key":"1089_CR14","unstructured":"Canadian Institute for Health Information. Data Quality Study of the 2015\u20132016 Discharge Abstract Database: A Focus on Hospital Harm. Ottawa; 2016. https:\/\/secure.cihi.ca\/free_products\/DAD_15_16_Reab_Report_EN.pdf. Accessed 12 Feb 2018."},{"key":"1089_CR15","unstructured":"Canadian Institute for Health Information. Canadian Coding Standards for ICD-10-CA and CCI. Ottawa; 2009. https:\/\/secure.cihi.ca\/free_products\/Coding standard_EN_web.pdf. Accessed 16 Feb 2018."},{"issue":"4","key":"1089_CR16","doi-asserted-by":"publisher","first-page":"596","DOI":"10.3174\/ajnr.A4696","volume":"37","author":"JA Hirsch","year":"2016","unstructured":"Hirsch JA, Nicola G, McGinty G, et al. ICD-10: history and context. Am J Neuroradiol. 2016;37(4):596\u20139. https:\/\/doi.org\/10.3174\/ajnr.A4696.","journal-title":"Am J Neuroradiol"},{"key":"1089_CR17","volume-title":"The Arules R-Package Ecosystem: Analyzing Interesting Patterns from Large Transaction Data Sets Christian Buchta","author":"M Hahsler","year":"2011","unstructured":"Hahsler M, Chelluboina S, Hornik K. The Arules R-Package Ecosystem: Analyzing Interesting Patterns from Large Transaction Data Sets Christian Buchta, vol. Vol 12; 2011. http:\/\/cran.r-project.org. Accessed 3 Apr 2019."},{"key":"1089_CR18","doi-asserted-by":"publisher","first-page":"289","DOI":"10.2307\/2346101","volume":"57","author":"Y Benjamini","year":"1995","unstructured":"Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B. 1995;57:289\u2013300. https:\/\/doi.org\/10.2307\/2346101.","journal-title":"J R Stat Soc Ser B"},{"key":"1089_CR19","unstructured":"Fitch K, Bernstein Mar\u00eda SJ, Aguilar D, et al. The RAND\/UCLA appropriateness method User\u2019s manual. Santa Monica; 2001. http:\/\/www.rand.org. Accessed 16 Jan 2019."},{"issue":"2","key":"1089_CR20","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1214\/ss\/1009213286","volume":"16","author":"LD Brown","year":"2001","unstructured":"Brown LD, Cai TT, DasGupta A. Interval estimation for a binomial proportion. Stat Sci. 2001;16(2):101\u201333. https:\/\/doi.org\/10.1214\/ss\/1009213286.","journal-title":"Stat Sci"},{"issue":"4","key":"1089_CR21","doi-asserted-by":"publisher","first-page":"1270","DOI":"10.1111\/j.1541-0420.2008.00990.x","volume":"64","author":"A Agresti","year":"2008","unstructured":"Agresti A, Bini M, Bertaccini B, Ryu E. Simultaneous confidence intervals for comparing binomial parameters. Biometrics. 2008;64(4):1270\u20135. https:\/\/doi.org\/10.1111\/j.1541-0420.2008.00990.x.","journal-title":"Biometrics."},{"issue":"5 II","key":"1089_CR22","doi-asserted-by":"publisher","first-page":"1620","DOI":"10.1111\/j.1475-6773.2005.00444.x","volume":"40","author":"KJ O\u2019Malley","year":"2005","unstructured":"O\u2019Malley KJ, Cook KF, Price MD, Wildes KR, Hurdle JF, Ashton CM. Measuring diagnoses: ICD code accuracy. Health Serv Res. 2005;40(5 II):1620\u201339. https:\/\/doi.org\/10.1111\/j.1475-6773.2005.00444.x.","journal-title":"Health Serv Res"},{"key":"1089_CR23","doi-asserted-by":"publisher","unstructured":"Lucyk K, Tang K, Quan H. Barriers to data quality resulting from the process of coding health information to administrative data: A qualitative study. BMC Health Serv Res. 2017;17(1). https:\/\/doi.org\/10.1186\/s12913-017-2697-y.","DOI":"10.1186\/s12913-017-2697-y"},{"issue":"3","key":"1089_CR24","doi-asserted-by":"publisher","first-page":"E617","DOI":"10.9778\/cmajo.20170036","volume":"5","author":"KL Tang","year":"2017","unstructured":"Tang KL, Lucyk K, Quan H. Coder perspectives on physician-related barriers to producing high-quality administrative data: a qualitative study. C Open. 2017;5(3):E617\u201322. https:\/\/doi.org\/10.9778\/cmajo.20170036.","journal-title":"C Open"},{"issue":"1","key":"1089_CR25","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1177\/183335830803700103","volume":"37","author":"S Santos","year":"2008","unstructured":"Santos S, Murphy G, Baxter K, Robinson KM. Organisational factors affecting the quality of hospital clinical coding. Heal Inf Manag J. 2008;37(1):25\u201337. https:\/\/doi.org\/10.1177\/183335830803700103.","journal-title":"Heal Inf Manag J"},{"issue":"SUPPL. 1","key":"1089_CR26","doi-asserted-by":"publisher","first-page":"S21","DOI":"10.1097\/MLR.0b013e318257dd67","volume":"50","author":"MG Kahn","year":"2012","unstructured":"Kahn MG, Raebel MA, Glanz JM, Riedlinger K, Steiner JF. A pragmatic framework for single-site and multisite data quality assessment in electronic health record-based clinical research. Med Care. 2012;50(SUPPL. 1):S21\u20139. https:\/\/doi.org\/10.1097\/MLR.0b013e318257dd67.","journal-title":"Med Care"},{"key":"1089_CR27","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1080\/12460125.2018.1460161","volume":"27","author":"L Bai","year":"2018","unstructured":"Bai L, Meredith R, Burstein F. A data quality framework, method and tools for managing data quality in a health care setting: an action case study. J Decis Syst. 2018;27:144\u201354. https:\/\/doi.org\/10.1080\/12460125.2018.1460161.","journal-title":"J Decis Syst"},{"issue":"1","key":"1089_CR28","doi-asserted-by":"publisher","first-page":"18","DOI":"10.13063\/2327-9214.1244","volume":"4","author":"MG Kahn","year":"2016","unstructured":"Kahn MG, Callahan TJ, Barnard J, et al. A harmonized data quality assessment terminology and framework for the secondary use of electronic health record data. eGEMs (Generating Evid Methods to Improv patient outcomes). 2016;4(1):18. https:\/\/doi.org\/10.13063\/2327-9214.1244.","journal-title":"eGEMs (Generating Evid Methods to Improv patient outcomes)"},{"key":"1089_CR29","doi-asserted-by":"publisher","unstructured":"Luna JM, Fournier-Viger P, Ventura S. Frequent itemset mining: A 25 years review. Wiley Interdiscip Rev Data Min Knowl Discov. 2019;9(6). https:\/\/doi.org\/10.1002\/widm.1329.","DOI":"10.1002\/widm.1329"},{"issue":"10","key":"1089_CR30","doi-asserted-by":"publisher","first-page":"2851","DOI":"10.1109\/TCYB.2017.2751081","volume":"48","author":"JM Luna","year":"2018","unstructured":"Luna JM, Padillo F, Pechenizkiy M, Ventura S. Apriori versions based on mapreduce for mining frequent patterns on big data. IEEE Trans Cybern. 2018;48(10):2851\u201365. https:\/\/doi.org\/10.1109\/TCYB.2017.2751081.","journal-title":"IEEE Trans Cybern"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-020-1089-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-020-1089-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-020-1089-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,4,24]],"date-time":"2021-04-24T23:25:56Z","timestamp":1619306756000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-020-1089-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,25]]},"references-count":30,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["1089"],"URL":"https:\/\/doi.org\/10.1186\/s12911-020-1089-0","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,4,25]]},"assertion":[{"value":"4 November 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 April 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 April 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The study analyzed the de-identified data that were routinely collected for administrative purpose. No consent to participate is required. This study was approved by the Conjoint Health Research Ethics Board (REB15\u20130791) at the University of Calgary.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not Applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"75"}}