{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T19:01:30Z","timestamp":1782846090429,"version":"3.54.5"},"reference-count":43,"publisher":"JMIR Publications Inc.","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JMIR Med Inform"],"abstract":"Abstract<\/jats:title>\n \n Background<\/jats:title>\n As data-driven medical research advances, vast amounts of medical data are being collected, giving researchers access to important information. However, issues such as heterogeneity, complexity, and incompleteness of datasets limit their practical use. Errors and missing data negatively affect artificial intelligence\u2013based predictive models, undermining the reliability of clinical decision-making. Thus, it is important to develop a quality management process (QMP) for clinical data.<\/jats:p>\n <\/jats:sec>\n \n Objective<\/jats:title>\n This study aimed to develop a rules-based QMP to address errors and impute missing values in real-world data, establishing high-quality data for clinical research.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n We used clinical data from 6491 patients with colorectal cancer (CRC) collected at Gachon University Gil Medical Center between 2010 and 2022, leveraging the clinical library established within the Korea Clinical Data Use Network for Research Excellence. First, we conducted a literature review on the prognostic prediction of CRC to assess whether the data met our research purposes, comparing selected variables with real-world data. A labeling process was then implemented to extract key variables, which facilitated the creation of an automatic staging library. This library, combined with a rule-based process, allowed for systematic analysis and evaluation.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Theoretically, the tumor, node, metastasis (TNM) stage was identified as an important prognostic factor for CRC, but it was not selected through feature selection in real-world data. After applying the QMP, rates of missing data were reduced from 75.3% to 35.7% for TNM and from 24.3% to 18.5% for surveillance, epidemiology, and end results across 6491 cases, confirming the system\u2019s effectiveness. Variable importance analysis through feature selection revealed that TNM stage and detailed code variables, which were previously unselected, were included in the improved model.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n In sum, we developed a rules-based QMP to address errors and impute missing values in Korea Clinical Data Use Network for Research Excellence data, enhancing data quality. The applicability of the process to real-world datasets highlights its potential for broader use in clinical studies and cancer research.<\/jats:p>\n <\/jats:sec>","DOI":"10.2196\/73884","type":"journal-article","created":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T20:11:13Z","timestamp":1763064673000},"page":"e73884-e73884","source":"Crossref","is-referenced-by-count":0,"title":["Process for Quality Management of Electronic Medical Records\u2013Based Data: Case Study Using Real Colorectal Cancer Data"],"prefix":"10.2196","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-0825-402X","authenticated-orcid":false,"given":"NaYoung","family":"Park","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-1256-530X","authenticated-orcid":false,"given":"Kyungmin","family":"Na","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0259-8654","authenticated-orcid":false,"given":"Woongsang","family":"Sunwoo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9124-8041","authenticated-orcid":false,"given":"Jeong-Heum","family":"Baek","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0720-0569","authenticated-orcid":false,"given":"Youngho","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0651-6481","authenticated-orcid":false,"given":"Suehyun","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5489-3404","authenticated-orcid":false,"given":"Hyekyung","family":"Woo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1010","published-online":{"date-parts":[[2025,11,13]]},"reference":[{"key":"R1","doi-asserted-by":"crossref","unstructured":"Shortliffe EH Barnett GO . Medical Data: Their Acquisition, Storage, and Use Medical Informatics: Computer Applications in Health Care and Biomedicine. Springer; 2001:41-75. [doi: 10.1007\/978-0-387-21721-5_2]","DOI":"10.1007\/978-0-387-21721-5_2"},{"key":"R2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2019.04.014","article-title":"The role of electronic medical records in improving the quality of health care services: comparative study","volume":"127","author":"Ayaad","journal-title":"Int J Med Inform"},{"issue":"10","key":"R3","doi-asserted-by":"publisher","first-page":"1419","DOI":"10.1093\/jamia\/ocy068","article-title":"Opportunities and challenges in developing deep learning models using electronic health records data: a systematic review","volume":"25","author":"Xiao","journal-title":"J Am Med Inform Assoc"},{"issue":"4","key":"R4","doi-asserted-by":"publisher","first-page":"103310","DOI":"10.1016\/j.retram.2021.103310","article-title":"Introduction to medical data and big data exploitation in research: errors, solutions and trends","volume":"69","author":"Alsuliman","journal-title":"Curr Res Transl Med"},{"issue":"11","key":"R5","doi-asserted-by":"publisher","first-page":"1100","DOI":"10.1002\/cac2.12215","article-title":"Artificial intelligence for assisting cancer diagnosis and treatment in the era of precision medicine","volume":"41","author":"Chen","journal-title":"Cancer Commun"},{"issue":"6","key":"R6","doi-asserted-by":"publisher","first-page":"220","DOI":"10.5392\/JKCA.2020.20.06.220","article-title":"Current status and issues of data management plan in Korea","volume":"20","author":"M-s","journal-title":"J Korea Contents Assoc"},{"issue":"1","key":"R7","doi-asserted-by":"publisher","DOI":"10.1136\/bmjoq-2021-001491","article-title":"Understanding challenges of using routinely collected health data to address clinical care gaps: a case study in Alberta, Canada","volume":"11","author":"McGuckin","journal-title":"BMJ Open Qual"},{"key":"R8","doi-asserted-by":"publisher","DOI":"10.3233\/SHTI190248","article-title":"Detecting systemic data quality issues in electronic health records","volume":"264","author":"Ta","journal-title":"Stud Health Technol Inform"},{"issue":"1","key":"R9","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-023-02361-2","article-title":"What prevents us from reusing medical real-world data in research","volume":"10","author":"Gehrmann","journal-title":"Sci Data"},{"key":"R10","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2022.3141776","article-title":"A hybrid GAN-based approach to solve imbalanced data problem in recommendation systems","volume":"10","author":"Shafqat","journal-title":"IEEE Access"},{"issue":"4","key":"R11","doi-asserted-by":"publisher","first-page":"791","DOI":"10.1007\/s00778-022-00775-9","article-title":"Data collection and quality challenges in deep learning: a data-centric AI perspective","volume":"32","author":"Whang","journal-title":"VLDB J"},{"key":"R12","doi-asserted-by":"crossref","unstructured":"Alalwani R Lucas A Alzubaidi M Shah HA Alam T Shah Z et al. Deep learning in colorectal cancer classification: a scoping review. In: Healthcare Transformation with Informatics and Artificial Intelligence. 2023:616-619. [doi: 10.3233\/SHTI230573]","DOI":"10.3233\/SHTI230573"},{"issue":"1","key":"R13","doi-asserted-by":"publisher","DOI":"10.1186\/s12885-021-08773-w","article-title":"Artificial intelligence for pre-operative lymph node staging in colorectal cancer: a systematic review and meta-analysis","volume":"21","author":"Bedrikovetski","journal-title":"BMC Cancer"},{"issue":"1","key":"R14","doi-asserted-by":"publisher","first-page":"108","DOI":"10.3748\/wjg.v28.i1.108","article-title":"Artificial intelligence in the diagnosis and management of colorectal cancer liver metastases","volume":"28","author":"Rompianesi","journal-title":"World J Gastroenterol"},{"key":"R15","doi-asserted-by":"publisher","DOI":"10.1016\/j.arr.2024.102497","article-title":"AI-driven innovations in Alzheimer\u2019s disease: Integrating early diagnosis, personalized treatment, and prognostic modelling","volume":"101","author":"Kale","journal-title":"Ageing Res Rev"},{"key":"R16","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejmp.2021.02.007","article-title":"Data preparation for artificial intelligence in medical imaging: a comprehensive guide to open-access platforms and tools","volume":"83","author":"Diaz","journal-title":"Phys Med"},{"issue":"4","key":"R17","doi-asserted-by":"publisher","first-page":"1293","DOI":"10.1590\/1413-81232020254.28922019","article-title":"Electronic medical records in the American health system: challenges and lessons learned","volume":"25","author":"Janett","journal-title":"Ci\u00eanc sa\u00fade coletiva"},{"issue":"4","key":"R18","doi-asserted-by":"publisher","first-page":"383","DOI":"10.1007\/s41666-020-00077-1","article-title":"Predicting missing values in medical data via XGBoost regression","volume":"4","author":"Zhang","journal-title":"J Healthc Inform Res"},{"key":"R19","unstructured":"Washington MK Brookland DR Gershenwald JE Compton CC Hess KR et al. AJCC Cancer Staging Manual. 8th ed. New York, NY: Springer; 2017. ISBN: 9783319406176"},{"key":"R20","unstructured":"Um JW . Korean Clinical Guideline for Colon and Rectal Cancer v 10. Seoul, Korean Academy of Medical Sciences; 2012."},{"key":"R21","unstructured":"Ruhl JL Callaghan C . Schussler N , editor. Summary Stage 2018: Codes and Coding Instructions. Bethesda, MD: National Cancer Institute; 2024."},{"issue":"9","key":"R22","doi-asserted-by":"publisher","first-page":"1322","DOI":"10.1016\/j.cjca.2020.11.010","article-title":"Missing data in clinical research: a tutorial on multiple imputation","volume":"37","author":"Austin","journal-title":"Can J Cardiol"},{"issue":"13","key":"R23","doi-asserted-by":"publisher","first-page":"5621","DOI":"10.1016\/j.eswa.2015.02.050","article-title":"Hybrid prediction model with missing value imputation for medical data","volume":"42","author":"Purwar","journal-title":"Expert Syst Appl"},{"issue":"2","key":"R24","doi-asserted-by":"publisher","first-page":"1487","DOI":"10.1007\/s10462-019-09709-4","article-title":"Missing value imputation: a review and analysis of the literature (2006\u20132017)","volume":"53","author":"Lin","journal-title":"Artif Intell Rev"},{"issue":"3","key":"R25","doi-asserted-by":"publisher","DOI":"10.13063\/2327-9214.1035","article-title":"Strategies for handling missing data in electronic health record derived data","volume":"1","author":"Wells","journal-title":"EGEMS (Wash DC)"},{"issue":"196","key":"R26","first-page":"1","volume":"18","author":"Bertsimas","journal-title":"J Mach Learn Res"},{"issue":"6","key":"R27","doi-asserted-by":"publisher","first-page":"4361","DOI":"10.1007\/s00500-019-04199-6","article-title":"Missing value imputation using unsupervised machine learning techniques","volume":"24","author":"Raja","journal-title":"Soft Comput"},{"key":"R28","unstructured":"Wo\u017anica K Biecek P . Does imputation matter? Benchmark for predictive models. arXiv. Preprint posted online on Jul 6, 2020. [doi: 10.48550\/arXiv.2007.02837]"},{"issue":"5-6","key":"R29","doi-asserted-by":"publisher","first-page":"519","DOI":"10.1080\/713827181","article-title":"An analysis of four missing data treatment methods for supervised learning","volume":"17","author":"Batista","journal-title":"Appl Artif Intell"},{"issue":"2287-322","key":"R30","first-page":"2287","volume":"11","author":"Mazumder","journal-title":"J Mach Learn Res"},{"issue":"1","key":"R31","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1093\/bioinformatics\/btr597","article-title":"MissForest--non-parametric missing value imputation for mixed-type data","volume":"28","author":"Stekhoven","journal-title":"Bioinformatics"},{"issue":"4","key":"R32","doi-asserted-by":"publisher","first-page":"558","DOI":"10.1108\/DTA-12-2020-0298","article-title":"A systematic review of machine learning-based missing value imputation techniques","volume":"55","author":"Thomas","journal-title":"DTA"},{"key":"R33","doi-asserted-by":"crossref","unstructured":"Kowsar I Rabbani SB Samad MD . Attention-based imputation of missing values in electronic health records tabular data. In: Kowsar I Rabbani SB Samad MD , editors. Presented at: 2024 IEEE 12th International Conference on Healthcare Informatics (ICHI); Jun 3-6, 2024; Orlando, FL. [doi: 10.1109\/ICHI61247.2024.00030]","DOI":"10.1109\/ICHI61247.2024.00030"},{"key":"R34","unstructured":"He X Ban Y Zou J Wei T Cook CB He J . LLM-forest for health tabular data imputation. arXiv. Preprint posted online on Oct 28, 2024. [doi: 10.48550\/arXiv.2410.21520]"},{"issue":"1","key":"R35","doi-asserted-by":"publisher","DOI":"10.1186\/s12916-020-01618-6","article-title":"Risk factors and risk prediction models for colorectal cancer metastasis and recurrence: an umbrella review of systematic reviews and meta-analyses of observational studies","volume":"18","author":"Xu","journal-title":"BMC Med"},{"key":"R36","volume":"2022","author":"Mohamed","journal-title":"AMIA Annu Symp Proc"},{"key":"R37","doi-asserted-by":"crossref","unstructured":"Wang Z Dagtas S Talburt J Baghal A Zozus M . Rule-based data quality assessment and monitoring system in healthcare facilities. In: Improving Usability, Safety and Patient Outcomes with Health Information. IOS Press; 2019:460-467. [doi: 10.3233\/978-1-61499-951-5-460]","DOI":"10.3233\/978-1-61499-951-5-460"},{"issue":"04","key":"R38","doi-asserted-by":"publisher","first-page":"622","DOI":"10.1055\/s-0040-1715567","article-title":"A rule-based data quality assessment system for electronic health record data","volume":"11","author":"Wang","journal-title":"Appl Clin Inform"},{"key":"R39","doi-asserted-by":"publisher","DOI":"10.1097\/MLR.0b013e318257dd67","article-title":"A pragmatic framework for single-site and multisite data quality assessment in electronic health record-based clinical research","volume":"50 Suppl","author":"Kahn","journal-title":"Med Care"},{"issue":"1","key":"R40","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1136\/amiajnl-2011-000681","article-title":"Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research","volume":"20","author":"Weiskopf","journal-title":"J Am Med Inform Assoc"},{"key":"R41","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2023.105262","article-title":"Effective DATA quality management for electronic medical record DATA using SMART DATA","volume":"180","author":"Lee","journal-title":"Int J Med Inform"},{"issue":"1","key":"R42","doi-asserted-by":"publisher","first-page":"1","DOI":"10.4102\/sajim.v23i1.1230","article-title":"Critical success factors to improve data quality of electronic medical records in public healthcare institutions","volume":"23","author":"Makeleni","journal-title":"S Afr J Inf Manag"},{"key":"R43","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijmedinf.2016.03.006","article-title":"Data quality assessment framework to assess electronic medical record data for use in research","volume":"90","author":"Reimer","journal-title":"Int J Med Inform"}],"container-title":["JMIR Medical Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/medinform.jmir.org\/2025\/1\/e73884","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T18:04:46Z","timestamp":1782842686000},"score":1,"resource":{"primary":{"URL":"https:\/\/medinform.jmir.org\/2025\/1\/e73884"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,13]]},"references-count":43,"URL":"https:\/\/doi.org\/10.2196\/73884","relation":{},"ISSN":["2291-9694"],"issn-type":[{"value":"2291-9694","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,13]]},"article-number":"v13i10e73884"}}