{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T16:56:56Z","timestamp":1791565016874,"version":"4.3.4"},"reference-count":24,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T00:00:00Z","timestamp":1790812800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"},{"start":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T00:00:00Z","timestamp":1790812800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/100027896","name":"Patrick J. McGovern Foundation","doi-asserted-by":"publisher","award":["383000239"],"award-info":[{"award-number":["383000239"]}],"id":[{"id":"10.13039\/100027896","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Health Informatics J"],"published-print":{"date-parts":[[2026,10]]},"abstract":"<jats:sec>\n                    <jats:title>Purpose<\/jats:title>\n                    <jats:p>High-quality data are critical for developing healthcare machine learning (ML) models yet remain a major challenge in low- and middle-income countries (LMICs). This study evaluated the applicability of the Duke Institute for Health Innovation\u2019s (DIHI) Machine Learning Data Quality Assurance (ML-DQA) framework in an LMIC setting using two ML projects at a tertiary care hospital in Pakistan.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We applied the ML-DQA framework to two ML projects, Sepsis Watch (SW) and In-hospital Mortality Prediction (IMP). The framework comprises four phases: pre-DQA, data element pre-processing, ML-DQA checks, and ML-DQA adjudication, and was used to evaluate data quality and usability for both models.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>In the pre-DQA phase, required data elements were identified through consultation with clinicians and project teams. During data element pre-processing, transformations and harmonization were performed, including consolidation of differently labelled glucose variables. ML-DQA checks assessed plausibility, conformance, and completeness, identifying elements that met quality standards. In the adjudication phase, reports were reviewed by two independent clinicians to determine suitability for model development.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>The Duke ML-DQA framework effectively identified data limitations and informed model development, demonstrating its utility for assessing data quality and supporting ML implementation in resource-constrained settings.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1177\/14604582261486769","type":"journal-article","created":{"date-parts":[[2026,10,7]],"date-time":"2026-10-07T17:06:28Z","timestamp":1791392788000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["Implementation of Duke Machine Learning Data Quality Assurance Framework in a Pakistani Healthcare Institution"],"prefix":"10.1177","volume":"32","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6972-6665","authenticated-orcid":false,"given":"Zarmeen","family":"Nasim","sequence":"first","affiliation":[{"name":"Aga Khan University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nida Saddaf","family":"Khan","sequence":"additional","affiliation":[{"name":"Aga Khan University"},{"name":"University of Texas Health Science Center, Houston"},{"name":"The University of Texas MD Anderson Cancer Centre"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mark","family":"Sendak","sequence":"additional","affiliation":[{"name":"Duke University School of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7555-0774","authenticated-orcid":false,"given":"Khalid","family":"Aziz","sequence":"additional","affiliation":[{"name":"Aga Khan University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Salma","family":"Tajuddin","sequence":"additional","affiliation":[{"name":"Aga Khan University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Haroon","family":"Khan","sequence":"additional","affiliation":[{"name":"Aga Khan University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maaha","family":"Ayub","sequence":"additional","affiliation":[{"name":"Aga Khan University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mohummad Hassan","family":"Raza Raja","sequence":"additional","affiliation":[{"name":"Aga Khan University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mushyada","family":"Ali","sequence":"additional","affiliation":[{"name":"Aga Khan University"},{"name":"Aga Khan University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jee Young","family":"Kim","sequence":"additional","affiliation":[{"name":"Duke University School of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Henry David Jeffry","family":"Hogg","sequence":"additional","affiliation":[{"name":"University Hospitals Birmingham NHS Foundation Trust"},{"name":"University of Birmingham"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alifia","family":"Hasan","sequence":"additional","affiliation":[{"name":"Duke University School of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Suresh","family":"Balu","sequence":"additional","affiliation":[{"name":"Duke University School of Medicine"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zahra","family":"Hoodbhoy","sequence":"additional","affiliation":[{"name":"Aga Khan University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zainab","family":"Samad","sequence":"additional","affiliation":[{"name":"Aga Khan University"},{"name":"Aga Khan University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2026,10,7]]},"reference":[{"key":"e_1_3_6_2_2","first-page":"471","volume-title":"Studies in Health Technology and Informatics","author":"Ranjbar A","year":"2023","unstructured":"Ranjbar A, Ravn J. Data Quality in Healthcare for the Purpose of Artificial Intelligence: A Case Study on ECG Digitalization. In: Studies in Health Technology and Informatics. IOS Press BV, 2023, pp. 471\u2013474."},{"key":"e_1_3_6_3_2","doi-asserted-by":"publisher","DOI":"10.1177\/1833358318774357"},{"key":"e_1_3_6_4_2","doi-asserted-by":"publisher","DOI":"10.1093\/intqhc\/mzz031"},{"key":"e_1_3_6_5_2","first-page":"135","article-title":"Understanding the challenges associated with the use of data from routine health information systems in low- and middle-income countries: A systematic review","volume":"51","author":"Hoxha K","year":"2022","unstructured":"Hoxha K, Hung YW, Irwin BR, et al. Understanding the challenges associated with the use of data from routine health information systems in low- and middle-income countries: A systematic review. Health Inf Manag 2022; 51: 135\u2013148.","journal-title":"Health Inf Manag"},{"key":"e_1_3_6_6_2","doi-asserted-by":"publisher","DOI":"10.1093\/nsr\/nwad125"},{"key":"e_1_3_6_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.mser.2025.101050"},{"key":"e_1_3_6_8_2","volume-title":"Duke Institute for Health Innovation - Promoting Transformative Innovation","unstructured":"Duke Institute for Health Innovation - Promoting Transformative Innovation. https:\/\/dihi.org\/ (accessed 14 February 2025)."},{"key":"e_1_3_6_9_2","unstructured":"Sendak M Sirdeshmukh G Ochoa T et al. Development and Validation of ML-DQA \u2013 a Machine Learning Data Quality Assurance Framework for Healthcare. In: Machine Learning for Healthcare Conference. PMLR pp. 741\u2013759."},{"key":"e_1_3_6_10_2","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2015-004411"},{"key":"e_1_3_6_11_2","author":"World Health AI Partnership - Duke Institute for","unstructured":"World Health AI Partnership - Duke Institute for. Health Innovation. https:\/\/dihi.org\/project\/world-health-ai-partnership\/ (accessed 14 February 2025).","journal-title":"Health Innovation"},{"key":"e_1_3_6_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.annemergmed.2019.08.005"},{"key":"e_1_3_6_13_2","doi-asserted-by":"publisher","DOI":"10.2196\/15182"},{"key":"e_1_3_6_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(19)32989-7"},{"key":"e_1_3_6_15_2","doi-asserted-by":"publisher","DOI":"10.13063\/2327-9214.1244"},{"key":"e_1_3_6_16_2","doi-asserted-by":"publisher","DOI":"10.1108\/09544780210439734"},{"key":"e_1_3_6_17_2","doi-asserted-by":"crossref","unstructured":"Jain A Patel H Nagalapatti L et al. Overview and Importance of Data Quality for Machine Learning Tasks. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. Association for Computing Machinery pp. 3561\u20133562.","DOI":"10.1145\/3394486.3406477"},{"key":"e_1_3_6_18_2","doi-asserted-by":"publisher","DOI":"10.2196\/42615"},{"key":"e_1_3_6_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jiph.2023.07.001"},{"key":"e_1_3_6_20_2","doi-asserted-by":"publisher","DOI":"10.4314\/mmj.v30i2.11"},{"key":"e_1_3_6_21_2","doi-asserted-by":"publisher","DOI":"10.1097\/QAI.0000000000001313"},{"key":"e_1_3_6_22_2","doi-asserted-by":"publisher","DOI":"10.1177\/20552076211061922"},{"key":"e_1_3_6_23_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00392-016-1025-6"},{"key":"e_1_3_6_24_2","first-page":"189","article-title":"Clinical Use of an Enterprise Data Warehouse","volume":"2012","author":"Evans RS","year":"2012","unstructured":"Evans RS, Lloyd JF, Pierce LA. Clinical Use of an Enterprise Data Warehouse. AMIA Annual Symposium Proceedings 2012; 2012: 189\u2013198.","journal-title":"AMIA Annual Symposium Proceedings"},{"key":"e_1_3_6_25_2","first-page":"ooad039","article-title":"Research data warehouse: using electronic health records to conduct population-based observational studies","volume":"6","author":"Chen W","year":"2023","unstructured":"Chen W, Xie F, Mccarthy DP, et al. Research data warehouse: using electronic health records to conduct population-based observational studies. JAMIA Open 2023; 6: ooad039. https:\/\/doi.org\/10.1093\/jamiaopen\/ooad039","journal-title":"JAMIA Open"}],"container-title":["Health Informatics Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/14604582261486769","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/14604582261486769","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/14604582261486769","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T16:30:04Z","timestamp":1791563404000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/14604582261486769"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,10]]},"references-count":24,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2026,10]]}},"alternative-id":["10.1177\/14604582261486769"],"URL":"https:\/\/doi.org\/10.1177\/14604582261486769","relation":{},"ISSN":["1460-4582","1741-2811"],"issn-type":[{"value":"1460-4582","type":"print"},{"value":"1741-2811","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,10]]},"article-number":"14604582261486769"}}