{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,4]],"date-time":"2026-08-04T16:08:31Z","timestamp":1785859711200,"version":"3.56.0"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,8,26]],"date-time":"2020-08-26T00:00:00Z","timestamp":1598400000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,8,26]],"date-time":"2020-08-26T00:00:00Z","timestamp":1598400000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000060","name":"National Institute of Allergy and Infectious Diseases","doi-asserted-by":"publisher","award":["[AI027757]"],"award-info":[{"award-number":["[AI027757]"]}],"id":[{"id":"10.13039\/100000060","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100009054","name":"U.S. President\u2019s Emergency Plan for AIDS Relief","doi-asserted-by":"publisher","award":["[NU2GGH001130-04-00]"],"award-info":[{"award-number":["[NU2GGH001130-04-00]"]}],"id":[{"id":"10.13039\/100009054","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Health Serv Res"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Universal health coverage promises equity in access to and quality of health services. However, there is variability in the quality of the care (QoC) delivered at health facilities in low and middle-income countries (LMICs). Detecting gaps in implementation of clinical guidelines is key to prioritizing the efforts to improve quality of care. The aim of this study was to present statistical methods that maximize the use of existing electronic medical records (EMR) to monitor compliance with evidence-based care guidelines in LMICs.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>We used <jats:italic>iSant\u00e9,<\/jats:italic> Haiti\u2019s largest EMR to assess adherence to treatment guidelines and retention on treatment of HIV patients across Haitian HIV care facilities. We selected three processes of care \u2013 (1) implementation of a \u2018test and start\u2019 approach to antiretroviral therapy (ART), (2) implementation of HIV viral load testing, and (3) uptake of multi-month scripting for ART, and three continuity of care indicators \u2013 (4) timely ART pick-up, (5) 6-month ART retention of pregnant women and (6) 6-month ART retention of non-pregnant adults. We estimated these six indicators using a model-based approach to account for their volatility and measurement error. We added a case-mix adjustment for continuity of care indicators to account for the effect of factors other than medical care (biological, socio-economic). We combined the six indicators in a composite measure of appropriate care based on adherence to treatment guidelines.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>We analyzed data from 65,472 patients seen in 89 health facilities between June 2016 and March 2018. Adoption of treatment guidelines differed greatly between facilities; several facilities displayed 100% compliance failure, suggesting implementation issues. Risk-adjusted continuity of care indicators showed less variability, although several facilities had patient retention rates that deviated significantly from the national average. Based on the composite measure, we identified two facilities with consistently poor performance and two star performers.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>Our work demonstrates the potential of EMRs to detect gaps in appropriate care processes, and thereby to guide quality improvement efforts. Closing quality gaps will be pivotal in achieving equitable access to quality care in LMICs.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12913-020-05613-8","type":"journal-article","created":{"date-parts":[[2020,8,26]],"date-time":"2020-08-26T05:02:32Z","timestamp":1598418152000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Closing the gap in implementation of HIV clinical guidelines in a low resource setting using electronic medical records"],"prefix":"10.1186","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9663-7561","authenticated-orcid":false,"given":"Adrien","family":"Allorant","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Canada","family":"Parrish","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gracia","family":"Desforges","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ermane","family":"Robin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jean Guy","family":"Honore","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nancy","family":"Puttkammer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,8,26]]},"reference":[{"key":"5613_CR1","doi-asserted-by":"publisher","first-page":"e1196","DOI":"10.1016\/S2214-109X(18)30386-3","volume":"6","author":"ME Kruk","year":"2018","unstructured":"Kruk ME, Gage AD, Arsenault C, Jordan K, Leslie HH, Roder-DeWan S, et al. High-quality health systems in the sustainable development goals era: time for a revolution. Lancet Glob Health. 2018;6:e1196\u2013252.","journal-title":"Lancet Glob Health"},{"key":"5613_CR2","volume-title":"An introduction to quality Assurance in Health Care","author":"A Donabedian","year":"2003","unstructured":"Donabedian A. An introduction to quality Assurance in Health Care. Oxford: Oxford University Press; 2003."},{"key":"5613_CR3","first-page":"856","volume":"200","author":"A Donabedian","year":"1978","unstructured":"Donabedian A. The Quality of Medical Care Science. 1978;200:856\u201364.","journal-title":"The Quality of Medical Care Science"},{"key":"5613_CR4","doi-asserted-by":"publisher","first-page":"452","DOI":"10.1186\/s12913-017-2357-2","volume":"17","author":"J Robertson-Preidler","year":"2017","unstructured":"Robertson-Preidler J, Biller-Andorno N, Johnson TJ. What is appropriate care? An integrative review of emerging themes in the literature. BMC Health Serv Res. 2017;17:452.","journal-title":"BMC Health Serv Res"},{"key":"5613_CR5","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1093\/intqhc\/mzy136","volume":"31","author":"D Rios-Zertuche","year":"2019","unstructured":"Rios-Zertuche D, Z\u00fa\u00f1iga-Brenes P, Palmisano E, Hern\u00e1ndez B, Schaefer A, Johanns CK, et al. Methods to measure quality of care and quality indicators through health facility surveys in low- and middle-income countries. Int J Qual Health Care. 2019;31:183\u201390.","journal-title":"Int J Qual Health Care"},{"key":"5613_CR6","doi-asserted-by":"publisher","first-page":"273","DOI":"10.7326\/0003-4819-138-4-200302180-00006","volume":"138","author":"ES Fisher","year":"2003","unstructured":"Fisher ES, Wennberg DE, Stukel TA, Gottlieb DJ, Lucas FL, Pinder \u00c9L. The Implications of Regional Variations in Medicare Spending. Part 1: The Content, Quality, and Accessibility of Care. Ann Intern Med. 2003;138:273.","journal-title":"Ann Intern Med"},{"key":"5613_CR7","volume-title":"GLOBAL DIFFUSION OF EHEALTH: making universal health coverage achievable","author":"WORLD HEALTH ORGANIZATION","year":"2017","unstructured":"WORLD HEALTH ORGANIZATION. GLOBAL DIFFUSION OF EHEALTH: making universal health coverage achievable. GENEVA: WORLD HEALTH ORGANIZATION; 2017."},{"key":"5613_CR8","unstructured":"DHIS 2 In Action [Internet]. 2020 [cited 2020 Feb 10];Available from: https:\/\/www.dhis2.org\/inaction."},{"key":"5613_CR9","doi-asserted-by":"publisher","first-page":"e1001384","DOI":"10.1371\/journal.pmed.1001384","volume":"10","author":"E Hazel","year":"2013","unstructured":"Hazel E, Requejo J, David J, Bryce J. Measuring coverage in MNCH: evaluation of community-based treatment of childhood illnesses through household surveys. PLoS Med. 2013;10:e1001384.","journal-title":"PLoS Med"},{"key":"5613_CR10","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1186\/1475-2875-8-209","volume":"8","author":"AK Rowe","year":"2009","unstructured":"Rowe AK, Kachur SP, Yoon SS, Lynch M, Slutsker L, Steketee RW. Caution is required when using health facility-based data to evaluate the health impact of malaria control efforts in Africa. Malar J. 2009;8:209.","journal-title":"Malar J"},{"key":"5613_CR11","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1093\/heapol\/czv029","volume":"31","author":"BH Wagenaar","year":"2016","unstructured":"Wagenaar BH, Sherr K, Fernandes Q, Wagenaar AC. Using routine health information systems for well-designed health evaluations in low- and middle-income countries. Health Policy Plan. 2016;31:129\u201335.","journal-title":"Health Policy Plan"},{"key":"5613_CR12","doi-asserted-by":"publisher","first-page":"196","DOI":"10.1016\/j.aogh.2015.02.952","volume":"81","author":"N Puttkammer","year":"2015","unstructured":"Puttkammer N, Baseman J, Devine B, Hyppolite N, France G, Honore J, et al. An assessment of data quality in Haiti\u2019s multi-site electronic medical record system. Ann Global Health. 2015;81:196.","journal-title":"Ann Global Health"},{"key":"5613_CR13","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1186\/s12992-018-0418-x","volume":"14","author":"C El Bcheraoui","year":"2018","unstructured":"El Bcheraoui C, Kamath AM, Dansereau E, Palmisano EB, Schaefer A, Hernandez B, et al. Results-based aid with lasting effects: sustainability in the Salud Mesoam\u00e9rica initiative. Glob Health. 2018;14:97.","journal-title":"Glob Health"},{"key":"5613_CR14","doi-asserted-by":"publisher","first-page":"e000664","DOI":"10.1136\/bmjgh-2017-000664","volume":"3","author":"E Paul","year":"2018","unstructured":"Paul E, Albert L, Bisala BN, Bodson O, Bonnet E, Bossyns P, et al. Performance-based financing in low-income and middle-income countries: isn\u2019t it time for a rethink? BMJ Glob Health. 2018;3:e000664.","journal-title":"BMJ Glob Health"},{"key":"5613_CR15","doi-asserted-by":"publisher","first-page":"244","DOI":"10.1016\/j.ijmedinf.2012.01.011","volume":"81","author":"AI Matheson","year":"2012","unstructured":"Matheson AI, Baseman JG, Wagner SH, O\u2019Malley GE, Puttkammer NH, Emmanuel E, et al. Implementation and expansion of an electronic medical record for HIV care and treatment in Haiti: an assessment of system use and the impact of large-scale disruptions. Int J Med Inform. 2012;81:244\u201356.","journal-title":"Int J Med Inform"},{"key":"5613_CR16","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1108\/17410400810841209","volume":"57","author":"B Gurd","year":"2007","unstructured":"Gurd B, Gao T. Lives in the balance: an analysis of the balanced scorecard (BSC) in healthcare organizations. Int J Productivity & Perf Mgmt. 2007;57:6\u201321.","journal-title":"Int J Productivity & Perf Mgmt"},{"key":"5613_CR17","doi-asserted-by":"publisher","first-page":"1185","DOI":"10.1002\/sim.1970","volume":"24","author":"DJ Spiegelhalter","year":"2005","unstructured":"Spiegelhalter DJ. Funnel plots for comparing institutional performance. Stat Med. 2005;24:1185\u2013202.","journal-title":"Stat Med"},{"key":"5613_CR18","doi-asserted-by":"publisher","first-page":"865","DOI":"10.1111\/j.1467-985X.2007.00487.x","volume":"170","author":"DI Ohlssen","year":"2007","unstructured":"Ohlssen DI, Sharples LD, Spiegelhalter DJ. A hierarchical modelling framework for identifying unusual performance in health care providers. J Royal Stat Soc. 2007;170:865\u201390.","journal-title":"J Royal Stat Soc"},{"key":"5613_CR19","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1016\/j.jclinepi.2007.04.017","volume":"61","author":"HE Jones","year":"2008","unstructured":"Jones HE, Ohlssen DI, Spiegelhalter DJ. Use of the false discovery rate when comparing multiple health care providers. J Clin Epidemiol. 2008;61:232\u2013240.e2.","journal-title":"J Clin Epidemiol"},{"key":"5613_CR20","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1136\/qshc.2007.024802","volume":"18","author":"M Bardsley","year":"2009","unstructured":"Bardsley M, Spiegelhalter DJ, Blunt I, Chitnis X, Roberts A, Bharania S. Using routine intelligence to target inspection of healthcare providers in England. Qual Safety Health Care. 2009;18:189\u201394.","journal-title":"Qual Safety Health Care"},{"key":"5613_CR21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1111\/j.1467-985X.2011.01010.x","volume":"175","author":"D Spiegelhalter","year":"2012","unstructured":"Spiegelhalter D, Sherlaw-Johnson C, Bardsley M, Blunt I, Wood C, Grigg O. Statistical methods for healthcare regulation: rating, screening and surveillance: Statistical Methods for Healthcare Regulation. J Royal Stat Soc. 2012;175:1\u201347.","journal-title":"J Royal Stat Soc"},{"key":"5613_CR22","unstructured":"UNAIDS. 90\u201390-90: An ambitious treatment target to help end the AIDS epidemic. Available from: http:\/\/www.unaids.org\/sites\/default\/files\/media_asset\/90-90-90_en.pdf."},{"key":"5613_CR23","doi-asserted-by":"crossref","unstructured":"Billong SC, Fokam J, Penda CI, Amadou S, Kob DS, Billong E-J, et al. Predictors of poor retention on antiretroviral therapy as a major HIV drug resistance early warning indicator in Cameroon: results from a nationwide systematic random sampling. BMC Infect Dis. 2016;16 [cited 2019 Feb 2] Available from: http:\/\/bmcinfectdis.biomedcentral.com\/articles\/10.1186\/s12879-016-1991-3.","DOI":"10.1186\/s12879-016-1991-3"},{"key":"5613_CR24","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1111\/j.1365-3156.2010.02506.x","volume":"15","author":"AD Harries","year":"2010","unstructured":"Harries AD, Zachariah R, Lawn SD, Rosen S. Strategies to improve patient retention on antiretroviral therapy in sub-Saharan Africa: retention on antiretroviral therapy in Africa. Tropical Med Int Health. 2010;15:70\u20135.","journal-title":"Tropical Med Int Health"},{"key":"5613_CR25","first-page":"1","volume":"2016","author":"J Dionne-Odom","year":"2016","unstructured":"Dionne-Odom J, Massaro C, Jogerst KM, Li Z, Deschamps M-M, Destine CJ, et al. Retention in care among HIV-infected pregnant women in Haiti with PMTCT option B. AIDS Res Treatment. 2016;2016:1\u201310.","journal-title":"AIDS Res Treatment"},{"key":"5613_CR26","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1097\/QAD.0000000000000143","volume":"28","author":"L Tenthani","year":"2014","unstructured":"Tenthani L, Haas AD, Tweya H, Jahn A, van Oosterhout JJ, Chimbwandira F, et al. Retention in care under universal antiretroviral therapy for HIV-infected pregnant and breastfeeding women (\u2018Option B+\u2019) in Malawi. AIDS. 2014;28:589\u201398.","journal-title":"AIDS"},{"key":"5613_CR27","doi-asserted-by":"publisher","first-page":"1322","DOI":"10.1001\/jama.1996.03530410036030","volume":"275","author":"ST Normand","year":"1996","unstructured":"Normand ST. Using admission characteristics to predict short-term mortality from myocardial infarction in elderly patients. Results from the cooperative cardiovascular project. JAMA. 1996;275:1322\u20138.","journal-title":"JAMA"},{"key":"5613_CR28","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1097\/MLR.0b013e3181589bb6","volume":"46","author":"GJ Escobar","year":"2008","unstructured":"Escobar GJ, Greene JD, Scheirer P, Gardner MN, Draper D, Kipnis P. Risk-adjusting hospital inpatient mortality using automated inpatient, outpatient, and laboratory databases. Med Care. 2008;46:232\u20139.","journal-title":"Med Care"},{"key":"5613_CR29","doi-asserted-by":"publisher","first-page":"591","DOI":"10.1111\/1467-9876.00214","volume":"49","author":"Y Lee","year":"2000","unstructured":"Lee Y, Nelder JA. Two ways of modelling overdispersion in non-normal data. J R Stat Soc: Ser C: Appl Stat. 2000;49:591\u20138.","journal-title":"J R Stat Soc: Ser C: Appl Stat"},{"key":"5613_CR30","doi-asserted-by":"publisher","first-page":"144","DOI":"10.2307\/2347977","volume":"31","author":"DA Williams","year":"1982","unstructured":"Williams DA. Extra-binomial variation in logistic linear models. Appl Stat. 1982;31:144.","journal-title":"Appl Stat"},{"key":"5613_CR31","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1016\/j.healthpol.2010.06.003","volume":"97","author":"L Muhamadi","year":"2010","unstructured":"Muhamadi L, Nsabagasani X, Tumwesigye MN, Wabwire-Mangen F, Ekstr\u00f6m A-M, Peterson S, et al. Inadequate pre-antiretroviral care, stock-out of antiretroviral drugs and stigma: policy challenges\/bottlenecks to the new WHO recommendations for earlier initiation of antiretroviral therapy (CD<350 cells\/\u03bcL) in eastern Uganda. Health Policy. 2010;97:187\u201394.","journal-title":"Health Policy"},{"key":"5613_CR32","doi-asserted-by":"crossref","unstructured":"Pasquet A, Messou E, Gabillard D, Minga A, Depoulosky A, Deuffic-Burban S, et al. Impact of Drug Stock-Outs on Death and Retention to Care among HIV-Infected Patients on Combination Antiretroviral Therapy in Abidjan, C\u00f4te d\u2019Ivoire. PLoS One. 2010;5 [cited 2020 May 31];Available from: https:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC2955519\/.","DOI":"10.1371\/journal.pone.0013414"},{"key":"5613_CR33","doi-asserted-by":"publisher","first-page":"810","DOI":"10.1016\/S1473-3099(11)70301-2","volume":"11","author":"O Sued","year":"2011","unstructured":"Sued O, Schreiber C, Gir\u00f3n N, Ghidinelli M. HIV drug and supply stock-outs in Latin America. Lancet Infect Dis. 2011;11:810\u20131.","journal-title":"Lancet Infect Dis"},{"key":"5613_CR34","first-page":"41","volume-title":"BULLETIN DE SURVEILLANCE \u00c9PID\u00c9MIOLOGIQUE VIH\/SIDA NO 11","author":"Ministere de la Sante Publique et de la Population","year":"2015","unstructured":"Ministere de la Sante Publique et de la Population. BULLETIN DE SURVEILLANCE \u00c9PID\u00c9MIOLOGIQUE VIH\/SIDA NO 11; 2015. p. 41."}],"container-title":["BMC Health Services Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12913-020-05613-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12913-020-05613-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12913-020-05613-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,8,25]],"date-time":"2021-08-25T23:34:22Z","timestamp":1629934462000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmchealthservres.biomedcentral.com\/articles\/10.1186\/s12913-020-05613-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,26]]},"references-count":34,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["5613"],"URL":"https:\/\/doi.org\/10.1186\/s12913-020-05613-8","relation":{},"ISSN":["1472-6963"],"issn-type":[{"value":"1472-6963","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,26]]},"assertion":[{"value":"18 March 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 July 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 August 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Ethics approval for the study was granted by the Haiti Ministry of Public Health and Population National Bioethics committee (#1718\u201366) and by the University of Washington Human Subjects Division (STUDY00002145), based upon a minimal risk determination for secondary use of de-identified data.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"804"}}