{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,18]],"date-time":"2026-10-18T01:55:29Z","timestamp":1792288529224,"version":"4.4.0"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,6,18]],"date-time":"2024-06-18T00:00:00Z","timestamp":1718668800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,6,18]],"date-time":"2024-06-18T00:00:00Z","timestamp":1718668800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Health Serv Res"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Implementation science frameworks situate intervention implementation and sustainment within the context of the implementing organization and system. Aspects of organizational context such as leadership have been defined and measured largely within US health care settings characterized by decentralization and individual autonomy. The relevance of these constructs in other settings may be limited by differences like collectivist orientation, resource constraints, and hierarchical power structures. We aimed to adapt measures of organizational context in South African primary care clinics.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>We convened a panel of South African experts in social science and HIV care delivery and presented implementation domains informed by existing frameworks and prior work in South Africa. Based on panel input, we selected contextual domains and adapted candidate items. We conducted cognitive interviews with 25 providers in KwaZulu-Natal Province to refine measures. We then conducted a cross-sectional survey of 16 clinics with 5\u201320 providers per clinic (<jats:italic>N<\/jats:italic>\u2009=\u2009186). We assessed reliability using Cronbach\u2019s alpha and calculated interrater agreement (a<jats:sub>wg<\/jats:sub>) and intraclass correlation coefficient (ICC) at the clinic level. Within clinics with moderate agreement, we calculated correlation of clinic-level measures with each other and with hypothesized predictors \u2013 staff continuity and infrastructure \u2013 and a clinical outcome, patient retention on antiretroviral therapy.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Panelists emphasized contextual factors; we therefore focused on elements of clinic leadership, stress, cohesion, and collective problem solving (critical consciousness). Cognitive interviews confirmed salience of the domains and improved item clarity. After excluding items related to leaders\u2019 coordination abilities due to missingness and low agreement, all other scales demonstrated individual-level reliability and at least moderate interrater agreement in most facilities. ICC was low for most leadership measures and moderate for others. Measures tended to correlate within facility, and higher stress was significantly correlated with lower staff continuity. Organizational context was generally more positively rated in facilities that showed consistent agreement.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>As theorized, organizational context is important in understanding program implementation within the South African health system. Most adapted measures show good reliability at individual and clinic levels. Additional revision of existing frameworks to suit this context and further testing in high and low performing clinics is warranted.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s12913-024-11184-9","type":"journal-article","created":{"date-parts":[[2024,6,18]],"date-time":"2024-06-18T03:46:42Z","timestamp":1718682402000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Adapting and testing measures of organizational context in primary care clinics in KwaZulu-Natal, South Africa"],"prefix":"10.1186","volume":"24","author":[{"given":"Hannah H.","family":"Leslie","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sheri A.","family":"Lippman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alastair","family":"van Heerden","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mbali Nokulunga","family":"Manaka","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Phillip","family":"Joseph","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bryan J.","family":"Weiner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wayne T.","family":"Steward","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,6,18]]},"reference":[{"issue":"3","key":"11184_CR1","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1093\/her\/11.3.317","volume":"11","author":"D Nutbeam","year":"1996","unstructured":"Nutbeam D. Achieving \u2018best practice\u2019 in health promotion: improving the fit between research and practice. Health Educ Res. 1996;11(3):317\u201326.","journal-title":"Health Educ Res"},{"key":"11184_CR2","doi-asserted-by":"publisher","first-page":"214","DOI":"10.1017\/9781108157797","volume-title":"Doomed Interventions: The Failure of Global Responses to AIDS in Africa","author":"KY Dionne","year":"2017","unstructured":"Dionne KY. Doomed Interventions: The Failure of Global Responses to AIDS in Africa. Cambridge: Cambridge University Press; 2017. p. 214."},{"key":"11184_CR3","unstructured":"UNAIDS: Joint UN Program on HIV\/AIDS. UNAIDS. 2018 [cited 2019 Dec 11]. UNAIDS: South Africa. Available from: https:\/\/www.unaids.org\/en\/regionscountries\/countries\/southafrica"},{"issue":"10","key":"11184_CR4","doi-asserted-by":"publisher","first-page":"e1375","DOI":"10.1016\/S2214-109X(19)30374-2","volume":"7","author":"HN Gouda","year":"2019","unstructured":"Gouda HN, Charlson F, Sorsdahl K, Ahmadzada S, Ferrari AJ, Erskine H, et al. Burden of non-communicable diseases in sub-Saharan Africa, 1990\u20132017: results from the Global Burden of Disease Study 2017. Lancet Glob Health. 2019;7(10):e1375\u201387.","journal-title":"Lancet Glob Health"},{"key":"11184_CR5","doi-asserted-by":"publisher","first-page":"1198","DOI":"10.1111\/tmi.13297","volume":"24","author":"M Sharman","year":"2019","unstructured":"Sharman M, Bachmann M. Prevalence and health effects of communicable and non-communicable disease comorbidity in rural KwaZulu-Natal. South Africa Trop Med Int Health. 2019;24:1198\u2013207.","journal-title":"South Africa. Trop Med Int Health."},{"issue":"3","key":"11184_CR6","first-page":"59","volume":"2","author":"D Croce","year":"2018","unstructured":"Croce D, Mueller D, Rizzardini G, Restelli U. Organising HIV ageing-patient care in South Africa\u202f: an implementation science approach. S Afr J Public Health. 2018;2(3):59\u201362.","journal-title":"S Afr J Public Health"},{"issue":"1","key":"11184_CR7","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1186\/1744-8603-8-11","volume":"8","author":"G Yamey","year":"2012","unstructured":"Yamey G. What are the barriers to scaling up health interventions in low and middle income countries? A qualitative study of academic leaders in implementation science. Glob Health. 2012;8(1):11.","journal-title":"Glob Health"},{"issue":"4","key":"11184_CR8","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.1002288","volume":"14","author":"EH Geng","year":"2017","unstructured":"Geng EH, Peiris D, Kruk ME. Implementation science: Relevance in the real world without sacrificing rigor. PLoS Med. 2017;14(4).","journal-title":"PLoS Med"},{"issue":"1","key":"11184_CR9","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1007\/s10488-010-0327-7","volume":"38","author":"GA Aarons","year":"2011","unstructured":"Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011;38(1):4\u201323.","journal-title":"Adm Policy Ment Health"},{"issue":"6","key":"11184_CR10","doi-asserted-by":"publisher","first-page":"991","DOI":"10.1007\/s10488-016-0751-4","volume":"43","author":"GA Aarons","year":"2016","unstructured":"Aarons GA, Green AE, Trott E, Willging CE, Torres EM, Ehrhart MG, et al. The roles of system and organizational leadership in system-wide evidence-based intervention sustainment: a mixed-method study. Adm Policy Ment Health. 2016;43(6):991\u20131008.","journal-title":"Adm Policy Ment Health"},{"issue":"1","key":"11184_CR11","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1186\/1748-5908-4-50","volume":"4","author":"LJ Damschroder","year":"2009","unstructured":"Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50.","journal-title":"Implement Sci"},{"issue":"1","key":"11184_CR12","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1186\/s13012-022-01245-0","volume":"17","author":"LJ Damschroder","year":"2022","unstructured":"Damschroder LJ, Reardon CM, Widerquist MAO, Lowery J. The updated Consolidated Framework for Implementation Research based on user feedback. Implement Sci. 2022;17(1):75.","journal-title":"Implement Sci"},{"issue":"1","key":"11184_CR13","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1186\/1748-5908-4-67","volume":"4","author":"BJ Weiner","year":"2009","unstructured":"Weiner BJ. A theory of organizational readiness for change. Implement Sci. 2009;4(1):67.","journal-title":"Implement Sci"},{"issue":"1","key":"11184_CR14","doi-asserted-by":"publisher","first-page":"591","DOI":"10.1186\/s12913-017-2459-x","volume":"17","author":"JD Allen","year":"2017","unstructured":"Allen JD, Towne SD, Maxwell AE, DiMartino L, Leyva B, Bowen DJ, et al. Measures of organizational characteristics associated with adoption and\/or implementation of innovations: a systematic review. BMC Health Serv Res. 2017;17(1):591.","journal-title":"BMC Health Serv Res"},{"issue":"4","key":"11184_CR15","doi-asserted-by":"publisher","first-page":"e0214454","DOI":"10.1371\/journal.pone.0214454","volume":"14","author":"M Daivadanam","year":"2019","unstructured":"Daivadanam M, Ingram M, Annerstedt KS, Parker G, Bobrow K, Dolovich L, et al. The role of context in implementation research for non-communicable diseases: answering the \u2018how-to\u2019 dilemma. PLoS ONE. 2019;14(4).","journal-title":"PLoS ONE"},{"key":"11184_CR16","doi-asserted-by":"crossref","unstructured":"Alonge O, Rodriguez DC, Brandes N, Geng E, Reveiz L, Peters DH. How is implementation research applied to advance health in low-income and middle-income countries? BMJ Global Health. 2019;4.","DOI":"10.1136\/bmjgh-2018-001257"},{"key":"11184_CR17","doi-asserted-by":"crossref","unstructured":"Gilson L, Ellokor S, Lehmann U, Brady L. Organizational change and everyday health system resilience: lessons from Cape Town, South Africa. Soc Sci Med. 2020;266:113407.","DOI":"10.1016\/j.socscimed.2020.113407"},{"issue":"4","key":"11184_CR18","doi-asserted-by":"publisher","first-page":"722","DOI":"10.1177\/1049732320983270","volume":"31","author":"A Julien","year":"2021","unstructured":"Julien A, Anthierens S, Van Rie A, West R, Maritze M, Twine R, et al. Health care providers\u2019 challenges to high-quality HIV care and Antiretroviral treatment retention in Rural South Africa. Qual Health Res. 2021;31(4):722\u201335.","journal-title":"Qual Health Res"},{"key":"11184_CR19","first-page":"912","volume":"11","author":"HH Leslie","year":"2020","unstructured":"Leslie HH, West R, Twine R, Masilela N, Steward WT, Kahn K, et al. Measuring Organizational Readiness for Implementing Change in Primary Care Facilities in Rural Bushbuckridge, South Africa. Int J Health Policy Manag. 2020;11:912\u20138.","journal-title":"Int J Health Policy Manag."},{"issue":"1","key":"11184_CR20","doi-asserted-by":"publisher","first-page":"819","DOI":"10.1186\/s12913-023-09826-5","volume":"23","author":"W Odendaal","year":"2023","unstructured":"Odendaal W, Chetty T, Goga A, Tomlinson M, Singh Y, Marshall C, et al. From purists to pragmatists: a qualitative evaluation of how implementation processes and contexts shaped the uptake and methodological adaptations of a maternal and neonatal quality improvement programme in South Africa prior to, and during COVID-19. BMC Health Serv Res. 2023;23(1):819.","journal-title":"BMC Health Serv Res"},{"issue":"1","key":"11184_CR21","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1186\/s13690-022-00975-3","volume":"80","author":"A van Heerden","year":"2022","unstructured":"van Heerden A, Ntinga X, Lippman SA, Leslie HH, Steward WT. Understanding the factors that impact effective uptake and maintenance of HIV care programs in South African primary health care clinics. Arch Public Health. 2022;80(1):221.","journal-title":"Arch Public Health"},{"issue":"9","key":"11184_CR22","doi-asserted-by":"publisher","first-page":"1970","DOI":"10.1111\/jan.12402","volume":"70","author":"DL Streiner","year":"2014","unstructured":"Streiner DL, Kottner J. Recommendations for reporting the results of studies of instrument and scale development and testing. J Adv Nurs. 2014;70(9):1970\u20139.","journal-title":"J Adv Nurs"},{"key":"#cr-split#-11184_CR23.1","unstructured":"Department of Health. Province of KwaZulu-Natal Annual Performance Plan 2018\/19 - 2020\/21 [Internet]. KwaZulu-Natal, South Africa: Department of Health, Republic of South Africa"},{"key":"#cr-split#-11184_CR23.2","unstructured":"[cited 2023 Feb 6]. Available from: http:\/\/www.kznhealth.gov.za\/app\/APP-2018-19.pdf"},{"issue":"7760","key":"11184_CR24","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1038\/s41586-019-1200-9","volume":"570","author":"L Dwyer-Lindgren","year":"2019","unstructured":"Dwyer-Lindgren L, Cork MA, Sligar A, Steuben KM, Wilson KF, Provost NR, et al. Mapping HIV prevalence in sub-Saharan Africa between 2000 and 2017. Nature. 2019;570(7760):189\u201393.","journal-title":"Nature"},{"issue":"1","key":"11184_CR25","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1186\/s13012-018-0736-7","volume":"13","author":"ME Fernandez","year":"2018","unstructured":"Fernandez ME, Walker TJ, Weiner BJ, Calo WA, Liang S, Risendal B, et al. Developing measures to assess constructs from the Inner Setting domain of the Consolidated Framework for Implementation Research. Implement Sci. 2018;13(1):52.","journal-title":"Implement Sci"},{"issue":"1","key":"11184_CR26","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1186\/1748-5908-4-38","volume":"4","author":"CD Helfrich","year":"2009","unstructured":"Helfrich CD, Li YF, Sharp ND, Sales AE. Organizational Readiness to Change Assessment (ORCA): Development of an instrument based on the Promoting Action on Research in Health Services (PARIHS) framework. Implement Sci. 2009;4(1):38.","journal-title":"Implement Sci"},{"key":"11184_CR27","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1016\/j.socscimed.2016.04.002","volume":"157","author":"SA Lippman","year":"2016","unstructured":"Lippman SA, Neilands TB, Leslie HH, Maman S, MacPhail C, Twine R, et al. Development, validation, and performance of a scale to measure community mobilization. Soc Sci Med. 2016;157:127\u201337.","journal-title":"Soc Sci Med"},{"key":"11184_CR28","doi-asserted-by":"crossref","unstructured":"Lippman SA, Maman S, MacPhail C, Twine R, Peacock D, Kahn K, et al. Conceptualizing community mobilization for HIV prevention: implications for HIV prevention programming in the African context. PLoS ONE. 2013;8(10):e78208.","DOI":"10.1371\/journal.pone.0078208"},{"issue":"9","key":"11184_CR29","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1186\/1748-5908-9-7","volume":"10","author":"CM Shea","year":"2014","unstructured":"Shea CM, Jacobs SR, Esserman DA, Bruce K, Weiner BJ. Organizational readiness for implementing change: a psychometric assessment of a new measure. Implement Sci. 2014;10(9):7.","journal-title":"Implement Sci"},{"issue":"2","key":"11184_CR30","doi-asserted-by":"publisher","first-page":"12","DOI":"10.12927\/whp.2013.23271","volume":"14","author":"LL Zullig","year":"2013","unstructured":"Zullig LL, Muiruri C, Abernethy A, Weiner BJ, Bartlett J, Oneko O, et al. Cancer registration needs assessment at a tertiary medical center in Kilimanjaro. Tanzania World Health Popul. 2013;14(2):12\u201323.","journal-title":"Tanzania World Health Popul"},{"key":"11184_CR31","unstructured":"COVID-19 \/ Coronavirus | South African Government [Internet]. [cited 2023 Mar 20]. Available from: https:\/\/www.gov.za\/Coronavirus"},{"key":"11184_CR32","volume-title":"Service Availability and Readiness Assessment (SARA) Reference Manual","author":"World Health Organization","year":"2013","unstructured":"World Health Organization. Service Availability and Readiness Assessment (SARA) reference manual. Geneva, Switzerland: World Health Organization; 2013."},{"issue":"4","key":"11184_CR33","doi-asserted-by":"publisher","first-page":"815","DOI":"10.1177\/1094428106296642","volume":"11","author":"JM LeBreton","year":"2008","unstructured":"LeBreton JM, Senter JL. Answers to 20 Questions about interrater reliability and interrater agreement. Organ Res Methods. 2008;11(4):815\u201352.","journal-title":"Organ Res Methods"},{"key":"11184_CR34","first-page":"567","volume-title":"Statistical Power Analysis for the Behavioral Sciences","author":"J Cohen","year":"1988","unstructured":"Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. New York: Routledge; 1988. p. 567.","edition":"2"},{"issue":"1","key":"11184_CR35","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1186\/1748-5908-9-45","volume":"9","author":"GA Aarons","year":"2014","unstructured":"Aarons GA, Ehrhart MG, Farahnak LR. The Implementation Leadership Scale (ILS): development of a brief measure of unit level implementation leadership. Implementation Sci. 2014;9(1):45.","journal-title":"Implementation Sci"},{"issue":"1","key":"11184_CR36","doi-asserted-by":"publisher","first-page":"652","DOI":"10.3390\/ijerph120100652","volume":"12","author":"N Khamisa","year":"2015","unstructured":"Khamisa N, Oldenburg B, Peltzer K, Ilic D. Work related stress, burnout, job satisfaction and general health of nurses. Int J Environ Res Public Health. 2015;12(1):652\u201366.","journal-title":"Int J Environ Res Public Health"},{"issue":"1","key":"11184_CR37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.4102\/sajip.v35i1.423","volume":"35","author":"JJ van der Colff","year":"2009","unstructured":"van der Colff JJ, Rothmann S. Occupational stress, sense of coherence, coping, burnout and work engagement of registered nurses in South Africa. SA J Ind Psychol. 2009;35(1):1\u201310.","journal-title":"SA J Ind Psychol"},{"issue":"245","key":"11184_CR38","doi-asserted-by":"publisher","DOI":"10.1016\/j.socscimed.2019.112698","volume":"1","author":"J McKnight","year":"2020","unstructured":"McKnight J, Nzinga J, Jepkosgei J, English M. Collective strategies to cope with work related stress among nurses in resource constrained settings: An ethnography of neonatal nursing in Kenya. Soc Sci Med. 2020;1(245).","journal-title":"Soc Sci Med"},{"key":"11184_CR39","doi-asserted-by":"crossref","unstructured":"Gilson L, Barasa E, Nxumalo N, Cleary S, Goudge J, Molyneux S, et al. Everyday resilience in district health systems: emerging insights from the front lines in Kenya and South Africa. BMJ Glob Health. 2017;2:e000224.","DOI":"10.1136\/bmjgh-2016-000224"}],"container-title":["BMC Health Services Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12913-024-11184-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12913-024-11184-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12913-024-11184-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,22]],"date-time":"2024-11-22T02:01:49Z","timestamp":1732240909000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmchealthservres.biomedcentral.com\/articles\/10.1186\/s12913-024-11184-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,18]]},"references-count":40,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["11184"],"URL":"https:\/\/doi.org\/10.1186\/s12913-024-11184-9","relation":{},"ISSN":["1472-6963"],"issn-type":[{"value":"1472-6963","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,18]]},"assertion":[{"value":"4 August 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 June 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 June 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This study was approved by the Institutional Review Board at the University of California, San Francisco (20\u201331802), the Research Ethics Committee at the Human Sciences Research Council (REC 1\/19\/08\/20), and the uMgungundlovu Health District; all methods were carried out in accordance with relevant guidelines and regulations. All facilities provided consent for inclusion and each participant provided written informed consent to participate.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"744"}}