{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T06:05:20Z","timestamp":1790661920717,"version":"4.1.0"},"reference-count":39,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T00:00:00Z","timestamp":1790640000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001807","name":"S\u00e3o Paulo Research Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001807","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Institute of Health"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Public Health"],"abstract":"<jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Brazil\u2019s Unified Health System (SUS) is one of the world\u2019s largest universal health systems and operates through a plural governance arrangement involving public, philanthropic, and community actors under public coordination. In Primary Health Care (PHC), non-profit Social Health Organizations (OSS) are increasingly responsible for managing public healthcare facilities in large urban municipalities. However, evaluation systems used by public managers remain largely focused on service delivery indicators, with limited consideration of equity and user experience.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Aim<\/jats:title>\n                    <jats:p>To examine how participatory approaches can broaden the informational foundations of evaluation, strengthen social accountability in contractual governance, and support more equity-oriented primary health care.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We conducted a comparative cross-sectional qualitative study embedded in a multi-stage participatory research process in two large urban Brazilian municipalities. Data collection included a review of policy documents and literature, semi-structured interviews with public officials, OSS managers, health professionals, health council representatives, and focus group discussions with users and health council representatives. Findings from these stages informed an iterative co-creation process to develop a user-centered questionnaire.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Documentary analysis and key informant interviews showed that evaluation systems in both municipalities had developed substantial capacities for monitoring service production, coverage, operational performance and contractual compliance, while user experience, responsiveness and equity remained less systematically incorporated. Drawing on these materials, we developed an equity framework organized around three broad evaluative dimensions\u2014Responsiveness to Population Needs and Territorial Conditions, Sociocultural Dimensions of Care, and Comprehensive Care for the Person. Focus group discussions further showed how these gaps were experienced in practice, particularly through barriers related to access, communication, continuity, respect and responsiveness to diverse needs. Finally, findings from the documentary analysis, interviews and focus group discussions were integrated with the equity framework and translated into a proposed user-centered questionnaire.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Co-creation broadens the informational foundations of evaluation by translating users\u2019 experiential knowledge into actionable measures for performance assessment and quality improvement. This has the potential to strengthen accountability by incorporating forms of knowledge that are typically absent from conventional performance frameworks.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/fpubh.2026.1938730","type":"journal-article","created":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T05:48:10Z","timestamp":1790660890000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Accountability and equity in primary health care: co-creating user-centered evaluation systems for public-private partnerships"],"prefix":"10.3389","volume":"14","author":[{"given":"Vera Schattan P.","family":"Coelho","sequence":"first","affiliation":[{"name":"Citizenship, Health and Development Group, Brazilian Center of Analysis and Planning (CEBRAP), Federal University of ABC","place":["Santo Andr\u00e9, Brazil"]},{"name":"Centro Brasileiro de Analise e Planejamento","place":["S\u00e3o Paulo, Brazil"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Frederico","family":"Haddad","sequence":"additional","affiliation":[{"name":"Centro Brasileiro de Analise e Planejamento","place":["S\u00e3o Paulo, Brazil"]},{"name":"Citizenship, Health and Development Group, Brazilian Center of Analysis and Planning (CEBRAP), Federal University of Maranh\u00e3o","place":["S\u00e3o Lu\u00eds, Brazil"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,9,29]]},"reference":[{"key":"ref1","volume-title":"SUS a plural Healthcare system. COMPLUS Series Brazil","year":"2025"},{"key":"ref2","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1186\/s12939-025-02567-3","article-title":"Community participation and contracting between state and non-state actors in primary care: a scoping review of evidence","volume":"24","author":"Khan","year":"2025","journal-title":"Int J Equity Health"},{"key":"ref3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1093\/heapol\/czm042","article-title":"The effectiveness of contracting-out primary health care services in developing countries: a review of the evidence","volume":"23","author":"Liu","year":"2008","journal-title":"Health Policy Plan"},{"key":"ref4","volume-title":"Contracting for the Delivery of Community Health Services: A Review of Global Experience. Health, Nutrition and Population Discussion Paper","author":"Loevinsohn","year":"2004"},{"key":"ref5","doi-asserted-by":"crossref","first-page":"418","DOI":"10.4337\/9781800887565.00027","volume-title":"Research Handbook on Health Care Policy","author":"Coelho","year":"2024"},{"key":"ref6","doi-asserted-by":"publisher","first-page":"1504","DOI":"10.1002\/hec.4676","article-title":"Is primary health care worth it in the long run? Evidence from Brazil","volume":"32","author":"Ferreira-Batista","year":"2023","journal-title":"Health Econ"},{"key":"ref7","doi-asserted-by":"publisher","first-page":"e000829","DOI":"10.1136\/bmjgh-2018-000829","article-title":"Brazilian health system at crossroads: progress, crisis and resilience","volume":"3","author":"Massuda","year":"2018","journal-title":"BMJ Glob Health"},{"key":"ref8","doi-asserted-by":"publisher","first-page":"867","DOI":"10.1590\/00115258201694","article-title":"Social health organizations and the performance of the SUS: a study on basic healthcare in S\u00e3o Paulo","volume":"59","author":"Coelho","year":"2016","journal-title":"Dados"},{"key":"ref9","volume-title":"Anais do 14\u00ba Encontro da Associa\u00e7\u00e3o Brasileira de Ci\u00eancia Pol\u00edtica (ABCP)","author":"Khan","year":"2024"},{"key":"ref10","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1186\/s12939-019-0935-0","article-title":"The health equity measurement framework: a comprehensive model to measure social inequities in health","volume":"18","author":"Dover","year":"2019","journal-title":"Int J Equity Health"},{"key":"ref11","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1186\/1471-2296-13-20","article-title":"Mapping the coverage of attributes in validated instruments that evaluate primary healthcare from the patient perspective","volume":"13","author":"L\u00e9vesque","year":"2012","journal-title":"BMC Fam Pract"},{"key":"ref12","doi-asserted-by":"publisher","first-page":"125","DOI":"10.17566\/ciads.v10i4.810","article-title":"Transpar\u00eancia nas rela\u00e7\u00f5es p\u00fablico-privadas para presta\u00e7\u00e3o de servi\u00e7os de sa\u00fade no estado de S\u00e3o Paulo","volume":"10","author":"Barboza","year":"2021","journal-title":"Cad Ibero Am Direito Sanit"},{"key":"ref13","doi-asserted-by":"publisher","first-page":"03061","DOI":"10.7189\/jogh.11.03061","article-title":"Community participation: lessons and challenges of the 30 years of health councils in Brazil","volume":"11","author":"Bispo","year":"2021","journal-title":"J Glob Health"},{"key":"ref14","doi-asserted-by":"publisher","first-page":"9","DOI":"10.16997\/jdd.161","article-title":"What did we learn about citizen involvement in the health policy process: lessons from Brazil","volume":"9","author":"Coelho","year":"2013","journal-title":"J Public Deliberation"},{"key":"ref15","doi-asserted-by":"publisher","first-page":"1120","DOI":"10.1186\/s12913-021-07161-1","article-title":"Social participation in the unified health system of Brazil: an exploratory study on the adequacy of health councils to resolution 453\/2012","volume":"21","author":"de C\u00e1ssia Costa Da Silva","year":"2021","journal-title":"BMC Health Serv Res"},{"key":"ref16","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1177\/1098214013478142","article-title":"The case for participatory evaluation in an era of accountability","volume":"34","author":"Chouinard","year":"2013","journal-title":"Am J Eval"},{"key":"ref17","doi-asserted-by":"publisher","first-page":"325","DOI":"10.1146\/annurev.publhealth.29.091307.083824","article-title":"The value and challenges of participatory research: strengthening its practice","volume":"29","author":"Cargo","year":"2008","journal-title":"Annu Rev Public Health"},{"key":"ref18","doi-asserted-by":"crossref","first-page":"1667","DOI":"10.1016\/0277-9536(95)00127-S","article-title":"What is participatory research?","volume":"41","author":"Cornwall","year":"1995","journal-title":"Soc Sci Med"},{"key":"ref19","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1136\/qshc.2005.016527","article-title":"Experience-based design: from redesigning the system around the patient to co-designing services with the patient","volume":"15","author":"Bate","year":"2006","journal-title":"BMJ Qual Saf"},{"key":"ref20","doi-asserted-by":"publisher","first-page":"785","DOI":"10.1111\/hex.12888","article-title":"Frameworks for supporting patient and public involvement in research: systematic review and co-design pilot","volume":"22","author":"Greenhalgh","year":"2019","journal-title":"Health Expect"},{"key":"ref21","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1590\/0103-1104202313705","article-title":"O Fundo de Sa\u00fade e sua apropria\u00e7\u00e3o pelas Organiza\u00e7\u00f5es Sociais no munic\u00edpio de S\u00e3o Paulo","volume":"47","author":"Correia","year":"2023","journal-title":"Saude Debate"},{"key":"ref22","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1186\/s40900-016-0019-x","article-title":"Patient-reported quality indicators for osteoarthritis: a patient and public generated self-report measure for primary care","volume":"2","author":"Blackburn","year":"2016","journal-title":"Res Involv Engagem"},{"key":"ref23","doi-asserted-by":"publisher","first-page":"3558","DOI":"10.1016\/j.pec.2022.08.018","article-title":"Co-design to increase implementation of insomnia guidelines in primary care","volume":"105","author":"Coteur","year":"2022","journal-title":"Patient Educ Couns"},{"key":"ref24","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1097\/CEH.0000000000000440","article-title":"Consensus-based development of an assessment tool: a methodology for patient engagement in primary care and CPD research","volume":"42","author":"Lin","year":"2022","journal-title":"J Contin Educ Heal Prof"},{"key":"ref25","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1186\/s12961-021-00716-y","article-title":"Collective reflections on the first cycle of a collaborative learning platform to strengthen rural primary healthcare in Mpumalanga, South Africa","volume":"19","author":"van der Merwe","year":"2021","journal-title":"Health Res Policy Syst"},{"key":"ref26","volume-title":"An\u00e1lise de conte\u00fado","author":"Bardin","year":"2016"},{"key":"ref27","doi-asserted-by":"publisher","first-page":"mzab107","DOI":"10.1093\/intqhc\/mzab107","article-title":"What makes a good quality indicator set? A systematic review of criteria","volume":"33","author":"Schang","year":"2021","journal-title":"Int J Qual Health Care"},{"key":"ref28","doi-asserted-by":"publisher","first-page":"323","DOI":"10.25091\/S01013300201900020003","article-title":"\u201cAccountability\u201d e redu\u00e7\u00e3o das desigualdades em sa\u00fade: a experi\u00eancia de S\u00e3o Paulo","volume":"38","author":"Coelho","year":"2019","journal-title":"Novos Estud CEBRAP"},{"key":"ref29","volume-title":"Portaria no 2.436, de 21 de setembro de 2017: Pol\u00edtica Nacional de Aten\u00e7\u00e3o B\u00e1sica [Ordinance No. 2,436 of 21 September 2017: National Primary Health Care Policy]","year":"2017"},{"key":"ref30","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1002\/ev.20245","article-title":"Building evaluation capacity to address problems of equity","volume":"154","author":"Carden","year":"2017","journal-title":"N Dir Eval"},{"key":"ref31","doi-asserted-by":"publisher","first-page":"102648","DOI":"10.1016\/j.evalprogplan.2025.102648","article-title":"Approaches to incorporating equity into program evaluation: a scoping review","volume":"112","author":"Faruquzzaman","year":"2025","journal-title":"Eval Program Plann"},{"key":"ref32","doi-asserted-by":"publisher","first-page":"302","DOI":"10.1177\/1098214005278749","article-title":"The use of multiple evaluation approaches in program evaluation","volume":"26","author":"Bledsoe","year":"2005","journal-title":"Am J Eval"},{"key":"ref33","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1136\/bmjqs-2024-017301","article-title":"Development of the patient-reported Indicator surveys (PaRIS) conceptual framework to monitor and improve the performance of primary care for people living with chronic conditions","volume":"34","author":"Valderas","year":"2025","journal-title":"BMJ Qual Saf"},{"key":"ref34","first-page":"93","volume-title":"Mosaico de Olhares","author":"Coelho","year":"2021"},{"key":"ref35","volume-title":"Evaluation for equitable development results","author":"Segone","year":"2012"},{"key":"ref36","volume-title":"Lei n\u00b0 8.142, de 28 de dezembro de 1990 [Law No. 8,142 of 28 December 1990]. Disp\u00f5e sobre a participa\u00e7\u00e3o da comunidade na gest\u00e3o do Sistema \u00danico de Sa\u00fade (SUS) e sobre as transfer\u00eancias intergovernamentais de recursos financeiros na \u00e1rea da sa\u00fade e d\u00e1 outras provid\u00eancias","year":"1990"},{"key":"ref37","volume-title":"HumanizaSUS: Documento base para Gestores e Trabalhadores do SUS [HumanizaSUS: National Humanization Policy\u2014Reference Document for SUS Managers and Workers]","year":"2010"},{"key":"ref38","volume-title":"Programa Estrat\u00e9gico de A\u00e7\u00f5es Afirmativas: Popula\u00e7\u00e3o Negra e Aids [Strategic Affirmative Action Programme: Black Population and AIDS]","year":"2005"},{"key":"ref39","volume-title":"Portaria n\u00b0 1.820, de 13 de agosto de 2009: Carta dos Direitos dos Usu\u00e1rios da Sa\u00fade [Ordinance No. 1,820 of 13 August 2009: Health Service Users\u2019 Bill of Rights]","year":"2009"}],"container-title":["Frontiers in Public Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2026.1938730\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T05:48:14Z","timestamp":1790660894000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpubh.2026.1938730\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,29]]},"references-count":39,"alternative-id":["10.3389\/fpubh.2026.1938730"],"URL":"https:\/\/doi.org\/10.3389\/fpubh.2026.1938730","relation":{},"ISSN":["2296-2565"],"issn-type":[{"value":"2296-2565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,29]]},"article-number":"1938730"}}