{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,6,4]],"date-time":"2023-06-04T21:11:03Z","timestamp":1685913063528},"reference-count":36,"publisher":"FapUNIFESP (SciELO)","issue":"12","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Cad. Sa\u00fade P\u00fablica"],"published-print":{"date-parts":[[2010,12]]},"abstract":"<jats:p>A participatory, formative meta-evaluation of baseline studies in Brazil is presented. International standards recommended by associations of evaluators were used, along with \"specificity\" criteria built up using the terms of reference for proposals for the selection of studies. The methodological approach combined a \"peer review\" of baseline study reports, with a participatory (self) assessment for \"primary\" evaluators, the average of which provided the final score. Results revealed a classification of \"good\" and \"very good\" for the set of standards. The differences between the attribution of scores further highlight the importance of taking into account multiple points of view. Given the lack of pre-existing standards for the reports, the absence of standards and the incipient nature of evaluation focusing on utility, this meta-evaluation does not adequately reflect the quality or potential utility of the baseline studies, however, it will certainly contribute to overcoming these limitations and improving future impact studies of the Brazilian Family Health Strategy Expansion Project (PROESF).<\/jats:p>","DOI":"10.1590\/s0102-311x2010001200006","type":"journal-article","created":{"date-parts":[[2011,1,11]],"date-time":"2011-01-11T21:38:24Z","timestamp":1294781904000},"page":"2270-2278","source":"Crossref","is-referenced-by-count":2,"title":["Meta-evaluation of baseline studies of the Brazilian Family Health Strategy Expansion Project: a participatory and formative approach"],"prefix":"10.1590","volume":"26","author":[{"given":"Ana Cl\u00e1udia","family":"Figueir\u00f3","sequence":"first","affiliation":[{"name":"Instituto de Medicina Integral Prof. Fernando Figueira, Brasil"}]},{"given":"Zulmira Maria de Ara\u00fajo","family":"Hartz","sequence":"additional","affiliation":[{"name":"Instituto de Medicina Integral Prof. Fernando Figueira, Brasil"}]},{"given":"Luiz Claudio Santos","family":"Thuler","sequence":"additional","affiliation":[{"name":"Instituto Nacional de C\u00e2ncer, Brasil"}]},{"given":"Andr\u00e9 Luiz Freitas","family":"Dias","sequence":"additional","affiliation":[{"name":"Universidade Federal de Minas Gerais, Brasil"}]}],"member":"530","reference":[{"key":"ref1","series-title":"Termo de Refer\u00eancia para o Sub-Componente D Linha de A\u00e7\u00e3o 3 _ Estudos de Linha de Base: Desenvolvimento de Estudos de Linha de Base nos Munic\u00edpios Selecionados para o Componente 1 _ 2004"},{"key":"ref2","series-title":"Meta-avalia\u00e7\u00e3o da aten\u00e7\u00e3o b\u00e1sica em sa\u00fade: teoria e pr\u00e1tica","first-page":"369","volume-title":"Estudos de impacto do PROESF: considera\u00e7\u00f5es e diretrizes preliminares necess\u00e1rias \u00e0 sua proposi\u00e7\u00e3o","author":"Felisberto E","year":"2008"},{"key":"ref3","doi-asserted-by":"crossref","first-page":"iii","DOI":"10.56645\/jmde.v6i11.220","article-title":"Meta-evaluation revisited","volume":"6","author":"Scriven M","year":"2009","journal-title":"Journal of MultiDisciplinary Evaluation"},{"key":"ref4","series-title":"National AIDS programmes: a guide to monitoring and evaluating HIV\/AIDS care and support","year":"2004"},{"key":"ref5","doi-asserted-by":"crossref","first-page":"553","DOI":"10.1590\/S1413-81232006000300002","article-title":"Da teoria \u00e0 formula\u00e7\u00e3o de uma Pol\u00edtica Nacional de Avalia\u00e7\u00e3o em Sa\u00fade: reabrindo o debate","volume":"11","author":"Felisberto E","year":"2006","journal-title":"Ci\u00eanc Sa\u00fade Coletiva"},{"key":"ref6","doi-asserted-by":"crossref","first-page":"725","DOI":"10.1590\/S1413-81232006000300019","article-title":"Estudos de Linha de Base do Projeto de Expans\u00e3o e Consolida\u00e7\u00e3o do Sa\u00fade da Fam\u00edlia (ELB\/PROESF): considera\u00e7\u00f5es sobre seu acompanhamento","volume":"11","author":"Bodstein R","year":"2006","journal-title":"Ci\u00eanc Sa\u00fade Coletiva"},{"key":"ref7","doi-asserted-by":"crossref","first-page":"454","DOI":"10.1177\/13563890260620649","article-title":"Theoretical framework and grid for analysis of programme _ evaluation practices","volume":"8","author":"Demarteau M","year":"2002","journal-title":"American Journal of Evaluation"},{"key":"ref8","doi-asserted-by":"crossref","first-page":"733","DOI":"10.1590\/S1413-81232006000300020","article-title":"Princ\u00edpios e padr\u00f5es em meta-avalia\u00e7\u00e3o: diretrizes para os programas de Sa\u00fade","volume":"11","author":"Hartz ZMA","year":"2006","journal-title":"Ci\u00eanc Sa\u00fade Coletiva"},{"key":"ref9","series-title":"Meta-avalia\u00e7\u00e3o da aten\u00e7\u00e3o b\u00e1sica em sa\u00fade: teoria e pr\u00e1tica","first-page":"27","volume-title":"Do qu\u00ea ao pra qu\u00ea da meta-avalia\u00e7\u00e3o em sa\u00fade","author":"Hartz ZMA","year":"2008"},{"key":"ref10","doi-asserted-by":"crossref","first-page":"S93","DOI":"10.1590\/S1519-38292005000500010","article-title":"Why we should be worried about evidence-based practice in health promotion","volume":"5","author":"Potvin L","year":"2005","journal-title":"Rev Bras Sa\u00fade Matern Infant"},{"key":"ref11","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1177\/109821400102200204","article-title":"The metaevaluation imperative","volume":"2","author":"Stufflebeam DL","year":"2001","journal-title":"American Journal of Evaluation"},{"key":"ref12","series-title":"Program evaluation: alternative approaches and practical guidelines","author":"Worthen BR","year":"1997","edition":"2th"},{"key":"ref13","series-title":"Avalia\u00e7\u00e3o de programas: concep\u00e7\u00f5es e pr\u00e1ticas","author":"Worthen BR","year":"2004"},{"key":"ref14","series-title":"Evaluation thesaurus","author":"Scriven M","year":"1991","edition":"4th"},{"key":"ref15","first-page":"120","article-title":"Une approche pluraliste et participative: coproduire l'\u00e9valuation avec la soci\u00e9t\u00e9 civile","volume":"110","author":"Baron G","year":"2003","journal-title":"Informations Sociales"},{"key":"ref16","series-title":"Sourcebook for evaluating global and regional partnership programs: indicative principles and standards _ 2007"},{"key":"ref17","series-title":"Fourth generation evaluation","first-page":"228","volume-title":"Judging the quality of fourth generation evaluation","author":"Guba EG","year":"1989"},{"key":"ref18","series-title":"Program evaluations metaevaluation checklist","author":"Stufflebeam DL"},{"key":"ref19","first-page":"1","article-title":"Framework for program evaluation in public health","volume":"48","year":"1999","journal-title":"MMWR Recomm Rep"},{"key":"ref20","series-title":"International perspectives on evaluation standards: new directions for evaluation","first-page":"5","volume-title":"Evaluation standards in an international context","author":"Love A","year":"2004"},{"key":"ref21","series-title":"Health promotion evaluation practices in the Americas: values and research","first-page":"253","volume-title":"Multi-strategy in the evaluation of health promotion community interventions: an indicator of quality","author":"Hartz ZMA","year":"2008"},{"key":"ref22","doi-asserted-by":"crossref","first-page":"705","DOI":"10.1590\/S1413-81232006000300017","article-title":"Avaliando a institucionaliza\u00e7\u00e3o da avalia\u00e7\u00e3o","volume":"11","author":"Contandriopoulos AP","year":"2006","journal-title":"Ci\u00eanc Sa\u00fade Coletiva"},{"key":"ref23","series-title":"L'\u00e9valuacion: conceptes et m\u00e9thodes","first-page":"273","volume-title":"\u00c9valuer l'\u00e9valuation","author":"Contandriopoulos AP","year":"2009"},{"issue":"80","key":"ref24","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1002\/ev.1114","article-title":"Framing participatory evaluation","author":"Cousins JB","year":"1998","journal-title":"New Directions for Evaluation"},{"key":"ref25","series-title":"An evaluation framework of community health programs","author":"Center for the Advancement of Community Based Public Health; Baker QE","year":"2000"},{"key":"ref26","series-title":"Dimens\u00e3o t\u00e9cnico-operacional: Unidade did\u00e1tico-pedag\u00f3gica: modelo te\u00f3rico de avalia\u00e7\u00e3o","author":"Santos EM","year":"2006"},{"key":"ref27","series-title":"Utilization focused evaluation: the news century text","first-page":"371","volume-title":"Utilization-focused evaluation: process and premises","author":"Patton MQ","year":"1997","edition":"3th"},{"key":"ref28","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1177\/1356389006066972","article-title":"Evaluation in multi-actor policy processes","volume":"12","author":"Van Der Meer FB","year":"2006","journal-title":"Evaluation","ISSN":"http:\/\/id.crossref.org\/issn\/0090-4449","issn-type":"print"},{"key":"ref29","doi-asserted-by":"crossref","first-page":"32","DOI":"10.56645\/jmde.v6i11.209","article-title":"Metaevaluation as a means of examining evaluation influence","volume":"6","author":"Oliver ML","year":"2009","journal-title":"Journal of MultiDisciplinary Evaluation"},{"key":"ref30","doi-asserted-by":"crossref","first-page":"468","DOI":"10.1177\/135638909900500408","article-title":"The interface between evaluation and public policy","volume":"5","author":"Weiss CH","year":"1999","journal-title":"Evaluation","ISSN":"http:\/\/id.crossref.org\/issn\/0090-4449","issn-type":"print"},{"key":"ref31","series-title":"Educational evaluation: alternative approaches and practical guidelines","author":"Worthen BR","year":"1987"},{"key":"ref32","series-title":"Theory-driven evaluation","first-page":"17","volume-title":"Method and theory in program evaluation: a question of balance","author":"Chen HT","year":"1990"},{"key":"ref33","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1177\/13563890022209118","article-title":"Meta-evaluation as a tool for learning","volume":"6","author":"Uusikyl\u00e4 P","year":"2000","journal-title":"Evaluation","ISSN":"http:\/\/id.crossref.org\/issn\/0090-4449","issn-type":"print"},{"key":"ref34","series-title":"Meta-avalia\u00e7\u00e3o da aten\u00e7\u00e3o b\u00e1sica em sa\u00fade: teoria e pr\u00e1tica","first-page":"71","volume-title":"Linha de base matricial da implementa\u00e7\u00e3o do PROESF","author":"Pontes-da-Silva GA","year":"2008"},{"key":"ref35","series-title":"Meta-avalia\u00e7\u00e3o da aten\u00e7\u00e3o b\u00e1sica em sa\u00fade: teoria e pr\u00e1tica","first-page":"101","volume-title":"Utilidade da avalia\u00e7\u00e3o para gestores de sa\u00fade: uma contribui\u00e7\u00e3o com base na an\u00e1lise dos relat\u00f3rios dos Estudos de Linha de Base","author":"Medina MG","year":"2008"},{"key":"ref36","series-title":"Report on improving the professionalism of evaluation 2005"}],"container-title":["Cadernos de Sa\u00fade P\u00fablica"],"original-title":[],"link":[{"URL":"http:\/\/www.scielo.br\/pdf\/csp\/v26n12\/06.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,4]],"date-time":"2023-06-04T20:34:30Z","timestamp":1685910870000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.scielo.br\/scielo.php?script=sci_arttext&pid=S0102-311X2010001200006&lng=en&tlng=en"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,12]]},"references-count":36,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2010,12]]}},"alternative-id":["S0102-311X2010001200006"],"URL":"https:\/\/doi.org\/10.1590\/s0102-311x2010001200006","relation":{},"ISSN":["0102-311X"],"issn-type":[{"value":"0102-311X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,12]]}}}