{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T15:44:41Z","timestamp":1759938281886},"reference-count":42,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2014,8,26]],"date-time":"2014-08-26T00:00:00Z","timestamp":1409011200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2014,10]]},"DOI":"10.1007\/s11192-014-1397-1","type":"journal-article","created":{"date-parts":[[2014,8,25]],"date-time":"2014-08-25T11:36:11Z","timestamp":1408966571000},"page":"85-107","update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["A propensity score approach in the impact evaluation on scientific production in Brazilian biodiversity research: the BIOTA Program"],"prefix":"10.1007","volume":"101","author":[{"given":"Fernando A. B.","family":"Colugnati","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sergio","family":"Firpo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paula F. Drummond","family":"de Castro","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Juan E.","family":"Sepulveda","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sergio L. M.","family":"Salles-Filho","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2014,8,26]]},"reference":[{"issue":"1","key":"1397_CR1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/0034-6527.00321","volume":"72","author":"A Abadie","year":"2005","unstructured":"Abadie, A. (2005). Semiparametric difference-in-differences estimators. The Review of Economic Studies, 72(1), 1\u201319.","journal-title":"The Review of Economic Studies"},{"issue":"3","key":"1397_CR2","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1111\/j.1756-2171.2011.00140.x","volume":"42","author":"P Azoulay","year":"2011","unstructured":"Azoulay, P., Zivin, J. S. G., & Manso, G. (2011). Incentives and creativity: Evidence from the academic life sciences. RAND Journal of Economics, 42(3), 527\u2013554.","journal-title":"RAND Journal of Economics"},{"issue":"3","key":"1397_CR3","doi-asserted-by":"crossref","first-page":"177","DOI":"10.3152\/095820209X466865","volume":"18","author":"S B\u00f6hmer","year":"2009","unstructured":"B\u00f6hmer, S., & von Ins, M. (2009). Different\u2014Not just by label: Research-oriented academic careers in Germany. Research Evaluation, 18(3), 177\u2013184.","journal-title":"Research Evaluation"},{"key":"1397_CR4","volume-title":"Evaluation of the Faculty Early Career Development (CAREER) Program","author":"J Carney","year":"2008","unstructured":"Carney, J., Smith, W., Parsad, A., Johnston, K., & Millsap, M. (2008). Evaluation of the Faculty Early Career Development (CAREER) Program. Bethesda, MD: Abt Associates Inc."},{"key":"1397_CR5","unstructured":"Chen, S., Mu, R., & Ravallion, M. (2008). Are there lasting impacts of aid to poor areas? Evidence for rural China. Policy Research Working Paper 4084, World Bank, Washington, DC."},{"issue":"1","key":"1397_CR6","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1093\/biomet\/asn055","volume":"96","author":"RK Crump","year":"2009","unstructured":"Crump, R. K., Hotz, J., Imbens, W., & Mitinik, O. A. (2009). Dealing with limited overlap in estimation of average treatment effects. Biometrika, 96(1), 187\u2013199.","journal-title":"Biometrika"},{"key":"1397_CR7","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1080\/01621459.2000.10474263","volume":"95","author":"RB D\u2019Agostino Jr","year":"2000","unstructured":"D\u2019Agostino, R. B, Jr, & Rubin, D. B. (2000). Estimating and using propensity scores with partially missing data. Journal of the American Statistical Association, 95, 749\u2013759.","journal-title":"Journal of the American Statistical Association"},{"key":"1397_CR8","unstructured":"Ferraro, P. J. (2009). Counterfactual thinking and impact evaluation in environmental policy. New Directions for Evaluation 122 (Special Issue: Environmental Program and Policy Evaluation: Addressing Methodological Challenges)."},{"issue":"4","key":"1397_CR9","doi-asserted-by":"crossref","first-page":"e105","DOI":"10.1371\/journal.pbio.0040105","volume":"4","author":"PJ Ferraro","year":"2006","unstructured":"Ferraro, P. J., & Pattanayak, S. K. (2006). Money for nothing? A call for empirical evaluation of biodiversity conservation investments. PLoS Biology, 4(4), e105. doi: 10.1371\/journal.pbio.0040105 .","journal-title":"PLoS Biology"},{"issue":"5","key":"1397_CR10","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1214\/aos\/1013203451","volume":"29","author":"JH Friedman","year":"2001","unstructured":"Friedman, J. H. (2001). Greedy function approximation: A gradient boosting machine. Annals of Statistics, 29(5), 1189\u20131232.","journal-title":"Annals of Statistics"},{"issue":"4","key":"1397_CR11","doi-asserted-by":"crossref","first-page":"515","DOI":"10.1016\/j.ecolecon.2004.12.013","volume":"55","author":"M Frondel","year":"2005","unstructured":"Frondel, M., & Schmidt, C. M. (2005). Evaluating environmental programs: The perspective of modern evaluation research. Ecological Economics, 55(4), 515\u2013526.","journal-title":"Ecological Economics"},{"key":"1397_CR12","doi-asserted-by":"crossref","DOI":"10.1007\/978-0-387-21606-5","volume-title":"The elements of statistical learning","author":"T Hastie","year":"2001","unstructured":"Hastie, T., Tibshirani, R., & Friedman, J. (2001). The elements of statistical learning. New York: Springer."},{"key":"1397_CR13","doi-asserted-by":"crossref","first-page":"1161","DOI":"10.1111\/1468-0262.00442","volume":"71","author":"K Hirano","year":"2003","unstructured":"Hirano, K., Imbens, G. W., & Ridder, G. (2003). Efficient estimation of average treatment effects using the estimated propensity score. Econometrica, 71, 1161\u20131189.","journal-title":"Econometrica"},{"issue":"1","key":"1397_CR14","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1007\/s11192-009-0411-5","volume":"79","author":"S Hornbostel","year":"2009","unstructured":"Hornbostel, S., B\u00f6hmer, S., Klingsporn, B., Neufeld, J., & von Ins, M. (2009). Funding of young scientist and scientific excellence. Scientometrics, 79(1), 171\u2013190.","journal-title":"Scientometrics"},{"issue":"3","key":"1397_CR15","doi-asserted-by":"crossref","first-page":"1413","DOI":"10.1016\/j.csda.2007.03.024","volume":"52","author":"T Hoshino","year":"2008","unstructured":"Hoshino, T. (2008). A Bayesian propensity score adjustment for latent variable modeling and MCMC algorithm. Computational Statistics & Data Analysis, 52(3), 1413\u20131429.","journal-title":"Computational Statistics & Data Analysis"},{"issue":"3","key":"1397_CR16","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1080\/10618600.1996.10474713","volume":"5","author":"R Ihaka","year":"1996","unstructured":"Ihaka, R., & Gentleman, R. (1996). R: A language for data analysis and graphics. Journal of Computational and Graphical Statistics, 5(3), 299\u2013314.","journal-title":"Journal of Computational and Graphical Statistics"},{"issue":"3","key":"1397_CR17","doi-asserted-by":"crossref","first-page":"747","DOI":"10.1007\/s11192-011-0440-8","volume":"88","author":"R Inglesi-Lotz","year":"2011","unstructured":"Inglesi-Lotz, R., & Pouris, A. (2011). Scientometric impact assessment of a research policy instrument: The case of rating researchers on scientific outputs in South Africa. Scientometrics, 88(3), 747\u2013760.","journal-title":"Scientometrics"},{"key":"1397_CR18","doi-asserted-by":"crossref","first-page":"864","DOI":"10.1016\/j.respol.2011.04.003","volume":"40","author":"BA Jacob","year":"2011","unstructured":"Jacob, B. A., & Lefgren, L. (2011). The impact of NIH postdoctoral training grants on scientific productivity. Research Policy, 40, 864\u2013874.","journal-title":"Research Policy"},{"issue":"1","key":"1397_CR19","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1198\/073500102288618720","volume":"21","author":"J Jalan","year":"2003","unstructured":"Jalan, J., & Ravallion, M. (2003). Estimating the benefit incidence of an antipoverty program by propensity-score matching. Journal of Business and Economic Statistics, 21(1), 19\u201330.","journal-title":"Journal of Business and Economic Statistics"},{"key":"1397_CR20","doi-asserted-by":"crossref","first-page":"1358","DOI":"10.1126\/science.1188639","volume":"328","author":"CA Joly","year":"2010","unstructured":"Joly, C. A., Rodrigues, R. R., Metzger, J. P., Haddad, C. F. B., Verdade, L. M., Oliveira, M. C., et al. (2010). Biodiversity conservation research, training, and policy in S\u00e3o Paulo. Science, 328, 1358\u20131359.","journal-title":"Science"},{"key":"1397_CR21","doi-asserted-by":"crossref","DOI":"10.1596\/978-0-8213-8028-4","volume-title":"Handbook on impact evaluation quantitative methods and practices","author":"SR Khandker","year":"2009","unstructured":"Khandker, S. R., Koolwal, G. B., & Samad, H. A. (2009). Handbook on impact evaluation quantitative methods and practices. Washington, DC: World Bank."},{"issue":"807","key":"1397_CR22","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1007\/s10531-010-9981-z","volume":"20","author":"X Liu","year":"2011","unstructured":"Liu, X., Zhang, L., & Hong, S. (2011). Global biodiversity research during 1900\u20132009: A bibliometric analysis. Biodiversity Conservation, 20(807), 807\u2013826.","journal-title":"Biodiversity Conservation"},{"issue":"3","key":"1397_CR23","first-page":"502","volume":"29","author":"L Lynch","year":"2007","unstructured":"Lynch, L., Gray, W., & Geoghegan, J. (2007). Are farmland preservation program easement restrictions capitalized into farmland prices? What can a propensity score matching analysis tell us? Applied Economic Perspectives and Policy, 29(3), 502\u2013509.","journal-title":"Applied Economic Perspectives and Policy"},{"issue":"4","key":"1397_CR24","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1037\/1082-989X.9.4.403","volume":"9","author":"D McCarey","year":"2004","unstructured":"McCarey, D., Ridgeway, G., & Morral, A. (2004). Propensity score estimation with boosted regression for evaluating adolescent substance abuse treatment. Psychological Methods, 9(4), 403\u2013425.","journal-title":"Psychological Methods"},{"issue":"4","key":"1397_CR25","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1007\/BF03194511","volume":"15","author":"JP Mena-Chalco","year":"2009","unstructured":"Mena-Chalco, J. P., & Cesar, R. M, Jr. (2009). scriptLattes: An open-source knowledge extraction system from the Lattes platform. Journal of the Brazilian Computer Society, 15(4), 31\u201339.","journal-title":"Journal of the Brazilian Computer Society"},{"issue":"2","key":"1397_CR26","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1007\/s11192-012-0670-4","volume":"92","author":"R Mutz","year":"2012","unstructured":"Mutz, R., & Daniel, H.-D. (2012). The generalized propensity score methodology for estimating unbiased journal impact factors. Scientometrics, 92(2), 377\u2013390.","journal-title":"Scientometrics"},{"issue":"3","key":"1397_CR27","doi-asserted-by":"crossref","first-page":"370","DOI":"10.2307\/2344614","volume":"135","author":"J Nelder","year":"1972","unstructured":"Nelder, J., & Wedderburn, R. (1972). Generalized linear models. Journal of the Royal Statistical Society. Series A (General), 135(3), 370\u2013384.","journal-title":"Journal of the Royal Statistical Society. Series A (General)"},{"key":"1397_CR28","first-page":"3787","volume-title":"Handbook of development economics","author":"M Ravallion","year":"2008","unstructured":"Ravallion, M. (2008). Evaluating anti-poverty programs. In T. P. Schultz & J. Strauss (Eds.), Handbook of development economics (4th ed., pp. 3787\u20133846). Amsterdam: North-Holland.","edition":"4"},{"key":"1397_CR29","first-page":"172","volume":"31","author":"G Ridgeway","year":"1999","unstructured":"Ridgeway, G. (1999). The state of boosting. Computing Science and Statistics, 31, 172\u2013181.","journal-title":"Computing Science and Statistics"},{"key":"1397_CR30","unstructured":"Ridgeway, G. (2005). GBM 1.5 package manual. http:\/\/cran.r-project.org\/doc\/packages\/gbm.pdf ."},{"issue":"1","key":"1397_CR31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10940-005-9000-9","volume":"22","author":"G Ridgeway","year":"2006","unstructured":"Ridgeway, G. (2006). Assessing the effect of race bias in post-traffic stop outcomes using propensity scores. Journal of Quantitative Criminology, 22(1), 1\u201329.","journal-title":"Journal of Quantitative Criminology"},{"key":"1397_CR32","unstructured":"Ridgeway, G., McCaffrey, D., & Morral, A. (2006). twang: Toolkit for weighting and analysis of nonequivalent groups. Software for using matching methods in R. Available at http:\/\/cran.r-project.org\/web\/packages\/twang\/index.html ."},{"key":"1397_CR33","first-page":"920","volume":"11","author":"JM Robins","year":"2001","unstructured":"Robins, J. M., & Rotnitzky, A. (2001). Comment on \u201cinference for semiparametric models: Some questions and an answer\u201d by P. Bickel and J. Kwon. Statistica Sinica, 11, 920\u2013936.","journal-title":"Statistica Sinica"},{"key":"1397_CR34","volume-title":"Diretrizes para conserva\u00e7\u00e3o e restaura\u00e7\u00e3o da biodiversidade no estado de S\u00e3o Paulo","year":"2008","unstructured":"Rodrigues, R. R., & Bonomi, V. L. R. (Eds.). (2008). Diretrizes para conserva\u00e7\u00e3o e restaura\u00e7\u00e3o da biodiversidade no estado de S\u00e3o Paulo. S\u00e3o Paulo: SMA-SP & FAPESP."},{"issue":"1","key":"1397_CR35","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1093\/biomet\/70.1.41","volume":"70","author":"P Rosenbaum","year":"1983","unstructured":"Rosenbaum, P., & Rubin, D. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70(1), 41\u201355.","journal-title":"Biometrika"},{"key":"1397_CR50","doi-asserted-by":"crossref","unstructured":"Rubin, D. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology, 66(5), 688\u2013701.","DOI":"10.1037\/h0037350"},{"key":"1397_CR36","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1023\/A:1020363010465","volume":"2","author":"D Rubin","year":"2001","unstructured":"Rubin, D. (2001). Using propensity scores to help design observational studies: Application to the tobacco litigation. Health Services and Outcomes Research Methodology, 2, 169\u2013188.","journal-title":"Health Services and Outcomes Research Methodology"},{"issue":"5","key":"1397_CR37","doi-asserted-by":"crossref","first-page":"361","DOI":"10.3152\/095820210X12904313498360","volume":"19","author":"S Salles-Filho","year":"2010","unstructured":"Salles-Filho, S., Avila, F. D., Sepulveda, J., & Colugnati, F. A. B. (2010a). Multidimensional assessment of technology and innovation programs: The impact evaluation of INCAGRO-Peru. Research Evaluation, 19(5), 361\u2013372.","journal-title":"Research Evaluation"},{"key":"1397_CR38","unstructured":"Salles-Filho, S., Bonacelli, M. B. M., Zackiewicz, M., Castro, P. F. D., & Bin, A. (2007). Development and application of a methodology for evaluating S,T&I Programs: The decomposition method. In Workshop Internacional sobre Inova\u00e7\u00f5es Metodol\u00f3gicas na Avalia\u00e7\u00e3o de Impacto da pesquisa Agropecu\u00e1ria, 2008, Bras\u00edlia, XII Semin\u00e1rio Latino-Iberoamericano de Gesti\u00f3n Tecnol\u00f3gica - ALTEC 2007, Buenos Aires, 2007 (Vol. 1, pp. 2\u20136)."},{"key":"1397_CR39","unstructured":"Salles-Filho, S., Castro, P. F. D., Bonacelli, M. B. M., Zeitoum, C., & S\u00e1, F. P. (2010b). Indicators for evaluation of results and impacts of research program in conservation and sustainable use of biodiversity, the case of BIOTA\/FAPESP. In International conference: Getting post 2010 biodiversity targets right, Bragan\u00e7a Paulista."},{"issue":"1","key":"1397_CR40","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1214\/09-STS313","volume":"25","author":"EA Stuart","year":"2010","unstructured":"Stuart, E. A. (2010). Matching methods for causal inference: A review and a look forward. Statistical Science, 25(1), 1\u201321.","journal-title":"Statistical Science"},{"key":"1397_CR41","doi-asserted-by":"crossref","first-page":"817","DOI":"10.2307\/1912934","volume":"48","author":"H White","year":"1980","unstructured":"White, H. (1980). A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica, 48, 817\u2013830.","journal-title":"Econometrica"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-014-1397-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11192-014-1397-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-014-1397-1","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,1]],"date-time":"2024-06-01T21:46:46Z","timestamp":1717278406000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11192-014-1397-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,8,26]]},"references-count":42,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2014,10]]}},"alternative-id":["1397"],"URL":"https:\/\/doi.org\/10.1007\/s11192-014-1397-1","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,8,26]]}}}