{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T05:21:49Z","timestamp":1780550509350,"version":"3.54.1"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2024,5,1]],"date-time":"2024-05-01T00:00:00Z","timestamp":1714521600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,5,19]],"date-time":"2024-05-19T00:00:00Z","timestamp":1716076800000},"content-version":"vor","delay-in-days":18,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2024,5]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Scientists and funding agencies invest considerable resources in writing and evaluating grant proposals. But do grant proposal texts noticeably change panel decisions in single blind review? We report on a field experiment conducted by The Dutch Research Council (NWO) in collaboration with the authors in an early-career competition for awards of 800,000 euros of research funding. A random half of panelists were shown a CV and only a one-paragraph summary of the proposed research, while the other half were shown a CV and a full proposal. We find that withholding proposal texts from panelists did not detectibly impact their proposal rankings. This result suggests that the resources devoted to writing and evaluating grant proposals may not have their intended effect of facilitating the selection of the most promising science.<\/jats:p>","DOI":"10.1007\/s11192-024-04968-7","type":"journal-article","created":{"date-parts":[[2024,5,19]],"date-time":"2024-05-19T12:01:21Z","timestamp":1716120081000},"page":"2521-2532","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Do grant proposal texts matter for funding decisions? A field experiment"],"prefix":"10.1007","volume":"129","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3559-6874","authenticated-orcid":false,"given":"M\u00fcge","family":"Simsek","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mathijs","family":"de Vaan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arnout","family":"van de Rijt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,5,19]]},"reference":[{"issue":"7784","key":"4968_CR1","doi-asserted-by":"publisher","first-page":"574","DOI":"10.1038\/d41586-019-03572-7","volume":"575","author":"D Adam","year":"2019","unstructured":"Adam, D. (2019). Science funders gamble on grant lotteries. Nature, 575(7784), 574\u2013575.","journal-title":"Nature"},{"key":"4968_CR2","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1007\/978-3-319-23015-3_9","volume-title":"Recent developments in the philosophy of science: EPSA13 Helsinki","author":"S Avin","year":"2015","unstructured":"Avin, S. (2015). Funding science by lottery. Recent developments in the philosophy of science: EPSA13 Helsinki (pp. 111\u2013126). Cham: Springer."},{"issue":"1","key":"4968_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s41073-017-0040-0","volume":"2","author":"AG Barnett","year":"2017","unstructured":"Barnett, A. G., Clarke, P., Vaquette, C., & Graves, N. (2017). Using democracy to award research funding: An observational study. Research Integrity and Peer Review, 2(1), 1\u20139.","journal-title":"Research Integrity and Peer Review"},{"issue":"26","key":"4968_CR4","doi-asserted-by":"publisher","first-page":"E5070","DOI":"10.1073\/pnas.1615978114","volume":"114","author":"J Becker","year":"2017","unstructured":"Becker, J., Brackbill, D., & Centola, D. (2017). Network dynamics of social influence in the wisdom of crowds. Proceedings of the National Academy of Sciences, 114(26), E5070\u2013E5076.","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"19","key":"4968_CR5","doi-asserted-by":"publisher","first-page":"4887","DOI":"10.1073\/pnas.1719557115","volume":"115","author":"T Bol","year":"2018","unstructured":"Bol, T., de Vaan, M., & van de Rijt, A. (2018). The Matthew effect in science funding. Proceedings of the National Academy of Sciences, 115(19), 4887\u20134890.","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"6","key":"4968_CR6","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0006022","volume":"4","author":"J Bollen","year":"2009","unstructured":"Bollen, J., Van de Sompel, H., Hagberg, A., & Chute, R. (2009). A principal component analysis of 39 scientific impact measures. PLoS ONE, 4(6), e6022.","journal-title":"PLoS ONE"},{"issue":"2","key":"4968_CR7","doi-asserted-by":"publisher","first-page":"286","DOI":"10.1016\/j.joi.2012.12.003","volume":"7","author":"L Bornmann","year":"2013","unstructured":"Bornmann, L., & Leydesdorff, L. (2013). The validation of (advanced) bibliometric indicators through peer assessments: A comparative study using data from InCites and F1000. Journal of Informetrics, 7(2), 286\u2013291.","journal-title":"Journal of Informetrics"},{"issue":"1","key":"4968_CR8","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1017\/S0140525X00065675","volume":"14","author":"DV Cicchetti","year":"1991","unstructured":"Cicchetti, D. V. (1991). The reliability of peer review for manuscript and grant submissions: A cross-disciplinary investigation. Behavioral and Brain Sciences, 14(1), 119\u2013135.","journal-title":"Behavioral and Brain Sciences"},{"issue":"4523","key":"4968_CR9","doi-asserted-by":"publisher","first-page":"881","DOI":"10.1126\/science.7302566","volume":"214","author":"S Cole","year":"1981","unstructured":"Cole, S., Cole, J. R., & Simon, G. A. (1981). Chance and consensus in peer review. Science, 214(4523), 881\u2013886.","journal-title":"Science"},{"issue":"4","key":"4968_CR10","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.2012","volume":"13","author":"G Eysenbach","year":"2011","unstructured":"Eysenbach, G. (2011). Can tweets predict citations? Metrics of social impact based on Twitter and correlation with traditional metrics of scientific impact. Journal of Medical Internet Research, 13(4), e2012.","journal-title":"Journal of Medical Internet Research"},{"key":"4968_CR11","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.13323","volume":"5","author":"FC Fang","year":"2016","unstructured":"Fang, F. C., Bowen, A., & Casadevall, A. (2016). NIH peer review percentile scores are poorly predictive of grant productivity. eLife, 5, e13323.","journal-title":"eLife"},{"key":"4968_CR12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1136\/bmj.d4797","volume":"343","author":"N Graves","year":"2011","unstructured":"Graves, N., Barnett, A. G., & Clarke, P. (2011). Funding grant proposals for scientific research: retrospective analysis of scores by members of grant review panel. BMJ, 343, 1.","journal-title":"BMJ"},{"issue":"1","key":"4968_CR13","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.3000065","volume":"17","author":"K Gross","year":"2019","unstructured":"Gross, K., & Bergstrom, C. T. (2019). Contest models highlight inherent inefficiencies of scientific funding competitions. PloS Biology, 17(1), e3000065.","journal-title":"PloS Biology"},{"issue":"5","key":"4968_CR14","volume":"3","author":"DL Herbert","year":"2013","unstructured":"Herbert, D. L., Barnett, A. G., Clarke, P., & Graves, N. (2013). On the time spent preparing grant proposals: An observational study of Australian researchers. British Medical Journal Open, 3(5), e002800.","journal-title":"British Medical Journal Open"},{"issue":"46","key":"4968_CR15","doi-asserted-by":"publisher","first-page":"16385","DOI":"10.1073\/pnas.0403723101","volume":"101","author":"L Hong","year":"2004","unstructured":"Hong, L., & Page, S. E. (2004). Groups of diverse problem solvers can outperform groups of high-ability problem solvers. Proceedings of the National Academy of Sciences, 101(46), 16385\u201316389.","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"7366","key":"4968_CR16","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1038\/477529a","volume":"477","author":"J Ioannidis","year":"2011","unstructured":"Ioannidis, J. (2011). Fund people not projects. Nature, 477(7366), 529\u2013531.","journal-title":"Nature"},{"issue":"9\u201310","key":"4968_CR17","doi-asserted-by":"publisher","first-page":"1168","DOI":"10.1016\/j.jpubeco.2011.05.005","volume":"95","author":"BA Jacob","year":"2011","unstructured":"Jacob, B. A., & Lefgren, L. (2011). The impact of research grant funding on scientific productivity. Journal of Public Economics, 95(9\u201310), 1168\u20131177.","journal-title":"Journal of Public Economics"},{"issue":"3","key":"4968_CR18","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1111\/1467-985X.00278","volume":"166","author":"UW Jayasinghe","year":"2003","unstructured":"Jayasinghe, U. W., Marsh, H. W., & Bond, N. (2003). A multilevel cross-classified modelling approach to peer review of grant proposals: The effects of assessor and researcher attributes on assessor ratings. Journal of the Royal Statistical Society: Series A (statistics in Society), 166(3), 279\u2013300.","journal-title":"Journal of the Royal Statistical Society: Series A (statistics in Society)"},{"issue":"20","key":"4968_CR19","doi-asserted-by":"publisher","first-page":"1893","DOI":"10.1056\/NEJMp1507427","volume":"373","author":"MS Lauer","year":"2015","unstructured":"Lauer, M. S., & Nakamura, R. (2015). Reviewing peer review at the NIH. New England Journal of Medicine, 373(20), 1893\u20131895.","journal-title":"New England Journal of Medicine"},{"issue":"6233","key":"4968_CR20","doi-asserted-by":"publisher","first-page":"434","DOI":"10.1126\/science.aaa0185","volume":"348","author":"D Li","year":"2015","unstructured":"Li, D., & Agha, L. (2015). Big names or big ideas: Do peer-review panels select the best science proposals? Science, 348(6233), 434\u2013438.","journal-title":"Science"},{"issue":"22","key":"4968_CR21","doi-asserted-by":"publisher","first-page":"9020","DOI":"10.1073\/pnas.1008636108","volume":"108","author":"J Lorenz","year":"2011","unstructured":"Lorenz, J., Rauhut, H., Schweitzer, F., & Helbing, D. (2011). How social influence can undermine the wisdom of crowd effect. Proceedings of the National Academy of Sciences, 108(22), 9020\u20139025.","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"2","key":"4968_CR22","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1177\/0049124114544225","volume":"44","author":"G Manzo","year":"2015","unstructured":"Manzo, G., & Baldassarri, D. (2015). Heuristics, interactions, and status hierarchies: An agent-based model of deference exchange. Sociological Methods & Research, 44(2), 329\u2013387.","journal-title":"Sociological Methods & Research"},{"issue":"1","key":"4968_CR23","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1017\/S0140525X00065912","volume":"14","author":"HW Marsh","year":"1991","unstructured":"Marsh, H. W., & Ball, S. (1991). Reflections on the peer review process. Behavioral and Brain Sciences, 14(1), 157\u2013158.","journal-title":"Behavioral and Brain Sciences"},{"issue":"3810","key":"4968_CR24","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1126\/science.159.3810.56","volume":"159","author":"RK Merton","year":"1968","unstructured":"Merton, R. K. (1968). The Matthew Effect in Science: The reward and communication systems of science are considered. Science, 159(3810), 56\u201363.","journal-title":"Science"},{"issue":"10","key":"4968_CR25","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0048509","volume":"7","author":"R Mutz","year":"2012","unstructured":"Mutz, R., Bornmann, L., & Daniel, H. D. (2012). Heterogeneity of inter-rater reliabilities of grant peer reviews and its determinants: A general estimating equations approach. PLoS ONE, 7(10), e48509.","journal-title":"PLoS ONE"},{"issue":"12","key":"4968_CR26","doi-asserted-by":"publisher","first-page":"2952","DOI":"10.1073\/pnas.1714379115","volume":"115","author":"EL Pier","year":"2018","unstructured":"Pier, E. L., Brauer, M., Filut, A., Kaatz, A., Raclaw, J., Nathan, M. J., & Carnes, M. (2018). Low agreement among reviewers evaluating the same NIH grant applications. Proceedings of the National Academy of Sciences, 115(12), 2952\u20132957.","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"45","key":"4968_CR27","doi-asserted-by":"publisher","first-page":"17268","DOI":"10.1073\/pnas.0806977105","volume":"105","author":"F Radicchi","year":"2008","unstructured":"Radicchi, F., Fortunato, S., & Castellano, C. (2008). Universality of citation distributions: Toward an objective measure of scientific impact. Proceedings of the National Academy of Sciences, 105(45), 17268\u201317272.","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"2","key":"4968_CR28","doi-asserted-by":"publisher","first-page":"274","DOI":"10.1287\/mnsc.1100.1270","volume":"57","author":"TS Simcoe","year":"2011","unstructured":"Simcoe, T. S., & Waguespack, D. M. (2011). Status, quality, and attention: What\u2019s in a (missing) name? Management Science, 57(2), 274\u2013290.","journal-title":"Management Science"},{"issue":"3","key":"4968_CR29","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1287\/orsc.1100.0533","volume":"22","author":"DM Waguespack","year":"2011","unstructured":"Waguespack, D. M., & Sorenson, O. (2011). The ratings game: Asymmetry in classification. Organization Science, 22(3), 541\u2013553.","journal-title":"Organization Science"},{"issue":"27","key":"4968_CR30","doi-asserted-by":"publisher","first-page":"13150","DOI":"10.1073\/pnas.1909217116","volume":"116","author":"WP Wahls","year":"2019","unstructured":"Wahls, W. P. (2019). Opinion: The National Institutes of Health needs to better balance funding distributions among US institutions. Proceedings of the National Academy of Sciences, 116(27), 13150\u201313154.","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"1","key":"4968_CR31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41467-024-52768-7","volume":"10","author":"Y Wang","year":"2019","unstructured":"Wang, Y., Jones, B. F., & Wang, D. (2019). Early-career setback and future career impact. Nature Communications, 10(1), 1\u201310.","journal-title":"Nature Communications"},{"issue":"6154","key":"4968_CR32","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1126\/science.1237825","volume":"342","author":"D Wang","year":"2013","unstructured":"Wang, D., Song, C., & Barab\u00e1si, A. L. (2013). Quantifying long-term scientific impact. Science, 342(6154), 127\u2013132.","journal-title":"Science"}],"updated-by":[{"DOI":"10.1007\/s11192-025-05378-z","type":"correction","label":"Correction","source":"publisher","updated":{"date-parts":[[2025,7,31]],"date-time":"2025-07-31T00:00:00Z","timestamp":1753920000000}}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-024-04968-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-024-04968-7\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-024-04968-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,5]],"date-time":"2025-09-05T19:46:40Z","timestamp":1757101600000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-024-04968-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5]]},"references-count":32,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2024,5]]}},"alternative-id":["4968"],"URL":"https:\/\/doi.org\/10.1007\/s11192-024-04968-7","relation":{"correction":[{"id-type":"doi","id":"10.1007\/s11192-025-05378-z","asserted-by":"object"}]},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5]]},"assertion":[{"value":"20 February 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 February 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 May 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 July 2025","order":4,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Update","order":5,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The wrong Supplementary file was originally published with this article; it has now been\nreplaced with the correct file.","order":6,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 July 2025","order":7,"name":"change_date","label":"Change Date","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Correction","order":8,"name":"change_type","label":"Change Type","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"A Correction to this paper has been published:","order":9,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"https:\/\/doi.org\/10.1007\/s11192-025-05378-z","URL":"https:\/\/doi.org\/10.1007\/s11192-025-05378-z","order":10,"name":"change_details","label":"Change Details","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Authors have no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}]}}