{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,14]],"date-time":"2026-03-14T20:26:38Z","timestamp":1773519998078,"version":"3.50.1"},"reference-count":38,"publisher":"Oxford University Press (OUP)","issue":"3","license":[{"start":{"date-parts":[[2022,3,24]],"date-time":"2022-03-24T00:00:00Z","timestamp":1648080000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"funder":[{"name":"GRODE"},{"name":"Universitat Rovira i Virgili and Generalitat de Catalunya","award":["2019PFR-URV-53"],"award-info":[{"award-number":["2019PFR-URV-53"]}]},{"DOI":"10.13039\/501100004837","name":"Spanish Ministry of Science and Innovation","doi-asserted-by":"publisher","award":["RTI2018-094733-B-100"],"award-info":[{"award-number":["RTI2018-094733-B-100"]}],"id":[{"id":"10.13039\/501100004837","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004837","name":"Spanish Ministry of Science and Innovation","doi-asserted-by":"publisher","award":["PID2019-105982GB-100"],"award-info":[{"award-number":["PID2019-105982GB-100"]}],"id":[{"id":"10.13039\/501100004837","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,7,23]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Research groups spend time and resources in the process of applying for funding. This issue raises important questions regarding inefficiency and whether the currently used funding mechanisms are adequate. This article aims to identify ways of reducing the inefficiency and the waste of resources when making research funding calls. We look at four ways of reducing inefficiency. Inefficiency decreases when: (1) the most productive research groups are favoured over the less productive ones, (2) the call is restricted to a small number of research groups actively working on the subject of the call, (3) the funding process is less dependent on the amount of effort spent on fund-seeking activities by the research groups, and (4) the number of research groups competing in the same call is small. However, not all these mechanisms are equally powerful or easy to implement. Our results suggest that (1) reducing the dependence of the funding process on funding activities\u2019 efforts, or (2) reducing the number of research groups by narrowing the subject of the call to groups that are very active in the call\u2019s subject might be particularly effective in reducing inefficiency.<\/jats:p>","DOI":"10.1093\/reseval\/rvac007","type":"journal-article","created":{"date-parts":[[2022,3,10]],"date-time":"2022-03-10T12:13:07Z","timestamp":1646914387000},"page":"289-296","source":"Crossref","is-referenced-by-count":6,"title":["Research calls, competition for funding and inefficiency"],"prefix":"10.1093","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3376-0164","authenticated-orcid":false,"given":"Ant\u00f3nio","family":"Os\u00f3rio","sequence":"first","affiliation":[{"name":"Department of Economics, Universitat Rovira i Virgili and Eco-SOS , Av. de la Universitat 1 , 43204 Reus, Spain"}]},{"given":"Lutz","family":"Bornmann","sequence":"additional","affiliation":[{"name":"Science Policy and Strategy Department, Administrative Headquarters of the Max Planck Society , Hofgartenstr. 8 , 80539 Munich, Germany"}]}],"member":"286","published-online":{"date-parts":[[2022,3,24]]},"reference":[{"key":"2022072318390042400_rvac007-B1","doi-asserted-by":"crossref","first-page":"1129","DOI":"10.1007\/s11192-014-1269-8","article-title":"How Do You Define and Measure Research Productivity?","volume":"101","author":"Abramo","year":"2014","journal-title":"Scientometrics"},{"key":"2022072318390042400_rvac007-B3","doi-asserted-by":"crossref","first-page":"574","DOI":"10.1038\/d41586-019-03572-7","article-title":"Science Funders Gamble on Grant Lotteries","volume":"575","author":"Adam","year":"2019","journal-title":"Nature"},{"key":"2022072318390042400_rvac007-B4","doi-asserted-by":"crossref","first-page":"5773","DOI":"10.1073\/pnas.1404402111","article-title":"Rescuing US Biomedical Research from Its Systemic Flaws","volume":"111","author":"Alberts","year":"2014","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"key":"2022072318390042400_rvac007-B5","first-page":"1","article-title":"Policy Considerations for Random Allocation of Research Funds","volume":"6","author":"Avin","year":"2018","journal-title":"RT. A Journal on Research Policy and Evaluation"},{"key":"2022072318390042400_rvac007-B6","doi-asserted-by":"crossref","first-page":"e006912","DOI":"10.1136\/bmjopen-2014-006912","article-title":"The Impact of a Streamlined Funding Application Process on Application Time: Two Cross-Sectional Surveys of Australian Researchers","volume":"5","author":"Barnett","year":"2015","journal-title":"BMJ Open"},{"key":"2022072318390042400_rvac007-B7","doi-asserted-by":"crossref","first-page":"e34569","DOI":"10.1371\/journal.pone.0034569","article-title":"Estimating the NIH Efficient Frontier","volume":"7","author":"Bisias","year":"2012","journal-title":"PLoS One"},{"key":"2022072318390042400_rvac007-B8","doi-asserted-by":"crossref","first-page":"4887","DOI":"10.1073\/pnas.1719557115","article-title":"The Matthew Effect in Science Funding","volume":"115","author":"Bol","year":"2018","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"key":"2022072318390042400_rvac007-B9","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1002\/aris.2011.1440450112","article-title":"Scientific Peer Review","volume":"45","author":"Bornmann","year":"2011","journal-title":"Annual Review of Information Science and Technology"},{"key":"2022072318390042400_rvac007-B10","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1007\/s11192-005-0214-2","article-title":"Selection of Research Fellowship Recipients by Committee Peer Review. Reliability, Fairness and Predictive Validity of Board of Trustees' Decisions","volume":"63","author":"Bornmann","year":"2005","journal-title":"Scientometrics"},{"key":"2022072318390042400_rvac007-B11","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1007\/s10058-007-0032-5","article-title":"The Theory of Contests: A Survey","volume":"11","author":"Corch\u00f3n","year":"2007","journal-title":"Review of Economic Design"},{"key":"2022072318390042400_rvac007-B12","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/S0048-7333(02)00009-4","article-title":"Research Groups as \u2018Quasi-Firms\u2019: The Invention of the Entrepreneurial University","volume":"32","author":"Etzkowitz","year":"2003","journal-title":"Research Policy"},{"key":"2022072318390042400_rvac007-B13","doi-asserted-by":"crossref","first-page":"e00422-16","DOI":"10.1128\/mBio.00422-16","article-title":"Research Funding: The Case for a Modified Lottery","volume":"7","author":"Fang","year":"2016","journal-title":"mBio"},{"key":"2022072318390042400_rvac007-B14","first-page":"869","article-title":"How many reviewers are required to obtain reliable evaluations of NIH R01 grant","volume-title":"Contemp. Clin. Trials","author":"Forscher","year":"2012"},{"key":"2022072318390042400_rvac007-B15","doi-asserted-by":"crossref","first-page":"e65263","DOI":"10.1371\/journal.pone.0065263","article-title":"Big Science vs. Little Science: How Scientific Impact Scales with Funding","volume":"8","author":"Fortin","year":"2013","journal-title":"PLoS One"},{"key":"2022072318390042400_rvac007-B17","first-page":"6","author":"Geard","year":"2010"},{"key":"2022072318390042400_rvac007-B18","doi-asserted-by":"crossref","first-page":"111","DOI":"10.5694\/mja2.50916","article-title":"A Comparison of the Distribution of Medical Research Future Fund Grants with Disease Burden in Australia","volume":"214","author":"Gilbert","year":"2021","journal-title":"Medical Journal of Australia"},{"key":"2022072318390042400_rvac007-B19","doi-asserted-by":"crossref","first-page":"e3000065","DOI":"10.1371\/journal.pbio.3000065","article-title":"Contest Models Highlight Inherent Inefficiencies of Scientific Funding Competitions","volume":"17","author":"Gross","year":"2019","journal-title":"PLoS Biology"},{"key":"2022072318390042400_rvac007-B20","author":"Hackett","year":"2003"},{"key":"2022072318390042400_rvac007-B21","article-title":"Rethinking the Funding Line at the Swiss National Science Foundation: Bayesian Ranking and Lottery","author":"Heyard","year":"2021"},{"key":"2022072318390042400_rvac007-B22","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1007\/s11192-016-1940-3","article-title":"The Consequences of Competition: Simulating the Effects of Research Grant Allocation Strategies","volume":"108","author":"H\u00f6yl\u00e4","year":"2016","journal-title":"Scientometrics"},{"key":"2022072318390042400_rvac007-B23","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1038\/477529a","article-title":"Fund People Not Projects","volume":"477","author":"Ioannidis","year":"2011","journal-title":"Nature"},{"key":"2022072318390042400_rvac007-B24","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780199549597.001.0001","volume-title":"Strategy and Dynamics in Contests","author":"Konrad","year":"2009"},{"key":"2022072318390042400_rvac007-B25","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1016\/j.econedurev.2007.04.002","article-title":"A Time Allocation Study of University Faculty","volume":"27","author":"Link","year":"2008","journal-title":"Economics of Education Review"},{"key":"2022072318390042400_rvac007-B26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s41073-019-0089-z","article-title":"The Acceptability of Using a Lottery to Allocate Research Funding: A Survey of Applicants","volume":"5","author":"Liu","year":"2020","journal-title":"Research Integrity and Peer Review"},{"key":"2022072318390042400_rvac007-B27","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1093\/reseval\/rvs001","article-title":"Conservatism and Risk-Taking in Peer Review: Emerging ERC Practices","volume":"21","author":"Luukkonen","year":"2012","journal-title":"Research Evaluation"},{"key":"2022072318390042400_rvac007-B28","volume-title":"A Historical Reflection on Research Evaluation Studies, Their Recurrent Themes and Challenges","author":"Marjanovic","year":"2010"},{"key":"2022072318390042400_rvac007-B29","volume-title":"Peer Review","year":"2002"},{"key":"2022072318390042400_rvac007-B30","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1093\/reseval\/rvaa027","article-title":"Science Rules! a Qualitative Study of Scientists\u2019 Approaches to Grant Lottery","volume":"30","author":"Philipps","year":"2021","journal-title":"Research Evaluation"},{"key":"2022072318390042400_rvac007-B31","doi-asserted-by":"crossref","first-page":"187","DOI":"10.3152\/147154406781775841","article-title":"Interdisciplinary Research: Meaning, Metrics and Nurture","volume":"15","author":"Porter","year":"2006","journal-title":"Research Evaluation"},{"key":"2022072318390042400_rvac007-B32","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/A:1016059222182","article-title":"Research Productivity of Scientists in Consolidated vs. non-Consolidated Teams: The Case of Spanish University Geologists","volume":"55","author":"Rey-Rocha","year":"2002","journal-title":"Scientometrics"},{"key":"2022072318390042400_rvac007-B33","doi-asserted-by":"crossref","first-page":"994","DOI":"10.1177\/0162243918822744","article-title":"Peer Review or Lottery? A Critical Analysis of Two Different Forms of Decision-Making Mechanisms for Allocation of Research Grants","volume":"44","author":"Roumbanis","year":"2019","journal-title":"Science, Technology, & Human Values"},{"key":"2022072318390042400_rvac007-B34","doi-asserted-by":"crossref","first-page":"2","DOI":"10.3152\/095820210X492477","article-title":"How to Use Indicators to Measure Scientific Performance: A Balanced Approach","volume":"19","author":"Schmoch","year":"2010","journal-title":"Research Evaluation"},{"key":"2022072318390042400_rvac007-B35","doi-asserted-by":"crossref","first-page":"S77","DOI":"10.1016\/j.amepre.2008.05.002","article-title":"The Science of Team Science: Overview of the Field and Introduction to the Supplement","volume":"35","author":"Stokols","year":"2008","journal-title":"American Journal of Preventive Medicine"},{"key":"2022072318390042400_rvac007-B36","doi-asserted-by":"crossref","first-page":"238146831664223","DOI":"10.1177\/2381468316642238","article-title":"Value of Information Analysis Informing Adoption and Research Decisions in a Portfolio of Health Care Interventions","volume":"1","author":"Tuffaha","year":"2016","journal-title":"MDM Policy & Practice"},{"key":"2022072318390042400_rvac007-B37","doi-asserted-by":"crossref","first-page":"e0183967","DOI":"10.1371\/journal.pone.0183967","article-title":"How Much Would Each Researcher Receive If Competitive Government Research Funding Were Distributed Equally among Researchers?","volume":"12","author":"Vaesen","year":"2017","journal-title":"PLoS One"},{"key":"2022072318390042400_rvac007-B38","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1057\/hep.2012.16","article-title":"Collaboration and Competition in Research","volume":"25","author":"Van den Besselaar","year":"2012","journal-title":"Higher Education Policy"},{"key":"2022072318390042400_rvac007-B40","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.joi.2010.06.004","article-title":"Approaches to Understanding and Measuring Interdisciplinary Scientific Research (IDR): A Review of the Literature","volume":"5","author":"Wagner","year":"2011","journal-title":"Journal of Informetrics"},{"key":"2022072318390042400_rvac007-B41","volume-title":"The Peer Review Process","author":"Wood","year":"1997"}],"container-title":["Research Evaluation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/rev\/article-pdf\/31\/3\/289\/45052994\/rvac007.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/rev\/article-pdf\/31\/3\/289\/45052994\/rvac007.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,18]],"date-time":"2023-11-18T17:33:10Z","timestamp":1700328790000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/rev\/article\/31\/3\/289\/6553360"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,24]]},"references-count":38,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,3,24]]},"published-print":{"date-parts":[[2022,7,23]]}},"URL":"https:\/\/doi.org\/10.1093\/reseval\/rvac007","relation":{},"ISSN":["0958-2029","1471-5449"],"issn-type":[{"value":"0958-2029","type":"print"},{"value":"1471-5449","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2022,7,1]]},"published":{"date-parts":[[2022,3,24]]}}}