{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T04:06:09Z","timestamp":1769918769550,"version":"3.49.0"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2016,9,3]],"date-time":"2016-09-03T00:00:00Z","timestamp":1472860800000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2017,1]]},"DOI":"10.1007\/s11192-016-2110-3","type":"journal-article","created":{"date-parts":[[2016,9,3]],"date-time":"2016-09-03T03:40:12Z","timestamp":1472874012000},"page":"521-528","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":42,"title":["An efficient system to fund science: from proposal review to peer-to-peer distributions"],"prefix":"10.1007","volume":"110","author":[{"given":"Johan","family":"Bollen","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Crandall","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Damion","family":"Junk","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ying","family":"Ding","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Katy","family":"B\u00f6rner","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2016,9,3]]},"reference":[{"key":"2110_CR1","doi-asserted-by":"publisher","unstructured":"Azoulay, P., Zivin, J. S. G., & Manso, G. (2009). Incentives and creativity: Evidence from the academic life sciences. Working Paper 15466, National Bureau of Economic Research. doi: 10.3386\/w15466 . http:\/\/www.nber.org\/papers\/w15466 .","DOI":"10.3386\/w15466"},{"key":"2110_CR2","doi-asserted-by":"crossref","unstructured":"Azoulay, P., Zivin, J. S. G., & Manso, G. (2012). NIH peer review: Challenges and avenues for reform. National Bureau of Economic Research Working Paper 18116.","DOI":"10.3386\/w18116"},{"issue":"3","key":"2110_CR3","doi-asserted-by":"crossref","first-page":"669","DOI":"10.1007\/s11192-006-0176-z","volume":"69","author":"J Bollen","year":"2006","unstructured":"Bollen, J., Rodriguez, M. A., & Van de Sompel, H. (2006). Journal status. Scientometrics, 69(3), 669.","journal-title":"Scientometrics"},{"key":"2110_CR4","doi-asserted-by":"crossref","first-page":"226","DOI":"10.1016\/j.joi.2007.03.001","volume":"1","author":"L Bornmann","year":"2007","unstructured":"Bornmann, L., Mutz, R., & Daniel, H. D. (2007). Gender differences in grant peer review: A meta-analysis. Journal of Informetrics, 1, 226.","journal-title":"Journal of Informetrics"},{"key":"2110_CR5","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/S0169-7552(98)00110-X","volume":"30","author":"S Brin","year":"1998","unstructured":"Brin, S., & Page, L. (1998). The anatomy of a large-scale hypertextual web search engine. Computer Networks and ISDN Systems, 30, 107.","journal-title":"Computer Networks and ISDN Systems"},{"issue":"1","key":"2110_CR6","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1017\/S0140525X00065675","volume":"14","author":"DV Cicchetti","year":"1991","unstructured":"Cicchetti, D. V. (1991). The reliability of peer review for manuscript and grant submissions: A cross-disciplinary investigation. Behavioral and Brain Sciences, 14(1), 119\u2013135.","journal-title":"Behavioral and Brain Sciences"},{"key":"2110_CR7","doi-asserted-by":"crossref","first-page":"881","DOI":"10.1126\/science.7302566","volume":"214","author":"GSS Cole","year":"1981","unstructured":"Cole, G. S. S., & Cole, J. R. (1981). Chance and consensus in peer review. Science, 214, 881.","journal-title":"Science"},{"issue":"11","key":"2110_CR8","doi-asserted-by":"crossref","first-page":"2229","DOI":"10.1002\/asi.21171","volume":"60","author":"Y Ding","year":"2009","unstructured":"Ding, Y., Yan, E., Frazho, A., & Caverlee, J. (2009). PageRank for ranking authors in co-citation networks. Journal of the American Society for Information Science and Technology, 60(11), 2229.","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"2110_CR9","doi-asserted-by":"crossref","unstructured":"Editor (2010). Calm in a crisis. Nature, 468, 1002.","DOI":"10.1038\/4681002a"},{"key":"2110_CR10","unstructured":"Editor (April 25 2011). Dr. No money: The broken science funding system. Scientific American."},{"key":"2110_CR11","unstructured":"Editorial (2013). Twice the price. Nature, 493(7434)."},{"key":"2110_CR12","unstructured":"F.S.C. of\u00a0the Federal Demonstration\u00a0Partnership (2007). A profile of federal grant administrative burden among federal demonstration partnership faculty. Tech. rep. http:\/\/www.iscintelligence.com\/archivos_subidos\/usfacultyburden_5.pdf ."},{"key":"2110_CR13","unstructured":"Geard, N., & Noble, J. (2010) Modelling academic research funding as a resource allocation problem. In 3rd world congress on social simulation."},{"issue":"145","key":"2110_CR14","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1038\/462145a","volume":"462","author":"N Gilbert","year":"2009","unstructured":"Gilbert, N. (2009). Wellcome trust makes it personal in funding revamp: People not projects are the focus of longer-term grants. Nature (Online), 462(145), 145. doi: 10.1038\/462145a .","journal-title":"Nature (Online)"},{"issue":"6878","key":"2110_CR15","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1038\/416258a","volume":"416","author":"T Gura","year":"2002","unstructured":"Gura, T. (2002). Scientific publishing: Peer review, unmasked. Nature, 416(6878), 258.","journal-title":"Nature"},{"key":"2110_CR16","doi-asserted-by":"publisher","DOI":"10.1038\/495314d","author":"DL Herbert","year":"2013","unstructured":"Herbert, D. L., Barnett, A. G., & Graves, N. (2013). Funding: Australia\u2019s grant system wastes time. Nature. doi: 10.1038\/495314d .","journal-title":"Nature"},{"key":"2110_CR17","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2013-004462","author":"DL Herbert","year":"2014","unstructured":"Herbert, D. L., Coveney, J., Clarke, P., Graves, N., & Barnett, A. G. (2014). The impact of funding deadlines on personal workloads, stress and family relationships: A qualitative study of Australian researchers. BMJ Open. doi: 10.1136\/bmjopen-2013-004462 .","journal-title":"BMJ Open"},{"key":"2110_CR18","doi-asserted-by":"crossref","first-page":"1293","DOI":"10.1016\/S0140-6736(96)08029-4","volume":"348","author":"D Horrobin","year":"1996","unstructured":"Horrobin, D. (1996). Peer review of grant applications: A harbinger for mediocrity in clinical research? The Lancet, 348, 1293.","journal-title":"The Lancet"},{"key":"2110_CR19","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1038\/492034a","volume":"492","author":"JM Ioannidis","year":"2012","unstructured":"Ioannidis, J. M., & Nicholson, J. P. A. (2012). Research grants: Conform and be funded. Nature, 492, 34. doi: 10.1038\/492034a .","journal-title":"Nature"},{"key":"2110_CR20","doi-asserted-by":"publisher","DOI":"10.1038\/nature05031","author":"T Jefferson","year":"2006","unstructured":"Jefferson, T. (2006). Quality and value: Models of quality control for scientific research. Nature. doi: 10.1038\/nature05031 .","journal-title":"Nature"},{"key":"2110_CR21","doi-asserted-by":"crossref","first-page":"11076","DOI":"10.1073\/pnas.0804538105","volume":"105","author":"VE Johnson","year":"2008","unstructured":"Johnson, V. E. (2008). Statistical analysis of the National Institutes of Health peer review system. Proceedings of the National Academy of Sciences, 105, 11076.","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"5903","key":"2110_CR22","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1126\/science.322.5903.834","volume":"322","author":"J Kaiser","year":"2008","unstructured":"Kaiser, J. (2008). Zerhouni\u2019s parting message: Make room for young scientists. Science, 322(5903), 834.","journal-title":"Science"},{"issue":"1","key":"2110_CR23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/asi.21228","volume":"61","author":"MH MacRoberts","year":"2010","unstructured":"MacRoberts, M. H., & MacRoberts, B. R. (2010). Problems of citation analysis: A study of uncited and seldom-cited influences. Journal of the American Society for Information Science, 61(1), 1\u201312.","journal-title":"Journal of the American Society for Information Science"},{"key":"2110_CR24","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1037\/0003-066X.63.3.160","volume":"63","author":"HW Marsh","year":"2008","unstructured":"Marsh, H. W., Jayasinghe, U. W., & Bond, N. W. (2008). Improving the peer-review process for grant applications: Reliability, validity, bias, and generalizability. American Psychologist, 63, 160.","journal-title":"American Psychologist"},{"key":"2110_CR25","doi-asserted-by":"crossref","first-page":"621","DOI":"10.1126\/science.282.5389.621","volume":"282","author":"N Myhrvold","year":"1998","unstructured":"Myhrvold, N. (1998). Supporting science. Science, 282, 621.","journal-title":"Science"},{"key":"2110_CR26","unstructured":"National Science Foundation (2009). Fiscal year 2010 budget request to congress."},{"key":"2110_CR27","unstructured":"National Science Foundation (2015). Fy2015 agency financial report. NSF report nsf16002. http:\/\/www.nsf.gov\/publications\/pub_summ.jsp?ods_key=nsf16002 ."},{"key":"2110_CR28","unstructured":"Rowe, G. L., Burgoon, S., Burgoon, J., Ke, W., & B\u00f6rner, K. (2007). The scholarly database and its utility for scientometrics research. In Proceedings of the 11th international conference on scientometrics and informetrics (pp. 457\u2013462)."},{"key":"2110_CR29","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1177\/016224398501000309","volume":"10","author":"R Roy","year":"1985","unstructured":"Roy, R. (1985). Funding science: The real defects of peer review and an alternative to it. Science, Technology, and Human Values, 10, 73.","journal-title":"Science, Technology, and Human Values"},{"key":"2110_CR30","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1258\/jrsm.99.4.178","volume":"99","author":"R Smith","year":"2006","unstructured":"Smith, R. (2006). Peer review: A flawed process at the heart of science and journals. Journal of the Royal Society of Medicine, 99, 178.","journal-title":"Journal of the Royal Society of Medicine"},{"key":"2110_CR31","unstructured":"Southwick, F. (2012). Academia suppresses creativity. The Scientist."},{"key":"2110_CR32","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1038\/490337a","volume":"490","author":"S Suresh","year":"2012","unstructured":"Suresh, S. (2012). Research funding: Global challenges need global solutions. Nature, 490, 337.","journal-title":"Nature"},{"key":"2110_CR33","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1016\/S0140-6736(97)11129-1","volume":"352","author":"S Wessely","year":"1998","unstructured":"Wessely, S. (1998). Peer review of grant applications: What do we know? The Lancet, 352, 301.","journal-title":"The Lancet"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-016-2110-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11192-016-2110-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-016-2110-3","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-016-2110-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2017,6,24]],"date-time":"2017-06-24T17:58:49Z","timestamp":1498327129000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11192-016-2110-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,9,3]]},"references-count":33,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2017,1]]}},"alternative-id":["2110"],"URL":"https:\/\/doi.org\/10.1007\/s11192-016-2110-3","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,9,3]]}}}