{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,31]],"date-time":"2026-01-31T02:25:49Z","timestamp":1769826349585,"version":"3.49.0"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2012,9,9]],"date-time":"2012-09-09T00:00:00Z","timestamp":1347148800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2013,3]]},"DOI":"10.1007\/s11192-012-0841-3","type":"journal-article","created":{"date-parts":[[2012,9,8]],"date-time":"2012-09-08T02:19:17Z","timestamp":1347070757000},"page":"1253-1273","source":"Crossref","is-referenced-by-count":28,"title":["Effects of large-scale research funding programs: a Japanese case study"],"prefix":"10.1007","volume":"94","author":[{"given":"Takanori","family":"Ida","sequence":"first","affiliation":[]},{"given":"Naomi","family":"Fukuzawa","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2012,9,9]]},"reference":[{"issue":"2","key":"841_CR1","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1002\/asi.4630290208","volume":"29","author":"R Anderson","year":"1978","unstructured":"Anderson, R., Narin, F., & McAllister, P. (1978). Publication ratings versus peer ratings of universities. Journal of the American Society for Information Science, 29(2), 91\u2013103.","journal-title":"Journal of the American Society for Information Science"},{"issue":"5","key":"841_CR2","doi-asserted-by":"crossref","first-page":"694","DOI":"10.1016\/j.respol.2007.01.007","volume":"36","author":"B Bozeman","year":"2007","unstructured":"Bozeman, B., & Gaughan, M. (2007). Impacts of grants and contracts on academic researchers\u2019 interactions with industry. Research Policy, 36(5), 694\u2013707.","journal-title":"Research Policy"},{"key":"841_CR3","doi-asserted-by":"crossref","first-page":"860","DOI":"10.1017\/CBO9780511811241.032","volume-title":"Microeconometrics: Methods and applications","author":"A Cameron","year":"2005","unstructured":"Cameron, A., & Trivedi, P. (2005). Microeconometrics: Methods and applications (pp. 860\u2013898). New York: Cambridge University Press."},{"key":"841_CR4","unstructured":"Committee for Research Evaluations. (2008). Present status of research evaluations and its future in Japan. Science Council of Japan. http:\/\/www.scj.go.jp\/ja\/info\/kohyo\/pdf\/kohyo-20-t51-3e.pdf"},{"issue":"1","key":"841_CR5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.2517-6161.1979.tb01052.x","volume":"41","author":"A Dawid","year":"1979","unstructured":"Dawid, A. (1979). Conditional independence in statistical theory. Journal of the Royal Statistical Society Series B (Methodological), 41(1), 1\u201331.","journal-title":"Journal of the Royal Statistical Society Series B (Methodological)"},{"issue":"3","key":"841_CR6","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1016\/j.respol.2005.01.008","volume":"34","author":"J Dietz","year":"2005","unstructured":"Dietz, J., & Bozeman, B. (2005). Academic careers, patents, and productivity: industry experience as scientific and technical human capital. Research Policy, 34(3), 349\u2013367.","journal-title":"Research Policy"},{"issue":"2","key":"841_CR7","doi-asserted-by":"crossref","first-page":"117","DOI":"10.3152\/095820209X441781","volume":"18","author":"M Gaughan","year":"2009","unstructured":"Gaughan, M. (2009). Using the curriculum vitae for policy research: an evaluation of national institutes of health center and training support on career trajectories. Research Evaluation, 18(2), 117\u2013124.","journal-title":"Research Evaluation"},{"issue":"1","key":"841_CR8","doi-asserted-by":"crossref","first-page":"17","DOI":"10.3152\/147154402781776952","volume":"11","author":"M Gaughan","year":"2002","unstructured":"Gaughan, M., & Bozeman, B. (2002). Using curriculum vitae to compare some impacts of NSF research grants with research center funding. Research Evaluation, 11(1), 17\u201326.","journal-title":"Research Evaluation"},{"issue":"2","key":"841_CR9","doi-asserted-by":"crossref","first-page":"103","DOI":"10.3152\/095820208X287180","volume":"17","author":"M Gaughan","year":"2008","unstructured":"Gaughan, M., & Ponomariov, B. (2008). Faculty publication productivity, collaboration, and grants velocity: using curricula vitae to compare center-affiliated and unaffiliated scientists. Research Evaluation, 17(2), 103\u2013110.","journal-title":"Research Evaluation"},{"key":"841_CR10","volume-title":"Evaluation of research: A selection of current practices","author":"M Gibbons","year":"1987","unstructured":"Gibbons, M., & Georghiou, L. (1987). Evaluation of research: A selection of current practices. Paris: Organisation for Economic Co-operation and Development."},{"issue":"2","key":"841_CR11","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1007\/s11192-010-0198-4","volume":"85","author":"G Haddow","year":"2010","unstructured":"Haddow, G., & Genoni, P. (2010). Citation analysis and peer ranking of Australian social science journals. Scientometrics, 85(2), 471\u2013487.","journal-title":"Scientometrics"},{"key":"841_CR12","doi-asserted-by":"crossref","unstructured":"Hall, B., Jaffe, A., & Trajtenberg, M. (2000). Market value and patent citations: A first look. NBER Working Paper No 7741. http:\/\/www.nber.org\/papers\/w7741.pdf?new_window=1","DOI":"10.3386\/w7741"},{"key":"841_CR13","doi-asserted-by":"crossref","unstructured":"Hall, B., Jaffe, A., & Trajtenberg, M. (2001). The NBER patent citations data file: Lessons, insights and methodological tools. NBER Working Paper No 8498. http:\/\/www.nber.org\/papers\/w8498.pdf?new_window=1","DOI":"10.3386\/w8498"},{"issue":"3","key":"841_CR14","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1162\/003465399558265","volume":"81","author":"D Harhoff","year":"1999","unstructured":"Harhoff, D., Narin, F., Scherer, F., & Vopel, K. (1999). Citation frequency and the value of patented inventions. The Review of Economics and Statistics, 81(3), 511\u2013515.","journal-title":"The Review of Economics and Statistics"},{"key":"841_CR15","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1017\/CCOL0521304539.004","volume-title":"Longitudinal analysis of labor market data","author":"J Heckman","year":"1985","unstructured":"Heckman, J., & Robb, R. (1985). Alternative methods for evaluating the impact of interventions. In: J. Heckman & B. Singer (eds.), Longitudinal analysis of labor market data (pp. 156\u2013245). New York: Cambridge University Press."},{"issue":"1","key":"841_CR16","doi-asserted-by":"crossref","first-page":"167","DOI":"10.2307\/2696403","volume":"32","author":"A Jaffe","year":"2001","unstructured":"Jaffe, A., & Lerner, J. (2001). Reinviting public R&D: patent policy and the commercialization of national laboratory technologies. RAND Journal of Economics, 32(1), 167\u2013198.","journal-title":"RAND Journal of Economics"},{"issue":"23","key":"841_CR17","doi-asserted-by":"crossref","first-page":"12671","DOI":"10.1073\/pnas.93.23.12671","volume":"93","author":"A Jaffe","year":"1996","unstructured":"Jaffe, A., & Trajtenberg, M. (1996). Flows of knowledge from universities and federal laboratories: modeling the flow of patent citations over time and across institutional and geographic boundaries. Proceedings of the National Academy of Sciences, 93(23), 12671\u201312677.","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"841_CR18","doi-asserted-by":"crossref","unstructured":"Jaffe, A., Trajtenberg, M., & Fogarty, M. (2000). The Meaning of patent citations: Report of the NBER\/case-western reserve survey of patentees. NBER Working Paper No 7631. http:\/\/www.nber.org\/papers\/w7631.pdf?new_window=1","DOI":"10.3386\/w7631"},{"issue":"6","key":"841_CR19","doi-asserted-by":"crossref","first-page":"428","DOI":"10.1002\/(SICI)1097-4571(199407)45:6<428::AID-ASI9>3.0.CO;2-S","volume":"45","author":"R Kostoff","year":"1994","unstructured":"Kostoff, R. (1994). Federal research impact assessment: state-of-the-art. Journal of the American Society for Information Science, 45(6), 428\u2013440.","journal-title":"Journal of the American Society for Information Science"},{"key":"841_CR20","doi-asserted-by":"crossref","unstructured":"Lanjouw, J., & Schankerman, M. (1999). The Quality of ideas: Measuring innovation with multiple indicators. NBER Working Paper No 7345. http:\/\/www.nber.org\/papers\/w7345.pdf?new_window=1","DOI":"10.3386\/w7345"},{"key":"841_CR21","doi-asserted-by":"crossref","DOI":"10.1093\/0199267693.001.0001","volume-title":"Micro-econometrics for policy, program, and treatment effects","author":"M-J Lee","year":"2005","unstructured":"Lee, M.-J. (2005). Micro-econometrics for policy, program, and treatment effects. New York: Oxford University Press."},{"issue":"13","key":"841_CR22","doi-asserted-by":"crossref","first-page":"2105","DOI":"10.1002\/asi.20677","volume":"58","author":"L Meho","year":"2007","unstructured":"Meho, L., & Yang, K. (2007). Impact of data sources on citation counts and rankings of LIS faculty: web of science versus scopus and google scholar. Journal of the American Society for Information Science and Technology, 58(13), 2105\u20132125.","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"2","key":"841_CR23","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/j.joi.2006.12.001","volume":"1","author":"M Norris","year":"2007","unstructured":"Norris, M., & Oppenheim, C. (2007). Comparing alternatives to the web of science for coverage of the social sciences\u2019 literature. Journal of Informetrics, 1(2), 161\u2013169.","journal-title":"Journal of Informetrics"},{"issue":"1","key":"841_CR24","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1108\/eb026940","volume":"51","author":"C Oppenheim","year":"1995","unstructured":"Oppenheim, C. (1995). The correlation between citation counts and the 1992 research assessment exercise ratings for British library and information science university departments. Journal of Documentation, 51(1), 18\u201327.","journal-title":"Journal of Documentation"},{"issue":"5","key":"841_CR25","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1108\/EUM0000000007207","volume":"53","author":"C Oppenheim","year":"1997","unstructured":"Oppenheim, C. (1997). The correlation between citation counts and the 1992 research assessment exercise ratings for british research in genetics. Anatomy and archaeology. Journal of Documentation, 53(5), 477\u2013487.","journal-title":"Journal of Documentation"},{"issue":"3","key":"841_CR26","doi-asserted-by":"crossref","first-page":"1011","DOI":"10.1007\/s11192-011-0424-8","volume":"88","author":"T Opthof","year":"2011","unstructured":"Opthof, T., & Leydesdorff, L. (2011). A comment to the paper by Waltman et al. Scientometrics 87 467\u2013481, 2011. Scientometrics, 88(3), 1011\u20131016.","journal-title":"Scientometrics"},{"issue":"1","key":"841_CR27","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1016\/S0048-7333(98)00026-2","volume":"27","author":"E Rinia","year":"1998","unstructured":"Rinia, E., van Leeuwen, Th, van Vuren, H., & van Raan, A. (1998). Comparative analysis of a set of bibliometric indicators and central peer review criteria evaluation of condensed matter physics in the Netherlands. Research Policy, 27(1), 95\u2013107.","journal-title":"Research Policy"},{"issue":"3","key":"841_CR28","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1016\/S0048-7333(00)00082-2","volume":"30","author":"E Rinia","year":"2001","unstructured":"Rinia, E., van Leeuwen, Th, van Vuren, H., & van Raan, A. (2001). Influence of interdisciplinarity on peer-review and bibliometric evaluations in physics research. Research Policy, 30(3), 357\u2013361.","journal-title":"Research Policy"},{"issue":"1","key":"841_CR29","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1093\/biomet\/70.1.41","volume":"70","author":"P Rosenbaum","year":"1983","unstructured":"Rosenbaum, P., & Rubin, D. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70(1), 41\u201355.","journal-title":"Biometrika"},{"key":"841_CR30","first-page":"468","volume-title":"Introduction to econometrics: International edition","author":"J Stock","year":"2007","unstructured":"Stock, J., & Watson, M. (2007). Introduction to econometrics: International edition (2nd edn., pp. 468\u2013519). Boston: Pearson\/Addison-Wesley.","edition":"2"},{"issue":"3","key":"841_CR31","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1556\/Scient.67.2006.3.10","volume":"67","author":"A Raan Van","year":"2006","unstructured":"Van Raan, A. (2006). Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups. Scientometrics, 67(3), 491\u2013502.","journal-title":"Scientometrics"},{"key":"841_CR32","first-page":"603","volume-title":"Econometric analysis of cross section and panel data","author":"J Wooldridge","year":"2002","unstructured":"Wooldridge, J. (2002). Econometric analysis of cross section and panel data (pp. 603\u2013643). Cambridge: The MIT Press."},{"issue":"2","key":"841_CR33","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1007\/BF02017567","volume":"21","author":"J Zhu","year":"1991","unstructured":"Zhu, J., Meadows, A., & Mason, G. (1991). Citations and departmental research ratings. Scientometrics, 21(2), 171\u2013179.","journal-title":"Scientometrics"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-012-0841-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11192-012-0841-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-012-0841-3","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,7,3]],"date-time":"2019-07-03T12:15:14Z","timestamp":1562156114000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11192-012-0841-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,9,9]]},"references-count":33,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2013,3]]}},"alternative-id":["841"],"URL":"https:\/\/doi.org\/10.1007\/s11192-012-0841-3","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,9,9]]}}}