{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2024,7,20]],"date-time":"2024-07-20T06:34:03Z","timestamp":1721457243861},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2016,5,23]],"date-time":"2016-05-23T00:00:00Z","timestamp":1463961600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2016,8]]},"DOI":"10.1007\/s11192-016-1979-1","type":"journal-article","created":{"date-parts":[[2016,5,24]],"date-time":"2016-05-24T06:04:09Z","timestamp":1464069849000},"page":"917-935","update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Research assessment using early citation information"],"prefix":"10.1007","volume":"108","author":[{"given":"Stephan B.","family":"Bruns","sequence":"first","affiliation":[]},{"given":"David I.","family":"Stern","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2016,5,23]]},"reference":[{"issue":"3","key":"1979_CR1","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1007\/s11192-005-0228-9","volume":"63","author":"J Adams","year":"2005","unstructured":"Adams, J. (2005). Early citation counts correlate with accumulated impact. Scientometrics, 63(3), 567\u2013581.","journal-title":"Scientometrics"},{"issue":"1","key":"1979_CR2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1093\/reseval\/rvt017","volume":"23","author":"DL Anderson","year":"2014","unstructured":"Anderson, D. L., & Tressler, J. (2014). The New Zealand performance based research fund and its impact on publication activity in economics. Research Evaluation, 23(1), 1\u201311.","journal-title":"Research Evaluation"},{"issue":"2","key":"1979_CR3","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1016\/j.respol.2014.08.004","volume":"44","author":"G Bertocchi","year":"2015","unstructured":"Bertocchi, G., Gambardella, A., Jappelli, T., Nappi, C. A., & Peracchi, F. (2015). Bibliometric evaluation vs. informed peer review: Evidence from Italy. Research Policy, 44(2), 451\u2013466.","journal-title":"Research Policy"},{"key":"1979_CR4","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1002\/aris.2011.1440450112","volume":"45","author":"L Bornmann","year":"2011","unstructured":"Bornmann, L. (2011). Scientific peer review. Annual Review of Information Science and Technology, 45, 199\u2013245.","journal-title":"Annual Review of Information Science and Technology"},{"key":"1979_CR5","doi-asserted-by":"publisher","unstructured":"Bornmann, L. (2015). How much does the expected number of citations for a publication change if it contains the address of a specific scientific institute? A new approach for the analysis of citation data on the institutional level based on regression models. Journal of the Association for Information Science and Technology. doi: 10.1002\/asi.23546 .","DOI":"10.1002\/asi.23546"},{"issue":"12","key":"1979_CR6","doi-asserted-by":"crossref","first-page":"1228","DOI":"10.15252\/embr.201439608","volume":"15","author":"L Bornmann","year":"2014","unstructured":"Bornmann, L., & Leydesdorff, L. (2014). Scientometrics in a changing research landscape. EMBO Reports, 15(12), 1228\u20131232.","journal-title":"EMBO Reports"},{"issue":"311","key":"1979_CR7","doi-asserted-by":"crossref","first-page":"565","DOI":"10.1111\/j.1468-0335.2009.00837.x","volume":"78","author":"S Clerides","year":"2011","unstructured":"Clerides, S., Pashardes, P., & Polycarpou, A. (2011). Peer review vs metric-based assessment: Testing for bias in the RAE ratings of UK economics departments. Economica, 78(311), 565\u2013583.","journal-title":"Economica"},{"issue":"1","key":"1979_CR8","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1007\/BF02020188","volume":"32","author":"AM Colman","year":"1995","unstructured":"Colman, A. M., Dhillon, D., & Coulthard, B. (1995). A bibliometric evaluation of the research performance of British university politics departments: Publications in leading journals. Scientometrics, 32(1), 49\u201366.","journal-title":"Scientometrics"},{"key":"1979_CR9","unstructured":"Department for Business, Innovation & Skills and Johnson, J. (2015). Press release: Government launches review to improve university research funding. https:\/\/www.gov.uk\/government\/news\/government-launches-review-to-improve-university-research-funding ."},{"key":"1979_CR10","unstructured":"Farla, K., & Simmonds, P. (2015). REF accountability review: Costs, benefits and burden. Report by Technopolis to the four UK higher education funding bodies."},{"issue":"9","key":"1979_CR11","doi-asserted-by":"crossref","first-page":"e106474","DOI":"10.1371\/journal.pone.0106474","volume":"9","author":"SA Gallo","year":"2014","unstructured":"Gallo, S. A., Carpenter, A. S., Irwin, D., McPartland, C. D., Travis, J., Reynders, S., et al. (2014). The validation of peer review through research impact measures and the implications for funding strategies. PLoS ONE, 9(9), e106474.","journal-title":"PLoS ONE"},{"key":"1979_CR12","doi-asserted-by":"publisher","DOI":"10.13140\/RG.2.1.3362.4162","author":"HEFCE","year":"2015","unstructured":"HEFCE. (2015). The Metric Tide: Correlation analysis of REF2014 scores and metrics (Supplementary Report II to the Independent Review of the Role of Metrics in Research Assessment and Management). Higher Education Funding Council for England. doi: 10.13140\/RG.2.1.3362.4162 .","journal-title":"Higher Education Funding Council for England"},{"issue":"3","key":"1979_CR13","doi-asserted-by":"crossref","first-page":"261","DOI":"10.15252\/embr.201439972","volume":"16","author":"ST Holgate","year":"2015","unstructured":"Holgate, S. T. (2015). A comment on \u201cScientometrics in a changing research landscape\u201d. EMBO Reports, 16(3), 261.","journal-title":"EMBO Reports"},{"key":"1979_CR14","doi-asserted-by":"crossref","first-page":"F202","DOI":"10.1111\/ecoj.12064","volume":"123","author":"J Hudson","year":"2013","unstructured":"Hudson, J. (2013). Ranking journals. Economic Journal, 123, F202\u2013F222.","journal-title":"Economic Journal"},{"key":"1979_CR15","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/S0304-4076(03)00092-7","volume":"115","author":"KS Im","year":"2003","unstructured":"Im, K. S., Pesaran, M. H., & Shin, Y. (2003). Testing for unit roots in heterogeneous panels. Journal of Econometrics, 115, 53\u201374.","journal-title":"Journal of Econometrics"},{"issue":"5","key":"1979_CR16","doi-asserted-by":"crossref","first-page":"590","DOI":"10.1080\/03054985.2014.959912","volume":"40","author":"J Johnston","year":"2014","unstructured":"Johnston, J., Reeves, A., & Talbot, S. (2014). Has economics become an elite subject for elite UK universities? Oxford Review of Education, 40(5), 590\u2013609.","journal-title":"Oxford Review of Education"},{"issue":"2","key":"1979_CR17","doi-asserted-by":"crossref","first-page":"527","DOI":"10.1007\/s11192-010-0282-9","volume":"86","author":"R Kenna","year":"2011","unstructured":"Kenna, R., & Berche, B. (2011). Critical mass and the dependency of research quality on group size. Scientometrics, 86(2), 527\u2013540.","journal-title":"Scientometrics"},{"key":"1979_CR18","volume-title":"A comparative review of research assessment regimes in five countries and the role of libraries in the research assessment process: A pilot study","author":"Key Perspectives Ltd","year":"2009","unstructured":"Key Perspectives Ltd. (2009). A comparative review of research assessment regimes in five countries and the role of libraries in the research assessment process: A pilot study. Dublin: OCLC Research."},{"key":"1979_CR19","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1016\/j.ipm.2010.09.005","volume":"47","author":"JM Levitt","year":"2011","unstructured":"Levitt, J. M., & Thelwall, M. (2011). A combined bibliometric indicator to predict article impact. Information Processing and Management, 47, 300\u2013308.","journal-title":"Information Processing and Management"},{"issue":"3","key":"1979_CR20","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1016\/j.joi.2010.01.002","volume":"4","author":"H Moed","year":"2010","unstructured":"Moed, H. (2010). Measuring contextual citation impact of scientific journals. Journal of Informetrics, 4(3), 265\u2013277.","journal-title":"Journal of Informetrics"},{"key":"1979_CR21","doi-asserted-by":"crossref","first-page":"767","DOI":"10.1007\/s11192-013-1058-9","volume":"97","author":"O Mryglod","year":"2013","unstructured":"Mryglod, O., Kenna, R., Holovatch, Y., & Berche, B. (2013). Comparison of a citation-based indicator and peer review for absolute and specific measures of research-group excellence. Scientometrics, 97, 767\u2013777.","journal-title":"Scientometrics"},{"issue":"3","key":"1979_CR22","doi-asserted-by":"crossref","first-page":"2165","DOI":"10.1007\/s11192-014-1512-3","volume":"102","author":"O Mryglod","year":"2015","unstructured":"Mryglod, O., Kenna, R., Holovatch, Y., & Berche, B. (2015). Predicting results of the Research Excellence Framework using departmental h-index. Scientometrics, 102(3), 2165\u20132180.","journal-title":"Scientometrics"},{"issue":"292","key":"1979_CR23","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1111\/1475-4932.12165","volume":"91","author":"F Neri","year":"2015","unstructured":"Neri, F., & Rodgers, J. (2015). The contribution of Australian academia to the world\u2019s best economics research: 2001 to 2010. Economic Record, 91(292), 107\u2013124.","journal-title":"Economic Record"},{"issue":"6","key":"1979_CR24","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1108\/00220410310698734","volume":"59","author":"M Norris","year":"2003","unstructured":"Norris, M., & Oppenheim, C. (2003). Citation counts and the research assessment exercise V: Archaeology and the 2001 RAE. Journal of Documentation, 59(6), 709\u2013730.","journal-title":"Journal of Documentation"},{"key":"1979_CR25","first-page":"155","volume":"9","author":"C Oppenheim","year":"1996","unstructured":"Oppenheim, C. (1996). \u2018Do citations count? Citation indexing and the research assessment exercise\u2019, Serials, 9, 155\u2013161.","journal-title":"Citation indexing and the research assessment exercise\u2019, Serials"},{"key":"1979_CR26","unstructured":"Ostriker, J. P., Kuh, C. V., & Voytuk, J. A. (Eds.) (2011) A data-based assessment of research-doctorate programs in the United States. Committee to Assess Research-Doctorate Programs, National Research Council."},{"key":"1979_CR27","unstructured":"Regibeau, P., & Rockett, K. E. (2014). A tale of two metrics: Research assessment vs. recognized excellence. University of Essex, Department of Economics, Discussion Paper Series 757."},{"key":"1979_CR28","volume-title":"Rank hypocrisies: The insult of the REF","author":"D Sayer","year":"2014","unstructured":"Sayer, D. (2014). Rank hypocrisies: The insult of the REF. Thousand Oaks: Sage."},{"key":"1979_CR29","doi-asserted-by":"crossref","first-page":"F255","DOI":"10.1111\/ecoj.12070","volume":"123","author":"D Sgroi","year":"2013","unstructured":"Sgroi, D., & Oswald, A. J. (2013). How should peer-review panels behave? Economic Journal, 123, F255\u2013F278.","journal-title":"Economic Journal"},{"issue":"11","key":"1979_CR30","doi-asserted-by":"crossref","first-page":"e112520","DOI":"10.1371\/journal.pone.0112520","volume":"9","author":"DI Stern","year":"2014","unstructured":"Stern, D. I. (2014). High-ranked social science journal articles can be identified from early citation information. PLoS ONE, 9(11), e112520.","journal-title":"PLoS ONE"},{"issue":"3","key":"1979_CR31","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1007\/s11192-006-0042-z","volume":"66","author":"B S\u00fcssmuth","year":"2006","unstructured":"S\u00fcssmuth, B., Steininger, M., & Ghio, S. (2006). Towards a European economics of economics: Monitoring a decade of top research and providing some explanation. Scientometrics, 66(3), 579\u2013612.","journal-title":"Scientometrics"},{"key":"1979_CR32","doi-asserted-by":"crossref","first-page":"2419","DOI":"10.1002\/asi.22708","volume":"63","author":"L Waltman","year":"2012","unstructured":"Waltman, L., Calero-Medina, C., Kosten, J., Noyons, E. C. M., Tijssen, R. J. W., Van Eck, N. J., et al. (2012). The Leiden Ranking 2011\/2012: Data collection, indicators, and interpretation. Journal of the American Society for Information Science and Technology, 63, 2419\u20132432.","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"3","key":"1979_CR33","doi-asserted-by":"crossref","first-page":"699","DOI":"10.1007\/s11192-012-0913-4","volume":"96","author":"L Waltman","year":"2013","unstructured":"Waltman, L., & van Eck, N. J. (2013). Source normalized indicators of citation impact: An overview of different approaches and an empirical comparison. Scientometrics, 96(3), 699\u2013716.","journal-title":"Scientometrics"},{"key":"1979_CR34","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1007\/s11192-011-0354-5","volume":"87","author":"L Waltman","year":"2011","unstructured":"Waltman, L., van Eck, N. J., van Leeuwen, T. N., Visser, M. S., & van Raan, A. F. J. (2011). Towards a new crown indicator: An empirical analysis. Scientometrics, 87, 467\u2013481.","journal-title":"Scientometrics"},{"issue":"3","key":"1979_CR35","doi-asserted-by":"crossref","first-page":"851","DOI":"10.1007\/s11192-012-0775-9","volume":"94","author":"J Wang","year":"2013","unstructured":"Wang, J. (2013). Citation time window choice for research impact evaluation. Scientometrics, 94(3), 851\u2013872.","journal-title":"Scientometrics"},{"key":"1979_CR36","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1126\/science.1237825","volume":"342","author":"D Wang","year":"2013","unstructured":"Wang, D., Song, C., & Barab\u00e1si, A.-L. (2013). Quantifying long-term scientific impact. Science, 342, 127\u2013132.","journal-title":"Science"},{"key":"1979_CR37","doi-asserted-by":"publisher","DOI":"10.13140\/RG.2.1.4929.1363","author":"J Wilsdon","year":"2015","unstructured":"Wilsdon, J., et al. (2015). The metric tide: Report of the independent review of the role of metrics in research assessment and management. Higher Education Funding Council for England. doi: 10.13140\/RG.2.1.4929.1363 .","journal-title":"Higher Education Funding Council for England"},{"issue":"7","key":"1979_CR38","doi-asserted-by":"crossref","first-page":"e0132990","DOI":"10.1371\/journal.pone.0132990","volume":"10","author":"S Wooding","year":"2015","unstructured":"Wooding, S., van Leeuwen, T. N., Parks, S., Kapur, S., & Grant, J. (2015). UK doubles its \u201cworld-leading\u201d research in life sciences and medicine in six years: Testing the claim? PLoS ONE, 10(7), e0132990.","journal-title":"PLoS ONE"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-016-1979-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11192-016-1979-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-016-1979-1","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2019,6,3]],"date-time":"2019-06-03T14:13:27Z","timestamp":1559571207000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11192-016-1979-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,5,23]]},"references-count":38,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2016,8]]}},"alternative-id":["1979"],"URL":"https:\/\/doi.org\/10.1007\/s11192-016-1979-1","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,5,23]]}}}