{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T07:04:32Z","timestamp":1779260672500,"version":"3.51.4"},"reference-count":38,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2014,3,19]],"date-time":"2014-03-19T00:00:00Z","timestamp":1395187200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2014,11]]},"DOI":"10.1007\/s11192-014-1269-8","type":"journal-article","created":{"date-parts":[[2014,3,18]],"date-time":"2014-03-18T06:43:19Z","timestamp":1395124999000},"page":"1129-1144","source":"Crossref","is-referenced-by-count":228,"title":["How do you define and measure research productivity?"],"prefix":"10.1007","volume":"101","author":[{"given":"Giovanni","family":"Abramo","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ciriaco Andrea","family":"D\u2019Angelo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2014,3,19]]},"reference":[{"issue":"3","key":"1269_CR1","doi-asserted-by":"crossref","first-page":"1005","DOI":"10.1007\/s11192-012-0714-9","volume":"93","author":"G Abramo","year":"2012","unstructured":"Abramo, G., Cicero, T., & D\u2019Angelo, C. A. (2012a). What is the appropriate length of the publication period over which to assess research performance? Scientometrics, 93(3), 1005\u20131017.","journal-title":"Scientometrics"},{"issue":"2","key":"1269_CR2","doi-asserted-by":"crossref","first-page":"192","DOI":"10.1016\/j.joi.2011.12.003","volume":"6","author":"G Abramo","year":"2012","unstructured":"Abramo, G., Cicero, T., & D\u2019Angelo, C. A. (2012b). A sensitivity analysis of researchers\u2019 productivity rankings to the time of citation observation. Journal of Informetrics, 6(2), 192\u2013201.","journal-title":"Journal of Informetrics"},{"issue":"4","key":"1269_CR3","doi-asserted-by":"crossref","first-page":"470","DOI":"10.1016\/j.joi.2012.03.005","volume":"6","author":"G Abramo","year":"2012","unstructured":"Abramo, G., Cicero, T., & D\u2019Angelo, C. A. (2012c). Revisiting the scaling of citations for research assessment. Journal of Informetrics, 6(4), 470\u2013479.","journal-title":"Journal of Informetrics"},{"issue":"6","key":"1269_CR4","doi-asserted-by":"crossref","first-page":"701","DOI":"10.1007\/s10734-011-9471-6","volume":"63","author":"G Abramo","year":"2012","unstructured":"Abramo, G., Cicero, T., & D\u2019Angelo, C. A. (2012d). Revisiting size effects in higher education research productivity. Higher Education, 63(6), 701\u2013717.","journal-title":"Higher Education"},{"issue":"2","key":"1269_CR5","doi-asserted-by":"crossref","first-page":"528","DOI":"10.1016\/j.joi.2013.01.013","volume":"7","author":"G Abramo","year":"2013","unstructured":"Abramo, G., Cicero, T., & D\u2019Angelo, C. A. (2013a). Individual research performance: A proposal for comparing apples to oranges. Journal of Informetrics, 7(2), 528\u2013529.","journal-title":"Journal of Informetrics"},{"issue":"6","key":"1269_CR6","first-page":"762","volume":"93","author":"G Abramo","year":"2007","unstructured":"Abramo, G., & D\u2019Angelo, C. A. (2007). Measuring science: Irresistible temptations, easy shortcuts and dangerous consequences. Current Science, 93(6), 762\u2013766.","journal-title":"Current Science"},{"issue":"2","key":"1269_CR7","doi-asserted-by":"crossref","first-page":"111","DOI":"10.3152\/095820208X280916","volume":"17","author":"G Abramo","year":"2008","unstructured":"Abramo, G., D\u2019Angelo, C. A., & Di Costa, F. (2008). Assessment of sectoral aggregation distortion in research productivity measurements. Research Evaluation, 17(2), 111\u2013121.","journal-title":"Research Evaluation"},{"issue":"3","key":"1269_CR8","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1007\/s11192-011-0426-6","volume":"88","author":"G Abramo","year":"2011","unstructured":"Abramo, G., D\u2019Angelo, C. A., & Di Costa, F. (2011). Research productivity: Are higher academic ranks more productive than lower ones? Scientometrics, 88(3), 915\u2013928.","journal-title":"Scientometrics"},{"key":"1269_CR9","author":"G Abramo","year":"2013","unstructured":"Abramo, G., D\u2019Angelo, C. A., & Di Costa, F. (2013b). Investigating returns to scope of research fields in universities. Higher Education,. doi: 10.1007\/s10734-013-9685-x .","journal-title":"Higher Education"},{"issue":"1","key":"1269_CR10","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1016\/j.joi.2012.11.003","volume":"7","author":"G Abramo","year":"2013","unstructured":"Abramo, G., D\u2019Angelo, C. A., & Rosati, F. (2013c). The importance of accounting for the number of co-authors and their order when assessing research performance at the individual level in the life sciences. Journal of Informetrics, 7(1), 198\u2013208.","journal-title":"Journal of Informetrics"},{"issue":"3","key":"1269_CR11","doi-asserted-by":"crossref","first-page":"779","DOI":"10.1007\/s11192-013-1013-9","volume":"97","author":"G Abramo","year":"2013","unstructured":"Abramo, G., D\u2019Angelo, C. A., & Rosati, F. (2013d). Measuring institutional research productivity for the life sciences: The importance of accounting for the order of authors in the byline. Scientometrics, 97(3), 779\u2013795.","journal-title":"Scientometrics"},{"issue":"3","key":"1269_CR12","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1007\/s11192-010-0164-1","volume":"84","author":"G Abramo","year":"2010","unstructured":"Abramo, G., D\u2019Angelo, C. A., & Solazzi, M. (2010). National research assessment exercises: A measure of the distortion of performance rankings when labor input is treated as uniform. Scientometrics, 84(3), 605\u2013619.","journal-title":"Scientometrics"},{"issue":"7","key":"1269_CR13","doi-asserted-by":"crossref","first-page":"1320","DOI":"10.1002\/asi.21062","volume":"60","author":"\u00c9 Archambault","year":"2009","unstructured":"Archambault, \u00c9., Campbell, D., Gingras, Y., & Larivi\u00e8re, V. (2009). Comparing bibliometric statistics obtained from the Web of Science and Scopus. Journal of the American Society for Information Science and Technology, 60(7), 1320\u20131326.","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"1269_CR37","doi-asserted-by":"crossref","unstructured":"Banker, R. D., Charnes, A., & Cooper, W. W. (1984). Some models for estimating technical and scale inefficiencies in data envelopment analysis. Management Science, 30(9), 1078\u20131092.","DOI":"10.1287\/mnsc.30.9.1078"},{"issue":"8","key":"1269_CR14","doi-asserted-by":"crossref","first-page":"565","DOI":"10.3152\/030234207X254404","volume":"34","author":"L Butler","year":"2007","unstructured":"Butler, L. (2007). Assessing university research: A plea for a balanced approach. Science and Public Policy, 34(8), 565\u2013574.","journal-title":"Science and Public Policy"},{"key":"1269_CR38","doi-asserted-by":"crossref","unstructured":"Charnes, A., Cooper, W. W., & Rhodes, E. (1978). Measuring the efficiency of decision making units. European Journal of Operational Research, 2, 429\u2013444.","DOI":"10.1016\/0377-2217(78)90138-8"},{"issue":"4","key":"1269_CR15","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1007\/BF02019306","volume":"1","author":"E Garfield","year":"1979","unstructured":"Garfield, E. (1979). Is citation analysis a legitimate evaluation tool? Scientometrics, 1(4), 359\u2013375.","journal-title":"Scientometrics"},{"key":"1269_CR16","unstructured":"Gl\u00e4nzel, W. (2008). Seven myths in bibliometrics. About facts and fiction in quantitative science studies. Kretschmer & F. Havemann (Eds) Proceedings of WIS fourth international conference on webometrics, informetrics and scientometrics and ninth COLLNET meeting, Berlin, Germany."},{"issue":"46","key":"1269_CR17","doi-asserted-by":"crossref","first-page":"16569","DOI":"10.1073\/pnas.0507655102","volume":"102","author":"JE Hirsch","year":"2005","unstructured":"Hirsch, J. E. (2005). An index to quantify an individual\u2019s scientific research output. Proceedings of the National Academy of Sciences, 102(46), 16569\u201316572.","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"1269_CR18","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1038\/430311a","volume":"430","author":"DA King","year":"2004","unstructured":"King, D. A. (2004). The scientific impact of nations\u2014What different countries get for their research spending. Nature, 430, 311\u2013316.","journal-title":"Nature"},{"issue":"1","key":"1269_CR19","doi-asserted-by":"crossref","first-page":"2","DOI":"10.3152\/147154406781776066","volume":"15","author":"G Laudel","year":"2006","unstructured":"Laudel, G., & Origgi, G. (2006). Introduction to a special issue on the assessment of interdisciplinary research. Research Evaluation, 15(1), 2\u20134.","journal-title":"Research Evaluation"},{"issue":"2","key":"1269_CR20","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1002\/asi.21450","volume":"62","author":"L Leydesdorff","year":"2011","unstructured":"Leydesdorff, L., & Bornmann, L. (2011). How fractional counting of citations affects the impact factor: Normalization in terms of differences in citation potentials among fields of science. JASIST, 62(2), 217\u2013229.","journal-title":"JASIST"},{"issue":"1","key":"1269_CR21","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1016\/j.joi.2010.10.003","volume":"5","author":"L Leydesdorff","year":"2011","unstructured":"Leydesdorff, L., & Opthof, T. (2011). Remaining problems with the \u201cNew Crown Indicator\u201d (MNCS) of the CWTS. Journal of Informetrics, 5(1), 224\u2013225.","journal-title":"Journal of Informetrics"},{"issue":"12","key":"1269_CR22","first-page":"317","volume":"16","author":"AJ Lotka","year":"1926","unstructured":"Lotka, A. J. (1926). The frequency distribution of scientific productivity. Journal of the Washington Academy of Sciences, 16(12), 317\u2013324.","journal-title":"Journal of the Washington Academy of Sciences"},{"issue":"5301","key":"1269_CR23","doi-asserted-by":"crossref","first-page":"793","DOI":"10.1126\/science.275.5301.793","volume":"275","author":"RM May","year":"1997","unstructured":"May, R. M. (1997). The scientific wealth of nations. Science, 275(5301), 793\u2013796.","journal-title":"Science"},{"key":"1269_CR24","unstructured":"Moed, H. F. (2005). Citation analysis in research evaluation. Springer, ISBN: 978-1-4020-3713-9."},{"issue":"3\u20134","key":"1269_CR25","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1007\/BF02016935","volume":"8","author":"HF Moed","year":"1985","unstructured":"Moed, H. F., Burger, W. J. M., Frankfort, J. G., & Van Raan, A. F. J. (1985). The application of bibliometric indicators: Important field- and time-dependent factors to be considered. Scientometrics, 8(3\u20134), 177\u2013203.","journal-title":"Scientometrics"},{"issue":"3","key":"1269_CR26","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1016\/j.joi.2010.02.003","volume":"4","author":"T Opthof","year":"2010","unstructured":"Opthof, T., & Leydesdorff, L. (2010). Caveats for the journal and field normalizations in the CWTS (\u201cLeiden\u201d) evaluations of research performance. Journal of Informetrics, 4(3), 423\u2013430.","journal-title":"Journal of Informetrics"},{"issue":"11","key":"1269_CR27","doi-asserted-by":"crossref","first-page":"e46428","DOI":"10.1371\/journal.pone.0046428","volume":"7","author":"A Pepe","year":"2012","unstructured":"Pepe, A., & Kurtz, M. J. (2012). A Measure of total research impact independent of time and discipline. PLoS ONE, 7(11), e46428.","journal-title":"PLoS ONE"},{"key":"1269_CR28","doi-asserted-by":"crossref","DOI":"10.4000\/books.editionscnrs.31478","volume-title":"La Signature Scientifique: Une Sociologie Pragmatique de l\u2019Attribution","author":"D Pontille","year":"2004","unstructured":"Pontille, D. (2004). La Signature Scientifique: Une Sociologie Pragmatique de l\u2019Attribution. Paris: CNRS \u00c9DITIONS."},{"key":"1269_CR29","unstructured":"QS-Quacquarelli Symonds. (2013). World University Rankings 2013. Retrieved Feb. 10, 2014 from http:\/\/www.topuniversities.com\/university-rankings\/world-university-rankings ."},{"key":"1269_CR30","unstructured":"RIN (Research Information Network). (2009). Communicating Knowledge: How and Why Researchers Publish and Disseminate Their Findings. London, UK: RIN. Retrieved Februarys 10, 2014 from www.jisc.ac.uk\/publications\/research\/2009\/communicatingknowledgereport.aspx ."},{"key":"1269_CR39","unstructured":"Scheel, H. (2000). EMS: Efficiency Measurement System. A Data Envelopment Analysis (DEA) Software. http:\/\/www.holger-scheel.de\/ems\/ . Accessed 6 March 2014."},{"key":"1269_CR31","unstructured":"SJTU-Shanghai Jiao Tong University. (2013). Academic Ranking of World Universities 2013. Retrieved November 14, 2013 from http:\/\/www.shanghairanking.com\/ARWU2011.html ."},{"key":"1269_CR32","unstructured":"THE-Times Higher Education. (2013). World University Rankings 2013\u20132014. Retrieved November 8, 2013 from http:\/\/www.timeshighereducation.co.uk\/world-university-rankings\/2013-14\/world-ranking ."},{"key":"1269_CR33","unstructured":"Thompson, B. (1993). GRE percentile ranks cannot be added or averaged: A position paper exploring the scaling characteristics of percentile ranks, and the ethical and legal culpabilities created by adding percentile ranks in making \u201chigh-stakes\u201d admission decisions. Paper presented at the Annual Meeting of the Mid-South Educational Research Association, New Orleans, LA."},{"issue":"12","key":"1269_CR34","doi-asserted-by":"crossref","first-page":"2419","DOI":"10.1002\/asi.22708","volume":"63","author":"L Waltman","year":"2012","unstructured":"Waltman, L., Calero-Medina, C., Kosten, J., Noyons, E. C. M., Tijssen, R. J. W., Van Eck, N. J., et al. (2012). The Leiden ranking 2011\/2012: Data collection, indicators, and interpretation. Journal of the American Society for Information Science and Technology, 63(12), 2419\u20132432.","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"1","key":"1269_CR35","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.joi.2010.08.001","volume":"5","author":"L Waltman","year":"2011","unstructured":"Waltman, L., Van Eck, N. J., Van Leeuwen, T. N., Visser, M. S., & Van Raan, A. F. J. (2011). Towards a new crown indicator: Some theoretical considerations. Journal of Informetrics, 5(1), 37\u201347.","journal-title":"Journal of Informetrics"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-014-1269-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11192-014-1269-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-014-1269-8","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,3,30]],"date-time":"2022-03-30T03:24:53Z","timestamp":1648610693000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11192-014-1269-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,3,19]]},"references-count":38,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2014,11]]}},"alternative-id":["1269"],"URL":"https:\/\/doi.org\/10.1007\/s11192-014-1269-8","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,3,19]]}}}