{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,14]],"date-time":"2025-05-14T03:42:45Z","timestamp":1747194165385,"version":"3.40.5"},"reference-count":41,"publisher":"MIT Press","issue":"3","content-domain":{"domain":["www.mitpressjournals.org"],"crossmark-restriction":true},"short-container-title":["Quantitative Science Studies"],"published-print":{"date-parts":[[2020,8]]},"abstract":"<jats:p> In this work we ask whether and to what extent applying a predictor of a publication\u2019s impact that is better than early citations has an effect on the assessment of the research performance of individual scientists. Specifically, we measure the total impact of Italian professors in the sciences and economics over time, valuing their publications first by early citations and then by a weighted combination of early citations and the impact factor of the hosting journal. As expected, the scores and ranks of the two indicators show a very strong correlation, but significant shifts occur in many fields, mainly in economics and statistics, and mathematics and computer science. The higher the share of uncited professors in a field and the shorter the citation time window, the more recommendable is recourse to the above combination. <\/jats:p>","DOI":"10.1162\/qss_a_00051","type":"journal-article","created":{"date-parts":[[2020,5,28]],"date-time":"2020-05-28T19:05:22Z","timestamp":1590692722000},"page":"1321-1333","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":2,"title":["Informed peer review for publication assessments: Are improved impact measures worth the hassle?"],"prefix":"10.1162","volume":"1","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0731-3635","authenticated-orcid":true,"given":"Giovanni","family":"Abramo","sequence":"first","affiliation":[{"name":"Laboratory for Studies in Research Evaluation, Institute for System Analysis and Computer Science (IASI-CNR), National Research Council, Rome, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6977-6611","authenticated-orcid":true,"given":"Ciriaco Andrea","family":"D\u2019Angelo","sequence":"additional","affiliation":[{"name":"University of Rome \u201cTor Vergata,\u201d Dept of Engineering and Management, Rome, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0544-5407","authenticated-orcid":true,"given":"Giovanni","family":"Felici","sequence":"additional","affiliation":[{"name":"Institute for System Analysis and Computer Science (IASI-CNR), National Research Council, Rome, Italy"}]}],"member":"281","reference":[{"issue":"3","key":"bib1","doi-asserted-by":"crossref","first-page":"590","DOI":"10.1016\/j.joi.2018.05.001","volume":"12","author":"Abramo G.","year":"2018","journal-title":"Journal of Informetrics"},{"issue":"4","key":"bib2","doi-asserted-by":"crossref","first-page":"659","DOI":"10.1016\/j.joi.2011.06.004","volume":"5","author":"Abramo G.","year":"2011","journal-title":"Journal of Informetrics"},{"issue":"4","key":"bib3","doi-asserted-by":"crossref","first-page":"470","DOI":"10.1016\/j.joi.2012.03.005","volume":"6","author":"Abramo G.","year":"2012","journal-title":"Journal of Informetrics"},{"issue":"3","key":"bib4","doi-asserted-by":"crossref","first-page":"2053","DOI":"10.1007\/s11192-016-2153-5","volume":"109","author":"Abramo G.","year":"2016","journal-title":"Scientometrics"},{"issue":"3","key":"bib5","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1007\/s11192-010-0200-1","volume":"84","author":"Abramo G.","year":"2010","journal-title":"Scientometrics"},{"issue":"1","key":"bib6","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1016\/j.joi.2018.11.003","volume":"13","author":"Abramo G.","year":"2019","journal-title":"Journal of Informetrics"},{"issue":"3","key":"bib7","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1007\/s11192-005-0228-9","volume":"63","author":"Adams J.","year":"2005","journal-title":"Scientometrics"},{"issue":"2","key":"bib8","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1007\/s11192-016-1882-9","volume":"107","author":"Anfossi A.","year":"2016","journal-title":"Scientometrics"},{"issue":"4","key":"bib9","first-page":"797","volume":"65","author":"Baumgartner S.","year":"2014","journal-title":"Journal of the American Society for Information Science and Technology"},{"volume-title":"Knowledge and social imagery","year":"1976","author":"Bloor D.","key":"bib10"},{"issue":"1","key":"bib11","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1108\/00220410810844150","volume":"64","author":"Bornmann L.","year":"2008","journal-title":"Journal of Documentation"},{"issue":"1","key":"bib12","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1016\/j.joi.2013.11.005","volume":"8","author":"Bornmann L.","year":"2014","journal-title":"Journal of Informetrics"},{"issue":"4","key":"bib13","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1002\/asi.4630360402","volume":"36","author":"Brooks T. A.","year":"1985","journal-title":"Journal of the American Society for Information Science"},{"issue":"3","key":"bib14","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1002\/asi.4630370106","volume":"37","author":"Brooks T. A.","year":"1986","journal-title":"Journal of the American Society for Information Science"},{"key":"bib15","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1126\/science.178.4060.471","volume":"178","author":"Garfield E.","year":"1972","journal-title":"Science"},{"issue":"1","key":"bib16","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1177\/030631277700700112","volume":"7","author":"Gilbert G. N.","year":"1977","journal-title":"Social Studies of Science"},{"issue":"3","key":"bib17","doi-asserted-by":"crossref","first-page":"571","DOI":"10.1023\/B:SCIE.0000006881.30700.ea","volume":"58","author":"Gl\u00e4nzel W.","year":"2003","journal-title":"Scientometrics"},{"issue":"3","key":"bib18","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1002\/asi.5090160305","volume":"16","author":"Kaplan N.","year":"1965","journal-title":"American Documentation"},{"volume-title":"Science in action: How to follow scientists and engineers through society","year":"1987","author":"Latour B.","key":"bib19"},{"issue":"2","key":"bib20","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1016\/j.ipm.2010.09.005","volume":"47","author":"Levitt J. M.","year":"2011","journal-title":"Information Processing and Management"},{"issue":"1","key":"bib21","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1177\/030631284014001006","volume":"14","author":"MacRoberts M. H.","year":"1984","journal-title":"Social Studies of Science"},{"issue":"4","key":"bib22","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1002\/(SICI)1097-4571(198707)38:4<305::AID-ASI11>3.0.CO;2-I","volume":"38","author":"MacRoberts M. H.","year":"1987","journal-title":"Journal of the American Society for Information Science"},{"issue":"6","key":"bib23","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1002\/(SICI)1097-4571(198811)39:6<432::AID-ASI8>3.0.CO;2-2","volume":"39","author":"MacRoberts M. H.","year":"1988","journal-title":"Journal of the American Society for Information Science"},{"issue":"1","key":"bib24","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/0968-0004(89)90077-7","volume":"14","author":"MacRoberts M. H.","year":"1989","journal-title":"Trends in Biochemical Science"},{"issue":"5","key":"bib25","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1002\/(SICI)1097-4571(198909)40:5<342::AID-ASI7>3.0.CO;2-U","volume":"40","author":"MacRoberts M. H.","year":"1989","journal-title":"Journal of the American Society for Information Science"},{"issue":"3","key":"bib26","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1007\/BF02129604","volume":"36","author":"MacRoberts M. H.","year":"1996","journal-title":"Scientometrics"},{"issue":"3","key":"bib27","doi-asserted-by":"crossref","first-page":"474","DOI":"10.1002\/asi.23970","volume":"69","author":"MacRoberts M. H.","year":"2018","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"bib28","first-page":"286","author":"Merton R. K.","year":"1973","journal-title":"The sociology of science: Theoretical and empirical investigations"},{"issue":"8","key":"bib29","doi-asserted-by":"crossref","first-page":"1013","DOI":"10.1057\/palgrave.jors.2602428","volume":"59","author":"Mingers J.","year":"2008","journal-title":"Journal Operational Research Society"},{"issue":"4","key":"bib30","doi-asserted-by":"crossref","first-page":"637","DOI":"10.1177\/053901847601500406","volume":"15","author":"Mulkay M.","year":"1976","journal-title":"Social Science Information"},{"issue":"1","key":"bib31","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1093\/reseval\/rvr005","volume":"21","author":"Nederhof A. J.","year":"2012","journal-title":"Research Evaluation"},{"issue":"4","key":"bib32","doi-asserted-by":"crossref","first-page":"981","DOI":"10.1016\/j.joi.2016.07.001","volume":"10","author":"Onodera N.","year":"2016","journal-title":"Journal of Informetrics"},{"key":"bib33","first-page":"249","volume-title":"Informetrics 87\/88","author":"Rousseau R.","year":"1988"},{"issue":"1","key":"bib34","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1007\/s11192-018-2830-7","volume":"117","author":"Song Y.","year":"2018","journal-title":"Scientometrics"},{"issue":"3","key":"bib35","doi-asserted-by":"crossref","first-page":"642","DOI":"10.1016\/j.joi.2015.06.005","volume":"9","author":"Stegehuis C.","year":"2015","journal-title":"Journal of Informetrics"},{"issue":"11","key":"bib36","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pone.0112520","volume":"9","author":"Stern D. I.","year":"2014","journal-title":"PLOS ONE"},{"issue":"2","key":"bib37","doi-asserted-by":"crossref","first-page":"e1683","DOI":"10.1371\/journal.pone.0001683","volume":"3","author":"Stringer M. J.","year":"2008","journal-title":"PLOS ONE"},{"issue":"2","key":"bib38","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1007\/s11192-016-2186-9","volume":"110","author":"Teixeira A. A. C.","year":"2017","journal-title":"Scientometrics"},{"volume-title":"Proceedings of the 17th International Society of Scientometrics and Informetrics Conference (ISSI 2019)","year":"2019","author":"Teplitskiy M.","key":"bib39"},{"issue":"3","key":"bib40","first-page":"461","volume":"59","author":"van Raan A. F. J.","year":"2004","journal-title":"Scientometrics"},{"issue":"3","key":"bib41","doi-asserted-by":"crossref","first-page":"851","DOI":"10.1007\/s11192-012-0775-9","volume":"94","author":"Wang J.","year":"2013","journal-title":"Scientometrics"}],"container-title":["Quantitative Science Studies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/qss_a_00051","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:30:27Z","timestamp":1615584627000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/qss\/article\/1\/3\/1321-1333\/96110"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8]]},"references-count":41,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,8]]}},"alternative-id":["10.1162\/qss_a_00051"],"URL":"https:\/\/doi.org\/10.1162\/qss_a_00051","relation":{},"ISSN":["2641-3337"],"issn-type":[{"type":"electronic","value":"2641-3337"}],"subject":[],"published":{"date-parts":[[2020,8]]},"assertion":[{"value":"2020-02-26","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-03-31","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-09-04","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}