{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T07:31:40Z","timestamp":1740123100498,"version":"3.37.3"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"10","license":[{"start":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T00:00:00Z","timestamp":1662595200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T00:00:00Z","timestamp":1662595200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2022,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The aim of this paper is to study the role of citation network measures in the assessment of scientific maturity. Referring to the case of the Italian national scientific qualification (ASN), we investigate if there is a relationship between citation network indices and the results of the researchers\u2019 evaluation procedures. In particular, we want to understand if network measures can enhance the prediction accuracy of the results of the evaluation procedures beyond basic performance indices. Moreover, we want to highlight which citation network indices prove to be more relevant in explaining the ASN results, and if quantitative indices used in the citation-based disciplines assessment can replace the citation network measures in non-citation-based disciplines. Data concerning Statistics and Computer Science disciplines are collected from different sources (ASN, Italian Ministry of University and Research, and Scopus) and processed in order to calculate the citation-based measures used in this study. Then, we apply logistic regression models to estimate the effects of network variables. We find that network measures are strongly related to the results of the ASN and significantly improve the explanatory power of the models, especially for the research fields of Statistics. Additionally, citation networks in the specific sub-disciplines are far more relevant than those in the general disciplines. Finally, results show that the citation network measures are not a substitute of the citation-based bibliometric indices.<\/jats:p>","DOI":"10.1007\/s11192-022-04485-5","type":"journal-article","created":{"date-parts":[[2022,9,8]],"date-time":"2022-09-08T03:25:13Z","timestamp":1662607513000},"page":"5633-5659","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["The role of citation networks to explain academic promotions: an empirical analysis of the Italian national scientific qualification"],"prefix":"10.1007","volume":"127","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5622-9187","authenticated-orcid":false,"given":"Maria Cristiana","family":"Martini","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3247-4150","authenticated-orcid":false,"given":"Elvira","family":"Pelle","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6577-5606","authenticated-orcid":false,"given":"Francesco","family":"Poggi","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5621-5463","authenticated-orcid":false,"given":"Andrea","family":"Sciandra","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,9,8]]},"reference":[{"issue":"3","key":"4485_CR1","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1007\/s40888-015-0016-9","volume":"32","author":"G Abramo","year":"2015","unstructured":"Abramo, G., & D\u2019Angelo, C. A. (2015). An assessment of the first \u201cscientific habilitation\u201d for university appointments in Italy. Economia Politica, 32(3), 329\u2013357. https:\/\/doi.org\/10.1007\/s40888-015-0016-9","journal-title":"Economia Politica"},{"issue":"1","key":"4485_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1214\/09-STS285","volume":"24","author":"R Adler","year":"2009","unstructured":"Adler, R., Ewing, J., & Taylor, P. (2009). Citation statistics. Statistical Science, 24(1), 1\u201314. https:\/\/doi.org\/10.1214\/09-STS285","journal-title":"Statistical Science"},{"key":"4485_CR3","first-page":"1","volume":"1","author":"M Amin","year":"2000","unstructured":"Amin, M., & Mabe, M. (2000). Impact factor: Use and abuse. Perspectives in Publishing, 1, 1\u20136.","journal-title":"Perspectives in Publishing"},{"key":"4485_CR4","doi-asserted-by":"publisher","DOI":"10.1108\/LHT-09-2021-0305","author":"L Bedogni","year":"2022","unstructured":"Bedogni, L., Cabri, G., Martoglia, R., & Poggi, F. (2022). Does the venue of scientific conferences leverage their impact? A large scale study on Computer Science conferences. Library Hi Tech. https:\/\/doi.org\/10.1108\/LHT-09-2021-0305","journal-title":"Library Hi Tech."},{"issue":"357","key":"4485_CR5","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1080\/01621459.1977.10479905","volume":"72","author":"RB Bendel","year":"1977","unstructured":"Bendel, R. B., & Afifi, A. A. (1977). Comparison of stopping rules in forward \u201cstepwise\u201d regression. Journal of the American Statistical Association, 72(357), 46\u201353. https:\/\/doi.org\/10.1080\/01621459.1977.10479905","journal-title":"Journal of the American Statistical Association"},{"issue":"1","key":"4485_CR6","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1080\/0022250X.1972.9989806","volume":"2","author":"P Bonacich","year":"1972","unstructured":"Bonacich, P. (1972). Factoring and weighting approaches to status scores and clique identification. The Journal of Mathematical Sociology, 2(1), 113\u2013120. https:\/\/doi.org\/10.1080\/0022250X.1972.9989806","journal-title":"The Journal of Mathematical Sociology"},{"issue":"5","key":"4485_CR7","doi-asserted-by":"publisher","first-page":"1170","DOI":"10.1086\/228631","volume":"92","author":"P Bonacich","year":"1987","unstructured":"Bonacich, P. (1987). Power and centrality: A family of measures. American Journal of Sociology, 92(5), 1170\u20131182. https:\/\/doi.org\/10.1086\/228631","journal-title":"American Journal of Sociology"},{"issue":"1","key":"4485_CR8","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1016\/j.socnet.2004.11.008","volume":"27","author":"SP Borgatti","year":"2005","unstructured":"Borgatti, S. P. (2005). Centrality and network flow. Social Networks, 27(1), 55\u201371. https:\/\/doi.org\/10.1016\/j.socnet.2004.11.008","journal-title":"Social Networks"},{"issue":"6","key":"4485_CR9","doi-asserted-by":"publisher","first-page":"06","DOI":"10.18637\/jss.v024.i06","volume":"24","author":"CT Butts","year":"2008","unstructured":"Butts, C. T. (2008). Social network analysis with sna. Journal of Statistical Software, 24(6), 06. https:\/\/doi.org\/10.18637\/jss.v024.i06","journal-title":"Journal of Statistical Software"},{"key":"4485_CR10","doi-asserted-by":"publisher","unstructured":"Dawson, S., Ga\u0161evi\u0107, D., Siemens, G., & Joksimovic, S. (2014). Current state and future trends: A citation network analysis of the learning analytics field. 231\u2013240. https:\/\/doi.org\/10.1145\/2567574.2567585","DOI":"10.1145\/2567574.2567585"},{"issue":"3","key":"4485_CR11","doi-asserted-by":"publisher","first-page":"2207","DOI":"10.1007\/s11192-020-03548-9","volume":"124","author":"C Demetrescu","year":"2020","unstructured":"Demetrescu, C., Finocchi, I., Ribichini, A., & Schaerf, M. (2020). On bibliometrics in academic promotions: A case study in Computer Science and engineering in Italy. Scientometrics, 124(3), 2207\u20132228. https:\/\/doi.org\/10.1007\/s11192-020-03548-9","journal-title":"Scientometrics"},{"key":"4485_CR12","unstructured":"Di Iorio, A., Poggi, F., & Peroni, S. (2019). Open data to evaluate academic researchers: An experiment with the Italian Scientific Habilitation. In 17th International Conference on Scientometrics and Informetrics, ISSI 2019\u2014Proceedings Volume 2, (pp. 2133\u20132144). http:\/\/arxiv.org\/abs\/1902.03287"},{"issue":"3","key":"4485_CR13","doi-asserted-by":"publisher","first-page":"1005","DOI":"10.1007\/s11192-016-1891-8","volume":"107","author":"SY Diallo","year":"2016","unstructured":"Diallo, S. Y., Lynch, C. J., Gore, R., & Padilla, J. J. (2016). Identifying key papers within a journal via network centrality measures. Scientometrics, 107(3), 1005\u20131020. https:\/\/doi.org\/10.1007\/s11192-016-1891-8","journal-title":"Scientometrics"},{"issue":"1","key":"4485_CR14","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1016\/j.joi.2010.10.008","volume":"5","author":"Y Ding","year":"2011","unstructured":"Ding, Y. (2011). Scientific collaboration and endorsement: Network analysis of coauthorship and citation networks. Journal of Informetrics, 5(1), 187\u2013203. https:\/\/doi.org\/10.1016\/j.joi.2010.10.008","journal-title":"Journal of Informetrics"},{"issue":"11","key":"4485_CR15","doi-asserted-by":"publisher","first-page":"2229","DOI":"10.1002\/asi.21171","volume":"60","author":"Y Ding","year":"2009","unstructured":"Ding, Y., Yan, E., Frazho, A., & Caverlee, J. (2009). PageRank for ranking authors in co-citation networks. Journal of the American Society for Information Science and Technology, 60(11), 2229\u20132243. https:\/\/doi.org\/10.1002\/asi.21171","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"2","key":"4485_CR16","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1007\/s11192-010-0324-3","volume":"87","author":"TH Feeley","year":"2011","unstructured":"Feeley, T. H., LaVail, K. H., & Barnett, G. A. (2011). Predicting faculty job centrality in communication. Scientometrics, 87(2), 303\u2013314. https:\/\/doi.org\/10.1007\/s11192-010-0324-3","journal-title":"Scientometrics"},{"issue":"3","key":"4485_CR17","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1016\/0378-8733(78)90021-7","volume":"1","author":"LC Freeman","year":"1978","unstructured":"Freeman, L. C. (1978). Centrality in social networks conceptual clarification. Social Networks, 1(3), 215\u2013239. https:\/\/doi.org\/10.1016\/0378-8733(78)90021-7","journal-title":"Social Networks"},{"issue":"3","key":"4485_CR18","doi-asserted-by":"publisher","first-page":"1577","DOI":"10.1007\/s11192-015-1737-9","volume":"105","author":"SR Goldberg","year":"2015","unstructured":"Goldberg, S. R., Anthony, H., & Evans, T. S. (2015). Modelling citation networks. Scientometrics, 105(3), 1577\u20131604. https:\/\/doi.org\/10.1007\/s11192-015-1737-9","journal-title":"Scientometrics"},{"key":"4485_CR19","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-21606-5","volume-title":"The elements of statistical learning","author":"T Hastie","year":"2001","unstructured":"Hastie, T., Friedman, J., & Tibshirani, R. (2001). The elements of statistical learning. Springer. https:\/\/doi.org\/10.1007\/978-0-387-21606-5"},{"issue":"3","key":"4485_CR20","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1007\/s11192-007-2014-3","volume":"78","author":"P Jensen","year":"2008","unstructured":"Jensen, P., Rouquier, J.-B., & Croissant, Y. (2008). Testing bibliometric indicators by their prediction of scientists promotions. Scientometrics, 78(3), 467\u2013479. https:\/\/doi.org\/10.1007\/s11192-007-2014-3","journal-title":"Scientometrics"},{"issue":"4","key":"4485_CR21","doi-asserted-by":"publisher","first-page":"1779","DOI":"10.1214\/15-AOAS896","volume":"10","author":"P Ji","year":"2016","unstructured":"Ji, P., & Jin, J. (2016). Coauthorship and citation networks for statisticians. The Annals of Applied Statistics, 10(4), 1779\u20131812. https:\/\/doi.org\/10.1214\/15-AOAS896","journal-title":"The Annals of Applied Statistics"},{"key":"4485_CR22","unstructured":"Krackhardt, D. (1994). Graph theoretical dimensions of informal organizations. In Computational organization theory (pp. 89\u2013111). Lawrence Erlbaum Associates, Inc."},{"key":"4485_CR23","unstructured":"Law. (2011). Rules concerning the organization of the universities, academic employees and recruitment procedures, empowering the government to foster the quality and efficiency of the university system (Norme in materia di organizzazione delle universit\u00e0, di personale accademico e reclutamento, nonche\u2019 delega al Governo per incentivare la qualit\u00e0 e l\u2019efficienza del sistema universitario). Gazzetta Ufficiale n. 10 Del 14 Gennaio 2011 Suppl. Ordinario n. 11. http:\/\/www.gazzettaufficiale.it\/eli\/id\/2011\/01\/14\/011G0009\/sg"},{"issue":"3","key":"4485_CR24","doi-asserted-by":"publisher","first-page":"1953","DOI":"10.1007\/s11192-015-1761-9","volume":"105","author":"X Liu","year":"2015","unstructured":"Liu, X., Jiang, S., Chen, H., Larson, C. A., & Roco, M. C. (2015). Modeling knowledge diffusion in scientific innovation networks: An institutional comparison between China and US with illustration for nanotechnology. Scientometrics, 105(3), 1953\u20131984. https:\/\/doi.org\/10.1007\/s11192-015-1761-9","journal-title":"Scientometrics"},{"issue":"2","key":"4485_CR25","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1007\/s10734-016-0008-x","volume":"73","author":"G Marini","year":"2017","unstructured":"Marini, G. (2017). New promotion patterns in Italian universities: Less seniority and more productivity? Data from ASN. Higher Education, 73(2), 189\u2013205. https:\/\/doi.org\/10.1007\/s10734-016-0008-x","journal-title":"Higher Education"},{"key":"4485_CR26","doi-asserted-by":"publisher","unstructured":"Martini, M. C., Pelle, E., Poggi, F., & Sciandra, A. (2021). Datasets and results of the paper titled \u201cAre citation networks relevant to explain academic promotions? An empirical analysis of the Italian national scientific qualification.\u201d https:\/\/doi.org\/10.5281\/zenodo.6364742","DOI":"10.5281\/zenodo.6364742"},{"issue":"2","key":"4485_CR27","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1016\/j.joi.2015.02.006","volume":"9","author":"M Marzolla","year":"2015","unstructured":"Marzolla, M. (2015). Quantitative analysis of the Italian National Scientific Qualification. Journal of Informetrics, 9(2), 285\u2013316. https:\/\/doi.org\/10.1016\/j.joi.2015.02.006","journal-title":"Journal of Informetrics"},{"issue":"2","key":"4485_CR28","doi-asserted-by":"publisher","first-page":"408","DOI":"10.1016\/j.joi.2016.01.009","volume":"10","author":"M Marzolla","year":"2016","unstructured":"Marzolla, M. (2016). Assessing evaluation procedures for individual researchers: The case of the Italian National Scientific Qualification. Journal of Informetrics, 10(2), 408\u2013438. https:\/\/doi.org\/10.1016\/j.joi.2016.01.009","journal-title":"Journal of Informetrics"},{"issue":"2","key":"4485_CR29","doi-asserted-by":"publisher","first-page":"539","DOI":"10.1007\/s11192-018-2988-z","volume":"118","author":"AG Nuzzolese","year":"2019","unstructured":"Nuzzolese, A. G., Ciancarini, P., Gangemi, A., Peroni, S., Poggi, F., & Presutti, V. (2019). Do altmetrics work for assessing research quality? Scientometrics, 118(2), 539\u2013562. https:\/\/doi.org\/10.1007\/s11192-018-2988-z","journal-title":"Scientometrics"},{"issue":"1","key":"4485_CR30","doi-asserted-by":"publisher","first-page":"26","DOI":"10.3390\/challe6010026","volume":"6","author":"M Pautasso","year":"2015","unstructured":"Pautasso, M. (2015). The Italian University Habilitation and the challenge of increasing the representation of women in academia. Challenges, 6(1), 26\u201341. https:\/\/doi.org\/10.3390\/challe6010026","journal-title":"Challenges"},{"issue":"1","key":"4485_CR31","doi-asserted-by":"publisher","first-page":"253","DOI":"10.1007\/s11192-020-03397-6","volume":"123","author":"S Peroni","year":"2020","unstructured":"Peroni, S., Ciancarini, P., Gangemi, A., Nuzzolese, A. G., Poggi, F., & Presutti, V. (2020). The practice of self-citations: A longitudinal study. Scientometrics, 123(1), 253\u2013282. https:\/\/doi.org\/10.1007\/s11192-020-03397-6","journal-title":"Scientometrics"},{"key":"4485_CR32","doi-asserted-by":"publisher","DOI":"10.7717\/peerj-cs.199","volume":"5","author":"F Poggi","year":"2019","unstructured":"Poggi, F., Ciancarini, P., Gangemi, A., Nuzzolese, A. G., Peroni, S., & Presutti, V. (2019). Predicting the results of evaluation procedures of academics. PeerJ Computer Science, 5, e199. https:\/\/doi.org\/10.7717\/peerj-cs.199","journal-title":"PeerJ Computer Science"},{"key":"4485_CR33","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1007\/978-3-642-23068-4_7","volume-title":"Models of science dynamics: Encounters between complexity theory and information sciences","author":"F Radicchi","year":"2012","unstructured":"Radicchi, F., Fortunato, S., & Vespignani, A. (2012). Citation networks. In A. Scharnhorst, K. B\u00f6rner, & P. van den Besselaar (Eds.), Models of science dynamics: Encounters between complexity theory and information sciences (pp. 233\u2013257). London: Springer. https:\/\/doi.org\/10.1007\/978-3-642-23068-4_7"},{"issue":"2","key":"4485_CR34","doi-asserted-by":"publisher","first-page":"997","DOI":"10.1007\/s11192-018-2913-5","volume":"117","author":"F Scarpa","year":"2018","unstructured":"Scarpa, F., Bianco, V., & Tagliafico, L. A. (2018). The impact of the national assessment exercises on self-citation rate and publication venue: An empirical investigation on the engineering academic sector in Italy. Scientometrics, 117(2), 997\u20131022. https:\/\/doi.org\/10.1007\/s11192-018-2913-5","journal-title":"Scientometrics"},{"key":"4485_CR35","doi-asserted-by":"publisher","unstructured":"Singh, A. P., Shubhankar, K., & Pudi, V. (2011). An efficient algorithm for ranking research papers based on citation network (pp. 88\u201395). https:\/\/doi.org\/10.1109\/DMO.2011.5976510","DOI":"10.1109\/DMO.2011.5976510"},{"issue":"1","key":"4485_CR36","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/0378-8733(89)90016-6","volume":"11","author":"K Stephenson","year":"1989","unstructured":"Stephenson, K., & Zelen, M. (1989). Rethinking centrality: Methods and examples. Social Networks, 11(1), 1\u201337. https:\/\/doi.org\/10.1016\/0378-8733(89)90016-6","journal-title":"Social Networks"},{"key":"4485_CR37","doi-asserted-by":"publisher","DOI":"10.7717\/peerj.5707","volume":"6","author":"JR Tregellas","year":"2018","unstructured":"Tregellas, J. R., Smucny, J., Rojas, D. C., & Legget, K. T. (2018). Predicting academic career outcomes by predoctoral publication record. PeerJ, 6, e5707. https:\/\/doi.org\/10.7717\/peerj.5707","journal-title":"PeerJ"},{"issue":"2","key":"4485_CR38","doi-asserted-by":"publisher","first-page":"390","DOI":"10.1016\/j.joi.2014.01.012","volume":"8","author":"ES Vieira","year":"2014","unstructured":"Vieira, E. S., Cabral, J. A. S., & Gomes, J. A. N. F. (2014). How good is a model based on bibliometric indicators in predicting the final decisions made by peers? Journal of Informetrics, 8(2), 390\u2013405. https:\/\/doi.org\/10.1016\/j.joi.2014.01.012","journal-title":"Journal of Informetrics"},{"issue":"3","key":"4485_CR39","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0033339","volume":"7","author":"ML Wallace","year":"2012","unstructured":"Wallace, M. L., Larivi\u00e8re, V., & Gingras, Y. (2012). A small world of citations? The influence of collaboration networks on citation practices. PLoS ONE, 7(3), e33339. https:\/\/doi.org\/10.1371\/journal.pone.0033339","journal-title":"PLoS ONE"},{"key":"4485_CR40","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511815478","volume-title":"Social network analysis: Methods and applications","author":"S Wasserman","year":"1994","unstructured":"Wasserman, S., & Faust, K. (1994). Social network analysis: Methods and applications (1st ed.). Cambridge University Press. https:\/\/doi.org\/10.1017\/CBO9780511815478","edition":"1"},{"issue":"10","key":"4485_CR41","doi-asserted-by":"publisher","first-page":"2107","DOI":"10.1002\/asi.21128","volume":"60","author":"E Yan","year":"2009","unstructured":"Yan, E., & Ding, Y. (2009). Applying centrality measures to impact analysis: A coauthorship network analysis. Journal of the American Society for Information Science and Technology, 60(10), 2107\u20132118. https:\/\/doi.org\/10.1002\/asi.21128","journal-title":"Journal of the American Society for Information Science and Technology"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04485-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-022-04485-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04485-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,9,14]],"date-time":"2022-09-14T06:51:54Z","timestamp":1663138314000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-022-04485-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,8]]},"references-count":41,"journal-issue":{"issue":"10","published-print":{"date-parts":[[2022,10]]}},"alternative-id":["4485"],"URL":"https:\/\/doi.org\/10.1007\/s11192-022-04485-5","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"type":"print","value":"0138-9130"},{"type":"electronic","value":"1588-2861"}],"subject":[],"published":{"date-parts":[[2022,9,8]]},"assertion":[{"value":"29 July 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 August 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 September 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}