{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,23]],"date-time":"2025-12-23T10:03:51Z","timestamp":1766484231225,"version":"3.37.3"},"reference-count":56,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2022,6,21]],"date-time":"2022-06-21T00:00:00Z","timestamp":1655769600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,6,21]],"date-time":"2022-06-21T00:00:00Z","timestamp":1655769600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001773","name":"University of New South Wales","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100001773","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2022,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Research on academic paper ranking has received great attention in recent years, and many algorithms have been proposed to automatically assess a large number of papers for this purpose. How to evaluate or analyse the performance of these ranking algorithms becomes an open research question. Theoretically, evaluation of an algorithm requires to compare its ranking result against a ground truth paper list. However, such ground truth does not exist in the field of scholarly ranking due to the fact that there does not and will not exist an absolutely unbiased, objective, and unified standard to formulate the impact of papers. Therefore, in practice researchers evaluate or analyse their proposed ranking algorithms by different methods, such as using domain expert decisions (test data) and comparing against predefined ranking benchmarks. The question is whether using different methods leads to different analysis results, and if so, how should we analyse the performance of the ranking algorithms? To answer these questions, this study compares among test data and different citation-based benchmarks by examining their relationships and assessing the effect of the method choices on their analysis results. The results of our experiments show that there does exist difference in analysis results when employing test data and different benchmarks, and relying exclusively on one benchmark or test data may bring inadequate analysis results. In addition, a guideline on how to conduct a comprehensive analysis using multiple benchmarks from different perspectives is summarised, which can help provide a systematic understanding and profile of the analysed algorithms.<\/jats:p>","DOI":"10.1007\/s11192-022-04429-z","type":"journal-article","created":{"date-parts":[[2022,6,21]],"date-time":"2022-06-21T13:05:21Z","timestamp":1655816721000},"page":"4045-4074","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Analysing academic paper ranking algorithms using test data and benchmarks: an investigation"],"prefix":"10.1007","volume":"127","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8747-2603","authenticated-orcid":false,"given":"Yu","family":"Zhang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Min","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Morteza","family":"Saberi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Elizabeth","family":"Chang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,6,21]]},"reference":[{"issue":"4","key":"4429_CR1","doi-asserted-by":"publisher","first-page":"985","DOI":"10.1016\/j.joi.2014.09.010","volume":"8","author":"P Ahlgren","year":"2014","unstructured":"Ahlgren, P., & Waltman, L. (2014). The correlation between citation-based and expert-based assessments of publication channels: SNIP and SJR vs. Norwegian quality assessments. Journal of Inforetrics, 8(4), 985\u2013996.","journal-title":"Journal of Inforetrics"},{"key":"4429_CR2","doi-asserted-by":"publisher","first-page":"17607","DOI":"10.1109\/ACCESS.2017.2740226","volume":"5","author":"X Bai","year":"2017","unstructured":"Bai, X., Lee, I., Ning, Z., Tolba, A., & Xia, F. (2017). The role of positive and negative citations in scientific evaluation. IEEE Access, 5, 17607\u201317617.","journal-title":"IEEE Access"},{"issue":"1","key":"4429_CR3","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1108\/00220410810844150","volume":"64","author":"L Bornmann","year":"2008","unstructured":"Bornmann, L., & Daniel, H.-D. (2008). What do citation counts measure? A review of studies on citing behavior. Journal of Documentation, 64(1), 45\u201380.","journal-title":"Journal of Documentation"},{"issue":"2","key":"4429_CR4","doi-asserted-by":"publisher","first-page":"408","DOI":"10.1016\/j.joi.2015.01.006","volume":"9","author":"L Bornmann","year":"2015","unstructured":"Bornmann, L., & Marx, W. (2015a). Methods for the generation of normalized citation impact scores in bibliometrics: Which method best reflects the judgements of experts? Journal of Informetrics, 9(2), 408\u2013418.","journal-title":"Journal of Informetrics"},{"issue":"11","key":"4429_CR5","doi-asserted-by":"publisher","first-page":"2215","DOI":"10.1002\/asi.23329","volume":"66","author":"L Bornmann","year":"2015","unstructured":"Bornmann, L., & Mutz, R. (2015b). Growth rates of modern science: A bibliometric analysis based on the number of publications and cited references. Journal of the Association for Information Science and Technology, 66(11), 2215\u20132222.","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"2","key":"4429_CR6","doi-asserted-by":"publisher","first-page":"453","DOI":"10.1007\/s11192-018-2973-6","volume":"118","author":"L Cai","year":"2019","unstructured":"Cai, L., Tian, J., Liu, J., Bai, X., Lee, I., Kong, X., & Xia, F. (2019). Scholarly impact assessment: A survey of citation weighting solutions. Scientometrics, 118(2), 453\u2013478.","journal-title":"Scientometrics"},{"issue":"1","key":"4429_CR7","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1016\/j.joi.2006.06.001","volume":"1","author":"P Chen","year":"2007","unstructured":"Chen, P., Xie, H., Maslov, S., & Redner, S. (2007). Finding scientific gems with Google\u2019s PageRank algorithm. Journal of Informetrics, 1(1), 8\u201315.","journal-title":"Journal of Informetrics"},{"key":"4429_CR8","unstructured":"Dunaiski, M. (2019). Using test data to evaluate rankings of entities in large scholarly citation networks (Unpublished doctoral dissertation). Stellenbosch University."},{"issue":"3","key":"4429_CR9","doi-asserted-by":"publisher","first-page":"631","DOI":"10.1016\/j.joi.2018.06.002","volume":"12","author":"M Dunaiski","year":"2018","unstructured":"Dunaiski, M., Geldenhuys, J., & Visser, W. (2018). How to evaluate rankings of academic entities using test data. Journal of Informetrics, 12(3), 631\u2013655.","journal-title":"Journal of Informetrics"},{"key":"4429_CR10","doi-asserted-by":"crossref","unstructured":"Dunaiski, M., & Visser, W. (2012). Comparing paper ranking algorithms. In Proceedings of the South African institute for computer scientists and information technologists conference (pp. 21\u201330).","DOI":"10.1145\/2389836.2389840"},{"issue":"2","key":"4429_CR11","doi-asserted-by":"publisher","first-page":"392","DOI":"10.1016\/j.joi.2016.01.010","volume":"10","author":"M Dunaiski","year":"2016","unstructured":"Dunaiski, M., Visser, W., & Geldenhuys, J. (2016). Evaluating paper and author ranking algorithms using impact and contribution awards. Journal of Informetrics, 10(2), 392\u2013407.","journal-title":"Journal of Informetrics"},{"issue":"8","key":"4429_CR12","doi-asserted-by":"publisher","first-page":"861","DOI":"10.1016\/j.patrec.2005.10.010","volume":"27","author":"T Fawcett","year":"2006","unstructured":"Fawcett, T. (2006). An introduction to ROC analysis. Pattern Recognition Letters, 27(8), 861\u2013874.","journal-title":"Pattern Recognition Letters"},{"issue":"4","key":"4429_CR13","first-page":"507","volume":"10","author":"RA Fisher","year":"1915","unstructured":"Fisher, R. A. (1915). Frequency distribution of the values of the correlation coeficient in samples from an indefinitely large population. Biometrika, 10(4), 507\u2013521.","journal-title":"Biometrika"},{"issue":"4","key":"4429_CR14","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1007\/BF02019306","volume":"1","author":"E Garfield","year":"1979","unstructured":"Garfield, E. (1979). Is citation analysis a legitimate evaluation tool? Scientometrics, 1(4), 359\u2013375.","journal-title":"Scientometrics"},{"issue":"4","key":"4429_CR15","doi-asserted-by":"publisher","first-page":"1079","DOI":"10.1016\/j.joi.2016.10.002","volume":"10","author":"X Hu","year":"2016","unstructured":"Hu, X., & Rousseau, R. (2016). Scientific in uence is not always visible: The phenomenon of under-cited in uential publications. Journal of Informetrics, 10(4), 1079\u20131091.","journal-title":"Journal of Informetrics"},{"issue":"4","key":"4429_CR16","doi-asserted-by":"publisher","first-page":"422","DOI":"10.1145\/582415.582418","volume":"20","author":"K J\u00e4rvelin","year":"2002","unstructured":"J\u00e4rvelin, K., & Kek\u00e4l\u00e4inen, J. (2002). Cumulated gain-based evaluation of IR techniques. ACM Transactions on Information Systems (TOIS), 20(4), 422\u2013446.","journal-title":"ACM Transactions on Information Systems (TOIS)"},{"issue":"7","key":"4429_CR17","doi-asserted-by":"publisher","first-page":"1679","DOI":"10.1002\/asi.23463","volume":"67","author":"X Jiang","year":"2016","unstructured":"Jiang, X., Sun, X., Yang, Z., Zhuge, H., & Yao, J. (2016). Exploiting heterogeneous scientific literature networks to combat ranking bias: Evidence from the computational linguistics area. Journal of the Association for Information Science and Technology, 67(7), 1679\u20131702.","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"4","key":"4429_CR18","doi-asserted-by":"publisher","DOI":"10.1016\/j.joi.2019.100977","volume":"13","author":"X Jiang","year":"2019","unstructured":"Jiang, X., & Zhuge, H. (2019). Forward search path count as an alternative indirect citation impact indicator. Journal of Informetrics, 13(4), 100977.","journal-title":"Journal of Informetrics"},{"issue":"5","key":"4429_CR19","doi-asserted-by":"publisher","first-page":"604","DOI":"10.1145\/324133.324140","volume":"46","author":"JM Kleinberg","year":"1999","unstructured":"Kleinberg, J. M. (1999). Authoritative sources in a hyperlinked environment. Journal of ACM, 46(5), 604\u2013632.","journal-title":"Journal of ACM"},{"issue":"1","key":"4429_CR20","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1002\/asi.4630340109","volume":"34","author":"SM Lawani","year":"1983","unstructured":"Lawani, S. M., & Bayer, A. E. (1983). Validity of citation criteria for assessing the influence of scientifific publications: New evidence with peer assessment. Journal of the American Society for Information Science, 34(1), 59\u201366.","journal-title":"Journal of the American Society for Information Science"},{"issue":"1","key":"4429_CR21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41597-018-0005-2","volume":"6","author":"J Li","year":"2019","unstructured":"Li, J., Yin, Y., Fortunato, S., & Wang, D. (2019). A dataset of publication records for Nobel laureates. Scientific Data, 6(1), 1\u201310.","journal-title":"Scientific Data"},{"key":"4429_CR22","doi-asserted-by":"crossref","unstructured":"Li, X., Liu, B., & Philip, S. Y. (2010). Time sensitive ranking with application to publication search. In Link mining: Models, algorithms, and applications (pp. 187\u2013209). Springer.","DOI":"10.1007\/978-1-4419-6515-8_7"},{"issue":"2","key":"4429_CR23","doi-asserted-by":"publisher","first-page":"800","DOI":"10.1016\/j.ipm.2007.06.006","volume":"44","author":"N Ma","year":"2008","unstructured":"Ma, N., Guan, J., & Zhao, Y. (2008). Bringing PageRank to the citation analysis. Information Processing & Management, 44(2), 800\u2013810.","journal-title":"Information Processing & Management"},{"key":"4429_CR24","doi-asserted-by":"crossref","unstructured":"Ma, S., Gong, C., Hu, R., Luo, D., Hu, C., & Huai, J. (2018). Query independent scholarly article ranking. In 2018 IEEE 34th international conference on data engineering (ICDE) (pp. 953\u2013964).","DOI":"10.1109\/ICDE.2018.00090"},{"issue":"4","key":"4429_CR25","doi-asserted-by":"publisher","first-page":"1207","DOI":"10.1016\/j.joi.2016.10.005","volume":"10","author":"MS Mariani","year":"2016","unstructured":"Mariani, M. S., Medo, M., & Zhang, Y.-C. (2016). Identification of milestone papers through time-balanced network centrality. Journal of Informetrics, 10(4), 1207\u20131223.","journal-title":"Journal of Informetrics"},{"key":"4429_CR26","doi-asserted-by":"publisher","DOI":"10.4324\/9780203726631","volume-title":"Research design and statistical analysis","author":"JL Myers","year":"2013","unstructured":"Myers, J. L., Well, A. D., & Lorch, R. F., Jr. (2013). Research design and statistical analysis. Routledge."},{"key":"4429_CR27","doi-asserted-by":"crossref","unstructured":"Ng, A. Y., Zheng, A. X., & Jordan, M. I. (2001). Stable algorithms for link analysis. In Proceedings of the 24th annual international ACM SIGIR conference on research and development in information retrieval (pp. 258\u2013266).","DOI":"10.1145\/383952.384003"},{"key":"4429_CR28","doi-asserted-by":"crossref","unstructured":"Page, L., Brin, S., Motwani, R., & Winograd, T. (1999). The PageRank citation ranking: Bringing order to the web. (Technical Report No. 1999-66). Stanford InfoLab. Retrieved from http:\/\/ilpubs.stanford.edu:8090\/422\/.","DOI":"10.1016\/B978-088415228-6.50166-0"},{"key":"4429_CR29","unstructured":"Pilehvar, M. T., Jurgens, D., & Navigli, R. (2013). Align, disambiguate and walk: A unified approach for measuring semantic similarity. In Proceedings of the 51st annual meeting of the association for computational linguistics (volume 1: Long papers) (Vol. 1, pp. 1341\u20131351)."},{"issue":"4","key":"4429_CR30","doi-asserted-by":"publisher","first-page":"919","DOI":"10.1007\/s10579-012-9211-2","volume":"47","author":"DR Radev","year":"2013","unstructured":"Radev, D. R., Muthukrishnan, P., Qazvinian, V., & Abu-Jbara, A. (2013). The ACL anthology network corpus. Language Resources and Evaluation, 47(4), 919\u2013944.","journal-title":"Language Resources and Evaluation"},{"issue":"45","key":"4429_CR31","doi-asserted-by":"publisher","first-page":"17268","DOI":"10.1073\/pnas.0806977105","volume":"105","author":"F Radicchi","year":"2008","unstructured":"Radicchi, F., Fortunato, S., & Castellano, C. (2008). Universality of citation distributions: Toward an objective measure of scientific impact. Proceedings of the National Academy of Sciences, 105(45), 17268\u201317272.","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"4429_CR32","doi-asserted-by":"crossref","unstructured":"Ristoski, P., De Vries, G. K. D., & Paulheim, H. (2016). A collection of benchmark datasets for systematic evaluations of machine learning on the semantic web. In International semantic web conference (pp. 186\u2013194).","DOI":"10.1007\/978-3-319-46547-0_20"},{"issue":"3","key":"4429_CR33","doi-asserted-by":"publisher","first-page":"693","DOI":"10.1016\/j.joi.2016.03.004","volume":"10","author":"M Saarela","year":"2016","unstructured":"Saarela, M., K\u00e4rkk\u00e4inen, T., Lahtonen, T., & Rossi, T. (2016). Expertbased versus citation-based ranking of scholarly and scientific publication channels. Journal of Informetrics, 10(3), 693\u2013718.","journal-title":"Journal of Informetrics"},{"key":"4429_CR34","doi-asserted-by":"crossref","unstructured":"Sayyadi, H., & Getoor, L. (2009). Futurerank: Ranking scientific articles by predicting their future PageRank. Proceedings of the 2009 siam international conference on data mining (pp. 533\u2013544).","DOI":"10.1137\/1.9781611972795.46"},{"issue":"4","key":"4429_CR35","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1145\/1107499.1107506","volume":"34","author":"A Sidiropoulos","year":"2005","unstructured":"Sidiropoulos, A., & Manolopoulos, Y. (2005). A citation-based system to assist prize awarding. ACM SIGMOD Record, 34(4), 54\u201360.","journal-title":"ACM SIGMOD Record"},{"issue":"6","key":"4429_CR36","doi-asserted-by":"publisher","first-page":"757","DOI":"10.1016\/j.ipm.2015.07.002","volume":"51","author":"N Tax","year":"2015","unstructured":"Tax, N., Bockting, S., & Hiemstra, D. (2015). A cross-benchmark comparison of 87 learning to rank methods. Information Processing & Management, 51(6), 757\u2013772.","journal-title":"Information Processing & Management"},{"issue":"1","key":"4429_CR37","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1007\/s11192-016-1973-7","volume":"108","author":"M Thelwall","year":"2016","unstructured":"Thelwall, M. (2016). Interpreting correlations between citation counts and other indicators. Scientometrics, 108(1), 337\u2013347.","journal-title":"Scientometrics"},{"issue":"06","key":"4429_CR38","doi-asserted-by":"publisher","first-page":"P06010","DOI":"10.1088\/1742-5468\/2007\/06\/P06010","volume":"2007","author":"D Walker","year":"2007","unstructured":"Walker, D., Xie, H., Yan, K.-K., & Maslov, S. (2007). Ranking scientific publications using a model of network traffic. Journal of Statistical Mechanics: Theory and Experiment, 2007(06), P06010.","journal-title":"Journal of Statistical Mechanics: Theory and Experiment"},{"issue":"2","key":"4429_CR39","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1016\/j.joi.2016.02.007","volume":"10","author":"L Waltman","year":"2016","unstructured":"Waltman, L. (2016). A review of the literature on citation impact indicators. Journal of Informetrics, 10(2), 365\u2013391.","journal-title":"Journal of Informetrics"},{"issue":"4","key":"4429_CR40","first-page":"64","volume":"7","author":"S Wang","year":"2016","unstructured":"Wang, S., Xie, S., Zhang, X., Li, Z., Yu, P. S., & He, Y. (2016). Coranking the future influence of multiobjects in bibliographic network through mutual reinforcement. ACM Transactions on Intelligent Systems and Technology (TIST), 7(4), 64.","journal-title":"ACM Transactions on Intelligent Systems and Technology (TIST)"},{"key":"4429_CR41","doi-asserted-by":"crossref","unstructured":"Wang, S., Xie, S., Zhang, X., Li, Z., Yu, P.S., & Shu, X. (2014). Future influence ranking of scientific literature. In Proceedings of the 2014 SIAM international conference on data mining (pp. 749\u2013757).","DOI":"10.1137\/1.9781611973440.86"},{"key":"4429_CR42","doi-asserted-by":"crossref","unstructured":"Wang, Y., Tong, Y., & Zeng, M. (2013). Ranking scientific articles by exploiting citations, authors, journals, and time information. In Twenty-seventh AAAI conference on artificial intelligence.","DOI":"10.1609\/aaai.v27i1.8627"},{"key":"4429_CR43","doi-asserted-by":"crossref","unstructured":"Waumans, M., & Bersini, H. (2017). Ranking scientific papers on the basis of their citations growing trend. In International conference and school on network science (pp. 89\u2013101).","DOI":"10.1007\/978-3-319-55471-6_8"},{"issue":"9","key":"4429_CR44","doi-asserted-by":"publisher","first-page":"1800","DOI":"10.1002\/asi.21374","volume":"61","author":"J West","year":"2010","unstructured":"West, J., Bergstrom, T., & Bergstrom, C. T. (2010). Big Macs and Eigenfactor scores: Don\u2019t let correlation coefficients fool you. Journal of the American Society for Information Science and Technology, 61(9), 1800\u20131807.","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"1","key":"4429_CR45","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1109\/TBDATA.2016.2641460","volume":"3","author":"F Xia","year":"2017","unstructured":"Xia, F., Wang, W., Bekele, T. M., & Liu, H. (2017). Big scholarly data: A survey. IEEE Transactions on Big Data, 3(1), 18\u201335.","journal-title":"IEEE Transactions on Big Data"},{"issue":"3","key":"4429_CR46","doi-asserted-by":"publisher","first-page":"546","DOI":"10.1016\/j.joi.2014.04.006","volume":"8","author":"H Xu","year":"2014","unstructured":"Xu, H., Martin, E., & Mahidadia, A. (2014). Contents and time sensitive document ranking of scientific literature. Journal of Informetrics, 8(3), 546\u2013561.","journal-title":"Journal of Informetrics"},{"issue":"8","key":"4429_CR47","doi-asserted-by":"crossref","first-page":"1635","DOI":"10.1002\/asi.21349","volume":"61","author":"E Yan","year":"2010","unstructured":"Yan, E., & Ding, Y. (2010). Weighted citation: An indicator of an article\u2019s prestige. Journal of the American Society for Information Science and Technology, 61(8), 1635\u20131643.","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"3","key":"4429_CR48","doi-asserted-by":"crossref","first-page":"467","DOI":"10.1002\/asi.21461","volume":"62","author":"E Yan","year":"2011","unstructured":"Yan, E., Ding, Y., & Sugimoto, C. R. (2011a). P-rank: An indicator measuring prestige in heterogeneous scholarly networks. Journal of the American Society for Information Science and Technology, 62(3), 467\u2013477.","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"4429_CR49","doi-asserted-by":"crossref","unstructured":"Yan, R., Tang, J., Liu, X., Shan, D., & Li, X. (2011b). Citation count prediction: learning to estimate future citations for literature. In Proceedings of the 20th ACM international conference on information and knowledge management (pp. 1247\u20131252).","DOI":"10.1145\/2063576.2063757"},{"key":"4429_CR50","doi-asserted-by":"crossref","unstructured":"Zhang, J., Xia, F., Wang, W., Bai, X., Yu, S., Bekele, T. M., & Peng, Z. (2016). Cocarank: A collaboration caliber-based method for finding academic rising stars. In Proceedings of the 25th international conference companion on world wide web (pp. 395\u2013400).","DOI":"10.1145\/2872518.2890524"},{"key":"4429_CR51","doi-asserted-by":"publisher","first-page":"55661","DOI":"10.1109\/ACCESS.2018.2863938","volume":"6","author":"J Zhang","year":"2018","unstructured":"Zhang, J., Xu, B., Liu, J., Tolba, A., Al-Makhadmeh, Z., & Xia, F. (2018). PePSI: Personalized prediction of scholars\u2019 impact in heterogeneous temporal academic networks. IEEE Access, 6, 55661\u201355672.","journal-title":"IEEE Access"},{"key":"4429_CR52","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Saberi, M., Wang, M., & Chang, E. (2019a). K3S: Knowledge-driven solution support system. In Proceedings of the twenty-seventh AAAI conference on artificial intelligence (Vol. 33, pp. 9873\u20139874).","DOI":"10.1609\/aaai.v33i01.33019873"},{"issue":"2","key":"4429_CR53","doi-asserted-by":"publisher","first-page":"616","DOI":"10.1016\/j.joi.2019.03.013","volume":"13","author":"Y Zhang","year":"2019","unstructured":"Zhang, Y., Wang, M., Gottwalt, F., Saberi, M., & Chang, E. (2019b). Ranking scientific articles based on bibliometric networks with a weighting scheme. Journal of Informetrics, 13(2), 616\u2013634.","journal-title":"Journal of Informetrics"},{"key":"4429_CR54","doi-asserted-by":"publisher","first-page":"38","DOI":"10.3389\/fdata.2019.00038","volume":"2","author":"Y Zhang","year":"2019","unstructured":"Zhang, Y., Wang, M., Saberi, M., & Chang, E. (2019c). From big scholarly data to solution-oriented knowledge repository. Frontiers in Big Data, 2, 38.","journal-title":"Frontiers in Big Data"},{"key":"4429_CR55","doi-asserted-by":"crossref","unstructured":"Zhao, P., Han, J., & Sun, Y. (2009). P-rank: A comprehensive structural similarity measure over information networks. In Proceedings of the 18th ACM conference on information and knowledge management (pp. 553\u2013562). Association for Computing Machinery.","DOI":"10.1145\/1645953.1646025"},{"key":"4429_CR56","doi-asserted-by":"crossref","unstructured":"Zhou, D., Orshanskiy, S. A., Zha, H., & Giles, C. L. (2007). Co-ranking authors and documents in a heterogeneous network. In Seventh IEEE international conference on data mining (ICDM 2007) (pp. 739\u2013744).","DOI":"10.1109\/ICDM.2007.57"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04429-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-022-04429-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-022-04429-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,23]],"date-time":"2023-11-23T13:55:21Z","timestamp":1700747721000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-022-04429-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,21]]},"references-count":56,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2022,7]]}},"alternative-id":["4429"],"URL":"https:\/\/doi.org\/10.1007\/s11192-022-04429-z","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"type":"print","value":"0138-9130"},{"type":"electronic","value":"1588-2861"}],"subject":[],"published":{"date-parts":[[2022,6,21]]},"assertion":[{"value":"29 September 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 May 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 June 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that there is no conflicts of interest that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}