{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T14:09:26Z","timestamp":1760710166234,"version":"3.37.3"},"reference-count":76,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2020,3,18]],"date-time":"2020-03-18T00:00:00Z","timestamp":1584489600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,3,18]],"date-time":"2020-03-18T00:00:00Z","timestamp":1584489600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Identification of important works and assessment of importance of publications in vast scientific corpora are challenging yet common tasks subjected by many research projects. While the influence of citations in finding seminal papers has been analysed thoroughly, citation-based approaches come with several problems. Their impracticality when confronted with new publications which did not yet receive any citations, area-dependent citation practices and different reasons for citing are only a few drawbacks of them. Methods relying on more than citations, for example semantic features such as words or topics contained in publications of citation networks, are regarded with less vigour while providing promising preliminary results. In this work we tackle the issue of classifying publications with their respective referenced and citing papers as either seminal, survey or uninfluential by utilising semantometrics. We use distance measures over words, semantics, topics and publication years of papers in their citation network to engineer features on which we predict the class of a publication. We present the SUSdblp dataset consisting of 1980 labelled entries to provide a means of evaluating this approach. A classification accuracy of up to .9247 was achieved when combining multiple types of features using semantometrics. This is +.1232 compared to the current state of the art (SOTA) which uses binary classification to identify papers from classes seminal and survey. The utilisation of one-vector representations for the ternary classification task resulted in an accuracy of .949 which is +.1475 compared to the binary SOTA. Classification based on information available at publication time derived with semantometrics resulted in an accuracy of .8152 while an accuracy of .9323 could be achieved when using one-vector representations.<\/jats:p>","DOI":"10.1007\/s11192-020-03409-5","type":"journal-article","created":{"date-parts":[[2020,3,18]],"date-time":"2020-03-18T12:28:13Z","timestamp":1584534493000},"page":"2915-2954","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Evaluating semantometrics from computer science publications"],"prefix":"10.1007","volume":"125","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5075-7699","authenticated-orcid":false,"given":"Christin Katharina","family":"Kreutz","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3908-5681","authenticated-orcid":false,"given":"Premtim","family":"Sahitaj","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5379-5191","authenticated-orcid":false,"given":"Ralf","family":"Schenkel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,3,18]]},"reference":[{"issue":"3","key":"3409_CR1","doi-asserted-by":"crossref","first-page":"159","DOI":"10.3152\/147154403781776645","volume":"12","author":"DW Aksnes","year":"2003","unstructured":"Aksnes, D. W. (2003). Characteristics of highly cited papers. Research Evaluation, 12(3), 159\u2013170.","journal-title":"Research Evaluation"},{"issue":"1","key":"3409_CR2","first-page":"67","volume":"2009","author":"L AlSumait","year":"2009","unstructured":"AlSumait, L., Barbar\u00e1, D., Gentle, J., & Domeniconi, C. (2009). Topic significance ranking of LDA generative models. ECML\/PKDD, 2009(1), 67\u201382.","journal-title":"ECML\/PKDD"},{"issue":"5","key":"3409_CR3","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1002\/asi.4630300509","volume":"30","author":"A Avramescu","year":"1979","unstructured":"Avramescu, A. (1979). Actuality and obsolescence of scientific literature. JASIS, 30(5), 296\u2013303.","journal-title":"JASIS"},{"key":"3409_CR4","doi-asserted-by":"crossref","unstructured":"Baltes, S., & Diehl, S. (2016). Worse than spam: issues in sampling software developers. In ESEM 2016 (pp. 52:1\u201352:6).","DOI":"10.1145\/2961111.2962628"},{"issue":"1","key":"3409_CR5","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1007\/s11192-006-0146-5","volume":"69","author":"MG Banks","year":"2006","unstructured":"Banks, M. G. (2006). An extension of the Hirsch index: Indexing scientific topics and compounds. Scientometrics, 69(1), 161\u2013168.","journal-title":"Scientometrics"},{"key":"3409_CR6","first-page":"993","volume":"3","author":"DM Blei","year":"2003","unstructured":"Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent dirichlet allocation. Journal of Machine Learning Research, 3, 993\u20131022.","journal-title":"Journal of Machine Learning Research"},{"key":"3409_CR7","doi-asserted-by":"crossref","unstructured":"Blei, D. M., & Lafferty, J. D. (2006). Dynamic topic models. In ICML 2006 (pp. 113\u2013120).","DOI":"10.1145\/1143844.1143859"},{"key":"3409_CR9","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1162\/tacl_a_00051","volume":"5","author":"P Bojanowski","year":"2017","unstructured":"Bojanowski, P., Grave, E., Joulin, A., & Mikolov, T. (2017). Enriching word vectors with subword information. TACL, 5, 135\u2013146.","journal-title":"TACL"},{"issue":"3","key":"3409_CR10","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1007\/s11192-006-0120-2","volume":"68","author":"K B\u00f6rner","year":"2006","unstructured":"B\u00f6rner, K., Penumarthy, S., Meiss, M. R., & Ke, W. (2006). Mapping the diffusion of scholarly knowledge among major U.S. research institutions. Scientometrics, 68(3), 415\u2013426.","journal-title":"Scientometrics"},{"issue":"3","key":"3409_CR11","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1016\/j.joi.2010.03.007","volume":"4","author":"L Bornmann","year":"2010","unstructured":"Bornmann, L., & Daniel, H.-D. (2010). The citation speed index: A useful bibliometric indicator to add to the h index. Journal of Informetrics, 4(3), 444\u2013446.","journal-title":"Journal of Informetrics"},{"issue":"1","key":"3409_CR12","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1002\/asi.5090110105","volume":"11","author":"RE Burton","year":"1960","unstructured":"Burton, R. E., & Kebler, R. W. (1960). The \u201chalf-life\u201d of some scientific and technical literatures. American Documentation, 11(1), 18\u201322.","journal-title":"American Documentation"},{"issue":"2","key":"3409_CR13","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1007\/BF02020003","volume":"22","author":"V Cano","year":"1991","unstructured":"Cano, V., & Lind, N. C. (1991). Citation life cycles of ten citation classics. Scientometrics, 22(2), 297\u2013312.","journal-title":"Scientometrics"},{"key":"3409_CR14","unstructured":"CORE Computing Research and Education. http:\/\/www.core.edu.au\/. Accessed 18 Dec 2019."},{"issue":"9","key":"3409_CR15","doi-asserted-by":"crossref","first-page":"1275","DOI":"10.1002\/asi.20354","volume":"57","author":"B Cronin","year":"2006","unstructured":"Cronin, B., & Meho, L. I. (2006). Using the h-index to rank influential information scientists. JASIST, 57(9), 1275\u20131278.","journal-title":"JASIST"},{"key":"3409_CR16","unstructured":"Davis, P. M., & Cochran, A. (2015). Cited half-life of the journal literature. CoRR. arXiv:1504.07479."},{"key":"3409_CR17","unstructured":"Devlin, J., Chang, M., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. NAACL-HLT 2019 (1), 4171\u20134186."},{"key":"3409_CR18","doi-asserted-by":"crossref","unstructured":"Dietz, L., Bickel, S., & Scheffer, T. (2007). Unsupervised prediction of citation influences. ICML 2007 (pp. 233\u2013240).","DOI":"10.1145\/1273496.1273526"},{"issue":"1","key":"3409_CR19","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1007\/s11192-006-0144-7","volume":"69","author":"L Egghe","year":"2006","unstructured":"Egghe, L. (2006). Theory and practise of the g-index. Scientometrics, 69(1), 131\u2013152.","journal-title":"Scientometrics"},{"issue":"3","key":"3409_CR20","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1145\/3190580.3190586","volume":"51","author":"N Fuhr","year":"2017","unstructured":"Fuhr, N. (2017). Some common mistakes in IR evaluation, and how they can be avoided. SIGIR Forum, 51(3), 32\u201341.","journal-title":"SIGIR Forum"},{"key":"3409_CR21","first-page":"84","volume":"1","author":"E Garfield","year":"1964","unstructured":"Garfield, E. (1964). Can citation indexing be automated? Essays of an Information Scientist, 1, 84\u201390.","journal-title":"Essays of an Information Scientist"},{"key":"3409_CR22","unstructured":"Gerrish, S., & Blei, D. M. (2010). A language-based approach to measuring scholarly impact. In ICML 2010 (pp. 375\u2013382)."},{"issue":"2","key":"3409_CR23","doi-asserted-by":"crossref","first-page":"563","DOI":"10.1148\/radiol.2015151169","volume":"278","author":"RJ Gillies","year":"2016","unstructured":"Gillies, R. J., Kinahan, P. E., & Hricak, H. (2016). Radiomics: Images are more than pictures, they are data. Radiology, 278(2), 563\u2013577.","journal-title":"Radiology"},{"key":"3409_CR25","doi-asserted-by":"crossref","unstructured":"Herrmannova, D., & Knoth, P. (2015). Semantometrics in coauthorship networks: Fulltext-based approach for analysing patterns of research collaboration. D-Lib Mag., 21(11\/12)","DOI":"10.1045\/november2015-herrmannova"},{"key":"3409_CR24","unstructured":"Herrmannova, D., Knoth, P., & Patton, R. M. (2018). Analyzing citation-distance networks for evaluating publication impact. In LREC 2018."},{"key":"3409_CR26","doi-asserted-by":"crossref","unstructured":"Herrmannova, D., Patton, R. M., Knoth, P., & Stahl, C. G. (2017). Citations and readership are poor indicators of research excellence: Introducing TrueImpactDataset, a new dataset for validating research evaluation metrics. In Proceedings of the 1st Workshop on Scholarly Web Mining, 2017.","DOI":"10.1145\/3057148.3057154"},{"issue":"46","key":"3409_CR27","doi-asserted-by":"crossref","first-page":"16569","DOI":"10.1073\/pnas.0507655102","volume":"102","author":"JE Hirsch","year":"2005","unstructured":"Hirsch, J. E. (2005). An index to quantify an individual\u2019s scientific research output. PNAS, 102(46), 16569\u201316572.","journal-title":"PNAS"},{"issue":"2","key":"3409_CR28","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1007\/s11192-018-2994-1","volume":"118","author":"JE Hirsch","year":"2019","unstructured":"Hirsch, J. E. (2019). $$h_{\\alpha }$$: An index to quantify an individual\u2019s scientific leadership. Scientometrics, 118(2), 673\u2013686.","journal-title":"Scientometrics"},{"issue":"10","key":"3409_CR29","doi-asserted-by":"crossref","first-page":"724","DOI":"10.1002\/bies.201100067","volume":"33","author":"W-R Hou","year":"2011","unstructured":"Hou, W.-R., Li, M., & Niu, D.-K. (2011). Counting citations in texts rather than reference lists to improve the accuracy of assessing scientific contribution. Bioessays, 33(10), 724\u2013727.","journal-title":"Bioessays"},{"issue":"6","key":"3409_CR30","first-page":"855","volume":"54","author":"B Jin","year":"2007","unstructured":"Jin, B., Liang, L., Rousseau, R., & Egghe, L. (2007). The R- and AR-indices: Complementing the h-index. Chinese Science Bulletin, 54(6), 855\u2013863.","journal-title":"Chinese Science Bulletin"},{"key":"3409_CR31","unstructured":"Jones, E., Oliphant, E., Peterson, P., et al. (2001). SciPy: Open source scientific tools for python. Retrieved September 18, 2019, from http:\/\/www.scipy.org."},{"key":"3409_CR32","doi-asserted-by":"crossref","unstructured":"Kanter, J. M., & Veeramachaneni, K. (2015). Deep feature synthesis: Towards automating data science endeavors. In DSAA 2015 (pp. 1\u201310).","DOI":"10.1109\/DSAA.2015.7344858"},{"key":"3409_CR33","doi-asserted-by":"crossref","unstructured":"Knoth, P. & Herrmannova, D.(2014). Towards semantometrics: A new semantic similarity based measure for assessing a research publication\u2019s contribution. D-Lib Magazine, 20(11\/12).","DOI":"10.1045\/november2014-knoth"},{"key":"3409_CR36","unstructured":"Kreutz, C. K., Sahitaj, P., & Schenkel, R. (2019). Revaluating semantometrics from computer science publications. In BIRNDL@SIGIR 2019 (pp. 42\u201355)."},{"issue":"9","key":"3409_CR37","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1016\/j.mri.2012.06.010","volume":"30","author":"V Kumar","year":"2012","unstructured":"Kumar, V., Gu, Y., Basu, S., Berglund, A., Eschrich, S. A., Schabath, M. B., et al. (2012). Radiomics: The process and the challenges. Magnetic Resonance Imaging, 30(9), 1234\u20131248.","journal-title":"Magnetic Resonance Imaging"},{"key":"3409_CR38","doi-asserted-by":"crossref","unstructured":"Lau, J. H., & Baldwin, T. (2016). An empirical evaluation of doc2vec with practical insights into document embedding generation. In Rep4NLP@ACL 2016 (pp. 78\u201386).","DOI":"10.18653\/v1\/W16-1609"},{"key":"3409_CR39","unstructured":"Le, Q. V., & Mikolov, T. (2014). Distributed representations of sentences and documents. In ICML 2014 (pp. 1188\u20131196)."},{"key":"3409_CR40","unstructured":"Levene, H. (1960). Robust tests for equality of variances. Contributions to Probability and Statistics: Essays in Honor of Harold Hotelling, 278\u2013292."},{"issue":"2","key":"3409_CR41","first-page":"1493","volume":"2","author":"M Ley","year":"2009","unstructured":"Ley, M. (2009). DBLP\u2014some lessons learned. PVLDB, 2(2), 1493\u20131500.","journal-title":"PVLDB"},{"issue":"1","key":"3409_CR43","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/asi.21228","volume":"61","author":"MH MacRoberts","year":"2010","unstructured":"MacRoberts, M. H., & MacRoberts, B. R. (2010). Problems of citation analysis: A study of uncited and seldom-cited influences. JASIST, 61(1), 1\u201312.","journal-title":"JASIST"},{"issue":"3","key":"3409_CR44","doi-asserted-by":"crossref","first-page":"1477","DOI":"10.1007\/s11192-016-1917-2","volume":"107","author":"A Mart\u00edn-Mart\u00edn","year":"2016","unstructured":"Mart\u00edn-Mart\u00edn, A., Ordu\u00f1a-Malea, E., Ayll\u00f3n, J. M., & L\u00f3pez-C\u00f3zar, E. D. (2016). Back to the past: On the shoulders of an academic search engine giant. Scientometrics, 107(3), 1477\u20131487.","journal-title":"Scientometrics"},{"key":"3409_CR34","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1080\/01621459.1951.10500769","volume":"46","author":"FJ Massey Jr","year":"1951","unstructured":"Massey, F. J, Jr. (1951). The Kolmogorov\u2013Smirnov test for goodness of fit. Journal of the American Statistical Association, 46, 68\u201378.","journal-title":"Journal of the American Statistical Association"},{"key":"3409_CR45","doi-asserted-by":"crossref","first-page":"731","DOI":"10.1038\/415731a","volume":"415","author":"HF Moed","year":"2002","unstructured":"Moed, H. F. (2002). The impact-factors debate: The ISI\u2019s uses and limits. Nature, 415, 731\u2013732.","journal-title":"Nature"},{"issue":"2","key":"3409_CR46","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1145\/2503792.2503795","volume":"42","author":"SL Montolio","year":"2013","unstructured":"Montolio, S. L., Dominguez-Sal, D., & Larriba-Pey, J.-L. (2013). Research endogamy as an indicator of conference quality. SIGMOD Record, 42(2), 11\u201316.","journal-title":"SIGMOD Record"},{"key":"3409_CR47","unstructured":"Paszke, A., Gross, S., Chintala, S., Chanan, G., Yang, E., DeVito, Z., et al. (2017). Automatic differentiation in PyTorch. In Autodiff@NIPS 2017."},{"key":"3409_CR48","doi-asserted-by":"crossref","unstructured":"Patton, R. M., Herrmannova, D., Stahl, C. G., Wells, J. C., & Potok, T. E. (2017). Audience based view of publication impact. In WOSP@JCDL 2017 (pp. 64-68).","DOI":"10.1145\/3127526.3127538"},{"key":"3409_CR49","doi-asserted-by":"crossref","unstructured":"Patton, R. M., Stahl, C. G., & Wells, J. C. (2016). Measuring scientific impact beyond citation counts. D-Lib Magazine, 22(9\/10)","DOI":"10.1045\/september2016-patton"},{"key":"3409_CR50","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., et al. (2011). Scikit-learn: Machine learning in python. JMLR, 12, 2825\u20132830.","journal-title":"JMLR"},{"key":"3409_CR51","first-page":"1532","volume":"2014","author":"J Pennington","year":"2014","unstructured":"Pennington, J., Socher, R., & Manning, C. D. (2014). GloVe: Global vectors for word representation. EMNLP, 2014, 1532\u20131543.","journal-title":"EMNLP"},{"key":"3409_CR52","doi-asserted-by":"crossref","unstructured":"Pietraszek, T. (2005). Optimizing abstaining classifiers using ROC analysis. In ICML 2005 (pp. 665\u2013672).","DOI":"10.1145\/1102351.1102435"},{"issue":"3","key":"3409_CR53","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1108\/eb046814","volume":"14","author":"MF Porter","year":"1980","unstructured":"Porter, M. F. (1980). An algorithm for suffix stripping. Program, 14(3), 130\u2013137.","journal-title":"Program"},{"key":"3409_CR54","doi-asserted-by":"crossref","first-page":"510","DOI":"10.1126\/science.149.3683.510","volume":"149","author":"DJDS Price","year":"1965","unstructured":"Price, D. J. D. S. (1965). Networks of scientific papers. Science, 149, 510\u2013515.","journal-title":"Science"},{"key":"3409_CR55","doi-asserted-by":"crossref","unstructured":"Pride, D., & Knoth, P. (2017). Incidental or Influential?\u2014Challenges in automatically detecting citation importance using publication full texts. In TPDL 2017 (pp. 572\u2013578).","DOI":"10.1007\/978-3-319-67008-9_48"},{"key":"3409_CR56","unstructured":"Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., & Sutskever, I. (2019). Language models are unsupervised multitask learners."},{"key":"3409_CR57","unstructured":"\u0158eh\u016f\u0159ek, R., & Sojka, P. (2010). Software framework for topic modelling with large Corpora. In New Challenges for NLP Frameworks@LREC 2010 (pp. 45\u201350)."},{"key":"3409_CR58","doi-asserted-by":"crossref","unstructured":"Rocha, L. M. A., & Moro, M. M. (2016). Research contribution as a measure of influence. In Proceedings of the 2016 International Conference on Management of Data (pp. 2259\u20132260).","DOI":"10.1145\/2882903.2914834"},{"key":"3409_CR59","unstructured":"Rosen-Zvi, M., Griffiths, T. L., Steyvers, M., & Smyth, P. (2004). The author-topic model for authors and documents. In UAI 2004 (pp. 487\u2013494)."},{"issue":"11","key":"3409_CR60","doi-asserted-by":"crossref","first-page":"1853","DOI":"10.1002\/asi.20890","volume":"59","author":"R Rousseau","year":"2008","unstructured":"Rousseau, R., & Ye, F. Y. (2008). A proposal for a dynamic h-type index. JASIST, 59(11), 1853\u20131855.","journal-title":"JASIST"},{"issue":"11","key":"3409_CR61","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1145\/361219.361220","volume":"18","author":"G Salton","year":"1975","unstructured":"Salton, G., Wong, A., & Yang, C.-S. (1975). A vector space model for automatic indexing. Communications of the ACM, 18(11), 613\u2013620.","journal-title":"Communications of the ACM"},{"key":"3409_CR62","doi-asserted-by":"crossref","unstructured":"Schofield, A., Magnusson, M., & Mimno, D. M. (2017). Pulling out the stops: Rethinking stopword removal for topic models. In EACL (vol. 2, pp. 432\u2013436).","DOI":"10.18653\/v1\/E17-2069"},{"issue":"3","key":"3409_CR63","first-page":"30002","volume":"78","author":"M Schreiber","year":"2007","unstructured":"Schreiber, M. (2007). Self-citation corrections for the Hirsch index. ELA, 78(3), 30002.","journal-title":"ELA"},{"issue":"1","key":"3409_CR64","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1007\/s11192-007-1886-6","volume":"76","author":"M Schreiber","year":"2008","unstructured":"Schreiber, M. (2008). The influence of self-citation corrections on Egghe\u2019s g index. Scientometrics, 76(1), 187\u2013200.","journal-title":"Scientometrics"},{"issue":"9","key":"3409_CR65","doi-asserted-by":"crossref","first-page":"628","DOI":"10.1002\/(SICI)1097-4571(199210)43:9<628::AID-ASI5>3.0.CO;2-0","volume":"43","author":"PO Seglen","year":"1992","unstructured":"Seglen, P. O. (1992). The skewness of science. JASIS, 43(9), 628\u2013638.","journal-title":"JASIS"},{"issue":"1","key":"3409_CR66","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/(SICI)1097-4571(199401)45:1<1::AID-ASI1>3.0.CO;2-Y","volume":"45","author":"PO Seglen","year":"1994","unstructured":"Seglen, P. O. (1994). Casual relationship between article citedness and journal impact. JASIS, 45(1), 1\u201311.","journal-title":"JASIS"},{"issue":"7079","key":"3409_CR67","doi-asserted-by":"crossref","first-page":"498","DOI":"10.1136\/bmj.314.7079.497","volume":"314","author":"PO Seglen","year":"1997","unstructured":"Seglen, P. O. (1997). Why the impact factor of journals should not be used for evaluating research. British Medical Journal, 314(7079), 498\u2013502.","journal-title":"British Medical Journal"},{"key":"3409_CR68","unstructured":"https:\/\/doi.org\/10.5281\/zenodo.3258164"},{"issue":"3\u20134","key":"3409_CR69","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1093\/biomet\/52.3-4.591","volume":"52","author":"SS Shapiro","year":"1965","unstructured":"Shapiro, S. S., & Wilk, M. B. (1965). An analysis of variance test for normality (complete samples). Biometrika, 52(3\u20134), 591\u2013611.","journal-title":"Biometrika"},{"key":"3409_CR70","doi-asserted-by":"crossref","unstructured":"Shi, X., Leskovec, J., & McFarland, D. A. (2010). Citing for high impact. In JCDL 2010 (pp. 49\u201358).","DOI":"10.1145\/1816123.1816131"},{"key":"3409_CR71","doi-asserted-by":"crossref","unstructured":"Silva, T. H. P., Moro, M. M., Silva, A. P. C. d., Meira Jr., W., & Laender, A. H. F. (2014). Community-based endogamy as an influence indicator. In JCDL 2014 (pp. 67\u201376).","DOI":"10.1109\/JCDL.2014.6970152"},{"issue":"1","key":"3409_CR73","doi-asserted-by":"crossref","first-page":"24","DOI":"10.3142\/107951405781748210","volume":"11","author":"MV Simkin","year":"2005","unstructured":"Simkin, M. V., & Roychowdhury, V. P. (2005). Copied citations create renowned papers? Annals of Improbable Research, 11(1), 24\u201327.","journal-title":"Annals of Improbable Research"},{"issue":"3\u20136","key":"3409_CR74","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1007\/BF02017156","volume":"7","author":"E Smith Aversa","year":"1985","unstructured":"Smith Aversa, E. (1985). Citation patterns of highly cited papers and their relationship to literature aging: A study of the working literature. Scientometrics, 7(3\u20136), 383\u2013389.","journal-title":"Scientometrics"},{"key":"3409_CR75","doi-asserted-by":"crossref","unstructured":"Tang, J., Zhang, J., Yao, L., Li, J., Zhang, L., & Su, Z. (2008). ArnetMiner: Extraction and mining of academic social networks. In KDD 2008 (pp. 990\u2013998).","DOI":"10.1145\/1401890.1402008"},{"key":"3409_CR76","doi-asserted-by":"crossref","unstructured":"Tortorella, F. (2000). An optimal reject rule for binary classifiers. In Proceedings of the Joint IAPR International Workshops on Advances in Pattern Recognition (pp. 611\u2013620).","DOI":"10.1007\/3-540-44522-6_63"},{"key":"3409_CR77","unstructured":"Valenzuela, M., Ha, V., & Etzioni, O. (2015). Identifying meaningful citations. In Workshops at the Twenty-Ninth AAAI Conference on Artificial Intelligence."},{"key":"3409_CR78","doi-asserted-by":"crossref","unstructured":"Wade, A. D., Wang, K., Sun, Y., & Gull, A. (2006). WSDM Cup 2016: Entity ranking challenge. In WSDM 2016 (pp. 593\u2013594).","DOI":"10.1145\/2835776.2855119"},{"key":"3409_CR79","unstructured":"Whalen, R., Huang, Y., Sawant, A., Uzzi, B., & Contractor, N. (2005). Natural language processing, article content & bibliometrics: Predicting high impact science. In ASCW\u201915 Workshop at Web Science 2015 (pp. 6\u20138)."},{"issue":"2","key":"3409_CR80","first-page":"408","volume":"66","author":"X Zhu","year":"2015","unstructured":"Zhu, X., Turney, P. D., Lemire, D., & Vellino, A. (2015). Measuring academic influence: Not all citations are equal. JASIST, 66(2), 408\u2013427.","journal-title":"JASIST"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-020-03409-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-020-03409-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-020-03409-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,2]],"date-time":"2021-07-02T11:25:44Z","timestamp":1625225144000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-020-03409-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,18]]},"references-count":76,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["3409"],"URL":"https:\/\/doi.org\/10.1007\/s11192-020-03409-5","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"type":"print","value":"0138-9130"},{"type":"electronic","value":"1588-2861"}],"subject":[],"published":{"date-parts":[[2020,3,18]]},"assertion":[{"value":"23 September 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 March 2020","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}