{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,23]],"date-time":"2025-09-23T14:05:09Z","timestamp":1758636309928,"version":"3.37.3"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2020,11,21]],"date-time":"2020-11-21T00:00:00Z","timestamp":1605916800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"},{"start":{"date-parts":[[2020,11,21]],"date-time":"2020-11-21T00:00:00Z","timestamp":1605916800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2021,2]]},"DOI":"10.1007\/s11192-020-03780-3","type":"journal-article","created":{"date-parts":[[2020,11,21]],"date-time":"2020-11-21T20:02:47Z","timestamp":1605988967000},"page":"1619-1645","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Validation of the Astro dataset clustering solutions with external data"],"prefix":"10.1007","volume":"126","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5737-8483","authenticated-orcid":false,"given":"Paul","family":"Donner","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,11,21]]},"reference":[{"issue":"2","key":"3780_CR1","doi-asserted-by":"publisher","first-page":"714","DOI":"10.1162\/qss\\_a_00027","volume":"1","author":"P Ahlgren","year":"2020","unstructured":"Ahlgren, P., Chen, Y., Colliander, C., & van Eck, N. J. (2020). Enhancing direct citations: A comparison of relatedness measures for community detection in a large set of PubMed publications. Quantitative Science Studies, 1(2), 714\u2013729. https:\/\/doi.org\/10.1162\/qss_a_00027.","journal-title":"Quantitative Science Studies"},{"issue":"3","key":"3780_CR2","doi-asserted-by":"publisher","first-page":"e4803","DOI":"10.1371\/journal.pone.0004803","volume":"4","author":"J Bollen","year":"2009","unstructured":"Bollen, J., Van de Sompel, H., Hagberg, A., Bettencourt, L., Chute, R., Rodriguez, M. A., et al. (2009). Clickstream data yields high-resolution maps of science. PLoS One, 4(3), e4803. https:\/\/doi.org\/10.1371\/journal.pone.0004803.","journal-title":"PLoS One"},{"issue":"2","key":"3780_CR3","doi-asserted-by":"publisher","first-page":"999","DOI":"10.1007\/s11192-017-2297-y","volume":"111","author":"KW Boyack","year":"2017","unstructured":"Boyack, K. W. (2017). Investigating the effect of global data on topic detection. Scientometrics, 111(2), 999\u20131015. https:\/\/doi.org\/10.1007\/s11192-017-2297-y.","journal-title":"Scientometrics"},{"issue":"12","key":"3780_CR4","doi-asserted-by":"publisher","first-page":"2389","DOI":"10.1002\/asi.21419","volume":"61","author":"KW Boyack","year":"2010","unstructured":"Boyack, K. W., & Klavans, R. (2010). Co-citation analysis, bibliographic coupling, and direct citation: Which citation approach represents the research front most accurately? Journal of the American Society for Information Science and Technology, 61(12), 2389\u20132404. https:\/\/doi.org\/10.1002\/asi.21419.","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"3780_CR5","doi-asserted-by":"publisher","unstructured":"Boyack, K.W., Newman, D., Duhon, R.J., Klavans, R., Patek, M., Biberstine, J. R., & B\u00f6rner, K. (2011). Clustering more than two million biomedical publications: Comparing the accuracies of nine text-based similarity approaches. PloS ONE, 6(3). https:\/\/doi.org\/10.1371\/journal.pone.0018029","DOI":"10.1371\/journal.pone.0018029"},{"issue":"2","key":"3780_CR6","doi-asserted-by":"publisher","first-page":"1071","DOI":"10.1007\/s11192-017-2301-6","volume":"111","author":"W Gl\u00e4nzel","year":"2017","unstructured":"Gl\u00e4nzel, W., & Thijs, B. (2017). Using hybrid methods and \u2019core documents\u2019 for the representation of clusters and topics: The astronomy dataset. Scientometrics, 111(2), 1071\u20131087. https:\/\/doi.org\/10.1007\/s11192-017-2301-6.","journal-title":"Scientometrics"},{"issue":"2","key":"3780_CR7","doi-asserted-by":"publisher","first-page":"981","DOI":"10.1007\/s11192-017-2296-z","volume":"111","author":"J Gl\u00e4ser","year":"2017","unstructured":"Gl\u00e4ser, J., Gl\u00e4nzel, W., & Scharnhorst, A. (2017). Same data-different results? Towards a comparative approach to the identification of thematic structures in science. Scientometrics, 111(2), 981\u2013998. https:\/\/doi.org\/10.1007\/s11192-017-2296-z.","journal-title":"Scientometrics"},{"key":"3780_CR8","unstructured":"Halkidi, M., Vazirgiannis, M., & Hennig, C. (2015). Method-independent indices for cluster validation and estimating the number of clusters. In C. Hennig, M. Meila, F. Murtagh, & R. Rocci (Eds.), Handbook of cluster analysis (pp. 616\u2013639). Chapman & Hall\/CRC."},{"issue":"2","key":"3780_CR9","doi-asserted-by":"publisher","first-page":"1089","DOI":"10.1007\/s11192-017-2302-5","volume":"111","author":"F Havemann","year":"2017","unstructured":"Havemann, F., Gl\u00e4ser, J., & Heinz, M. (2017). Memetic search for overlapping topics based on a local evaluation of link communities. Scientometrics, 111(2), 1089\u20131118. https:\/\/doi.org\/10.1007\/s11192-017-2302-5.","journal-title":"Scientometrics"},{"issue":"4","key":"3780_CR10","doi-asserted-by":"publisher","first-page":"984","DOI":"10.1002\/asi.23734","volume":"68","author":"R Klavans","year":"2017","unstructured":"Klavans, R., & Boyack, K. W. (2017). Which type of citation analysis generates the most accurate taxonomy of scientific and technical knowledge? Journal of the Association for Information Science and Technology, 68(4), 984\u2013998. https:\/\/doi.org\/10.1002\/asi.23734.","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"2","key":"3780_CR11","doi-asserted-by":"publisher","first-page":"1119","DOI":"10.1007\/s11192-017-2303-4","volume":"111","author":"R Koopman","year":"2017","unstructured":"Koopman, R., Wang, S., & Scharnhorst, A. (2017). Contextualization of topics: Browsing through the universe of bibliographic information. Scientometrics, 111(2), 1119\u20131139. https:\/\/doi.org\/10.1007\/s11192-017-2303-4.","journal-title":"Scientometrics"},{"issue":"1","key":"3780_CR12","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1002\/asi.20095","volume":"56","author":"MJ Kurtz","year":"2005","unstructured":"Kurtz, M. J., Eichhorn, G., Accomazzi, A., Grant, C., Demleitner, M., & Murray, S. S. (2005). Worldwide use and impact of the NASA Astrophysics Data System digital library. Journal of the American Society for Information Science and Technology, 56(1), 36\u201345. https:\/\/doi.org\/10.1002\/asi.20095.","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"3780_CR13","doi-asserted-by":"publisher","first-page":"238","DOI":"10.1117\/12.460438","volume":"4847","author":"MJ Kurtz","year":"2002","unstructured":"Kurtz, M. J., Eichhorn, G., Accomazzi, A., Grant, C. S., & Murray, S. S. (2002). Second-order bibliometric operators in the Astrophysics Data System. Astronomical Data Analysis II, 4847, 238\u2013245. https:\/\/doi.org\/10.1117\/12.460438.","journal-title":"Astronomical Data Analysis II"},{"key":"3780_CR14","unstructured":"Kurtz, M. J., & Henneken, E. A. (2014). Finding and recommending scholarly articles. In B. Cronin & C. R. Sugimoto (Eds.), Beyond Bibliometrics: Harnessing Multidimensional Indicators of Scholarly Impact (pp. 243\u2013259). MIT Press."},{"key":"3780_CR15","unstructured":"Meila, M. (2015). Criteria for comparing clusterings. In C. Hennig, M. Meila, F. Murtagh, & R. Rocci (Eds.), Handbook of cluster analysis (pp. 640\u2013657). Chapman & Hall\/CRC."},{"issue":"1","key":"3780_CR16","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1140\/epjds\/s13688-016-0090-4","volume":"5","author":"V Palchykov","year":"2016","unstructured":"Palchykov, V., Gemmetto, V., Boyarsky, A., & Garlaschelli, D. (2016). Ground truth? Concept-based communities versus the external classification of physics manuscripts. EPJ Data Science, 5(1), 28. https:\/\/doi.org\/10.1140\/epjds\/s13688-016-0090-4.","journal-title":"EPJ Data Science"},{"issue":"5","key":"3780_CR17","doi-asserted-by":"publisher","first-page":"e1602548","DOI":"10.1126\/sciadv.1602548","volume":"3","author":"L Peel","year":"2017","unstructured":"Peel, L., Larremore, D. B., & Clauset, A. (2017). The ground truth about metadata and community detection in networks. Science Advances, 3(5), e1602548. https:\/\/doi.org\/10.1126\/sciadv.1602548.","journal-title":"Science Advances"},{"issue":"1","key":"3780_CR18","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1016\/j.joi.2014.11.010","volume":"9","author":"J Ruiz-Castillo","year":"2015","unstructured":"Ruiz-Castillo, J., & Waltman, L. (2015). Field-normalized citation impact indicators using algorithmically constructed classification systems of science. Journal of Informetrics, 9(1), 102\u2013117. https:\/\/doi.org\/10.1016\/j.joi.2014.11.010.","journal-title":"Journal of Informetrics"},{"issue":"1","key":"3780_CR19","doi-asserted-by":"publisher","first-page":"202","DOI":"10.1016\/j.joi.2018.12.005","volume":"13","author":"F Shu","year":"2019","unstructured":"Shu, F., Julien, C.-A., Zhang, L., Qiu, J., Zhang, J., & Larivi\u00e8re, V. (2019). Comparing journal and paper level classifications of science. Journal of Informetrics, 13(1), 202\u2013225. https:\/\/doi.org\/10.1016\/j.joi.2018.12.005.","journal-title":"Journal of Informetrics"},{"issue":"1","key":"3780_CR20","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1016\/j.joi.2017.12.006","volume":"12","author":"P Sj\u00f6g\u00e5rde","year":"2018","unstructured":"Sj\u00f6g\u00e5rde, P., & Ahlgren, P. (2018). Granularity of algorithmically constructed publication-level classifications of research publications: Identification of topics. Journal of Informetrics, 12(1), 133\u2013152. https:\/\/doi.org\/10.1016\/j.joi.2017.12.006.","journal-title":"Journal of Informetrics"},{"issue":"1","key":"3780_CR21","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1162\/qss\\_a\\_00004","volume":"1","author":"P Sj\u00f6g\u00e5rde","year":"2020","unstructured":"Sj\u00f6g\u00e5rde, P., & Ahlgren, P. (2020). Granularity of algorithmically constructed publication-level classifications of research publications: Identification of specialties. Quantitative Science Studies, 1(1), 207\u2013238. https:\/\/doi.org\/10.1162\/qss_a_00004.","journal-title":"Quantitative Science Studies"},{"issue":"4","key":"3780_CR22","doi-asserted-by":"publisher","first-page":"e0154404","DOI":"10.1371\/journal.pone.0154404","volume":"11","author":"L \u0160ubelj","year":"2016","unstructured":"\u0160ubelj, L., van Eck, N. J., & Waltman, L. (2016). Clustering scientific publications based on citation relations: A systematic comparison of different methods. PLOS ONE, 11(4), e0154404. https:\/\/doi.org\/10.1371\/journal.pone.0154404.","journal-title":"PLOS ONE"},{"issue":"2","key":"3780_CR23","doi-asserted-by":"publisher","first-page":"1053","DOI":"10.1007\/s11192-017-2300-7","volume":"111","author":"NJ van Eck","year":"2017","unstructured":"van Eck, N. J., & Waltman, L. (2017). Citation-based clustering of publications using CitNetExplorer and VOSviewer. Scientometrics, 111(2), 1053\u20131070. https:\/\/doi.org\/10.1007\/s11192-017-2300-7.","journal-title":"Scientometrics"},{"issue":"2","key":"3780_CR24","doi-asserted-by":"publisher","first-page":"1169","DOI":"10.1007\/s11192-017-2306-1","volume":"111","author":"T Velden","year":"2017","unstructured":"Velden, T., Boyack, K. W., Gl\u00e4ser, J., Koopman, R., Scharnhorst, A., & Wang, S. (2017). Comparison of topic extraction approaches and their results. Scientometrics, 111(2), 1169\u20131221. https:\/\/doi.org\/10.1007\/s11192-017-2306-1.","journal-title":"Scientometrics"},{"issue":"2","key":"3780_CR25","doi-asserted-by":"publisher","first-page":"1033","DOI":"10.1007\/s11192-017-2299-9","volume":"111","author":"T Velden","year":"2017","unstructured":"Velden, T., Yan, S., & Lagoze, C. (2017). Mapping the cognitive structure of astrophysics by infomap clustering of the citation network and topic affinity analysis. Scientometrics, 111(2), 1033\u20131051. https:\/\/doi.org\/10.1007\/s11192-017-2299-9.","journal-title":"Scientometrics"},{"key":"3780_CR26","first-page":"2837","volume":"11","author":"NX Vinh","year":"2010","unstructured":"Vinh, N. X., Epps, J., & Bailey, J. (2010). Information theoretic measures for clusterings comparison: Variants, properties, normalization and correction for chance. Journal of Machine Learning Research, 11, 2837\u20132854.","journal-title":"Journal of Machine Learning Research"},{"issue":"2","key":"3780_CR27","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1162\/qss\\_a\\_00035","volume":"1","author":"L Waltman","year":"2020","unstructured":"Waltman, L., Boyack, K. W., Colavizza, G., & van Eck, N. J. (2020). A principled methodology for comparing relatedness measures for clustering publications. Quantitative Science Studies, 1(2), 691\u2013713. https:\/\/doi.org\/10.1162\/qss_a_00035.","journal-title":"Quantitative Science Studies"},{"issue":"2","key":"3780_CR28","doi-asserted-by":"publisher","first-page":"1017","DOI":"10.1007\/s11192-017-2303-4","volume":"111","author":"S Wang","year":"2017","unstructured":"Wang, S., & Koopman, R. (2017). Clustering articles based on semantic similarity. Scientometrics, 111(2), 1017\u20131031. https:\/\/doi.org\/10.1007\/s11192-017-2303-4.","journal-title":"Scientometrics"},{"issue":"1","key":"3780_CR29","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1007\/s11192-018-2841-4","volume":"117","author":"S Xu","year":"2018","unstructured":"Xu, S., Liu, J., Zhai, D., An, X., Wang, Z., & Pang, H. (2018). Overlapping thematic structures extraction with mixed-membership stochastic blockmodel. Scientometrics, 117(1), 61\u201384. https:\/\/doi.org\/10.1007\/s11192-018-2841-4.","journal-title":"Scientometrics"},{"issue":"4","key":"3780_CR30","doi-asserted-by":"publisher","first-page":"1099","DOI":"10.1016\/j.joi.2018.09.004","volume":"12","author":"Y Zhang","year":"2018","unstructured":"Zhang, Y., Lu, J., Liu, F., Liu, Q., Porter, A., Chen, H., et al. (2018). Does deep learning help topic extraction? A kernel k-means clustering method with word embedding. Journal of Informetrics, 12(4), 1099\u20131117. https:\/\/doi.org\/10.1016\/j.joi.2018.09.004.","journal-title":"Journal of Informetrics"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-020-03780-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11192-020-03780-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-020-03780-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T17:52:10Z","timestamp":1614793930000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11192-020-03780-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,21]]},"references-count":30,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,2]]}},"alternative-id":["3780"],"URL":"https:\/\/doi.org\/10.1007\/s11192-020-03780-3","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"type":"print","value":"0138-9130"},{"type":"electronic","value":"1588-2861"}],"subject":[],"published":{"date-parts":[[2020,11,21]]},"assertion":[{"value":"14 July 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 November 2020","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}