{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,6]],"date-time":"2026-07-06T13:24:49Z","timestamp":1783344289295,"version":"3.54.6"},"reference-count":77,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2023,3,21]],"date-time":"2023-03-21T00:00:00Z","timestamp":1679356800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,3,21]],"date-time":"2023-03-21T00:00:00Z","timestamp":1679356800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2023,5]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The field of science mapping has shown the power of citation-based clusters for literature analysis, yet this technique has barely been used for information retrieval tasks. This work evaluates the performance of citation-based clusters for information retrieval tasks. We simulated a search process with a tree hierarchy of clusters and a cluster selection algorithm. We evaluated the task of finding the relevant documents for 25 systematic reviews. Our evaluation considered several trade-offs between recall and precision for the cluster selection. We also replicated the Boolean queries self-reported by the systematic reviews to serve as a reference. We found that citation-based clusters\u2019 search performance is highly variable and unpredictable, that the clusters work best for users that prefer recall over precision at a ratio between 2 and 8, and that the clusters are able to complement query-based search by finding additional relevant documents.<\/jats:p>","DOI":"10.1007\/s11192-023-04681-x","type":"journal-article","created":{"date-parts":[[2023,3,21]],"date-time":"2023-03-21T12:02:44Z","timestamp":1679400164000},"page":"2895-2921","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["Academic information retrieval using citation clusters: in-depth evaluation based on systematic reviews"],"prefix":"10.1007","volume":"128","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4077-1024","authenticated-orcid":false,"given":"Juan Pablo","family":"Bascur","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9609-9505","authenticated-orcid":false,"given":"Suzan","family":"Verberne","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8448-4521","authenticated-orcid":false,"given":"Nees Jan","family":"van Eck","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8249-1752","authenticated-orcid":false,"given":"Ludo","family":"Waltman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,3,21]]},"reference":[{"issue":"3","key":"4681_CR1","doi-asserted-by":"publisher","first-page":"2301","DOI":"10.1007\/s11192-014-1478-1","volume":"102","author":"MK Abbasi","year":"2015","unstructured":"Abbasi, M. K., & Frommholz, I. (2015). Cluster-based polyrepresentation as science modelling approach for information retrieval. Scientometrics, 102(3), 2301\u20132322. https:\/\/doi.org\/10.1007\/s11192-014-1478-1","journal-title":"Scientometrics"},{"issue":"12","key":"4681_CR2","doi-asserted-by":"publisher","first-page":"1326","DOI":"10.14778\/2536274.2536307","volume":"6","author":"H Abdelhaq","year":"2013","unstructured":"Abdelhaq, H., Sengstock, C., & Gertz, M. (2013). EvenTweet: Online localized event detection from twitter. Proceedings of the VLDB Endowment, 6(12), 1326\u20131329. https:\/\/doi.org\/10.14778\/2536274.2536307","journal-title":"Proceedings of the VLDB Endowment"},{"issue":"2","key":"4681_CR3","doi-asserted-by":"publisher","first-page":"714","DOI":"10.1162\/qss_a_00027","volume":"1","author":"P Ahlgren","year":"2020","unstructured":"Ahlgren, P., Chen, Y., Colliander, C., & van Eck, N. J. (2020). Enhancing direct citations: A comparison of relatedness measures for community detection in a large set of PubMed publications. Quantitative Science Studies, 1(2), 714\u2013729. https:\/\/doi.org\/10.1162\/qss_a_00027","journal-title":"Quantitative Science Studies"},{"issue":"2","key":"4681_CR4","doi-asserted-by":"publisher","first-page":"e4345","DOI":"10.1371\/journal.pone.0004345","volume":"4","author":"HJ Atkinson","year":"2009","unstructured":"Atkinson, H. J., Morris, J. H., Ferrin, T. E., & Babbitt, P. C. (2009). Using sequence similarity networks for visualization of relationships Across diverse protein superfamilies. PLoS ONE, 4(2), e4345. https:\/\/doi.org\/10.1371\/journal.pone.0004345","journal-title":"PLoS ONE"},{"issue":"2","key":"4681_CR5","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1145\/1924475.1924484","volume":"44","author":"L Azzopardi","year":"2011","unstructured":"Azzopardi, L., J\u00e4rvelin, K., Kamps, J., & Smucker, M. D. (2011). Report on the SIGIR 2010 workshop on the simulation of interaction. ACM SIGIR Forum, 44(2), 35. https:\/\/doi.org\/10.1145\/1924475.1924484","journal-title":"ACM SIGIR Forum"},{"key":"4681_CR6","unstructured":"Bascur, J. P., van Eck, N. J., & Waltman, L. (2019). An interactive visual tool for scientific literature search: Proposal and algorithmic specification. Proceedings of the 8th International Workshop on Bibliometric-Enhanced Information Retrieval (BIR) Co-Located with the 41st European Conference on Information Retrieval (ECIR 2019), 76\u201387."},{"key":"4681_CR7","doi-asserted-by":"publisher","unstructured":"Bascur, J. P. (2022). Academic information retrieval using citation clusters: In-depth evaluation based on systematic reviews (Data) (1.0). Zenodo. https:\/\/doi.org\/10.5281\/zenodo.6702252","DOI":"10.5281\/zenodo.6702252"},{"issue":"11","key":"4681_CR8","doi-asserted-by":"publisher","first-page":"2766","DOI":"10.1002\/asi.23605","volume":"67","author":"CW Belter","year":"2016","unstructured":"Belter, C. W. (2016). Citation analysis as a literature search method for systematic reviews. Journal of the Association for Information Science and Technology, 67(11), 2766\u20132777. https:\/\/doi.org\/10.1002\/asi.23605","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"2","key":"4681_CR9","doi-asserted-by":"publisher","first-page":"731","DOI":"10.1007\/s11192-017-2406-y","volume":"112","author":"CW Belter","year":"2017","unstructured":"Belter, C. W. (2017). A relevance ranking method for citation-based search results. Scientometrics, 112(2), 731\u2013746. https:\/\/doi.org\/10.1007\/s11192-017-2406-y","journal-title":"Scientometrics"},{"issue":"1","key":"4681_CR10","doi-asserted-by":"publisher","first-page":"408","DOI":"10.1038\/s41597-020-00749-y","volume":"7","author":"KW Boyack","year":"2020","unstructured":"Boyack, K. W., Smith, C., & Klavans, R. (2020). A detailed open access model of the PubMed literature. Scientific Data, 7(1), 408. https:\/\/doi.org\/10.1038\/s41597-020-00749-y","journal-title":"Scientific Data"},{"issue":"2","key":"4681_CR11","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1145\/3053408.3053417","volume":"50","author":"G Cabanac","year":"2017","unstructured":"Cabanac, G., Chandrasekaran, M. K., Frommholz, I., Jaidka, K., Kan, M.-Y., Mayr, P., & Wolfram, D. (2017). Report on the joint workshop on bibliometric-enhanced information retrieval and natural language processing for digital libraries (BIRNDL 2016). ACM SIGIR Forum, 50(2), 36\u201343. https:\/\/doi.org\/10.1145\/3053408.3053417","journal-title":"ACM SIGIR Forum"},{"issue":"2","key":"4681_CR12","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1177\/053901883022002003","volume":"22","author":"M Callon","year":"1983","unstructured":"Callon, M., Courtial, J.-P., Turner, W. A., & Bauin, S. (1983). From translations to problematic networks: An introduction to co-word analysis. Social Science Information, 22(2), 191\u2013235. https:\/\/doi.org\/10.1177\/053901883022002003","journal-title":"Social Science Information"},{"key":"4681_CR13","doi-asserted-by":"publisher","unstructured":"Carmel, D., Yom-Tov, E., Darlow, A., & Pelleg, D. (2006). What makes a query difficult? Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval - SIGIR \u201906, 390. https:\/\/doi.org\/10.1145\/1148170.1148238","DOI":"10.1145\/1148170.1148238"},{"key":"4681_CR14","unstructured":"Chandra, K., Slater, B., & Ma, M. (2021). Research Rabbit. https:\/\/www.researchrabbit.ai\/"},{"issue":"3","key":"4681_CR15","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1002\/asi.20317","volume":"57","author":"C Chen","year":"2006","unstructured":"Chen, C. (2006). CiteSpace II: Detecting and visualizing emerging trends and transient patterns in scientific literature. Journal of the American Society for Information Science and Technology, 57(3), 359\u2013377. https:\/\/doi.org\/10.1002\/asi.20317","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"2","key":"4681_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1515\/jdis-2017-0006","volume":"2","author":"C Chen","year":"2017","unstructured":"Chen, C. (2017). Science Mapping: A Systematic Review of the Literature. Journal of Data and Information Science, 2(2), 1\u201340. https:\/\/doi.org\/10.1515\/jdis-2017-0006","journal-title":"Journal of Data and Information Science"},{"issue":"7","key":"4681_CR17","doi-asserted-by":"publisher","first-page":"1382","DOI":"10.1002\/asi.21525","volume":"62","author":"MJ Cobo","year":"2011","unstructured":"Cobo, M. J., L\u00f3pez-Herrera, A. G., Herrera-Viedma, E., & Herrera, F. (2011). Science mapping software tools: Review, analysis, and cooperative study among tools. Journal of the American Society for Information Science and Technology, 62(7), 1382\u20131402. https:\/\/doi.org\/10.1002\/asi.21525","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"4681_CR18","doi-asserted-by":"publisher","DOI":"10.1002\/14651858.CD002764.pub2","author":"SE Cousins","year":"2016","unstructured":"Cousins, S. E., Tempest, E., & Feuer, D. J. (2016). Surgery for the resolution of symptoms in malignant bowel obstruction in advanced gynaecological and gastrointestinal cancer. Cochrane Database of Systematic Reviews. https:\/\/doi.org\/10.1002\/14651858.CD002764.pub2","journal-title":"Cochrane Database of Systematic Reviews"},{"key":"4681_CR19","doi-asserted-by":"publisher","unstructured":"Cutting, D. R., Karger, D. R., Pedersen, J. O., & Tukey, J. W. (1992). Scatter\/Gather: A Cluster-based Approach to Browsing Large Document Collections. Proceedings of the 15th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval., 12. https:\/\/doi.org\/10.1145\/133160.133214","DOI":"10.1145\/133160.133214"},{"key":"4681_CR20","doi-asserted-by":"publisher","unstructured":"De Vries, C. M., Geva, S., & Trotman, A. (2012). Document Clustering Evaluation: Divergence from a Random Baseline. ArXiv:1208.5654 [Cs]. https:\/\/doi.org\/10.48550\/arXiv.1208.5654","DOI":"10.48550\/arXiv.1208.5654"},{"issue":"4","key":"4681_CR21","doi-asserted-by":"publisher","first-page":"469","DOI":"10.1086\/602622","volume":"63","author":"D Ellis","year":"1993","unstructured":"Ellis, D. (1993). Modeling the information-seeking patterns of academic researchers: A grounded theory approach. The Library Quarterly, 63(4), 469\u2013486. https:\/\/doi.org\/10.1086\/602622","journal-title":"The Library Quarterly"},{"key":"4681_CR22","unstructured":"Elsevier. (n.d.). Topic Prominence in Science\u2014Scival. Elsevier.Com. Retrieved January 25, 2023, from https:\/\/www.elsevier.com\/solutions\/scival\/features\/topic-prominence-in-science"},{"key":"4681_CR23","doi-asserted-by":"publisher","unstructured":"Frommholz, I., Mayr, P., Cabanac, G., & Verberne, S. (2021). Bibliometric-Enhanced Information Retrieval: 11th International BIR Workshop. In: D. Hiemstra, M.-F. Moens, J. Mothe, R. Perego, M. Potthast, & F. Sebastiani (Eds.), Advances in Information Retrieval (Vol. 12657, pp. 705\u2013709). Springer International Publishing. https:\/\/doi.org\/10.1007\/978-3-030-72240-1_85","DOI":"10.1007\/978-3-030-72240-1_85"},{"issue":"3","key":"4681_CR24","doi-asserted-by":"publisher","first-page":"2955","DOI":"10.1007\/s11192-020-03358-z","volume":"125","author":"R Haunschild","year":"2020","unstructured":"Haunschild, R., & Marx, W. (2020). Discovering seminal works with marker papers. Scientometrics, 125(3), 2955\u20132969. https:\/\/doi.org\/10.1007\/s11192-020-03358-z","journal-title":"Scientometrics"},{"issue":"8","key":"4681_CR25","doi-asserted-by":"publisher","first-page":"843","DOI":"10.1002\/asi.24171","volume":"70","author":"J He","year":"2019","unstructured":"He, J., Ping, Q., Lou, W., & Chen, C. (2019). PaperPoles: Facilitating adaptive visual exploration of scientific publications by citation links. Journal of the Association for Information Science and Technology, 70(8), 843\u2013857. https:\/\/doi.org\/10.1002\/asi.24171","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"4681_CR26","doi-asserted-by":"publisher","unstructured":"Hearst, M. A., & Pedersen, J. O. (1996). Reexamining the Cluster Hypothesis: Scatter\/Gather on Retrieval Results. Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM. https:\/\/doi.org\/10.1145\/243199.243216","DOI":"10.1145\/243199.243216"},{"issue":"3","key":"4681_CR27","doi-asserted-by":"publisher","first-page":"651","DOI":"10.1162\/qss_a_00194","volume":"3","author":"M Held","year":"2022","unstructured":"Held, M., & Velden, T. (2022). How to interpret algorithmically constructed topical structures of scientific fields? A case study of citationbased mappings of the research specialty of invasion biology. Quantitative Science Studies, 3(3), 651\u2013671.","journal-title":"Quantitative Science Studies"},{"issue":"14","key":"4681_CR28","doi-asserted-by":"publisher","first-page":"2205","DOI":"10.1002\/asi.20686","volume":"58","author":"BM Hemminger","year":"2007","unstructured":"Hemminger, B. M., Lu, D., Vaughan, K. T. L., & Adams, S. J. (2007). Information seeking behavior of academic scientists. Journal of the American Society for Information Science and Technology, 58(14), 2205\u20132225. https:\/\/doi.org\/10.1002\/asi.20686","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"1","key":"4681_CR29","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1007\/s10791-012-9197-9","volume":"16","author":"K Hofmann","year":"2013","unstructured":"Hofmann, K., Whiteson, S., & de Rijke, M. (2013). Balancing exploration and exploitation in listwise and pairwise online learning to rank for information retrieval. Information Retrieval, 16(1), 63\u201390. https:\/\/doi.org\/10.1007\/s10791-012-9197-9","journal-title":"Information Retrieval"},{"key":"4681_CR30","unstructured":"Honnibal, M., Montani, I., Van Landeghem, S., & Boyd, A. (2020). spaCy: Industrial-strength Natural Language Processing in Python."},{"key":"4681_CR31","doi-asserted-by":"publisher","DOI":"10.1002\/14651858.MR000026.pub2","author":"T Horsley","year":"2011","unstructured":"Horsley, T., Dingwall, O., & Sampson, M. (2011). Checking reference lists to find additional studies for systematic reviews. Cochrane Database of Systematic Reviews. https:\/\/doi.org\/10.1002\/14651858.MR000026.pub2","journal-title":"Cochrane Database of Systematic Reviews"},{"key":"4681_CR32","unstructured":"Inciteful. (2022). https:\/\/inciteful.xyz\/"},{"key":"4681_CR33","unstructured":"Iris.ai. (2019, September 30). https:\/\/iris.ai\/"},{"issue":"3","key":"4681_CR34","doi-asserted-by":"publisher","first-page":"607","DOI":"10.1007\/s11192-007-2002-7","volume":"75","author":"F Janssens","year":"2008","unstructured":"Janssens, F., Gl\u00e4nzel, W., & De Moor, B. (2008). A hybrid mapping of information science. Scientometrics, 75(3), 607\u2013631. https:\/\/doi.org\/10.1007\/s11192-007-2002-7","journal-title":"Scientometrics"},{"key":"4681_CR35","doi-asserted-by":"publisher","DOI":"10.1186\/s12874-020-0907-5","author":"ACJW Janssens","year":"2020","unstructured":"Janssens, A. C. J. W., Gwinn, M., Brockman, J. E., Powell, K., & Goodman, M. (2020). Novel citation-based search method for scientific literature: A validation study. BMC Medical Research Methodology. https:\/\/doi.org\/10.1186\/s12874-020-0907-5","journal-title":"BMC Medical Research Methodology"},{"issue":"5","key":"4681_CR36","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1016\/0020-0271(71)90051-9","volume":"7","author":"N Jardine","year":"1971","unstructured":"Jardine, N., & van Rijsbergen, C. J. (1971). The use of hierarchic clustering in information retrieval. Information Storage and Retrieval, 7(5), 217\u2013240. https:\/\/doi.org\/10.1016\/0020-0271(71)90051-9","journal-title":"Information Storage and Retrieval"},{"issue":"3","key":"4681_CR37","doi-asserted-by":"publisher","first-page":"475","DOI":"10.1007\/s11192-006-0125-x","volume":"68","author":"R Klavans","year":"2006","unstructured":"Klavans, R., & Boyack, K. W. (2006). Quantitative evaluation of large maps of science. Scientometrics, 68(3), 475\u2013499. https:\/\/doi.org\/10.1007\/s11192-006-0125-x","journal-title":"Scientometrics"},{"issue":"5","key":"4681_CR38","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1002\/(SICI)1097-4571(199106)42:5<361::AID-ASI6>3.0.CO;2-#","volume":"42","author":"CC Kuhlthau","year":"1991","unstructured":"Kuhlthau, C. C. (1991). Inside the search process: Information seeking from the user\u2019s perspective. Journal of the American Society for Information Science, 42(5), 361\u2013371. https:\/\/doi.org\/10.1002\/(SICI)1097-4571(199106)42:5%3c361::AID-ASI6%3e3.0.CO;2-#","journal-title":"Journal of the American Society for Information Science"},{"key":"4681_CR39","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23535-1_35","volume-title":"Web-Age Information Management","author":"Y Liang","year":"2011","unstructured":"Liang, Y., Li, Q., & Qian, T. (2011). Finding Relevant Papers Based on Citation Relations. In H. Wang, S. Li, S. Oyama, X. Hu, & T. Qian (Eds.), Web-Age Information Management. Springer. https:\/\/doi.org\/10.1007\/978-3-642-23535-1_35"},{"key":"4681_CR40","unstructured":"Ma, L.-O. (2015). Rituximab for rheumatoid arthritis (Review). Cochrane Database of Systematic Reviews, 253."},{"key":"4681_CR41","unstructured":"Madeira, F., & Vot. (2018). Citation Gecko. https:\/\/github.com\/CitationGecko\/gecko-client"},{"key":"4681_CR42","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511809071","volume-title":"Introduction to Information Retrieval","author":"CD Manning","year":"2008","unstructured":"Manning, C. D., Raghavan, P., & Sch\u00fctze, H. (2008). Introduction to Information Retrieval. Cambridge University Press."},{"issue":"4","key":"4681_CR43","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1108\/eb026352","volume":"20","author":"J Martyn","year":"1964","unstructured":"Martyn, J. (1964). Bibliographic coupling. Journal of Documentation, 20(4), 236\u2013236. https:\/\/doi.org\/10.1108\/eb026352","journal-title":"Journal of Documentation"},{"issue":"3","key":"4681_CR44","doi-asserted-by":"publisher","first-page":"2193","DOI":"10.1007\/s11192-014-1484-3","volume":"102","author":"P Mayr","year":"2015","unstructured":"Mayr, P., & Scharnhorst, A. (2015). Scientometrics and information retrieval: Weak-links revitalized. Scientometrics, 102(3), 2193\u20132199. https:\/\/doi.org\/10.1007\/s11192-014-1484-3","journal-title":"Scientometrics"},{"key":"4681_CR45","doi-asserted-by":"publisher","first-page":"2323","DOI":"10.1007\/s11192-014-1485-2","volume":"102","author":"P Mutschke","year":"2015","unstructured":"Mutschke, P., & Mayr, P. (2015). Science models for search: A study on combining scholarly information retrieval and scientometrics. Scientometrics, 102, 2323\u20132345. https:\/\/doi.org\/10.1007\/s11192-014-1485-2","journal-title":"Scientometrics"},{"key":"4681_CR46","unstructured":"Open Knowledge Maps: A Visual Interface to the World\u2019s Scientific Knowledge. (2019). Open Knowledge Maps. https:\/\/openknowledgemaps.org"},{"issue":"1","key":"4681_CR47","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1186\/1471-2105-14-113","volume":"14","author":"FM Ortu\u00f1o","year":"2013","unstructured":"Ortu\u00f1o, F. M., Rojas, I., Andrade-Navarro, M. A., & Fontaine, J.-F. (2013). Using cited references to improve the retrieval of related biomedical documents. BMC Bioinformatics, 14(1), 113. https:\/\/doi.org\/10.1186\/1471-2105-14-113","journal-title":"BMC Bioinformatics"},{"key":"4681_CR48","volume-title":"Cochrane Database of Systematic Reviews","author":"F Peinemann","year":"2013","unstructured":"Peinemann, F., Bartel, C., Grouven, U., & Berthold, F. (2013). Retinoic acid post consolidation therapy for high-risk neuroblastoma patients treated with autologous hematopoietic stem cell transplantation. Cochrane Database of Systematic Reviews. Wiley."},{"key":"4681_CR49","doi-asserted-by":"publisher","unstructured":"Pirolli, P., Schank, P., Hearst, M., & Diehl, C. (1996). Scatter\/gather browsing communicates the topic structure of a very large text collection. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems Common Ground - CHI \u201996, 213\u2013220. https:\/\/doi.org\/10.1145\/238386.238489","DOI":"10.1145\/238386.238489"},{"key":"4681_CR50","unstructured":"Pitt, A., Dixon, D., & Webster, K. (2022). Litmaps. https:\/\/www.litmaps.com\/"},{"key":"4681_CR51","unstructured":"Potter, I. (2020). Introducing Citation Topics in InCites. Clarivate Blog. https:\/\/clarivate.com\/blog\/introducing-citation-topics\/"},{"key":"4681_CR52","unstructured":"PubMed API. (2018). https:\/\/www.ncbi.nlm.nih.gov\/books\/NBK25500\/"},{"issue":"7","key":"4681_CR53","doi-asserted-by":"publisher","first-page":"793","DOI":"10.1016\/j.jclinepi.2013.11.015","volume":"67","author":"KA Robinson","year":"2014","unstructured":"Robinson, K. A., Dunn, A. G., Tsafnat, G., & Glasziou, P. (2014). Citation networks of related trials are often disconnected: Implications for bidirectional citation searches. Journal of Clinical Epidemiology, 67(7), 793\u2013799. https:\/\/doi.org\/10.1016\/j.jclinepi.2013.11.015","journal-title":"Journal of Clinical Epidemiology"},{"issue":"6","key":"4681_CR54","doi-asserted-by":"publisher","first-page":"1042","DOI":"10.1016\/j.ipm.2018.07.003","volume":"54","author":"T Russell-Rose","year":"2018","unstructured":"Russell-Rose, T., Chamberlain, J., & Azzopardi, L. (2018). Information retrieval in the workplace: A comparison of professional search practices. Information Processing & Management, 54(6), 1042\u20131057. https:\/\/doi.org\/10.1016\/j.ipm.2018.07.003","journal-title":"Information Processing & Management"},{"key":"4681_CR55","doi-asserted-by":"publisher","unstructured":"Scells, H., Zuccon, G., Koopman, B., Deacon, A., Azzopardi, L., & Geva, S. (2017). A Test Collection for Evaluating Retrieval of Studies for Inclusion in Systematic Reviews. Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval - SIGIR \u201917, 1237\u20131240. https:\/\/doi.org\/10.1145\/3077136.3080707","DOI":"10.1145\/3077136.3080707"},{"key":"4681_CR56","doi-asserted-by":"publisher","unstructured":"Scells, H., Locke, D., & Zuccon, G. (2018). An Information Retrieval Experiment Framework for Domain Specific Applications. The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, 1281\u20131284. https:\/\/doi.org\/10.1145\/3209978.3210167","DOI":"10.1145\/3209978.3210167"},{"issue":"1","key":"4681_CR57","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1016\/j.joi.2017.12.006","volume":"12","author":"P Sj\u00f6g\u00e5rde","year":"2018","unstructured":"Sj\u00f6g\u00e5rde, P., & Ahlgren, P. (2018). Granularity of algorithmically constructed publication-level classifications of research publications: Identification of topics. Journal of Informetrics, 12(1), 133\u2013152. https:\/\/doi.org\/10.1016\/j.joi.2017.12.006","journal-title":"Journal of Informetrics"},{"issue":"1","key":"4681_CR58","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1162\/qss_a_00004","volume":"1","author":"P Sj\u00f6g\u00e5rde","year":"2020","unstructured":"Sj\u00f6g\u00e5rde, P., & Ahlgren, P. (2020). Granularity of algorithmically constructed publication-level classifications of research publications: Identification of specialties. Quantitative Science Studies, 1(1), 207\u2013238. https:\/\/doi.org\/10.1162\/qss_a_00004","journal-title":"Quantitative Science Studies"},{"issue":"7","key":"4681_CR59","doi-asserted-by":"publisher","first-page":"853","DOI":"10.1002\/asi.24452","volume":"72","author":"P Sj\u00f6g\u00e5rde","year":"2021","unstructured":"Sj\u00f6g\u00e5rde, P., Ahlgren, P., & Waltman, L. (2021). Algorithmic labeling in hierarchical classifications of publications: Evaluation of bibliographic fields and term weighting approaches. Journal of the Association for Information Science and Technology, 72(7), 853\u2013869. https:\/\/doi.org\/10.1002\/asi.24452","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"4","key":"4681_CR60","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1002\/asi.4630240406","volume":"24","author":"H Small","year":"1973","unstructured":"Small, H. (1973). Co-citation in the scientific literature: A new measure of the relationship between two documents. Journal of the American Society for Information Science, 24(4), 265\u2013269. https:\/\/doi.org\/10.1002\/asi.4630240406","journal-title":"Journal of the American Society for Information Science"},{"issue":"4","key":"4681_CR61","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1177\/016555158501100402","volume":"11","author":"H Small","year":"1985","unstructured":"Small, H., & Garfield, E. (1985). The geography of science: Disciplinary and national mappings. Journal of Information Science, 11(4), 147\u2013159. https:\/\/doi.org\/10.1177\/016555158501100402","journal-title":"Journal of Information Science"},{"key":"4681_CR62","volume-title":"Advances in Web Intelligence","author":"J Stefanowski","year":"2003","unstructured":"Stefanowski, J., & Weiss, D. (2003). Carrot2 and Language Properties in Web Search Results Clustering. In E. Menasalvas, J. Segovia, & P. S. Szczepaniak (Eds.), Advances in Web Intelligence. Springer."},{"issue":"4","key":"4681_CR63","doi-asserted-by":"publisher","first-page":"559","DOI":"10.1016\/S0306-4573(01)00048-6","volume":"38","author":"A Tombros","year":"2002","unstructured":"Tombros, A., Villa, R., & Van Rijsbergen, C. J. (2002). The effectiveness of query-specific hierarchic clustering in information retrieval. Information Processing & Management, 38(4), 559\u2013582. https:\/\/doi.org\/10.1016\/S0306-4573(01)00048-6","journal-title":"Information Processing & Management"},{"key":"4681_CR64","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-019-41695-z","author":"VA Traag","year":"2019","unstructured":"Traag, V. A., Waltman, L., & van Eck, N. J. (2019). From Louvain to Leiden: Guaranteeing well-connected communities. Scientific Reports. https:\/\/doi.org\/10.1038\/s41598-019-41695-z","journal-title":"Scientific Reports"},{"key":"4681_CR65","volume-title":"Information Retrieval","author":"CJ van Rijsbergen","year":"1979","unstructured":"van Rijsbergen, C. J. (1979). Information Retrieval (2nd ed.). Butterworths.","edition":"2"},{"issue":"2","key":"4681_CR66","doi-asserted-by":"publisher","first-page":"523","DOI":"10.1007\/s11192-009-0146-3","volume":"84","author":"NJ van Eck","year":"2010","unstructured":"van Eck, N. J., & Waltman, L. (2010). Software survey: VOSviewer, a computer program for bibliometric mapping. Scientometrics, 84(2), 523\u2013538. https:\/\/doi.org\/10.1007\/s11192-009-0146-3","journal-title":"Scientometrics"},{"issue":"4","key":"4681_CR67","doi-asserted-by":"publisher","first-page":"802","DOI":"10.1016\/j.joi.2014.07.006","volume":"8","author":"NJ van Eck","year":"2014","unstructured":"van Eck, N. J., & Waltman, L. (2014). CitNetExplorer: A new software tool for analyzing and visualizing citation networks. Journal of Informetrics, 8(4), 802\u2013823. https:\/\/doi.org\/10.1016\/j.joi.2014.07.006","journal-title":"Journal of Informetrics"},{"issue":"2","key":"4681_CR68","doi-asserted-by":"publisher","first-page":"1053","DOI":"10.1007\/s11192-017-2300-7","volume":"111","author":"NJ van Eck","year":"2017","unstructured":"van Eck, N. J., & Waltman, L. (2017). Citation-based clustering of publications using CitNetExplorer and VOSviewer. Scientometrics, 111(2), 1053\u20131070. https:\/\/doi.org\/10.1007\/s11192-017-2300-7","journal-title":"Scientometrics"},{"issue":"5\u20137","key":"4681_CR69","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1016\/0306-4573(75)90006-0","volume":"11","author":"CJ Van Rijsbergen","year":"1975","unstructured":"Van Rijsbergen, C. J., & Croft, W. B. (1975). Document clustering: An evaluation of some experiments with the cranfield 1400 collection. Information Processing & Management, 11(5\u20137), 171\u2013182. https:\/\/doi.org\/10.1016\/0306-4573(75)90006-0","journal-title":"Information Processing & Management"},{"issue":"12","key":"4681_CR70","doi-asserted-by":"publisher","first-page":"2378","DOI":"10.1002\/asi.22748","volume":"63","author":"L Waltman","year":"2012","unstructured":"Waltman, L., & van Eck, N. J. (2012). A new methodology for constructing a publication-level classification system of science. Journal of the American Society for Information Science and Technology, 63(12), 2378\u20132392. https:\/\/doi.org\/10.1002\/asi.22748","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"4681_CR71","doi-asserted-by":"publisher","DOI":"10.1162\/qss_a_00035","author":"L Waltman","year":"2020","unstructured":"Waltman, L., Boyack, K. W., Colavizza, G., & van Eck, N. J. (2020). A principled methodology for comparing relatedness measures for clustering publications. Quantitative Science Studies. https:\/\/doi.org\/10.1162\/qss_a_00035","journal-title":"Quantitative Science Studies"},{"issue":"12","key":"4681_CR72","doi-asserted-by":"publisher","first-page":"2204","DOI":"10.1093\/rheumatology\/kes150","volume":"51","author":"ME Weinblatt","year":"2012","unstructured":"Weinblatt, M. E., Fleischmann, R., Huizinga, T. W. J., Emery, P., Pope, J., Massarotti, E. M., van Vollenhoven, R. F., Wollenhaupt, J., Bingham, C. O., Duncan, B., Goel, N., Davies, O. R., & Dougados, M. (2012). Efficacy and safety of certolizumab pegol in a broad population of patients with active rheumatoid arthritis: Results from the REALISTIC phase IIIb study. Rheumatology, 51(12), 2204\u20132214. https:\/\/doi.org\/10.1093\/rheumatology\/kes150","journal-title":"Rheumatology"},{"issue":"5","key":"4681_CR73","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1016\/0306-4573(88)90027-1","volume":"24","author":"P Willett","year":"1988","unstructured":"Willett, P. (1988). Recent trends in hierarchic document clustering: A critical review. Information Processing & Management, 24(5), 577\u2013597. https:\/\/doi.org\/10.1016\/0306-4573(88)90027-1","journal-title":"Information Processing & Management"},{"issue":"3","key":"4681_CR74","doi-asserted-by":"publisher","first-page":"2201","DOI":"10.1007\/s11192-014-1479-0","volume":"102","author":"D Wolfram","year":"2015","unstructured":"Wolfram, D. (2015). The symbiotic relationship between information retrieval and informetrics. Scientometrics, 102(3), 2201\u20132214. https:\/\/doi.org\/10.1007\/s11192-014-1479-0","journal-title":"Scientometrics"},{"issue":"1","key":"4681_CR75","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1186\/1471-2288-14-73","volume":"14","author":"K Wright","year":"2014","unstructured":"Wright, K., Golder, S., & Rodriguez-Lopez, R. (2014). Citation searching: A systematic review case study of multiple risk behaviour interventions. BMC Medical Research Methodology, 14(1), 73. https:\/\/doi.org\/10.1186\/1471-2288-14-73","journal-title":"BMC Medical Research Methodology"},{"key":"4681_CR76","doi-asserted-by":"publisher","DOI":"10.1007\/s10791-021-09401-8","author":"M Yuan","year":"2022","unstructured":"Yuan, M., Zobel, J., & Lin, P. (2022). Measurement of clustering effectiveness for document collections. Information Retrieval Journal. https:\/\/doi.org\/10.1007\/s10791-021-09401-8","journal-title":"Information Retrieval Journal"},{"issue":"3","key":"4681_CR77","doi-asserted-by":"publisher","first-page":"2223","DOI":"10.1007\/s11192-014-1482-5","volume":"102","author":"M Zitt","year":"2015","unstructured":"Zitt, M. (2015). Meso-level retrieval: IR-bibliometrics interplay and hybrid citation-words methods in scientific fields delineation. Scientometrics, 102(3), 2223\u20132245. https:\/\/doi.org\/10.1007\/s11192-014-1482-5","journal-title":"Scientometrics"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-023-04681-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-023-04681-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-023-04681-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,25]],"date-time":"2023-04-25T16:49:56Z","timestamp":1682441396000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-023-04681-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,21]]},"references-count":77,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2023,5]]}},"alternative-id":["4681"],"URL":"https:\/\/doi.org\/10.1007\/s11192-023-04681-x","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,21]]},"assertion":[{"value":"8 July 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 March 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 March 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"We have no competing interests to declare.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}