{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,15]],"date-time":"2026-09-15T05:25:42Z","timestamp":1789449942270,"version":"build-2803163510"},"reference-count":51,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2021,3,6]],"date-time":"2021-03-06T00:00:00Z","timestamp":1614988800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,3,6]],"date-time":"2021-03-06T00:00:00Z","timestamp":1614988800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002347","name":"Bundesministerium f\u00fcr Bildung und Forschung","doi-asserted-by":"publisher","award":["01PU17003"],"award-info":[{"award-number":["01PU17003"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006764","name":"Technische Universit\u00e4t Berlin","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006764","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Scientometrics"],"published-print":{"date-parts":[[2021,5]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In this paper we utilize an opportunity to construct ground truths for topics in the field of atomic, molecular and optical physics. Our research questions in this paper focus on (i) how to construct a ground truth for topics and (ii) the suitability of common algorithms applied to bibliometric networks to reconstruct these topics. We use the ground truths to test two data models (direct citation and bibliographic coupling) with two algorithms (the Leiden algorithm and the Infomap algorithm). Our results are discomforting: none of the four combinations leads to a consistent reconstruction of the ground truths. No combination of data model and algorithm simultaneously reconstructs all micro-level topics at any resolution level. Meso-level topics are not reconstructed at all. This suggests (a) that we are currently unable to predict which combination of data model, algorithm and parameter setting will adequately reconstruct which (types of) topics, and (b) that a combination of several data models, algorithms and parameter settings appears to be necessary to reconstruct all or most topics in a set of papers.<\/jats:p>","DOI":"10.1007\/s11192-021-03920-3","type":"journal-article","created":{"date-parts":[[2021,3,6]],"date-time":"2021-03-06T09:04:11Z","timestamp":1615021451000},"page":"4511-4536","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Challenges to the validity of topic reconstruction"],"prefix":"10.1007","volume":"126","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8541-8830","authenticated-orcid":false,"given":"Matthias","family":"Held","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Grit","family":"Laudel","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jochen","family":"Gl\u00e4ser","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,3,6]]},"reference":[{"key":"3920_CR1","doi-asserted-by":"publisher","DOI":"10.1162\/qss_a_00027","author":"P Ahlgren","year":"2020","unstructured":"Ahlgren, P., Chen, Y., Colliander, C., & van Eck, N. J. (2020). Enhancing direct citations: A comparison of relatedness measures for community detection in a large set of PubMed publications. Quant Sci Stud. https:\/\/doi.org\/10.1162\/qss_a_00027","journal-title":"Quant Sci Stud"},{"key":"3920_CR2","doi-asserted-by":"publisher","unstructured":"Bohlin, L., Edler, D., Lancichinetti, A., & Rosvall, M. (2014). Community Detection and Visualization of Networks with the Map Equation Framework. In Y. Ding, R. Rousseau, & D. Wolfram (Eds.), Measuring Scholarly Impact: Methods and Practice (S. 3\u201334). Springer International Publishing. https:\/\/doi.org\/https:\/\/doi.org\/10.1007\/978-3-319-10377-8_1","DOI":"10.1007\/978-3-319-10377-8_1"},{"issue":"12","key":"3920_CR3","doi-asserted-by":"publisher","first-page":"2389","DOI":"10.1002\/asi.21419","volume":"61","author":"KW Boyack","year":"2010","unstructured":"Boyack, K. W., & Klavans, R. (2010). Co-citation analysis, bibliographic coupling, and direct citation: Which citation approach represents the research front most accurately? Journal of the American Society for Information Science and Technology, 61(12), 2389\u20132404. https:\/\/doi.org\/10.1002\/asi.21419","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"1","key":"3920_CR4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s41109-019-0238-9","volume":"4","author":"H Cherifi","year":"2019","unstructured":"Cherifi, H., Palla, G., Szymanski, B. K., & Lu, X. (2019). On community structure in complex networks: Challenges and opportunities. Appl Netw Sci, 4(1), 1\u201335. https:\/\/doi.org\/10.1007\/s41109-019-0238-9","journal-title":"Appl Netw Sci"},{"issue":"4","key":"3920_CR5","doi-asserted-by":"publisher","first-page":"448","DOI":"10.1111\/j.1533-8525.1976.tb01715.x","volume":"17","author":"DE Chubin","year":"1976","unstructured":"Chubin, D. E. (1976). The conceptualization of scientific specialities. Sociol Quarterly, 17(4), 448\u2013476.","journal-title":"Sociol Quarterly"},{"key":"3920_CR6","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-020-03610-6","author":"AV Chumachenko","year":"2020","unstructured":"Chumachenko, A. V., Kreminskyi, B. G., Mosenkis, I. L., & Yakimenko, A. I. (2020). Dynamics of topic formation and quantitative analysis of hot trends in physical science. Scientometrics. https:\/\/doi.org\/10.1007\/s11192-020-03610-6","journal-title":"Scientometrics"},{"key":"3920_CR7","volume-title":"Astronomy transformed: The emergence of radio astronomy in britain","author":"D Edge","year":"1976","unstructured":"Edge, D., & Mulkay, M. J. (1976). Astronomy transformed: The emergence of radio astronomy in britain. Hoboken: Wiley."},{"issue":"2","key":"3920_CR8","doi-asserted-by":"publisher","first-page":"021025","DOI":"10.1103\/PhysRevX.1.021025","volume":"1","author":"AV Esquivel","year":"2011","unstructured":"Esquivel, A. V., & Rosvall, M. (2011). Compression of flow can reveal overlapping-module organization in networks. Phys Rev X, 1(2), 021025. https:\/\/doi.org\/10.1103\/PhysRevX.1.021025","journal-title":"Phys Rev X"},{"issue":"5","key":"3920_CR9","doi-asserted-by":"publisher","first-page":"53001","DOI":"10.1209\/0295-5075\/110\/53001","volume":"110","author":"L Fallani","year":"2015","unstructured":"Fallani, L., & Kastberg, A. (2015). Cold atoms: A field enabled by light. EPL (Europhys Lett), 110(5), 53001. https:\/\/doi.org\/10.1209\/0295-5075\/110\/53001","journal-title":"EPL (Europhys Lett)"},{"key":"3920_CR10","volume-title":"Genesis and development of a scientific fact","author":"L Fleck","year":"1979","unstructured":"Fleck, L. (1979). Genesis and development of a scientific fact. Chicago: The University of Chicago Press."},{"key":"3920_CR11","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-349-16161-4","volume-title":"Central problems in social theory: Action, structure, and contradiction in social analysis","author":"A Giddens","year":"1979","unstructured":"Giddens, A. (1979). Central problems in social theory: Action, structure, and contradiction in social analysis. University of California Press."},{"issue":"2","key":"3920_CR12","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1007\/BF02093621","volume":"37","author":"W Gl\u00e4nzel","year":"1996","unstructured":"Gl\u00e4nzel, W., & Czerwon, H. J. (1996). A new methodological approach to bibliographic coupling and its application to the national, regional and institutional level. Scientometrics, 37(2), 195\u2013221. https:\/\/doi.org\/10.1007\/BF02093621","journal-title":"Scientometrics"},{"issue":"2","key":"3920_CR13","doi-asserted-by":"publisher","first-page":"1071","DOI":"10.1007\/s11192-017-2301-6","volume":"111","author":"W Gl\u00e4nzel","year":"2017","unstructured":"Gl\u00e4nzel, W., & Thijs, B. (2017). Using hybrid methods and \u2018core documents\u2019 for the representation of clusters and topics: The astronomy dataset. Scientometrics, 111(2), 1071\u20131087. https:\/\/doi.org\/10.1007\/s11192-017-2301-6","journal-title":"Scientometrics"},{"key":"3920_CR14","volume-title":"Wissenschaftliche Produktionsgemeinschaften","author":"J Gl\u00e4ser","year":"2006","unstructured":"Gl\u00e4ser, J. (2006). Wissenschaftliche Produktionsgemeinschaften. Die soziale Ordnung der Forschung."},{"key":"3920_CR15","unstructured":"Gl\u00e4ser, J. (2020). Opening the Black Box of Expert Validation of Bibliometric Maps. Lockdown Bibliometrics: Papers not submitted to the STI Conference 2020 in Aarhus, 27\u201336. https:\/\/www.sos.tu-berlin.de\/fileadmin\/fg369\/Jochen_Glaeser__ed__2020_Lockdown_Bibliometrics_-_Papers_not_submitted_to_the_STI_conference_2020_in_Aarhaus_SoS_Discussion_Paper_02_2020.pdf"},{"issue":"2","key":"3920_CR16","doi-asserted-by":"publisher","first-page":"981","DOI":"10.1007\/s11192-017-2296-z","volume":"111","author":"J Gl\u00e4ser","year":"2017","unstructured":"Gl\u00e4ser, J., Gl\u00e4nzel, W., & Scharnhorst, A. (2017). Same data\u2014different results? Towards a comparative approach to the identification of thematic structures in science. Scientometrics, 111(2), 981\u2013998. https:\/\/doi.org\/10.1007\/s11192-017-2296-z","journal-title":"Scientometrics"},{"key":"3920_CR17","doi-asserted-by":"publisher","unstructured":"Gl\u00e4ser, J., & Laudel, G. (2013). Life With and without coding: Two methods for early-stage data analysis in qualitative research aiming at causal explanations. Forum Qualitative Sozialforschung \/ Forum: Qualitative Social Research, 14(2), Article 2. https:\/\/doi.org\/10.17169\/fqs-14.2.1886","DOI":"10.17169\/fqs-14.2.1886"},{"key":"3920_CR18","doi-asserted-by":"publisher","unstructured":"Gl\u00e4ser, J., & Laudel, G. (2015). A bibliometric reconstruction of research trails for qualitative investigations of scientific innovations. Historical Social Research \/ Historische Sozialforschung Vol. 40, No. 3 (2015): Special Issue: Methods of Innovation Research: Qualitative, Quantitative and Mixed Methods Approaches. https:\/\/doi.org\/10.12759\/hsr.40.2015.3.299-330","DOI":"10.12759\/hsr.40.2015.3.299-330"},{"key":"3920_CR19","doi-asserted-by":"publisher","unstructured":"Gl\u00e4ser, J., & Laudel, G. (2019). The discovery of causal mechanisms: Extractive qualitative content analysis as a tool for process tracing. Forum Qualitative Sozialforschung \/ Forum: Qualitative Social Research, 20(3), Article 3. https:\/\/doi.org\/10.17169\/fqs-20.3.3386","DOI":"10.17169\/fqs-20.3.3386"},{"key":"3920_CR20","volume-title":"Frame analysis: An essay on the organization of experience","author":"E Goffman","year":"1974","unstructured":"Goffman, E. (1974). Frame analysis: An essay on the organization of experience. Cambridge: Cambridge University Press."},{"issue":"2","key":"3920_CR21","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1016\/j.joi.2018.03.004","volume":"12","author":"R Haunschild","year":"2018","unstructured":"Haunschild, R., Schier, H., Marx, W., & Bornmann, L. (2018). Algorithmically generated subject categories based on citation relations: An empirical micro study using papers on overall water splitting. J Informetr, 12(2), 436\u2013447. https:\/\/doi.org\/10.1016\/j.joi.2018.03.004","journal-title":"J Informetr"},{"issue":"2","key":"3920_CR22","doi-asserted-by":"publisher","first-page":"1089","DOI":"10.1007\/s11192-017-2302-5","volume":"111","author":"F Havemann","year":"2017","unstructured":"Havemann, F., Gl\u00e4ser, J., & Heinz, M. (2017). Memetic search for overlapping topics based on a local evaluation of link communities. Scientometrics, 111(2), 1089\u20131118. https:\/\/doi.org\/10.1007\/s11192-017-2302-5","journal-title":"Scientometrics"},{"key":"3920_CR23","unstructured":"Held, M., & Velden, T. (2019). How to interpret algorithmically constructed topical structures of research specialties? A case study comparing an internal and an external mapping of the topical structure of invasion biology. Proceedings of the International Conference on Scientometrics and Informetrics, 1933\u20131939."},{"issue":"6","key":"3920_CR24","doi-asserted-by":"publisher","first-page":"062805","DOI":"10.1103\/PhysRevE.90.062805","volume":"90","author":"D Hric","year":"2014","unstructured":"Hric, D., Darst, R. K., & Fortunato, S. (2014). Community detection in networks: Structural communities versus ground truth. Physical Review E, 90(6), 062805. https:\/\/doi.org\/10.1103\/PhysRevE.90.062805","journal-title":"Physical Review E"},{"issue":"1","key":"3920_CR25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s41109-019-0111-x","volume":"4","author":"R Interdonato","year":"2019","unstructured":"Interdonato, R., Atzmueller, M., Gaito, S., Kanawati, R., Largeron, C., & Sala, A. (2019). Feature-rich networks: Going beyond complex network topologies. Appl Netw Sci, 4(1), 1\u201313. https:\/\/doi.org\/10.1007\/s41109-019-0111-x","journal-title":"Appl Netw Sci"},{"issue":"3","key":"3920_CR26","doi-asserted-by":"publisher","first-page":"032309","DOI":"10.1103\/PhysRevE.93.032309","volume":"93","author":"M Kheirkhahzadeh","year":"2016","unstructured":"Kheirkhahzadeh, M., Lancichinetti, A., & Rosvall, M. (2016). Efficient community detection of network flows for varying Markov times and bipartite networks. Physical Review E, 93(3), 032309. https:\/\/doi.org\/10.1103\/PhysRevE.93.032309","journal-title":"Physical Review E"},{"issue":"1","key":"3920_CR27","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/asi.21444","volume":"62","author":"R Klavans","year":"2011","unstructured":"Klavans, R., & Boyack, K. W. (2011). Using global mapping to create more accurate document-level maps of research fields. Journal of the American Society for Information Science and Technology, 62(1), 1\u201318. https:\/\/doi.org\/10.1002\/asi.21444","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"4","key":"3920_CR28","doi-asserted-by":"publisher","first-page":"1158","DOI":"10.1016\/j.joi.2017.10.002","volume":"11","author":"R Klavans","year":"2017","unstructured":"Klavans, R., & Boyack, K. W. (2017a). Research portfolio analysis and topic prominence. J Informetr, 11(4), 1158\u20131174. https:\/\/doi.org\/10.1016\/j.joi.2017.10.002","journal-title":"J Informetr"},{"issue":"4","key":"3920_CR29","doi-asserted-by":"publisher","first-page":"984","DOI":"10.1002\/asi.23734","volume":"68","author":"R Klavans","year":"2017","unstructured":"Klavans, R., & Boyack, K. W. (2017b). Which type of citation analysis generates the most accurate taxonomy of scientific and technical knowledge? J Assoc Inf Sci Technol, 68(4), 984\u2013998. https:\/\/doi.org\/10.1002\/asi.23734","journal-title":"J Assoc Inf Sci Technol"},{"issue":"2","key":"3920_CR30","doi-asserted-by":"publisher","first-page":"1157","DOI":"10.1007\/s11192-017-2305-2","volume":"111","author":"R Koopman","year":"2017","unstructured":"Koopman, R., & Wang, S. (2017). Mutual information based labelling and comparing clusters. Scientometrics, 111(2), 1157\u20131167. https:\/\/doi.org\/10.1007\/s11192-017-2305-2","journal-title":"Scientometrics"},{"key":"3920_CR31","volume-title":"The structure of scientific revolutions","author":"T Kuhn","year":"1962","unstructured":"Kuhn, T. (1962). The structure of scientific revolutions. Chicago: The University of Chicago Press."},{"key":"3920_CR32","doi-asserted-by":"publisher","unstructured":"Laudel, G., Lettkemann, E., Ramuz, R., Wedlin, L., & Woolley, R. (2014). Cold atoms\u2014Hot research: High risks, high rewards in five different authority structures. In R. Whitley & J. Gl\u00e4ser (Eds.), Research in the Sociology of Organizations (Bd. 42, S. 203\u2013234). Emerald Group Publishing Limited. https:\/\/doi.org\/10.1108\/S0733-558X20140000042007","DOI":"10.1108\/S0733-558X20140000042007"},{"issue":"5","key":"3920_CR33","doi-asserted-by":"publisher","first-page":"e1602548","DOI":"10.1126\/sciadv.1602548","volume":"3","author":"L Peel","year":"2017","unstructured":"Peel, L., Larremore, D. B., & Clauset, A. (2017). The ground truth about metadata and community detection in networks. Science Advances, 3(5), e1602548. https:\/\/doi.org\/10.1126\/sciadv.1602548","journal-title":"Science Advances"},{"issue":"4","key":"3920_CR34","doi-asserted-by":"publisher","first-page":"1118","DOI":"10.1073\/pnas.0706851105","volume":"105","author":"M Rosvall","year":"2008","unstructured":"Rosvall, M., & Bergstrom, C. T. (2008). Maps of random walks on complex networks reveal community structure. Proceedings of the National Academy, 105(4), 1118\u20131123.","journal-title":"Proceedings of the National Academy"},{"issue":"1","key":"3920_CR35","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1007\/s41109-017-0023-6","volume":"2","author":"MT Schaub","year":"2017","unstructured":"Schaub, M. T., Delvenne, J.-C., Rosvall, M., & Lambiotte, R. (2017). The many facets of community detection in complex networks. Applied Network Science, 2(1), 4. https:\/\/doi.org\/10.1007\/s41109-017-0023-6","journal-title":"Applied Network Science"},{"key":"3920_CR36","volume-title":"The phenomenology of the social world","author":"A Sch\u00fctz","year":"1967","unstructured":"Sch\u00fctz, A. (1967). The phenomenology of the social world. Evanston: Northwestern University Press."},{"key":"3920_CR37","volume-title":"The structures of the life-world","author":"A Sch\u00fctz","year":"1973","unstructured":"Sch\u00fctz, A., & Luckmann, T. (1973). The structures of the life-world. Evanston: Northwestern University Press."},{"issue":"3","key":"3920_CR38","doi-asserted-by":"publisher","first-page":"571","DOI":"10.1002\/asi.20994","volume":"60","author":"N Shibata","year":"2009","unstructured":"Shibata, N., Kajikawa, Y., Takeda, Y., & Matsushima, K. (2009). Comparative study on methods of detecting research fronts using different types of citation. Journal of the American Society for Information Science and Technology, 60(3), 571\u2013580. https:\/\/doi.org\/10.1002\/asi.20994","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"1","key":"3920_CR39","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1016\/j.joi.2017.12.006","volume":"12","author":"P Sj\u00f6g\u00e5rde","year":"2018","unstructured":"Sj\u00f6g\u00e5rde, P., & Ahlgren, P. (2018). Granularity of algorithmically constructed publication-level classifications of research publications: Identification of topics. Journal of Informetrics, 12(1), 133\u2013152. https:\/\/doi.org\/10.1016\/j.joi.2017.12.006","journal-title":"Journal of Informetrics"},{"issue":"3","key":"3920_CR40","doi-asserted-by":"publisher","first-page":"595","DOI":"10.1007\/s11192-006-0132-y","volume":"68","author":"H Small","year":"2006","unstructured":"Small, H. (2006). Tracking and predicting growth areas in science. Scientometrics, 68(3), 595\u2013610. https:\/\/doi.org\/10.1007\/s11192-006-0132-y","journal-title":"Scientometrics"},{"issue":"8","key":"3920_CR41","doi-asserted-by":"publisher","first-page":"1450","DOI":"10.1016\/j.respol.2014.02.005","volume":"43","author":"H Small","year":"2014","unstructured":"Small, H., Boyack, K. W., & Klavans, R. (2014). Identifying emerging topics in science and technology. Research Policy, 43(8), 1450\u20131467. https:\/\/doi.org\/10.1016\/j.respol.2014.02.005","journal-title":"Research Policy"},{"issue":"4","key":"3920_CR42","doi-asserted-by":"publisher","first-page":"e0154404","DOI":"10.1371\/journal.pone.0154404","volume":"11","author":"L \u0160ubelj","year":"2016","unstructured":"\u0160ubelj, L., van Eck, N. J., & Waltman, L. (2016). Clustering scientific publications based on citation relations: A systematic comparison of different methods. PLoS ONE, 11(4), e0154404. https:\/\/doi.org\/10.1371\/journal.pone.0154404","journal-title":"PLoS ONE"},{"issue":"1","key":"3920_CR43","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1007\/s11192-018-2659-0","volume":"115","author":"B Thijs","year":"2018","unstructured":"Thijs, B., & Gl\u00e4nzel, W. (2018). The contribution of the lexical component in hybrid clustering, the case of four decades of \u201cScientometrics.\u201d Scientometrics, 115(1), 21\u201333. https:\/\/doi.org\/10.1007\/s11192-018-2659-0","journal-title":"Scientometrics"},{"key":"3920_CR44","unstructured":"Traag, V., Waltman, L., van Eck, N. J. (2018). From Louvain to Leiden: Guaranteeing well-connected communities@@@. [Physics]. http:\/\/arxiv.org\/abs\/1810.08473"},{"issue":"2","key":"3920_CR45","doi-asserted-by":"publisher","first-page":"1169","DOI":"10.1007\/s11192-017-2306-1","volume":"111","author":"T Velden","year":"2017","unstructured":"Velden, T., Boyack, K. W., Gl\u00e4ser, J., Koopman, R., Scharnhorst, A., & Wang, S. (2017). Comparison of topic extraction approaches and their results. Scientometrics, 111(2), 1169\u20131221. https:\/\/doi.org\/10.1007\/s11192-017-2306-1","journal-title":"Scientometrics"},{"issue":"2","key":"3920_CR46","doi-asserted-by":"publisher","first-page":"1033","DOI":"10.1007\/s11192-017-2299-9","volume":"111","author":"T Velden","year":"2017","unstructured":"Velden, T., Yan, S., & Lagoze, C. (2017). Mapping the cognitive structure of astrophysics by infomap clustering of the citation network and topic affinity analysis. Scientometrics, 111(2), 1033\u20131051. https:\/\/doi.org\/10.1007\/s11192-017-2299-9","journal-title":"Scientometrics"},{"issue":"2","key":"3920_CR47","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1162\/qss_a_00035","volume":"1","author":"L Waltman","year":"2020","unstructured":"Waltman, L., Boyack, K. W., Colavizza, G., & van Eck, N. J. (2020). A principled methodology for comparing relatedness measures for clustering publications. Quantitative Science Studies, 1(2), 691\u2013713. https:\/\/doi.org\/10.1162\/qss_a_00035","journal-title":"Quantitative Science Studies"},{"issue":"12","key":"3920_CR48","doi-asserted-by":"publisher","first-page":"2378","DOI":"10.1002\/asi.22748","volume":"63","author":"L Waltman","year":"2012","unstructured":"Waltman, L., & van Eck, N. J. (2012). A new methodology for constructing a publication-level classification system of science: A new methodology for constructing a publication-level classification system of science. Journal of the American Society for Information Science and Technology, 63(12), 2378\u20132392. https:\/\/doi.org\/10.1002\/asi.22748","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"3920_CR49","unstructured":"Whitley, R. (1974). Cognitive and social institutionalization of scientific specialties and research areas. In R Whitley (Ed.), Social Processes of Scientific Development (S. 69\u201395). Routledge & Kegan Paul."},{"key":"3920_CR50","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780199240531.001.0001","volume-title":"The intellectual and social organization of the sciences","author":"R Whitley","year":"2000","unstructured":"Whitley, R. (2000). The intellectual and social organization of the sciences. Clarendon Press."},{"issue":"2","key":"3920_CR51","doi-asserted-by":"publisher","first-page":"373","DOI":"10.1007\/s11192-005-0218-y","volume":"63","author":"M Zitt","year":"2005","unstructured":"Zitt, M., Ramanana-Rahary, S., & Bassecoulard, E. (2005). Relativity of citation performance and excellence measures: From cross-field to cross-scale effects of field-normalisation. Scientometrics, 63(2), 373\u2013401. https:\/\/doi.org\/10.1007\/s11192-005-0218-y","journal-title":"Scientometrics"}],"container-title":["Scientometrics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-021-03920-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11192-021-03920-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11192-021-03920-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,25]],"date-time":"2024-08-25T14:21:50Z","timestamp":1724595710000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11192-021-03920-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,6]]},"references-count":51,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2021,5]]}},"alternative-id":["3920"],"URL":"https:\/\/doi.org\/10.1007\/s11192-021-03920-3","relation":{},"ISSN":["0138-9130","1588-2861"],"issn-type":[{"value":"0138-9130","type":"print"},{"value":"1588-2861","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,6]]},"assertion":[{"value":"8 December 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 February 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 March 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}