{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T01:38:20Z","timestamp":1780537100548,"version":"3.54.1"},"reference-count":32,"publisher":"MIT Press","issue":"1","license":[{"start":{"date-parts":[[2021,3,8]],"date-time":"2021-03-08T00:00:00Z","timestamp":1615161600000},"content-version":"vor","delay-in-days":66,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["71904081"],"award-info":[{"award-number":["71904081"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Chinese Education Department Research Foundation for Humanities and Social Sciences","award":["19YJC870017"],"award-info":[{"award-number":["19YJC870017"]}]}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,4,8]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The citation impact of a scientific publication is usually seen as a one-dimensional concept. We introduce a multidimensional framework for characterizing the citation impact of a publication. In addition to the level of citation impact, quantified by the number of citations received by a publication, we also conceptualize and operationalize the depth and breadth and the dependence and independence of the citation impact of a publication. The proposed framework distinguishes between publications that have a deep citation impact, typically in a relatively narrow research area, and publications that have a broad citation impact, probably covering a wider area of research. It also makes a distinction between publications that are strongly dependent on earlier work and publications that make a more independent scientific contribution. We use our multidimensional citation impact framework to report basic descriptive statistics on the citation impact of highly cited publications in all scientific disciplines. In addition, we present a detailed case study focusing on the field of scientometrics. The proposed citation impact framework provides a more in-depth understanding of the citation impact of a publication than a traditional one-dimensional perspective.<\/jats:p>","DOI":"10.1162\/qss_a_00109","type":"journal-article","created":{"date-parts":[[2021,1,11]],"date-time":"2021-01-11T13:35:38Z","timestamp":1610372138000},"page":"155-183","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":56,"title":["A multidimensional framework for characterizing the citation impact of scientific publications"],"prefix":"10.1162","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2549-4580","authenticated-orcid":true,"given":"Yi","family":"Bu","sequence":"first","affiliation":[{"name":"Department of Information Management, Peking University, Beijing, China"},{"name":"Center for Complex Networks and Systems Research, Luddy School of Informatics, Computing, and Engineering, Indiana University, Bloomington, IN, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8249-1752","authenticated-orcid":true,"given":"Ludo","family":"Waltman","sequence":"additional","affiliation":[{"name":"Centre for Science and Technology Studies, Leiden University, Leiden, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5953-6908","authenticated-orcid":true,"given":"Yong","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Information Management, Wuhan University, Wuhan, Hubei, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","published-online":{"date-parts":[[2021,4,8]]},"reference":[{"issue":"3","key":"2021041320051759400_bib1","doi-asserted-by":"crossref","first-page":"1242","DOI":"10.1162\/qss_a_00068","article-title":"Are disruption index indicators convergently valid? The comparison of several indicator variants with assessments by peers","volume":"1","author":"Bornmann","year":"2020","journal-title":"Quantitative Science Studies"},{"issue":"2","key":"2021041320051759400_bib2","doi-asserted-by":"crossref","first-page":"1149","DOI":"10.1007\/s11192-020-03406-8","article-title":"Disruptive papers published in Scientometrics: Meaningful results by using an improved variant of the disruption index originally proposed by Wu, Wang, and Evans (2019)","volume":"123","author":"Bornmann","year":"2020","journal-title":"Scientometrics"},{"issue":"2","key":"2021041320051759400_bib3","doi-asserted-by":"crossref","first-page":"e280207","DOI":"10.3145\/epi.2019.mar.07","article-title":"Disruption index depends on length of citation window","volume":"28","author":"Bornmann","year":"2019","journal-title":"El Profesional de la Informaci\u00f3n"},{"issue":"1","key":"2021041320051759400_bib4","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1007\/s11192-019-03113-z","article-title":"Disruptive papers published in Scientometrics","volume":"120","author":"Bornmann","year":"2019","journal-title":"Scientometrics"},{"key":"2021041320051759400_bib5","volume-title":"A multidimensional framework for characterizing the citation impact of scientific publications","author":"Bu","year":"2020"},{"issue":"1","key":"2021041320051759400_bib6","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.joi.2006.06.001","article-title":"Finding scientific gems with Google\u2019s PageRank algorithm","volume":"1","author":"Chen","year":"2007","journal-title":"Journal of Informetrics"},{"issue":"2","key":"2021041320051759400_bib7","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1093\/comnet\/cnu039","article-title":"Transitive reduction of citation networks","volume":"3","author":"Clough","year":"2015","journal-title":"Journal of Complex Networks"},{"issue":"3","key":"2021041320051759400_bib8","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1016\/j.joi.2013.03.003","article-title":"The distribution of references across texts: Some implications for citation analysis","volume":"7","author":"Ding","year":"2013","journal-title":"Journal of Informetrics"},{"issue":"1","key":"2021041320051759400_bib40","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1007\/s11192-006-0144-7","article-title":"Theory and practise of the g-index","volume":"69","author":"Egghe","year":"2006","journal-title":"Scientometrics"},{"issue":"1","key":"2021041320051759400_bib9","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1002\/aris.2010.1440440109","article-title":"The Hirsch index and related impact measures","volume":"44","author":"Egghe","year":"2010","journal-title":"Annual Review of Information Science and Technology"},{"issue":"2","key":"2021041320051759400_bib41","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1096\/fj.07-9492LSF","article-title":"Comparison of PubMed, Scopus, Web of Science, and Google Scholar: Strengths and weaknesses","volume":"22","author":"Falagas","year":"2008","journal-title":"The FASEB Journal"},{"issue":"3","key":"2021041320051759400_bib10","doi-asserted-by":"crossref","first-page":"791","DOI":"10.1287\/mnsc.2015.2366","article-title":"A dynamic network measure of technological change","volume":"63","author":"Funk","year":"2017","journal-title":"Management Science"},{"issue":"46","key":"2021041320051759400_bib11","doi-asserted-by":"crossref","first-page":"16569","DOI":"10.1073\/pnas.0507655102","article-title":"An index to quantify an individual\u2019s scientific research output","volume":"102","author":"Hirsch","year":"2005","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"issue":"3","key":"2021041320051759400_bib12","doi-asserted-by":"crossref","first-page":"2177","DOI":"10.1007\/s11192-018-2952-y","article-title":"Number versus structure: Towards citing cascades","volume":"117","author":"Huang","year":"2018","journal-title":"Scientometrics"},{"key":"2021041320051759400_bib13","doi-asserted-by":"crossref","DOI":"10.1177\/0165551520917654","article-title":"Exploring direct citations between citing publications","author":"Huang","year":"2020","journal-title":"Journal of Information Science"},{"key":"2021041320051759400_bib14","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1109\/JCDL.2019.00051","article-title":"Go wide, go deep: Quantifying the impact of scientific papers through influence dispersion trees","volume-title":"2019 ACM\/IEEE Joint Conference on Digital Libraries (JCDL)","author":"Mohapatra","year":"2019"},{"issue":"45","key":"2021041320051759400_bib15","doi-asserted-by":"crossref","first-page":"17268","DOI":"10.1073\/pnas.0806977105","article-title":"Universality of citation distributions: Toward an objective measure of scientific impact","volume":"105","author":"Radicchi","year":"2008","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"issue":"2","key":"2021041320051759400_bib16","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1016\/j.joi.2012.11.012","article-title":"The h-bubble","volume":"7","author":"Rousseau","year":"2013","journal-title":"Journal of Informetrics"},{"issue":"1","key":"2021041320051759400_bib17","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1007\/s11192-019-03263-0","article-title":"Measuring originality in science","volume":"122","author":"Shibayama","year":"2020","journal-title":"Scientometrics"},{"issue":"13","key":"2021041320051759400_bib18","doi-asserted-by":"crossref","first-page":"1157","DOI":"10.1002\/asi.1182","article-title":"Extracting macroscopic information from web links","volume":"52","author":"Thelwall","year":"2001","journal-title":"Journal of the American Society for Information Science and Technology"},{"issue":"2","key":"2021041320051759400_bib19","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1007\/s11192-009-0146-3","article-title":"Software survey: VOSviewer, a computer program for bibliometric mapping","volume":"84","author":"Van Eck","year":"2009","journal-title":"Scientometrics"},{"key":"2021041320051759400_bib20","first-page":"P06010","article-title":"Ranking scientific publications using a model of network traffic","volume":"6","author":"Walker","year":"2007","journal-title":"Journal of Statistical Mechanics: Theory and Experiment"},{"issue":"2","key":"2021041320051759400_bib21","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1016\/j.joi.2016.02.007","article-title":"A review of the literature on citation impact indicators","volume":"10","author":"Waltman","year":"2016","journal-title":"Journal of Informetrics"},{"issue":"12","key":"2021041320051759400_bib22","doi-asserted-by":"crossref","first-page":"2378","DOI":"10.1002\/asi.22748","article-title":"A new methodology for constructing a publication-level classification system of science","volume":"63","author":"Waltman","year":"2012","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"2021041320051759400_bib23","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1007\/978-3-030-02511-3_11","article-title":"Field normalization of scientometric indicators","volume-title":"Handbook of science and technology indicators","author":"Waltman","year":"2019"},{"issue":"1","key":"2021041320051759400_bib24","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.joi.2010.08.001","article-title":"Towards a new crown indicator: Some theoretical considerations","volume":"5","author":"Waltman","year":"2011","journal-title":"Journal of Informetrics"},{"issue":"1","key":"2021041320051759400_bib25","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1002\/asi.21671","article-title":"Universality of citation distributions revisited","volume":"63","author":"Waltman","year":"2012","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"2021041320051759400_bib26","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1007\/978-3-319-10377-8_4","article-title":"PageRank-related methods for analyzing citation networks","volume-title":"Measuring scholarly impact: Methods and practice","author":"Waltman","year":"2014"},{"issue":"12","key":"2021041320051759400_bib27","doi-asserted-by":"crossref","first-page":"2509","DOI":"10.1002\/asi.23151","article-title":"WL-index: Leveraging citation mention number to quantify an individual\u2019s scientific impact","volume":"65","author":"Wan","year":"2014","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"7744","key":"2021041320051759400_bib28","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1038\/s41586-019-0941-9","article-title":"Large teams develop and small teams disrupt science and technology","volume":"566","author":"Wu","year":"2019","journal-title":"Nature"},{"key":"2021041320051759400_bib29","volume-title":"Solo citations, duet citations, and prelude citations: New measures of the disruption of academic papers","author":"Wu","year":"2019"},{"issue":"2","key":"2021041320051759400_bib30","doi-asserted-by":"crossref","first-page":"408","DOI":"10.1002\/asi.23179","article-title":"Measuring academic influence: Not all citations are equal","volume":"66","author":"Zhu","year":"2015","journal-title":"Journal of the Association for Information Science and Technology"}],"container-title":["Quantitative Science Studies"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/qss\/article-pdf\/2\/1\/155\/1906510\/qss_a_00109.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/qss\/article-pdf\/2\/1\/155\/1906510\/qss_a_00109.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,17]],"date-time":"2023-10-17T06:49:22Z","timestamp":1697525362000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/qss\/article\/2\/1\/155\/97572\/A-multidimensional-framework-for-characterizing"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021]]},"references-count":32,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,4,8]]}},"URL":"https:\/\/doi.org\/10.1162\/qss_a_00109","relation":{"has-review":[{"id-type":"doi","id":"10.1162\/QSS_A_00109\/v2\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00109\/v1\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00109\/v2\/response1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00109\/v1\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00109\/v1\/review2","asserted-by":"object"}]},"ISSN":["2641-3337"],"issn-type":[{"value":"2641-3337","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021]]},"published":{"date-parts":[[2021]]}}}