{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,12]],"date-time":"2026-07-12T03:11:46Z","timestamp":1783825906791,"version":"3.55.0"},"reference-count":34,"publisher":"MIT Press","issue":"4","license":[{"start":{"date-parts":[[2024,9,4]],"date-time":"2024-09-04T00:00:00Z","timestamp":1725408000000},"content-version":"vor","delay-in-days":247,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,11,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Assessing the disruptive nature of a line of research is a new area of academic evaluation that moves beyond standard citation-based metrics by taking into account the broader citation context of publications or patents. The \u201cCD index\u201d and a number of related indicators have been proposed in order to characterize the disruptiveness of scientific publications or patents. This research area has generated a lot of attention in recent years, yet there is no general consensus on the significance and reliability of disruption indices. More experimentation and evaluation would be desirable, but it is hampered by the fact that the calculation of these indicators is time-consuming, especially if done at scale on large citation networks. We present a novel SQL-based method to calculate disruption indices for the Dimensions publications data on Google BigQuery. This reduces the computational time taken to produce such indices by an order of magnitude, as well as making available such functionalities within an online environment that requires no setup efforts. We explain the novel algorithm and describe how its results align with preexisting implementations of disruption indicators. This method will enable researchers to develop, validate, and improve disruption models more quickly and with more precision.<\/jats:p>","DOI":"10.1162\/qss_a_00328","type":"journal-article","created":{"date-parts":[[2024,9,4]],"date-time":"2024-09-04T14:47:19Z","timestamp":1725461239000},"page":"975-990","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":1,"title":["Dimensions: Calculating disruption indices at scale"],"prefix":"10.1162","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3475-6426","authenticated-orcid":true,"given":"Joerg","family":"Sixt","sequence":"first","affiliation":[{"name":"Digital Science & Research Solutions Ltd., London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8909-7766","authenticated-orcid":true,"given":"Michele","family":"Pasin","sequence":"additional","affiliation":[{"name":"Digital Science & Research Solutions Ltd., London, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","published-online":{"date-parts":[[2024,11,1]]},"reference":[{"issue":"12","key":"2024122514552800700_bib1","doi-asserted-by":"publisher","first-page":"893","DOI":"10.1016\/j.crad.2022.07.003","article-title":"Extra credit for disruption: Trend of disruption in radiology academic journals","volume":"77","author":"Abu-Omar","year":"2022","journal-title":"Clinical Radiology"},{"issue":"5252","key":"2024122514552800700_bib2","doi-asserted-by":"publisher","first-page":"1209","DOI":"10.1038\/2261209a0","article-title":"Viral RNA-dependent DNA polymerase: RNA-dependent DNA polymerase in virions of RNA tumour viruses","volume":"226","author":"Baltimore","year":"1970","journal-title":"Nature"},{"issue":"2","key":"2024122514552800700_bib3","doi-asserted-by":"publisher","first-page":"2350006","DOI":"10.1142\/S0219525923500066","article-title":"Is disruption decreasing, or is it accelerating?","volume":"26","author":"Bentley","year":"2023","journal-title":"Advances in Complex Systems"},{"issue":"2","key":"2024122514552800700_bib4","doi-asserted-by":"publisher","DOI":"10.3145\/epi.2019.mar.07","article-title":"Disruption index depends on length of citation window","volume":"28","author":"Bornmann","year":"2019","journal-title":"El Profesional de la Informaci\u00f3n"},{"issue":"1","key":"2024122514552800700_bib5","doi-asserted-by":"publisher","first-page":"331","DOI":"10.1007\/s11192-019-03113-z","article-title":"Disruptive papers published in Scientometrics","volume":"120","author":"Bornmann","year":"2019","journal-title":"Scientometrics"},{"issue":"3","key":"2024122514552800700_bib6","doi-asserted-by":"publisher","first-page":"1242","DOI":"10.1162\/qss_a_00068","article-title":"Are disruption index indicators convergently valid? The comparison of several indicator variants with assessments by peers","volume":"1","author":"Bornmann","year":"2020","journal-title":"Quantitative Science Studies"},{"key":"2024122514552800700_bib7","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1901.09663","article-title":"A multi-dimensional framework for characterizing the citation impact of scientific publications","author":"Bu","year":"2019","journal-title":"arXiv"},{"issue":"1","key":"2024122514552800700_bib8","doi-asserted-by":"publisher","first-page":"104115","DOI":"10.1016\/j.respol.2020.104115","article-title":"Destabilization and consolidation: Conceptualizing, measuring, and validating the dual characteristics of technology","volume":"50","author":"Chen","year":"2021","journal-title":"Research Policy"},{"key":"2024122514552800700_bib9","article-title":"COVID-19: Dataset of global research by Dimensions","year":"2023"},{"key":"2024122514552800700_bib10","volume-title":"Dimensions GBQ documention for the publications table","author":"Dimensions","year":"2023"},{"issue":"6379","key":"2024122514552800700_bib11","doi-asserted-by":"publisher","first-page":"eaao0185","DOI":"10.1126\/science.aao0185","article-title":"Science of science","volume":"359","author":"Fortunato","year":"2018","journal-title":"Science"},{"key":"2024122514552800700_bib12","volume-title":"cdindex. A Python package, written in C, for computing the CD index and other dynamic measures on evolving directed graphs","author":"Funk","year":"2017"},{"issue":"3","key":"2024122514552800700_bib13","doi-asserted-by":"publisher","first-page":"791","DOI":"10.1287\/mnsc.2015.2366","article-title":"A dynamic network measure of technological change","volume":"63","author":"Funk","year":"2017","journal-title":"Management Science"},{"key":"2024122514552800700_bib14","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.7585311","volume-title":"fast-cdindex V1.2.0","author":"Funk","year":"2023"},{"key":"2024122514552800700_bib15","volume-title":"Count function","author":"Google","year":"2023"},{"issue":"8","key":"2024122514552800700_bib16","doi-asserted-by":"publisher","first-page":"2385","DOI":"10.31557\/APJCP.2021.22.8.2385","article-title":"100 disruptive publications in breast cancer research","volume":"22","author":"Grunvald","year":"2021","journal-title":"Asian Pacific Journal of Cancer Prevention"},{"issue":"3","key":"2024122514552800700_bib17","doi-asserted-by":"publisher","first-page":"e3446","DOI":"10.1097\/GOX.0000000000003446","article-title":"The 100 most-disruptive articles in plastic and reconstructive surgery and sub-specialties (1954\u20132014)","volume":"9","author":"Hansdorfer","year":"2021","journal-title":"Plastic and Reconstructive Surgery\u2013Global Open"},{"key":"2024122514552800700_bib18","doi-asserted-by":"publisher","first-page":"656233","DOI":"10.3389\/frma.2021.656233","article-title":"Scaling scientometrics: Dimensions on Google BigQuery as an infrastructure for large-scale analysis","volume":"6","author":"Hook","year":"2021","journal-title":"Frontiers in Research Metrics and Analytics"},{"issue":"7","key":"2024122514552800700_bib19","doi-asserted-by":"publisher","first-page":"2426","DOI":"10.1097\/SCS.0000000000007804","article-title":"The most disruptive publications in craniofacial surgery (1954\u20132014)","volume":"32","author":"Horen","year":"2021","journal-title":"Journal of Craniofacial Surgery"},{"key":"2024122514552800700_bib20","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1016\/j.urology.2020.10.073","article-title":"Changing the status quo: The 100 most-disruptive papers in urology?","volume":"153","author":"Khusid","year":"2021","journal-title":"Urology"},{"key":"2024122514552800700_bib21","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-34668-2_6","article-title":"Study on the identification of disruptive technology, evidence from nano science","volume-title":"Proceedings of the 11th International Conference on Distributed, Ambient and Pervasive Interactions (DAPI 2023) held as part of the 25th International Conference on Human-Computer Interaction (HCII 2023)","author":"Kong","year":"2023"},{"key":"2024122514552800700_bib22","doi-asserted-by":"publisher","DOI":"10.7208\/chicago\/9780226458106.001.0001","volume-title":"The structure of scientific revolutions","author":"Kuhn","year":"1962"},{"key":"2024122514552800700_bib23","doi-asserted-by":"publisher","first-page":"601","DOI":"10.1007\/s11192-023-04873-5","article-title":"What do we know about the disruption index in scientometrics? An overview of the literature","volume":"129","author":"Leibel","year":"2023","journal-title":"Scientometrics"},{"issue":"1","key":"2024122514552800700_bib24","doi-asserted-by":"publisher","DOI":"10.3145\/epi.2021.ene.21","article-title":"A proposal to revise the disruption index","volume":"30","author":"Leydesdorff","year":"2021","journal-title":"El Profesional de la Informaci\u00f3n"},{"issue":"7942","key":"2024122514552800700_bib25","doi-asserted-by":"publisher","first-page":"138","DOI":"10.1038\/s41586-022-05543-x","article-title":"Papers and patents are becoming less disruptive over time","volume":"613","author":"Park","year":"2023","journal-title":"Nature"},{"key":"2024122514552800700_bib26","doi-asserted-by":"publisher","DOI":"10.6084\/m9.figshare.24100680","volume-title":"Calculating disruption indices at scale with Dimensions\u2014Supplementary material","author":"Pasin","year":"2023"},{"key":"2024122514552800700_bib27","volume-title":"Conjectures and refutations: The growth of scientific knowledge","author":"Popper","year":"1969"},{"issue":"11","key":"2024122514552800700_bib28","doi-asserted-by":"publisher","first-page":"e0294946","DOI":"10.1371\/journal.pone.0294946","article-title":"Open reproducible scientometric research with Alexandria3k","volume":"18","author":"Spinellis","year":"2023","journal-title":"PLOS ONE"},{"issue":"8","key":"2024122514552800700_bib29","doi-asserted-by":"publisher","first-page":"1263","DOI":"10.1016\/j.jpedsurg.2021.02.002","article-title":"Shifting paradigms: The top 100 most disruptive papers in core pediatric surgery journals","volume":"56","author":"Sullivan","year":"2021","journal-title":"Journal of Pediatric Surgery"},{"issue":"2","key":"2024122514552800700_bib30","doi-asserted-by":"publisher","first-page":"430","DOI":"10.1016\/j.joi.2018.03.006","article-title":"Dimensions: A competitor to Scopus and the Web of Science?","volume":"12","author":"Thelwall","year":"2018","journal-title":"Journal of Informetrics"},{"issue":"1","key":"2024122514552800700_bib31","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1162\/qss_a_00112","article-title":"Large-scale comparison of bibliographic data sources: Scopus, Web of Science, Dimensions, Crossref, and Microsoft Academic","volume":"2","author":"Visser","year":"2021","journal-title":"Quantitative Science Studies"},{"key":"2024122514552800700_bib32","article-title":"Nobel-Prize-winning papers are significantly more highly-cited but not more disruptive than non-prize-winning counterparts","volume-title":"Proceedings of the 15th International Conference on Information (iConference 2020)","author":"Wei","year":"2020"},{"issue":"7744","key":"2024122514552800700_bib33","doi-asserted-by":"publisher","first-page":"378","DOI":"10.1038\/s41586-019-0941-9","article-title":"Large teams develop and small teams disrupt science and technology","volume":"566","author":"Wu","year":"2019","journal-title":"Nature"},{"key":"2024122514552800700_bib34","doi-asserted-by":"publisher","DOI":"10.31235\/osf.io\/d3wpk","article-title":"A confusing definition of disruption","author":"Wu","year":"2019","journal-title":"SocArXiv"}],"container-title":["Quantitative Science Studies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/qss\/article-pdf\/5\/4\/975\/2478577\/qss_a_00328.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/qss\/article-pdf\/5\/4\/975\/2478577\/qss_a_00328.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,25]],"date-time":"2024-12-25T09:55:36Z","timestamp":1735120536000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/qss\/article\/5\/4\/975\/124268\/Dimensions-Calculating-disruption-indices-at-scale"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024]]},"references-count":34,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2024,11,1]]}},"URL":"https:\/\/doi.org\/10.1162\/qss_a_00328","relation":{"has-review":[{"id-type":"doi","id":"10.1162\/QSS_A_00328\/v1\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00328\/v2\/response1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00328\/v1\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00328\/v1\/review2","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00328\/v2\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00328\/v1\/review3","asserted-by":"object"}]},"ISSN":["2641-3337"],"issn-type":[{"value":"2641-3337","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024]]},"published":{"date-parts":[[2024]]}}}