{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,1]],"date-time":"2026-07-01T06:14:03Z","timestamp":1782886443103,"version":"3.54.5"},"reference-count":71,"publisher":"MIT Press","issue":"4","license":[{"start":{"date-parts":[[2021,10,12]],"date-time":"2021-10-12T00:00:00Z","timestamp":1633996800000},"content-version":"vor","delay-in-days":284,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,12,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Controlling for confounding factors is one of the central aspects of quantitative research. Although methods such as linear regression models are common, their results can be misleading under certain conditions. We demonstrate how statistical matching can be utilized as an alternative that enables the inspection of post-matching balancing. This contribution serves as an empirical demonstration of matching in bibliometrics and discusses the advantages and potential pitfalls. We propose matching as an easy-to-use approach in bibliometrics to estimate effects and remove bias. To exemplify matching, we use data about papers published in Physical Review E and a selection classified as milestone papers. We analyze whether milestone papers score higher in terms of a proposed class of indicators for measuring disruptiveness than nonmilestone papers. We consider disruption indicators DI1, DI5, DI1n, DI5n, and DEP and test which of the disruption indicators performs best, based on the assumption that milestone papers should have higher disruption indicator values than nonmilestone papers. Four matching algorithms (propensity score matching (PSM), coarsened exact matching (CEM), entropy balancing (EB), and inverse probability weighting (IPTW)) are compared. We find that CEM and EB perform best regarding covariate balancing and DI5 and DEP performing well to evaluate disruptiveness of published papers.<\/jats:p>","DOI":"10.1162\/qss_a_00158","type":"journal-article","created":{"date-parts":[[2021,10,17]],"date-time":"2021-10-17T17:45:12Z","timestamp":1634492712000},"page":"1246-1270","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":21,"title":["Applied usage and performance of statistical matching in bibliometrics: The comparison of milestone and regular papers with multiple measurements of disruptiveness as an empirical example"],"prefix":"10.1162","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0802-5854","authenticated-orcid":true,"given":"Felix","family":"Bittmann","sequence":"first","affiliation":[{"name":"Leibniz Institute for Educational Trajectories (Lifbi), Wilhelmsplatz 3, 96047 Bamberg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8765-9331","authenticated-orcid":true,"given":"Alexander","family":"Tekles","sequence":"additional","affiliation":[{"name":"Science Policy and Strategy Department, Administrative Headquarters of the Max Planck Society, Hofgartenstr. 8, 80539 Munich, Germany"},{"name":"Ludwig-Maximilians-Universit\u00e4t Munich, Department of Sociology, Konradstr. 6, 80801 Munich, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0810-7091","authenticated-orcid":true,"given":"Lutz","family":"Bornmann","sequence":"additional","affiliation":[{"name":"Science Policy and Strategy Department, Administrative Headquarters of the Max Planck Society, Hofgartenstr. 8, 80539 Munich, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"281","published-online":{"date-parts":[[2021,12,1]]},"reference":[{"issue":"490","key":"2022040819221815400_bib1","doi-asserted-by":"publisher","first-page":"493","DOI":"10.1198\/jasa.2009.ap08746","article-title":"Synthetic control methods for comparative case studies: Estimating the effect of California\u2019s tobacco control program","volume":"105","author":"Abadie","year":"2010","journal-title":"Journal of the American Statistical Association"},{"issue":"2","key":"2022040819221815400_bib2","doi-asserted-by":"publisher","first-page":"781","DOI":"10.3982\/ECTA11293","article-title":"Matching on the estimated propensity score","volume":"84","author":"Abadie","year":"2016","journal-title":"Econometrica"},{"issue":"5","key":"2022040819221815400_bib3","doi-asserted-by":"publisher","first-page":"728","DOI":"10.1002\/asi.23986","article-title":"Exploring the relation between referencing practices and citation impact: A large-scale study based on Web of Science data","volume":"69","author":"Ahlgren","year":"2018","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"2","key":"2022040819221815400_bib4","first-page":"491","article-title":"Examination of entropy balancing technique for estimating some standard measures of treatment effects: A simulation study","volume":"12","author":"Amusa","year":"2019","journal-title":"Electronic Journal of Applied Statistical Analysis"},{"issue":"11","key":"2022040819221815400_bib5","doi-asserted-by":"publisher","first-page":"1623","DOI":"10.1002\/sim.8502","article-title":"Variance estimation when using propensity-score matching with replacement with survival or time-to-event outcomes","volume":"39","author":"Austin","year":"2020","journal-title":"Statistics in Medicine"},{"issue":"28","key":"2022040819221815400_bib6","doi-asserted-by":"publisher","first-page":"3661","DOI":"10.1002\/sim.6607","article-title":"Moving towards best practice when using inverse probability of treatment weighting (IPTW) using the propensity score to estimate causal treatment effects in observational studies","volume":"34","author":"Austin","year":"2015","journal-title":"Statistics in Medicine"},{"issue":"3","key":"2022040819221815400_bib7","doi-asserted-by":"publisher","first-page":"399","DOI":"10.1023\/B:SCIE.0000034382.85360.cd","article-title":"Does collaborative research have greater epistemic authority?","volume":"60","author":"Beaver","year":"2004","journal-title":"Scientometrics"},{"key":"2022040819221815400_bib8","doi-asserted-by":"publisher","DOI":"10.1515\/9783110617160","volume-title":"Stata: A really short introduction","author":"Bittmann","year":"2019"},{"key":"2022040819221815400_bib9","doi-asserted-by":"publisher","DOI":"10.1515\/9783110693348","volume-title":"Bootstrapping. An integrated approach with Python and Stata","author":"Bittmann","year":"2021"},{"issue":"3","key":"2022040819221815400_bib10","doi-asserted-by":"publisher","first-page":"1242","DOI":"10.1162\/qss_a_00068","article-title":"Are disruption index indicators convergently valid? The comparison of several indicator variants with assessments by peers","volume":"1","author":"Bornmann","year":"2019","journal-title":"Quantitative Science Studies"},{"issue":"2","key":"2022040819221815400_bib11","doi-asserted-by":"publisher","first-page":"1149","DOI":"10.1007\/s11192-020-03406-8","article-title":"Disruptive papers published in Scientometrics: Meaningful results by using an improved variant of the disruption index originally proposed by Wu, Wang and Evans (2019)","volume":"123","author":"Bornmann","year":"2020","journal-title":"Scientometrics"},{"issue":"2","key":"2022040819221815400_bib12","doi-asserted-by":"publisher","first-page":"e280207","DOI":"10.3145\/epi.2019.mar.07","article-title":"Disruption index depends on length of citation window","volume":"28","author":"Bornmann","year":"2019","journal-title":"El profesional de la informaci\u00f3n"},{"key":"2022040819221815400_bib13","doi-asserted-by":"crossref","DOI":"10.1016\/j.joi.2021.101159","article-title":"Convergent validity of several indicators measuring disruptiveness with milestone assignments to physics papers by experts","volume-title":"Journal of Informetrics","author":"Bornmann","year":"2021"},{"issue":"1","key":"2022040819221815400_bib14","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1162\/qss_a_00109","article-title":"A multi-dimensional framework for characterizing the citation impact of scientific publications","volume":"2","author":"Bu","year":"2021","journal-title":"Quantitative Science Studies"},{"issue":"1","key":"2022040819221815400_bib15","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1111\/j.1467-6419.2007.00527.x","article-title":"Some practical guidance for the implementation of propensity score matching","volume":"22","author":"Caliendo","year":"2008","journal-title":"Journal of Economic Surveys"},{"key":"2022040819221815400_bib16","volume-title":"boot: Bootstrap R (S-Plus) functions","author":"Canty","year":"2021"},{"issue":"19","key":"2022040819221815400_bib17","doi-asserted-by":"publisher","first-page":"2265","DOI":"10.1002\/(SICI)1097-0258(19981015)17:19&lt;2265::AID-SIM918&gt;3.0.CO;2-B","article-title":"Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group","volume":"17","author":"D\u2019Agostino","year":"1998","journal-title":"Statistics in Medicine"},{"issue":"1","key":"2022040819221815400_bib18","doi-asserted-by":"publisher","first-page":"271","DOI":"10.1111\/j.0081-1750.2004.00154.x","article-title":"Assessing bias in the estimation of causal effects: Rosenbaum bounds on matching estimators and instrumental variables estimation with imperfect instruments","volume":"34","author":"DiPrete","year":"2004","journal-title":"Sociological Methodology"},{"issue":"4","key":"2022040819221815400_bib19","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1080\/00031305.1976.10479172","article-title":"Aesthetic frequency classifications","volume":"30","author":"Doane","year":"1976","journal-title":"The American Statistician"},{"key":"2022040819221815400_bib20","doi-asserted-by":"publisher","DOI":"10.1201\/9780429246593","volume-title":"An introduction to the bootstrap","author":"Efron","year":"1994"},{"issue":"9","key":"2022040819221815400_bib21","doi-asserted-by":"publisher","first-page":"2201","DOI":"10.1002\/asi.23802","article-title":"Matched control groups for modeling events in citation data: An illustration of Nobel prize effects in citation networks","volume":"68","author":"Farys","year":"2017","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"2","key":"2022040819221815400_bib22","doi-asserted-by":"publisher","first-page":"376","DOI":"10.1016\/j.jeconom.2006.10.021","article-title":"Modeling the diffusion of scientific publications","volume":"139","author":"Fok","year":"2007","journal-title":"Journal of Econometrics"},{"issue":"6379","key":"2022040819221815400_bib23","doi-asserted-by":"publisher","first-page":"eaao0185","DOI":"10.1126\/science.aao0185","article-title":"Science of science","volume":"359","author":"Fortunato","year":"2018","journal-title":"Science"},{"issue":"3","key":"2022040819221815400_bib24","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1007\/s10182-007-0035-0","article-title":"On the inefficiency of propensity score matching","volume":"91","author":"Fr\u00f6lich","year":"2007","journal-title":"Advances in Statistical Analysis"},{"issue":"7","key":"2022040819221815400_bib25","doi-asserted-by":"publisher","first-page":"761","DOI":"10.1093\/aje\/kwq439","article-title":"Doubly robust estimation of causal effects","volume":"173","author":"Funk","year":"2011","journal-title":"American Journal of Epidemiology"},{"issue":"3","key":"2022040819221815400_bib26","doi-asserted-by":"publisher","first-page":"791","DOI":"10.1287\/mnsc.2015.2366","article-title":"A dynamic network measure of technological change","volume":"63","author":"Funk","year":"2017","journal-title":"Management Science"},{"issue":"2","key":"2022040819221815400_bib27","doi-asserted-by":"publisher","first-page":"517","DOI":"10.1007\/s11192-017-2593-6","article-title":"Assessing the effect of the United States\u2019 \u201ccitation advantage\u201d on other countries\u2019 scientific impact as measured in the Web of Science (WoS) database","volume":"114","author":"Gingras","year":"2018","journal-title":"Scientometrics"},{"issue":"4","key":"2022040819221815400_bib28","doi-asserted-by":"publisher","DOI":"10.1016\/j.respol.2020.103953","article-title":"Administrative discretion in scientific funding: Evidence from a prestigious postdoctoral training program","volume":"49","author":"Ginther","year":"2020","journal-title":"Research Policy"},{"issue":"3","key":"2022040819221815400_bib29","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1007\/s10758-017-9317-0","article-title":"Balancing student success: Assessing supplemental instruction through coarsened exact matching","volume":"22","author":"Guarcello","year":"2017","journal-title":"Technology, Knowledge and Learning"},{"issue":"1","key":"2022040819221815400_bib30","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1093\/pan\/mpr025","article-title":"Entropy balancing for causal effects: A multivariate reweighting method to produce balanced samples in observational studies","volume":"20","author":"Hainmueller","year":"2012","journal-title":"Political Analysis"},{"key":"2022040819221815400_bib31","author":"Hainmueller","year":"2014","journal-title":"ebal: Entropy reweighting to create balanced samples. R package version 0.1-6"},{"issue":"3","key":"2022040819221815400_bib32","doi-asserted-by":"publisher","first-page":"625","DOI":"10.1148\/radiol.14140035","article-title":"Behind the numbers: Inverse probability weighting","volume":"271","author":"Halpern","year":"2014","journal-title":"Radiology"},{"key":"2022040819221815400_bib33","volume-title":"A primer for applying propensity-score matching. Inter-American Development Bank","author":"Heinrich","year":"2010"},{"issue":"12","key":"2022040819221815400_bib34","doi-asserted-by":"publisher","first-page":"2055","DOI":"10.1002\/sim.3245","article-title":"Discussion of research using propensity-score matching: Comments on \u2018A critical appraisal of propensity-score matching in the medical literature between 1996 and 2003\u2019 by Peter Austin, Statistics in Medicine","volume":"27","author":"Hill","year":"2008","journal-title":"Statistics in Medicine"},{"issue":"8","key":"2022040819221815400_bib35","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v042.i08","article-title":"MatchIt: Nonparametric preprocessing for parametric causal inference","volume":"42","author":"Ho","year":"2011","journal-title":"Journal of Statistical Software"},{"issue":"260","key":"2022040819221815400_bib36","doi-asserted-by":"publisher","first-page":"663","DOI":"10.1080\/01621459.1952.10483446","article-title":"A generalization of sampling without replacement from a finite universe","volume":"47","author":"Horvitz","year":"1952","journal-title":"Journal of the American Statistical Association"},{"issue":"1","key":"2022040819221815400_bib37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1093\/pan\/mpr013","article-title":"Causal inference without balance checking: Coarsened exact matching","volume":"20","author":"Iacus","year":"2012","journal-title":"Political Analysis"},{"key":"2022040819221815400_bib38","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781139025751","volume-title":"Causal inference for statistics, social, and biomedical sciences: An introduction","author":"Imbens","year":"2015"},{"key":"2022040819221815400_bib39","volume-title":"KMATCH: Stata module for multivariate-distance and propensity score matching, including entropy balancing, inverse probability weighting, (coarsened) exact matching and regression adjustment","author":"Jann","year":"2017"},{"key":"2022040819221815400_bib40","doi-asserted-by":"publisher","DOI":"10.7892\/boris.101593","volume-title":"Why propensity scores should be used for matching. German Stata Users Group Meeting, Berlin","author":"Jann","year":"2017"},{"key":"2022040819221815400_bib41","doi-asserted-by":"publisher","DOI":"10.7892\/boris.130362","article-title":"Influence functions for linear regression (with an application to regression adjustment)","author":"Jann","year":"2019"},{"issue":"4","key":"2022040819221815400_bib42","doi-asserted-by":"publisher","first-page":"435","DOI":"10.1017\/pan.2019.11","article-title":"Why propensity scores should not be used for matching","volume":"27","author":"King","year":"2019","journal-title":"Political Analysis"},{"issue":"4","key":"2022040819221815400_bib43","doi-asserted-by":"publisher","first-page":"767","DOI":"10.1016\/j.joi.2013.06.006","article-title":"Accuracy of simple, initials-based methods for author name disambiguation","volume":"7","author":"Milojevi\u0107","year":"2013","journal-title":"Journal of Informetrics"},{"key":"2022040819221815400_bib44","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781107587991","volume-title":"Counterfactuals and causal inference: Methods and principles for social research","author":"Morgan","year":"2015","edition":"2nd Edn"},{"issue":"2","key":"2022040819221815400_bib45","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1016\/j.joi.2011.12.006","article-title":"Skewed citation distributions and bias factors: Solutions to two core problems with the journal impact factor","volume":"6","author":"Mutz","year":"2012","journal-title":"Journal of Informetrics"},{"issue":"9","key":"2022040819221815400_bib46","doi-asserted-by":"publisher","first-page":"2139","DOI":"10.1002\/asi.23701","article-title":"The effect of the \u201cvery important paper\u201d (VIP) designation in Angewandte Chemie International Edition on citation impact: A propensity score matching analysis","volume":"68","author":"Mutz","year":"2017","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"25","key":"2022040819221815400_bib47","doi-asserted-by":"crossref","first-page":"68","DOI":"10.56645\/jmde.v11i25.431","article-title":"Propensity scores: A practical introduction using R","volume":"11","author":"Olmos","year":"2015","journal-title":"Journal of MultiDisciplinary Evaluation"},{"issue":"4","key":"2022040819221815400_bib48","doi-asserted-by":"publisher","first-page":"739","DOI":"10.1002\/asi.23209","article-title":"Factors affecting citation rates of research articles","volume":"66","author":"Onodera","year":"2015","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"2022040819221815400_bib49","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1214\/09-SS057","article-title":"Causal inference in statistics: An overview","volume":"3","author":"Pearl","year":"2009","journal-title":"Statistics Surveys"},{"key":"2022040819221815400_bib50","volume-title":"Causal inference in statistics: A primer","author":"Pearl","year":"2016"},{"key":"2022040819221815400_bib51","volume-title":"Book of why: The new science of cause and effect","author":"Pearl","year":"2019"},{"issue":"1","key":"2022040819221815400_bib52","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1002\/(SICI)1097-4571(199401)45:1&lt;39::AID-ASI5&gt;3.0.CO;2-Q","article-title":"On determinants of citation scores: A case study in chemical engineering","volume":"45","author":"Peters","year":"1994","journal-title":"Journal of the American Society for Information Science"},{"key":"2022040819221815400_bib53","volume-title":"Physical Review E","author":"PRE Milestones","year":".."},{"issue":"18","key":"2022040819221815400_bib54","article-title":"A step-by-step guide to propensity score matching in R","volume":"19","author":"Randolph","year":"2014","journal-title":"Practical Assessment, Research & Evaluation"},{"issue":"3","key":"2022040819221815400_bib55","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1214\/ss\/1009212410","article-title":"Choice as an alternative to control in observational studies","volume":"14","author":"Rosenbaum","year":"1999","journal-title":"Statistical Science"},{"key":"2022040819221815400_bib56","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-3692-2","volume-title":"Observational studies","author":"Rosenbaum","year":"2002"},{"issue":"1","key":"2022040819221815400_bib57","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1093\/biomet\/70.1.41","article-title":"The central role of the propensity score in observational studies for causal effects","volume":"70","author":"Rosenbaum","year":"1983","journal-title":"Biometrika"},{"issue":"1","key":"2022040819221815400_bib58","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1080\/00031305.1985.10479383","article-title":"Constructing a control group using multivariate matched sampling methods that incorporate the propensity score","volume":"39","author":"Rosenbaum","year":"1985","journal-title":"The American Statistician"},{"issue":"5","key":"2022040819221815400_bib59","doi-asserted-by":"publisher","first-page":"688","DOI":"10.1037\/h0037350","article-title":"Estimating causal effects of treatments in randomized and nonrandomized studies","volume":"66","author":"Rubin","year":"1974","journal-title":"Journal of Educational Psychology"},{"issue":"1","key":"2022040819221815400_bib60","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1002\/sim.2739","article-title":"The design versus the analysis of observational studies for causal effects: Parallels with the design of randomized trials","volume":"26","author":"Rubin","year":"2007","journal-title":"Statistics in Medicine"},{"issue":"296","key":"2022040819221815400_bib61","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1111\/1475-4932.12218","article-title":"The medical care costs of mood disorders: A coarsened exact matching approach","volume":"92","author":"Schurer","year":"2016","journal-title":"Economic Record"},{"issue":"9","key":"2022040819221815400_bib62","doi-asserted-by":"publisher","first-page":"628","DOI":"10.1002\/(SICI)1097-4571(199210)43:9&lt;628::AID-ASI5&gt;3.0.CO;2-0","article-title":"The skewness of science","volume":"43","author":"Seglen","year":"1992","journal-title":"Journal of the American Society for Information Science"},{"issue":"1","key":"2022040819221815400_bib63","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1478-7954-8-6","article-title":"Deaths from heart failure: Using coarsened exact matching to correct cause-of-death statistics","volume":"8","author":"Stevens","year":"2010","journal-title":"Population Health Metrics"},{"key":"2022040819221815400_bib64","volume-title":"Propensity score matching in SPSS","author":"Thoemmes","year":"2012"},{"issue":"8","key":"2022040819221815400_bib65","doi-asserted-by":"publisher","first-page":"349","DOI":"10.1016\/S0169-5347(02)02545-4","article-title":"Gender bias in the refereeing process?","volume":"17","author":"Tregenza","year":"2002","journal-title":"Trends in Ecology & Evolution"},{"issue":"5844","key":"2022040819221815400_bib66","doi-asserted-by":"publisher","first-page":"1496","DOI":"10.1126\/science.317.5844.1496b","article-title":"Why do team-authored papers get cited more?","volume":"317","author":"Valderas","year":"2007","journal-title":"Science"},{"issue":"3","key":"2022040819221815400_bib67","doi-asserted-by":"publisher","first-page":"1601","DOI":"10.1007\/s11192-013-1154-x","article-title":"What a difference a colon makes: How superficial factors influence subsequent citation","volume":"98","author":"van Wesel","year":"2014","journal-title":"Scientometrics"},{"key":"2022040819221815400_bib68","volume-title":"Nobel-prize-winning papers are significantly more highly-cited but not more disruptive than non-prize-winning counterparts","author":"Wei","year":"2020"},{"issue":"7744","key":"2022040819221815400_bib69","doi-asserted-by":"publisher","first-page":"378","DOI":"10.1038\/s41586-019-0941-9","article-title":"Large teams develop and small teams disrupt science and technology","volume":"566","author":"Wu","year":"2019","journal-title":"Nature"},{"issue":"1","key":"2022040819221815400_bib70","first-page":"37","article-title":"Features of scientific papers and the relationships with their citation impact","volume":"19","author":"Yu","year":"2014","journal-title":"Malaysian Journal of Library & Information Science"},{"issue":"1","key":"2022040819221815400_bib71","doi-asserted-by":"publisher","first-page":"20160010","DOI":"10.1515\/jci-2016-0010","article-title":"Entropy balancing is doubly robust","volume":"5","author":"Zhao","year":"2016","journal-title":"Journal of Causal Inference"}],"container-title":["Quantitative Science Studies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/qss\/article-pdf\/2\/4\/1246\/2007908\/qss_a_00158.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/qss\/article-pdf\/2\/4\/1246\/2007908\/qss_a_00158.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,11]],"date-time":"2023-11-11T03:59:39Z","timestamp":1699675179000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/qss\/article\/2\/4\/1246\/107611\/Applied-usage-and-performance-of-statistical"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021]]},"references-count":71,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,12,1]]}},"URL":"https:\/\/doi.org\/10.1162\/qss_a_00158","relation":{"has-review":[{"id-type":"doi","id":"10.1162\/QSS_A_00158\/v2\/review2","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00158\/v1\/review2","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00158\/v1\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00158\/v2\/response1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00158\/v1\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00158\/v2\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00158\/v3\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00158\/v3\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00158\/v3\/response1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00158\/v2\/decision1","asserted-by":"object"}]},"ISSN":["2641-3337"],"issn-type":[{"value":"2641-3337","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021]]},"published":{"date-parts":[[2021]]}}}