{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T04:01:32Z","timestamp":1772164892083,"version":"3.50.1"},"reference-count":66,"publisher":"MIT Press","issue":"2","license":[{"start":{"date-parts":[[2021,2,22]],"date-time":"2021-02-22T00:00:00Z","timestamp":1613952000000},"content-version":"vor","delay-in-days":52,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,7,15]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Research instruments play significant roles in the construction of scientific knowledge, even though we have only acquired very limited knowledge about their life cycles from quantitative studies. This paper aims to address this gap by quantitatively examining the citation contexts of an exemplary research instrument, the Diagnostic and Statistical Manual of Mental Disorders (DSM), in full-text psychological publications. We investigated the relationship between the citation contexts of the DSM and its status as a valid instrument being used and described by psychological researchers. We specifically focused on how this relationship has changed over the DSM\u2019s citation histories, especially through the temporal framework of its versions. We found that a new version of the DSM is increasingly regarded as a valid instrument after its publication; this is reflected in various key citation contexts, such as the use of hedges, attention markers, and the verb profile in sentences where the DSM is cited. We call this process the reinstrumentalization of the DSM in the space of scientific publications. Our findings bridge an important gap between quantitative and qualitative science studies and shed light on an aspect of the social process of scientific instrument development that is not addressed by the current qualitative literature.<\/jats:p>","DOI":"10.1162\/qss_a_00124","type":"journal-article","created":{"date-parts":[[2021,2,10]],"date-time":"2021-02-10T11:27:55Z","timestamp":1612956475000},"page":"678-697","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":1,"title":["The reinstrumentalization of the\n                    <i>Diagnostic and Statistical Manual of Mental Disorders<\/i>\n                    (\n                    <i>DSM<\/i>\n                    ) in psychological publications: A citation context analysis"],"prefix":"10.1162","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7264-365X","authenticated-orcid":true,"given":"Kai","family":"Li","sequence":"first","affiliation":[{"name":"School of Information Resource Management, Renmin University of China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","published-online":{"date-parts":[[2021,7,15]]},"reference":[{"key":"2021072016152436900_bib1","doi-asserted-by":"crossref","DOI":"10.1176\/appi.books.9780890425596","volume-title":"Diagnostic and statistical manual of mental disorders","author":"American Psychiatric Association","year":"2013","edition":"5th ed."},{"issue":"200,920","key":"2021072016152436900_bib2","first-page":"83","article-title":"A study of lexical distribution in citation contexts through the IMRaD standard","volume":"1","author":"Bertin","year":"2014","journal-title":"PLOS Neglected Tropical Diseases"},{"issue":"3","key":"2021072016152436900_bib3","doi-asserted-by":"crossref","first-page":"1417","DOI":"10.1007\/s11192-016-2134-8","article-title":"The linguistic patterns and rhetorical structure of citation context: an approach using n-grams","volume":"109","author":"Bertin","year":"2016","journal-title":"Scientometrics"},{"issue":"2","key":"2021072016152436900_bib4","doi-asserted-by":"crossref","first-page":"219","DOI":"10.17239\/jowr-2010.02.02.7","article-title":"A concordance-based study of the use of reporting verbs as rhetorical devices in academic papers","volume":"2","author":"Bloch","year":"2010","journal-title":"Journal of Writing Research"},{"key":"2021072016152436900_bib5","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/6352.001.0001","volume-title":"Sorting things out: Classification and its consequences","author":"Bowker","year":"2000"},{"issue":"1","key":"2021072016152436900_bib6","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1016\/j.joi.2017.12.004","article-title":"A scalable and adaptive method for finding semantically equivalent cue words of uncertainty","volume":"12","author":"Chen","year":"2018","journal-title":"Journal of Informetrics"},{"issue":"4","key":"2021072016152436900_bib7","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1177\/030631277500500403","article-title":"Content analysis of references: Adjunct or alternative to citation counting?","volume":"5","author":"Chubin","year":"1975","journal-title":"Social Studies of Science"},{"key":"2021072016152436900_bib8","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1515\/9781400863136.3","article-title":"What tools? Which jobs? Why right?","volume-title":"The right tools for the job: At work in twentieth-century life sciences","author":"Clarke","year":"1992"},{"key":"2021072016152436900_bib9","volume-title":"Objectivity","author":"Daston","year":"2010"},{"issue":"6","key":"2021072016152436900_bib10","doi-asserted-by":"crossref","first-page":"832","DOI":"10.1002\/asi.23934","article-title":"On the differences between citations and altmetrics: An investigation of factors driving altmetrics versus citations for Finnish articles","volume":"69","author":"Didegah","year":"2018","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"3","key":"2021072016152436900_bib11","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1016\/j.joi.2013.03.003","article-title":"The distribution of references across texts: Some implications for citation analysis","volume":"7","author":"Ding","year":"2013","journal-title":"Journal of Informetrics"},{"key":"2021072016152436900_bib12","first-page":"171","article-title":"When is a tool? Multiple meanings of artifacts in human activity","volume-title":"Learning, Working and Imagining: Twelve Studies in Activity Theory","author":"Engestr\u00f6m","year":"1990"},{"issue":"3","key":"2021072016152436900_bib13","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1037\/h0057532","article-title":"A new readability yardstick","volume":"32","author":"Flesch","year":"1948","journal-title":"Journal of Applied Psychology"},{"key":"2021072016152436900_bib14","doi-asserted-by":"crossref","DOI":"10.1093\/acprof:oso\/9780199278220.001.0001","volume-title":"Scientific Representation: Paradoxes of Perspective","author":"Fraassen","year":"2008"},{"issue":"1 Series II","key":"2021072016152436900_bib15","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1111\/j.2164-0947.1980.tb02769.x","article-title":"Citation measures of the influence of Robert K. Merton","volume":"39","author":"Garfield","year":"1980","journal-title":"Transactions of the New York Academy of Sciences"},{"issue":"3","key":"2021072016152436900_bib16","doi-asserted-by":"crossref","first-page":"1523","DOI":"10.1007\/s11192-016-1920-7","article-title":"Is time up for the Flesch measure of reading ease?","volume":"107","author":"Hartley","year":"2016","journal-title":"Scientometrics"},{"issue":"3","key":"2021072016152436900_bib71","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1023\/A:1025008802657","article-title":"Abstracts, introductions and discussions: How far do they differ in style?","volume":"57","author":"Hartley","year":"2003","journal-title":"Scientometrics"},{"issue":"1","key":"2021072016152436900_bib72","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1002\/bjs.5994","article-title":"Readability in the British Journal of Surgery","volume":"95","author":"Hayden","year":"2008","journal-title":"British Journal of Surgery"},{"key":"2021072016152436900_bib17","article-title":"spacy 2: Natural language understanding with bloom embeddings, convolutional neural networks and incremental parsing","author":"Honnibal","year":"2017"},{"issue":"6","key":"2021072016152436900_bib18","doi-asserted-by":"crossref","first-page":"397","DOI":"10.1002\/(SICI)1097-4571(199107)42:6<397::AID-ASI2>3.0.CO;2-N","article-title":"Frequency and functional use of cited documents in information science","volume":"42","author":"Hooten","year":"1991","journal-title":"Journal of the American Society for Information Science"},{"issue":"9","key":"2021072016152436900_bib19","doi-asserted-by":"crossref","first-page":"2137","DOI":"10.1002\/asi.23538","article-title":"Software in the scientific literature: Problems with seeing, finding, and using software mentioned in the biology literature","volume":"67","author":"Howison","year":"2015","journal-title":"Journal of the Association for Information Science and Technology"},{"issue":"1","key":"2021072016152436900_bib20","first-page":"7","article-title":"Genre analysis of moves in medical research articles","volume":"5","author":"Huang","year":"2014","journal-title":"Stylus"},{"issue":"3","key":"2021072016152436900_bib21","doi-asserted-by":"crossref","first-page":"341","DOI":"10.1093\/applin\/20.3.341","article-title":"Academic attribution: Citation and the construction of disciplinary knowledge","volume":"20","author":"Hyland","year":"1999","journal-title":"Applied Linguistics"},{"issue":"3","key":"2021072016152436900_bib22","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1002\/asi.10204","article-title":"Self-citation and self-reference: Credibility and promotion in academic publication","volume":"54","author":"Hyland","year":"2003","journal-title":"Journal of the American Society for Information Science and Technology"},{"key":"2021072016152436900_bib23","volume-title":"Metadiscourse: Exploring interaction in writing","author":"Hyland","year":"2005"},{"issue":"2","key":"2021072016152436900_bib24","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1177\/1461445605050365","article-title":"Stance and engagement: a model of interaction in academic discourse","volume":"7","author":"Hyland","year":"2005","journal-title":"Discourse Studies"},{"key":"2021072016152436900_bib25","doi-asserted-by":"crossref","DOI":"10.4324\/9780203413845","volume-title":"States of knowledge: the co-production of science and the social order","author":"Jasanoff","year":"2004"},{"issue":"1","key":"2021072016152436900_bib26","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1017\/S1351324915000443","article-title":"NLP-driven citation analysis for scientometrics","volume":"23","author":"Jha","year":"2017","journal-title":"Natural Language Engineering"},{"issue":"4","key":"2021072016152436900_bib27","article-title":"Facilitating scholarly publication: Genre characteristics of English research article Introductions and Methods","volume":"18","author":"Kanoksilapatham","year":"2012","journal-title":"3L: Language, Linguistics, Literature"},{"key":"2021072016152436900_bib28","doi-asserted-by":"crossref","DOI":"10.4159\/9780674039681","volume-title":"Epistemic cultures: How the sciences make knowledge","author":"Knorr-Cetina","year":"1999"},{"key":"2021072016152436900_bib29","article-title":"Patterns in citation context: The case of the field of scientometrics","volume-title":"23rd International Conference on Science and Technology Indicators (STI 2018)","author":"Lamers","year":"2018"},{"key":"2021072016152436900_bib30","doi-asserted-by":"crossref","first-page":"602","DOI":"10.1016\/B978-0-12-809633-8.20409-3","article-title":"Text mining for bioinformatics using biomedical literature","volume":"1","author":"Lamurias","year":"2019","journal-title":"Encyclopedia of Bioinformatics and Computational Biology"},{"issue":"6","key":"2021072016152436900_bib31","doi-asserted-by":"crossref","first-page":"1157","DOI":"10.1002\/asi.23044","article-title":"arXiv E-prints and the journal of record: An analysis of roles and relationships","volume":"65","author":"Larivi\u00e8re","year":"2014","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"2021072016152436900_bib32","volume-title":"Science in action: How to follow scientists and engineers through society","author":"Latour","year":"1987"},{"key":"2021072016152436900_bib33","volume-title":"Laboratory life: The construction of scientific facts","author":"Latour","year":"1979"},{"key":"2021072016152436900_bib34","doi-asserted-by":"crossref","DOI":"10.1162\/qss_e_00061","volume-title":"Bridging the divide between qualitative and quantitative science studies","author":"Leydesdorff","year":"2020"},{"issue":"1","key":"2021072016152436900_bib35","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1016\/j.joi.2019.02.007","article-title":"Challenges of measuring software impact through citations: An examination of the lme4 R package","volume":"13","author":"Li","year":"2019","journal-title":"Journal of Informetrics"},{"issue":"4","key":"2021072016152436900_bib36","doi-asserted-by":"crossref","first-page":"989","DOI":"10.1016\/j.joi.2017.08.003","article-title":"How is R cited in research outputs? Structure, impacts, and citation standard","volume":"11","author":"Li","year":"2017","journal-title":"Journal of Informetrics"},{"key":"2021072016152436900_bib37","doi-asserted-by":"crossref","first-page":"129","DOI":"10.7551\/mitpress\/9445.003.0011","article-title":"Obliteration by incorporation","volume-title":"Beyond bibliometrics: Harnessing multidimensional indicators of scholarly impact","author":"McCain","year":"2014"},{"issue":"3","key":"2021072016152436900_bib38","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1177\/0165551506064397","article-title":"How influential is Brooks\u2019 law? A longitudinal citation context analysis of Frederick Brooks\u2019 The Mythical Man-Month","volume":"32","author":"McCain","year":"2006","journal-title":"Journal of Information Science"},{"issue":"1","key":"2021072016152436900_bib39","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1007\/BF02017729","article-title":"Citation context analysis and aging patterns of journal articles in molecular genetics","volume":"17","author":"McCain","year":"1989","journal-title":"Scientometrics"},{"key":"2021072016152436900_bib40","volume-title":"Contemporary directions in psychopathology: Toward the DSM-IV","author":"Millon","year":"1986"},{"issue":"6","key":"2021072016152436900_bib41","doi-asserted-by":"crossref","first-page":"1473","DOI":"10.1016\/j.comppsych.2014.04.006","article-title":"Reliability and validity of the Arizona Sexual Experiences Scale-Arabic version in Tunisian patients with schizophrenia","volume":"55","author":"Nakhli","year":"2014","journal-title":"Comprehensive Psychiatry"},{"issue":"1","key":"2021072016152436900_bib42","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1007\/s11192-017-2466-z","article-title":"On academic reading: citation patterns and beyond","volume":"113","author":"Oleinik","year":"2017","journal-title":"Scientometrics"},{"key":"2021072016152436900_bib43","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1109\/BigData.2013.6691588","article-title":"Scalable data citation in dynamic, large databases: Model and reference implementation","volume-title":"Proceedings of the 2013 IEEE International Conference on Big Data (Big Data 2013)","author":"Pr\u00f6ll","year":"2013"},{"issue":"6","key":"2021072016152436900_bib44","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1176\/appi.ajp.2009.09020279","article-title":"The conceptual development of DSM-V","volume":"166","author":"Regier","year":"2009","journal-title":"American Journal of Psychiatry"},{"key":"2021072016152436900_bib45","volume-title":"Toward a history of epistemic things: Synthesizing proteins in the test tube","author":"Rheinberger","year":"1997"},{"key":"2021072016152436900_bib46","doi-asserted-by":"crossref","first-page":"101437","DOI":"10.1016\/j.poetic.2020.101437","article-title":"The socio-semantic space of John Mohr","author":"Roth","year":"2020","journal-title":"Poetics"},{"key":"2021072016152436900_bib47","first-page":"287","article-title":"Citation context analysis","volume":"3","author":"Small","year":"1982","journal-title":"Progress in Communication Sciences"},{"issue":"2","key":"2021072016152436900_bib48","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1016\/j.joi.2018.03.007","article-title":"Characterizing highly cited method and non-method papers using citation contexts: The role of uncertainty","volume":"12","author":"Small","year":"2018","journal-title":"Journal of Informetrics"},{"issue":"3","key":"2021072016152436900_bib49","doi-asserted-by":"crossref","first-page":"1079","DOI":"10.1007\/s11192-019-03016-z","article-title":"Citations and certainty: A new interpretation of citation counts","volume":"118","author":"Small","year":"2019","journal-title":"Scientometrics"},{"issue":"1","key":"2021072016152436900_bib50","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1016\/j.joi.2016.11.001","article-title":"Discovering discoveries: Identifying biomedical discoveries using citation contexts","volume":"11","author":"Small","year":"2017","journal-title":"Journal of Informetrics"},{"key":"2021072016152436900_bib51","doi-asserted-by":"crossref","first-page":"e86","DOI":"10.7717\/peerj-cs.86","article-title":"Software citation principles","volume":"2","author":"Smith","year":"2016","journal-title":"PeerJ Computer Science"},{"key":"2021072016152436900_bib52","volume-title":"Genre analysis: English in academic and research settings","author":"Swales","year":"1990"},{"issue":"5","key":"2021072016152436900_bib53","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1016\/j.jpsychores.2004.09.007","article-title":"Posttraumatic stress disorder in a psychosomatic outpatient clinic: Gender effects, psychosocial functioning, sense of coherence, and service utilization","volume":"58","author":"Tagay","year":"2005","journal-title":"Journal of Psychosomatic Research"},{"issue":"2","key":"2021072016152436900_bib54","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1108\/00220410810858047","article-title":"Author-rated importance of cited references in biology and psychology publications","volume":"64","author":"Tang","year":"2008","journal-title":"Journal of Documentation"},{"issue":"2","key":"2021072016152436900_bib55","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1016\/j.joi.2019.03.002","article-title":"The rhetorical structure of science? A multidisciplinary analysis of article headings","volume":"13","author":"Thelwall","year":"2019","journal-title":"Journal of Informetrics"},{"issue":"3","key":"2021072016152436900_bib56","doi-asserted-by":"crossref","first-page":"588","DOI":"10.1016\/j.comppsych.2013.11.017","article-title":"Panic disorder and agoraphobia in OCD patients: Clinical profile and possible treatment implications","volume":"55","author":"Torres","year":"2014","journal-title":"Comprehensive Psychiatry"},{"issue":"15","key":"2021072016152436900_bib57","doi-asserted-by":"crossref","first-page":"1035","DOI":"10.1016\/j.jpsychires.2010.03.012","article-title":"Emotional eating in adolescents: A gene (SLC6A4\/5-HTT)\u2013Depressive feelings interaction analysis","volume":"44","author":"van Strien","year":"2010","journal-title":"Journal of Psychiatric Research"},{"issue":"3","key":"2021072016152436900_bib58","doi-asserted-by":"crossref","first-page":"1601","DOI":"10.1007\/s11192-013-1154-x","article-title":"What a difference a colon makes: How superficial factors influence subsequent citation","volume":"98","author":"Van Wesel","year":"2014","journal-title":"Scientometrics"},{"issue":"6","key":"2021072016152436900_bib59","first-page":"19","article-title":"Are all citations equal? Or, did we op. cit. your idem?","volume":"1","author":"Voos","year":"1976","journal-title":"Journal of Academic Librarianship"},{"issue":"2","key":"2021072016152436900_bib60","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1016\/S0191-8869(02)00204-0","article-title":"Borderline personality traits correlate with death penalty decisions","volume":"35","author":"Watson","year":"2003","journal-title":"Personality and Individual Differences"},{"key":"2021072016152436900_bib61","volume-title":"The harmony of illusions: Inventing post-traumatic stress disorder","author":"Young","year":"1997"},{"issue":"1","key":"2021072016152436900_bib62","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1515\/jdis-2017-0003","article-title":"Functions of uni-and multi-citations: Implications for weighted citation analysis","volume":"2","author":"Zhao","year":"2017","journal-title":"Journal of Data and Information Science"},{"issue":"1","key":"2021072016152436900_bib63","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1007\/s11192-019-03280-z","article-title":"Deep and narrow impact: Introducing location filtered citation counting","volume":"122","author":"Zhao","year":"2020","journal-title":"Scientometrics"},{"issue":"1","key":"2021072016152436900_bib64","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1002\/asi.23919","article-title":"Data set mentions and citations: A content analysis of full-text publications","volume":"69","author":"Zhao","year":"2018","journal-title":"Journal of the Association for Information Science and Technology"}],"container-title":["Quantitative Science Studies"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/qss\/article-pdf\/2\/2\/678\/1930708\/qss_a_00124.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/qss\/article-pdf\/2\/2\/678\/1930708\/qss_a_00124.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,23]],"date-time":"2024-08-23T20:26:27Z","timestamp":1724444787000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/qss\/article\/2\/2\/678\/96158\/The-reinstrumentalization-of-the-Diagnostic-and"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021]]},"references-count":66,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,7,15]]}},"URL":"https:\/\/doi.org\/10.1162\/qss_a_00124","relation":{"has-review":[{"id-type":"doi","id":"10.1162\/QSS_A_00124\/v2\/review2","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00124\/v1\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00124\/v2\/response1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00124\/v2\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00124\/v1\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00124\/v3\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00124\/v1\/review2","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00124\/v2\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1162\/QSS_A_00124\/v3\/response1","asserted-by":"object"}]},"ISSN":["2641-3337"],"issn-type":[{"value":"2641-3337","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021]]},"published":{"date-parts":[[2021]]}}}