{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,2]],"date-time":"2026-08-02T19:58:18Z","timestamp":1785700698661,"version":"3.56.0"},"reference-count":36,"publisher":"SAGE Publications","license":[{"start":{"date-parts":[[2026,7,30]],"date-time":"2026-07-30T00:00:00Z","timestamp":1785369600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["72474004"],"award-info":[{"award-number":["72474004"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Assessment"],"abstract":"<jats:p>\n                    Traditional clinical scale development is a lengthy and resource-intensive process, particularly during the empirical validation phase. This paper proposes a paradigm shift by introducing a computational pre-validation framework that leverages sentence embedding models to assess semantic properties of scale items prior to data collection. By transforming items into high-dimensional vector representations and analyzing their relationships within an MTMM-like structure, our method identifies potential item ambiguity, evaluates construct coherence, and tests discriminant validity at an early stage. We demonstrate its utility using widely used clinical instruments\u2014including the SNAP-IV, CBCL Aggressive Behavior scale, and\n                    <jats:italic toggle=\"yes\">DSM-5-TR<\/jats:italic>\n                    Oppositional Defiant Disorder (ODD) criteria\u2014revealing semantic patterns that align with established psychometric properties. While not intended to replace traditional validation, this approach offers a novel, cost-effective complement that can inform early revisions and reduce pilot testing cycles. We develop an open-source R package \u201cembedScaleValid\u201d to facilitate practical implementation. This work introduces a new perspective in clinical assessment science, integrating advances in NLP to enhance the efficiency and validity of psychological measurement tools.\n                  <\/jats:p>","DOI":"10.1177\/10731911261467602","type":"journal-article","created":{"date-parts":[[2026,7,31]],"date-time":"2026-07-31T03:33:37Z","timestamp":1785468817000},"update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["A New Perspective on Clinical Scale Validation: Leveraging Sentence Embeddings for Pre-Validation Semantic Analysis"],"prefix":"10.1177","author":[{"given":"Shicong","family":"Feng","sequence":"first","affiliation":[{"name":"Peking University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1376-9439","authenticated-orcid":false,"given":"Zhehan","family":"Jiang","sequence":"additional","affiliation":[{"name":"Peking University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaohan","family":"Wang","sequence":"additional","affiliation":[{"name":"Guilin Medical University, Guilin, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenchao","family":"Ma","sequence":"additional","affiliation":[{"name":"University of Minnesota, Minneapolis, US"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinying","family":"Ouyang","sequence":"additional","affiliation":[{"name":"Peking University, Beijing, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2026,7,30]]},"reference":[{"key":"e_1_3_1_1_5_2_1","doi-asserted-by":"crossref","unstructured":"Aggarwal C. C. Hinneburg A. Keim D. A. (2001). On the surprising behavior of distance metrics in high dimensional space. In Van den Bussche J. Vianu V. (Eds.) Database theory\u2014ICDT 2001 (pp. 420\u2013434). Springer. https:\/\/doi.org\/10.1007\/3-540-44503-X_27","DOI":"10.1007\/3-540-44503-X_27"},{"key":"e_1_3_4_2_1","volume-title":"Manual for the ASEBA school-age forms & profiles: An integrated system of multi-informant assessment","author":"Achenbach T. M.","year":"2001","unstructured":"Achenbach T. M., Rescorla L. A. (2001). Manual for the ASEBA school-age forms & profiles: An integrated system of multi-informant assessment. ASEBA."},{"key":"e_1_3_4_3_1","doi-asserted-by":"crossref","unstructured":"Achenbach T. M. Ruffle T. M. (2000). The child behavior checklist and related forms for assessing behavioral\/emotional problems and competencies. Pediatrics in Review 21(8) 265\u2013271. https:\/\/doi.org\/10.1542\/pir.21-8-265","DOI":"10.1542\/pir.21.8.265"},{"key":"e_1_3_4_4_1","doi-asserted-by":"crossref","unstructured":"Aggarwal C. C. Hinneburg A. Keim D. A. (2001). On the surprising behavior of distance metrics in high dimensional space. In Van den Bussche J. Vianu V. (Eds.) Database theory\u2014ICDT 2001 (pp. 420\u2013434). Springer. https:\/\/doi.org\/10.1007\/3-540-44503-X_27","DOI":"10.1007\/3-540-44503-X_27"},{"key":"e_1_3_4_5_1","doi-asserted-by":"crossref","unstructured":"American Psychiatric Association. (2022). Diagnostic and statistical manual of mental disorders. American Psychiatric Association Publishing. https:\/\/doi.org\/10.1176\/appi.books.9780890425787","DOI":"10.1176\/appi.books.9780890425787"},{"key":"e_1_3_4_6_1","doi-asserted-by":"crossref","unstructured":"Biederman J. Ball S. W. Monuteaux M. C. Kaiser R. Faraone S. V. (2008). CBCL clinical scales discriminate ADHD youth with structured-interview derived diagnosis of oppositional defiant disorder (ODD). Journal of Attention Disorders 12(1) 76\u201382. https:\/\/doi.org\/10.1177\/1087054707299404","DOI":"10.1177\/1087054707299404"},{"key":"e_1_3_4_7_1","unstructured":"Blackstone A. (2018). Principles of sociological inquiry: Qualitative and quantitative methods. Saylor Academy Open Textbooks. https:\/\/openlibrary-repo.ecampusontario.ca\/jspui\/handle\/123456789\/296"},{"key":"e_1_3_4_8_1","doi-asserted-by":"crossref","unstructured":"Bradley L. Noble N. Hendricks B. (2023). DSM-5-TR: Salient changes. The Family Journal 31(1) 5\u201310. https:\/\/doi.org\/10.1177\/10664807221123558","DOI":"10.1177\/10664807221123558"},{"key":"e_1_3_4_9_1","doi-asserted-by":"crossref","unstructured":"Bussing R. Fernandez M. Harwood M. Hou W. Garvan C. W. Eyberg S. M. Swanson J. M. (2008). Parent and teacher SNAP-IV ratings of attention deficit hyperactivity disorder symptoms: Psychometric properties and normative ratings from a school district sample. Assessment 15(3) 317\u2013328. https:\/\/doi.org\/10.1177\/1073191107313888","DOI":"10.1177\/1073191107313888"},{"key":"e_1_3_4_10_1","doi-asserted-by":"crossref","unstructured":"Campbell D. T. Fiske D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin 56(2) 81\u2013105. https:\/\/doi.org\/10.1037\/h0046016","DOI":"10.1037\/h0046016"},{"key":"e_1_3_4_11_1","unstructured":"Cao H. (2024). Recent advances in text embedding: A comprehensive review of top-performing methods on the MTEB benchmark. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2406.01607"},{"key":"e_1_3_4_12_1","doi-asserted-by":"crossref","unstructured":"Costa D. S. de Paula J. J. Malloy-Diniz L. F. Romano-Silva M. A. Miranda D. M. (2019). Parent SNAP-IV rating of attention-deficit\/hyperactivity disorder: Accuracy in a clinical sample of ADHD validity and reliability in a Brazilian sample. Jornal de Pediatria 95(6) 736\u2013743. https:\/\/doi.org\/10.1016\/j.jped.2018.06.014","DOI":"10.1016\/j.jped.2018.06.014"},{"key":"e_1_3_4_13_1","volume-title":"Scale development: Theory and applications","author":"DeVellis R. F.","year":"2016","unstructured":"DeVellis R. F. (2016). Scale development: Theory and applications. SAGE Publications."},{"key":"e_1_3_4_14_1","volume-title":"Scale development: Theory and applications","author":"DeVellis R. F.","year":"2021","unstructured":"DeVellis R. F., Thorpe C. T. (2021). Scale development: Theory and applications. SAGE Publications."},{"key":"e_1_3_4_15_1","unstructured":"Devlin J. Chang M.-W. Lee K. Toutanova K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv. https:\/\/doi.org\/10.48550\/arXiv.1810.04805"},{"key":"e_1_3_4_16_1","doi-asserted-by":"crossref","unstructured":"Fang Q. Nguyen D. Oberski D. L. (2022). Evaluating the construct validity of text embeddings with application to survey questions. EPJ Data Science 11(1) Article 1. https:\/\/doi.org\/10.1140\/epjds\/s13688-022-00353-7","DOI":"10.1140\/epjds\/s13688-022-00353-7"},{"key":"e_1_3_4_17_1","doi-asserted-by":"crossref","unstructured":"Gau S. S.-F. Shang C.-Y. Liu S.-K. Lin C.-H. Swanson J. M. Liu Y.-C. Tu C.-L. (2008). Psychometric properties of the Chinese version of the Swanson Nolan and Pelham version IV scale\u2014parent form. International Journal of Methods in Psychiatric Research 17(1) 35\u201344. https:\/\/doi.org\/10.1002\/mpr.237","DOI":"10.1002\/mpr.237"},{"key":"e_1_3_4_18_1","doi-asserted-by":"crossref","unstructured":"Gillioz A. Casas J. Mugellini E. Khaled O. A. (2020). Overview of the transformer-based models for NLP tasks. Annals of Computer Science and Information Systems 21 179\u2013183. https:\/\/doi.org\/10.15439\/2020F20","DOI":"10.15439\/2020F20"},{"key":"e_1_3_4_19_1","doi-asserted-by":"crossref","unstructured":"Inoue Y. Ito K. Kita Y. Inagaki M. Kaga M. Swanson J. M. (2014). Psychometric properties of Japanese version of the Swanson Nolan and Pelham version-IV scale-teacher form: A study of school children in community samples. Brain and Development 36(8) 700\u2013706. https:\/\/doi.org\/10.1016\/j.braindev.2013.09.003","DOI":"10.1016\/j.braindev.2013.09.003"},{"key":"e_1_3_4_20_1","unstructured":"Kane M. T. (2006). Validation. In Brennan R. B. (Ed.) Educational measurement (4th ed. pp. 17\u201364). American Council on Education\/Praeger. https:\/\/scholar.google.com\/scholar?cluster=16777936156654752080&hl=en&oi=scholarr"},{"key":"e_1_3_4_21_1","doi-asserted-by":"crossref","unstructured":"Kane M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement 50(1) 1\u201373. https:\/\/doi.org\/10.1111\/jedm.12000","DOI":"10.1111\/jedm.12000"},{"key":"e_1_3_4_22_1","doi-asserted-by":"crossref","unstructured":"Kyriazos T. A. Stalikas A. (2018). Applied psychometrics: The steps of scale development and standardization process. Psychology 9(11) Article 11. https:\/\/doi.org\/10.4236\/psych.2018.911145","DOI":"10.4236\/psych.2018.911145"},{"key":"e_1_3_4_23_1","doi-asserted-by":"crossref","unstructured":"Langberg J. M. Epstein J. N. Simon J. O. Loren R. E. A. Arnold L. E. Hechtman L. Hinshaw S. P. Hoza B. Jensen P. S. Pelham W. E. Swanson J. M. Wigal T. (2010). Parent agreement on ratings of children\u2019s attention deficit\/hyperactivity disorder and broadband externalizing behaviors. Journal of Emotional and Behavioral Disorders 18(1) 41\u201350. https:\/\/doi.org\/10.1177\/1063426608330792","DOI":"10.1177\/1063426608330792"},{"key":"e_1_3_4_24_1","unstructured":"Li Z. Zhang X. Zhang Y. Long D. Xie P. Zhang M. (2023). Towards general text embeddings with multi-stage contrastive learning. arXiv. https:\/\/doi.org\/10.48550\/arXiv.2308.03281"},{"key":"e_1_3_4_25_1","unstructured":"Liu Y. Ott M. Goyal N. Du J. Joshi M. Chen D. Levy O. Lewis M. Zettlemoyer L. Stoyanov V. (2019). RoBERTa: A robustly optimized BERT pretraining approach. arXiv. https:\/\/doi.org\/10.48550\/arXiv.1907.11692"},{"key":"e_1_3_4_26_1","first-page":"13","volume-title":"Educational measurement","author":"Messick S.","year":"1989","unstructured":"Messick S. (1989). Validity. In Educational measurement (3rd ed., pp. 13\u2013103). American Council on Education.","edition":"3"},{"key":"e_1_3_4_27_1","doi-asserted-by":"crossref","unstructured":"Morgado F. F. R. Meireles J. F. F. Neves C. M. Amaral A. C. S. Ferreira M. E. C. (2017). Scale development: Ten main limitations and recommendations to improve future research practices. Psicologia: Reflex\u00e3o e Cr\u00edtica 30(1) 3. https:\/\/doi.org\/10.1186\/s41155-016-0057-1","DOI":"10.1186\/s41155-016-0057-1"},{"key":"e_1_3_4_28_1","doi-asserted-by":"crossref","unstructured":"Raine A. Ling S. Streicher W. Liu J. (2022). The conduct and oppositional defiant disorder scales (CODDS) for disruptive behaviour disorders. Psychiatry Research 316 114744. https:\/\/doi.org\/10.1016\/j.psychres.2022.114744","DOI":"10.1016\/j.psychres.2022.114744"},{"key":"e_1_3_4_29_1","doi-asserted-by":"crossref","unstructured":"Reimers N. Gurevych I. (2019). Sentence-BERT: Sentence embeddings using siamese BERT-networks. In Inui K. Jiang J. Ng V. Wan X. (Eds.) Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP) (pp. 3982\u20133992). Association for Computational Linguistics. https:\/\/doi.org\/10.18653\/v1\/D19-1410","DOI":"10.18653\/v1\/D19-1410"},{"key":"e_1_3_4_30_1","doi-asserted-by":"crossref","unstructured":"Rogers A. Kovaleva O. Rumshisky A. (2021). A Primer in BERTology: What we know about how BERT works. Transactions of the Association for Computational Linguistics 8 842\u2013866. https:\/\/doi.org\/10.1162\/tacl_a_00349","DOI":"10.1162\/tacl_a_00349"},{"key":"e_1_3_4_31_1","doi-asserted-by":"crossref","unstructured":"Steck H. Ekanadham C. Kallus N. (2024). Is cosine-similarity of embeddings really about similarity? (Version 1). arXiv. https:\/\/doi.org\/10.48550\/ARXIV.2403.05440","DOI":"10.1145\/3589335.3651526"},{"key":"e_1_3_4_32_1","doi-asserted-by":"crossref","unstructured":"Swanson J. M. Kraemer H. C. Hinshaw S. P. Arnold L. E. Conners C. K. Abikoff H. B. Clevenger W. Davies M. Elliott G. R. Greenhill L. L. Hechtman L. Hoza B. Jensen P. S. March J. S. Newcorn J. H. Owens E. B. Pelham W. E. Schiller E. Severe J. B. .\u2004.\u2004. Wu M. (2001). Clinical relevance of the primary findings of the MTA: Success rates based on severity of ADHD and ODD symptoms at the end of treatment. Journal of the American Academy of Child & Adolescent Psychiatry 40(2) 168\u2013179. https:\/\/doi.org\/10.1097\/00004583-200102000-00011","DOI":"10.1097\/00004583-200102000-00011"},{"key":"e_1_3_4_33_1","unstructured":"Vaswani A. Shazeer N. Parmar N. Uszkoreit J. Jones L. Gomez A. N. Kaiser \u0141. ukasz Polosukhin I. (2017). Attention is all you need. Advances in Neural Information Processing Systems 30. https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2017\/hash\/3f5ee243547dee91fbd053c1c4a845aa-Abstract.html"},{"key":"e_1_3_4_34_1","doi-asserted-by":"crossref","unstructured":"Xiao S. Liu Z. Zhang P. Muennighoff N. Lian D. Nie J.-Y. (2024). C-Pack: Packaged Resources To Advance General Chinese Embedding (arXiv:2309.07597). arXiv. https:\/\/doi.org\/10.48550\/arXiv.2309.07597","DOI":"10.1145\/3626772.3657878"},{"key":"e_1_3_4_35_1","unstructured":"Zehui Z. Siyuan H. U. Qiuhan C. A. I. Yueyue C. Lili C. A. I. (2023). Systematic review of SNAP-\u2163 measurement properties based on COSMIN. Chinese Journal of Evidence-Based Pediatrics 18(3) 215. https:\/\/doi.org\/10.3969\/j.issn.1673-5501.2023.03.010"},{"key":"e_1_3_4_36_1","doi-asserted-by":"crossref","unstructured":"Zieff M. R. Hoogenhout M. Eastman E. Christ B. U. Galvin A. de Menil V. Abubakar A. Newton C. R. Robinson E. Donald K. A. (2023). Validity of the SNAP-IV For ADHD assessment in South African children with neurodevelopmental disorders. Journal of Autism and Developmental Disorders 53(7) 2851\u20132862. https:\/\/doi.org\/10.1007\/s10803-022-05530-1","DOI":"10.1007\/s10803-022-05530-1"}],"container-title":["Assessment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10731911261467602","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/10731911261467602","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10731911261467602","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,2]],"date-time":"2026-08-02T19:44:15Z","timestamp":1785699855000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/10731911261467602"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,30]]},"references-count":36,"alternative-id":["10.1177\/10731911261467602"],"URL":"https:\/\/doi.org\/10.1177\/10731911261467602","relation":{},"ISSN":["1073-1911","1552-3489"],"issn-type":[{"value":"1073-1911","type":"print"},{"value":"1552-3489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,30]]},"article-number":"10731911261467602"}}