{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,11]],"date-time":"2026-08-11T06:27:47Z","timestamp":1786429667568,"version":"build-2736575974"},"reference-count":34,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,8,11]],"date-time":"2026-08-11T00:00:00Z","timestamp":1786406400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Psychol."],"abstract":"<jats:p>The replication crisis in psychology is now widely recognized as a crisis of measurement itself, not merely of questionable research practices. Recent critical work has revealed that many psychological scales may be measuring semantic associations rather than the psychological phenomena they purport to assess. This Hypothesis and Theory article makes three contributions. First, it synthesizes diverse lines of critique\u2014including Uher\u2019s distinction between statistical modeling and measurement, and the finding that computational language models, trained solely on word co-occurrence patterns, can predict questionnaire responses with surprising accuracy\u2014without any access to human participants\u2019 psychological states. These critiques converge on a common diagnosis: the \u201csemantic confound,\u201d where scales capture linguistic familiarity rather than latent psychological traits. Second, it argues that the root cause of this measurement crisis is not statistical but theoretical: the absence of explicit, falsifiable theories about the target phenomena themselves. This theory vacuum has, in practice, allowed scale development to default to an inductive, data-driven approach that conflates statistical structure with psychological structure, despite the field\u2019s long-standing theoretical commitment to construct validity (Cronbach and Meehl, 1955). Third, it outlines what theory-driven measurement would require: axiomatic assumptions, phenomenologically distinct state definitions, formal causal structures, and a mapping function from observable behaviors to latent states. We demonstrate that these conditions are neither arbitrary nor utopian by examining four research traditions\u2014psychophysics, structured diagnostic interviews, item response theory, and cognitive diagnostic models\u2014that each partially satisfy one or more of them. The Holographic Coding Framework (HCF), recently proposed as a theory-driven approach to consciousness measurement, is briefly introduced as an illustrative case of this alternative paradigm. We conclude by calling for a fundamental shift in quantitative psychology: from measurement models that fit data to theories that drive measurement. Standardizing poor measurement entrenches the validity crisis; theorization must precede standardization.<\/jats:p>","DOI":"10.3389\/fpsyg.2026.1870659","type":"journal-article","created":{"date-parts":[[2026,8,11]],"date-time":"2026-08-11T05:35:14Z","timestamp":1786426514000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["What are we really measuring? The semantic confound in psychological scales and the case for theory-driven measurement"],"prefix":"10.3389","volume":"17","author":[{"given":"Xiangyu","family":"Liu","sequence":"first","affiliation":[{"name":"Yuankong Technology Co., Ltd.","place":["Beijing, China"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,8,11]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","first-page":"e106361","DOI":"10.1371\/journal.pone.0106361","article-title":"Predicting survey responses: how and why semantics shape survey statistics on organizational behaviour","volume":"9","author":"Arnulf","year":"2014","journal-title":"PLoS One"},{"key":"ref2","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1037\/0033-2909.117.2.187","article-title":"A contrarian view of the five-factor approach to personality description","volume":"117","author":"Block","year":"1995","journal-title":"Psychol. Bull."},{"key":"ref3","doi-asserted-by":"publisher","first-page":"676","DOI":"10.1016\/j.beth.2011.03.007","article-title":"Preliminary psychometric properties of the acceptance and action questionnaire\u2013II","volume":"42","author":"Bond","year":"2011","journal-title":"Behav. Ther."},{"key":"ref4","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1177\/09593543221126178","article-title":"Squaring the circle: from latent variables to theory-based measurement","volume":"33","author":"Borgstede","year":"2023","journal-title":"Theory Psychol."},{"key":"ref5","doi-asserted-by":"publisher","first-page":"25","DOI":"10.1080\/15366360802035497","article-title":"Latent variable theory","volume":"6","author":"Borsboom","year":"2008","journal-title":"Measurement"},{"key":"ref6","doi-asserted-by":"publisher","first-page":"1390233","DOI":"10.3389\/fpsyg.2024.1390233","article-title":"Theory before methods: a manifesto for formal theory in psychology","volume":"15","author":"Borsboom","year":"2024","journal-title":"Front. Psychol."},{"key":"ref7","doi-asserted-by":"publisher","first-page":"365","DOI":"10.1038\/nrn3475","article-title":"Power failure: why small sample size undermines the reliability of neuroscience","volume":"14","author":"Button","year":"2013","journal-title":"Nat. Rev. Neurosci."},{"key":"ref8","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1037\/h0040957","article-title":"Construct validity in psychological tests","volume":"52","author":"Cronbach","year":"1955","journal-title":"Psychol. Bull."},{"key":"ref9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1027\/2151-2604\/a000600","article-title":"Theory crisis in psychology: historical roots and epistemological dimensions","volume":"233","author":"Gigerenzer","year":"","journal-title":"Z. Psychol."},{"key":"ref10","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1027\/2151-2604\/a000599","article-title":"Rethinking the replication crisis: from methodological fixes to theoretical foundations","volume":"233","author":"Gigerenzer","year":"","journal-title":"Z. Psychol."},{"key":"ref11","doi-asserted-by":"publisher","first-page":"1654996","DOI":"10.3389\/fpsyg.2026.1654996","article-title":"Latent trait or sum score: addressing measurement challenges in the prediction of self-rated symptom outcomes in psychological treatment","volume":"17","author":"Hentati Isacsson","year":"2026","journal-title":"Front. Psychol."},{"key":"ref12","doi-asserted-by":"publisher","first-page":"524","DOI":"10.1177\/0956797611430953","article-title":"Measuring the prevalence of questionable research practices with incentives for truth telling","volume":"23","author":"John","year":"2012","journal-title":"Psychol. Sci."},{"key":"ref13","first-page":"17","volume-title":"Educational Measurement","author":"Kane","year":"2006"},{"key":"ref14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1111\/jedm.12000","article-title":"Validating the interpretations and uses of test scores","volume":"50","author":"Kane","year":"2013","journal-title":"J. Educ. Meas."},{"key":"ref15","doi-asserted-by":"publisher","first-page":"1592658","DOI":"10.3389\/fpsyg.2025.1592658","article-title":"Clarifying the reliability paradox: poor measurement reliability attenuates group differences","volume":"16","author":"Karvelis","year":"2025","journal-title":"Front. Psychol."},{"key":"ref16","volume-title":"Interpretation of Educational Measurements","author":"Kelley","year":"1927"},{"key":"ref17","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1037\/0033-295X.104.2.211","article-title":"A solution to Plato\u2019s problem: the latent semantic analysis theory of acquisition, induction, and representation of knowledge","volume":"104","author":"Landauer","year":"1997","journal-title":"Psychol. Rev."},{"key":"ref18","doi-asserted-by":"publisher","first-page":"603","DOI":"10.1207\/s15327906mbr3104_13","article-title":"Meaning and mythology in the factor analysis model","volume":"31","author":"Maraun","year":"1996","journal-title":"Multivar. Behav. Res."},{"key":"ref19","doi-asserted-by":"publisher","first-page":"806","DOI":"10.1037\/0022-006x.46.4.806","article-title":"Theoretical risks and tabular asterisks: sir Karl, sir Ronald, and the slow progress of soft psychology","volume":"46","author":"Meehl","year":"1978","journal-title":"J. Consult. Clin. Psychol."},{"key":"ref20","first-page":"13","volume-title":"Educational Measurement","author":"Messick","year":"1989"},{"key":"ref21","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1111\/j.2044-8295.1997.tb02641.x","article-title":"Quantitative science and the definition of measurement in psychology","volume":"88","author":"Michell","year":"1997","journal-title":"Br. J. Psychol."},{"key":"ref22","doi-asserted-by":"publisher","first-page":"639","DOI":"10.1177\/0959354300105004","article-title":"Normal science, pathological science and psychometrics","volume":"10","author":"Michell","year":"2000","journal-title":"Theory Psychol."},{"key":"ref23","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1080\/15366360802021995","article-title":"Is psychometrics pathological science?","volume":"6","author":"Michell","year":"2008","journal-title":"Meas. Interdiscip. Res. Perspect."},{"key":"ref24","doi-asserted-by":"publisher","first-page":"2600","DOI":"10.1073\/pnas.1708274114","article-title":"The preregistration revolution","volume":"115","author":"Nosek","year":"2018","journal-title":"Proc. Natl. Acad. Sci."},{"key":"ref25","doi-asserted-by":"publisher","first-page":"1596","DOI":"10.3758\/s13423-019-01645-2","article-title":"Addressing the theory crisis in psychology","volume":"26","author":"Oberauer","year":"2019","journal-title":"Psychon. Bull. Rev."},{"key":"ref26","doi-asserted-by":"publisher","first-page":"37313","DOI":"10.1038\/s41598-025-21289-8","article-title":"Rethinking psychometrics through LLMs: how item semantics shape measurement and prediction in psychological questionnaires","volume":"15","author":"Ravenda","year":"2025","journal-title":"Sci. Rep."},{"key":"ref27","doi-asserted-by":"publisher","first-page":"1123","DOI":"10.1177\/1745691617708630","article-title":"Constraints on generality (COG): a proposed addition to all empirical papers","volume":"12","author":"Simons","year":"2017","journal-title":"Perspect. Psychol. Sci."},{"key":"ref28","doi-asserted-by":"publisher","first-page":"495","DOI":"10.1177\/0959354320969876","article-title":"Theory crisis in psychology: a metatheoretical perspective","volume":"31","author":"Slunecko","year":"2021","journal-title":"Theory Psychol."},{"key":"ref29","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511819322","volume-title":"The Psychology of Survey Response","author":"Tourangeau","year":"2000"},{"key":"ref30","doi-asserted-by":"publisher","first-page":"278","DOI":"10.1016\/j.jcbs.2018.09.005","article-title":"The acceptance and action questionnaire-II (AAQ-II) as a measure of experiential avoidance: concerns over discriminant validity","volume":"12","author":"Tyndall","year":"2019","journal-title":"J. Context. Behav. Sci."},{"key":"ref31","doi-asserted-by":"publisher","first-page":"1534270","DOI":"10.3389\/fpsyg.2025.1534270","article-title":"Statistics is not measurement: the inbuilt semantics of psychometric scales and language-based models obscures crucial epistemic differences","volume":"16","author":"Uher","year":"2025","journal-title":"Front. Psychol."},{"key":"ref32","doi-asserted-by":"publisher","first-page":"1553028","DOI":"10.3389\/fpsyg.2025.1553028","article-title":"Psychology\u2019s questionable research fundamentals (QRFs): key problems in quantitative psychology and psychological measurement beyond questionable research practices (QRPs)","volume":"16","author":"Uher","year":"","journal-title":"Front. Psychol."},{"key":"ref33","doi-asserted-by":"publisher","first-page":"1661765","DOI":"10.3389\/fpsyg.2025.1661765","article-title":"Editorial: critical debates on quantitative psychology and measurement: revived and novel perspectives on fundamental problems","volume":"16","author":"Uher","year":"","journal-title":"Front. Psychol."},{"key":"ref34","doi-asserted-by":"publisher","first-page":"831","DOI":"10.1016\/j.beth.2014.07.002","article-title":"What does the acceptance and action questionnaire (AAQ-II) really measure?","volume":"45","author":"Wolgast","year":"2014","journal-title":"Behav. Ther."}],"container-title":["Frontiers in Psychology"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2026.1870659\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,11]],"date-time":"2026-08-11T05:35:15Z","timestamp":1786426515000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fpsyg.2026.1870659\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,11]]},"references-count":34,"alternative-id":["10.3389\/fpsyg.2026.1870659"],"URL":"https:\/\/doi.org\/10.3389\/fpsyg.2026.1870659","relation":{},"ISSN":["1664-1078"],"issn-type":[{"value":"1664-1078","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,11]]},"article-number":"1870659"}}