{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T10:10:17Z","timestamp":1790244617038,"version":"4.1.0"},"reference-count":51,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2026,9,18]],"date-time":"2026-09-18T00:00:00Z","timestamp":1789689600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Intell."],"abstract":"<jats:p>Intelligence test scores underpin high-stakes educational, clinical, and occupational decisions, which makes the metric quality of these instruments a central concern for professional practice. This study aimed to evaluate the psychometric and documentary quality of intelligence tests reviewed by the Spanish National Test Commission, compare this quality with that of tests measuring other psychological constructs, and examine the influence of publisher and evaluation cohort on quality. To this end, 37 intelligence tests and 78 tests of other constructs, reviewed across 13 editions (2010\u20132026) of the project, were coded using the Revised Test Review Questionnaire (CET-R), which comprises 14 quality characteristics grouped into four dimensions: General, Validity, Reliability, and Norms. Intelligence tests did not report more information than tests of other constructs, showing similar omission rates. However, when information was reported, intelligence tests obtained higher scores on the General, Validity, and Norms dimensions, with no differences in Reliability. Publisher accounted for a substantial share of the variance in quality, whereas the evaluation cohort showed no significant influence on any psychometric characteristic once corrected for multiple comparisons (FDR). Item bias analyses and item-response-theory-based reliability remained the most consistently underreported forms of evidence across the manuals of all tests analyzed. These findings underscore the need to uphold high, transparent standards in the documentation of intelligence tests and provide empirical criteria to support the responsible selection of instruments by practitioners.<\/jats:p>","DOI":"10.3390\/jintelligence14090224","type":"journal-article","created":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T11:05:53Z","timestamp":1789988753000},"page":"224","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Metric Quality of Intelligence Tests in Spain: Evidence from 13 National Test Commission Reviews"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4927-1437","authenticated-orcid":false,"given":"Sergio","family":"Escorial","sequence":"first","affiliation":[{"name":"Department of Psychobiology and Methodology in Behavioral Sciences, Faculty of Psychology, Universidad Complutense de Madrid, Campus de Somosaguas, Pozuelo de Alarc\u00f3n, 28223 Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,9,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"56","DOI":"10.23923\/pap.psicol.3033","article-title":"D\u00e9cima evaluaci\u00f3n de test editados en Espa\u00f1a: Incorporando informaci\u00f3n sobre test no comerciales [Tenth review of tests published in Spain: Incorporating information on non-commercial tests]","volume":"45","author":"Abad","year":"2024","journal-title":"Papeles del Psic\u00f3logo\/Psychologist Papers"},{"key":"ref_2","unstructured":"American Educational Research Association, American Psychological Association, and National Council on Measurement in Education (2014). Standards for educational and psychological testing, American Educational Research Association."},{"key":"ref_3","unstructured":"Arribas, D., Santamar\u00eda, P., S\u00e1nchez-S\u00e1nchez, F., and Fern\u00e1ndez-Pinto, I. (2013). BAT-7, Bater\u00eda de aptitudes de TEA. Manual [BAT-7, TEA aptitude battery. Manual], TEA Ediciones."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Bayley, N. (2006). Bayley scales of infant and toddler development, Harcourt Assessment. [3rd ed.].","DOI":"10.1037\/t14978-000"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the false discovery rate: A practical and powerful approach to multiple testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"Journal of the Royal Statistical Society: Series B (Methodological)"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"101433","DOI":"10.1016\/j.intell.2020.101433","article-title":"Beyond individual intelligence tests: Application of Cattell-Horn-Carroll theory","volume":"79","author":"Caemmerer","year":"2020","journal-title":"Intelligence"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Carroll, J. B. (1993). Human cognitive abilities: A survey of factor-analytic studies, Cambridge University Press.","DOI":"10.1017\/CBO9780511571312"},{"key":"ref_8","unstructured":"Champely, S. (2026, September 14). pwr: Basic functions for power analysis (R package version 1.3-0), Available online: https:\/\/CRAN.R-project.org\/package=pwr."},{"key":"ref_9","unstructured":"Comisi\u00f3n Nacional de Test (2026). Informes de evaluaci\u00f3n de tests editados en Espa\u00f1a [Reports on the evaluation of tests published in Spain], Consejo General de la Psicolog\u00eda de Espa\u00f1a. Available online: https:\/\/www.cop.es\/test\/."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"e2901","DOI":"10.5964\/ejop.2901","article-title":"Guidelines for the revision and use of revised psychological tests: A systematic review study","volume":"18","author":"Cronje","year":"2022","journal-title":"Europe\u2019s Journal of Psychology"},{"key":"ref_11","first-page":"82","article-title":"Cuarta evaluaci\u00f3n de test editados en Espa\u00f1a: Forma y fondo [Fourth review of tests published in Spain: Form and content]","volume":"37","author":"Elosua","year":"2016","journal-title":"Papeles del Psic\u00f3logo\/Psychologist Papers"},{"key":"ref_12","first-page":"150","article-title":"Decimotercera evaluaci\u00f3n de test editados en Espa\u00f1a [Thirteenth review of tests published in Spain]","volume":"47","author":"Escorial","year":"2026","journal-title":"Papeles del Psic\u00f3logo\/Psychologist Papers"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"909","DOI":"10.1016\/j.paid.2005.09.013","article-title":"Personality level on the big five and the structure of intelligence","volume":"40","author":"Escorial","year":"2006","journal-title":"Personality and Individual Differences"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"136","DOI":"10.1080\/15305058.2012.658932","article-title":"The internationalization of test reviewing: Trends, differences, and results","volume":"12","author":"Evers","year":"2012","journal-title":"International Journal of Testing"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"283","DOI":"10.7334\/psicothema2013.97","article-title":"Assessing the quality of tests: Revision of the EFPA review model","volume":"25","author":"Evers","year":"2013","journal-title":"Psicothema"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1080\/15305058.2010.518325","article-title":"The Dutch review process for evaluating the quality of psychological tests: History, procedure, and results","volume":"10","author":"Evers","year":"2010","journal-title":"International Journal of Testing"},{"key":"ref_17","first-page":"161","article-title":"Quinta evaluaci\u00f3n de test editados en Espa\u00f1a: Mirando hacia atr\u00e1s, construyendo el futuro [Fifth review of tests published in Spain: Looking back, building the future]","volume":"38","year":"2017","journal-title":"Papeles del Psic\u00f3logo\/Psychologist Papers"},{"key":"ref_18","first-page":"205","article-title":"S\u00e9ptima evaluaci\u00f3n de test editados en Espa\u00f1a [Seventh review of tests published in Spain]","volume":"40","year":"2019","journal-title":"Papeles del Psic\u00f3logo\/Psychologist Papers"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Grant, S. P., Mayo-Wilson, E., Melendez-Torres, G. J., and Montgomery, P. (2013). Reporting quality of social and psychological intervention trials: A systematic review of reporting guidelines and trial publications. PLoS ONE, 8, (5).","DOI":"10.1371\/journal.pone.0065442"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"158","DOI":"10.70478\/pap.psicol.2025.46.20","article-title":"Und\u00e9cima evaluaci\u00f3n de test editados en Espa\u00f1a [Eleventh review of tests published in Spain]","volume":"46","author":"Guilera","year":"2025","journal-title":"Papeles del Psic\u00f3logo\/Psychologist Papers"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"e68347","DOI":"10.2196\/68347","article-title":"The feasibility of large language models in verbal comprehension assessment: Mixed methods feasibility study","volume":"9","author":"Lvovsky","year":"2025","journal-title":"JMIR Formative Research"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Haier, R. J., Colom, R., and Hunt, E. (2023). The science of human intelligence, Cambridge University Press. [2nd ed.].","DOI":"10.1017\/9781108569576"},{"key":"ref_23","unstructured":"Hern\u00e1ndez, A. (, January July). Hacia el CET-R-2: Actualizaci\u00f3n del modelo EFPA como marco de referencia [Toward CET-R-2: An update of the EFPA model as a reference framework] [Symposium]. XIX Congreso de la Asociaci\u00f3n Espa\u00f1ola de Metodolog\u00eda de las Ciencias del Comportamiento (AEMCCO), Almer\u00eda, Spain."},{"key":"ref_24","first-page":"55","article-title":"Comisi\u00f3n de test: Veinticinco a\u00f1os velando por la calidad de los test [The test commission: Twenty-five years safeguarding test quality]","volume":"43","author":"Elosua","year":"2022","journal-title":"Papeles del Psic\u00f3logo\/Psychologist Papers"},{"key":"ref_25","first-page":"192","article-title":"Revisi\u00f3n del modelo para evaluar la calidad de los test utilizados en Espa\u00f1a [Assessing the quality of tests in Spain: Revision of the Spanish test review model]","volume":"37","author":"Ponsoda","year":"2016","journal-title":"Papeles del Psic\u00f3logo\/Psychologist Papers"},{"key":"ref_26","first-page":"1","article-title":"Tercera evaluaci\u00f3n de tests editados en Espa\u00f1a [Third review of tests published in Spain]","volume":"36","author":"Ferreres","year":"2015","journal-title":"Papeles del Psic\u00f3logo\/Psychologist Papers"},{"key":"ref_27","first-page":"21","article-title":"Sexta evaluaci\u00f3n de test editados en Espa\u00f1a: Resultados e impacto del modelo en docentes y editoriales [Sixth review of tests published in Spain: Results and impact of the model on teachers and publishers]","volume":"40","author":"Hidalgo","year":"2019","journal-title":"Papeles del Psic\u00f3logo\/Psychologist Papers"},{"key":"ref_28","unstructured":"Hunt, E. (2011). Human intelligence, Cambridge University Press."},{"key":"ref_29","unstructured":"International Test Commission and Association of Test Publishers (2026, June 25). Guidelines for technology-based assessment, Available online: https:\/\/www.intestcom.org\/upload\/media-library\/tba-guidelines-ver-11-july-2025-1754044782Z3vV9.pdf."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","article-title":"A guideline of selecting and reporting intraclass correlation coefficients for reliability research","volume":"15","author":"Koo","year":"2016","journal-title":"Journal of Chiropractic Medicine"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.23923\/pap.psicol.3004","article-title":"Novena evaluaci\u00f3n de los test editados en Espa\u00f1a [Ninth review of tests published in Spain]","volume":"44","author":"Lozano","year":"2023","journal-title":"Papeles del Psic\u00f3logo\/Psychologist Papers"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1080\/08957347.2019.1619561","article-title":"Critically reflecting on the origins, evolution, and impact of the Cattell-Horn-Carroll (CHC) model","volume":"32","author":"McGill","year":"2019","journal-title":"Applied Measurement in Education"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"276","DOI":"10.1177\/0143034320903790","article-title":"Use of translated and adapted versions of the WISC-V: Caveat emptor","volume":"41","author":"McGill","year":"2020","journal-title":"School Psychology International"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"McGrew, K. S. (2023). Carroll\u2019s three-stratum (3S) cognitive ability theory at 30 years: Impact, 3S-CHC theory clarification, structural replication, and cognitive\u2013achievement psychometric network analysis extension. Journal of Intelligence, 11, (2).","DOI":"10.3390\/jintelligence11020032"},{"key":"ref_35","first-page":"41","article-title":"La utilizaci\u00f3n de los test en Espa\u00f1a [The use of tests in Spain]","volume":"76","year":"2000","journal-title":"Papeles del Psic\u00f3logo\/Psychologist Papers"},{"key":"ref_36","first-page":"108","article-title":"La opini\u00f3n de los psic\u00f3logos espa\u00f1oles sobre el uso de los tests [Spanish psychologists\u2019 opinions on the use of tests]","volume":"31","year":"2010","journal-title":"Papeles del Psic\u00f3logo\/Psychologist Papers"},{"key":"ref_37","first-page":"113","article-title":"Evaluaci\u00f3n de tests editados en Espa\u00f1a [Review of tests published in Spain]","volume":"32","year":"2011","journal-title":"Papeles del Psic\u00f3logo\/Psychologist Papers"},{"key":"ref_38","first-page":"1","article-title":"Utilizaci\u00f3n de los test en Espa\u00f1a: El punto de vista de los psic\u00f3logos [Test use in Spain: The psychologists\u2019 viewpoint]","volume":"41","year":"2020","journal-title":"Papeles del Psic\u00f3logo\/Psychologist Papers"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"819","DOI":"10.1017\/S135561772400050X","article-title":"Wechsler adult intelligence scale\u2013IV M\u00e9xico versus U.S. versions in the assessment of Mexican Americans","volume":"30","author":"Ontiveros","year":"2024","journal-title":"Journal of the International Neuropsychological Society"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"808","DOI":"10.1177\/17456916231214460","article-title":"AI psychometrics: Assessing the psychological profiles of large language models through psychometric inventories","volume":"19","author":"Pellert","year":"2024","journal-title":"Perspectives on Psychological Science"},{"key":"ref_41","first-page":"82","article-title":"Segunda evaluaci\u00f3n de tests editados en Espa\u00f1a [Second review of tests published in Spain]","volume":"34","author":"Ponsoda","year":"2013","journal-title":"Papeles del Psic\u00f3logo\/Psychologist Papers"},{"key":"ref_42","unstructured":"Posit Team (2026, July 10). RStudio: Integrated development environment for R (Version 2026.07.1+147) [Computer software]. Posit Software, PBC, Available online: https:\/\/posit.co\/."},{"key":"ref_43","first-page":"65","article-title":"Un modelo para evaluar la calidad de los tests utilizados en Espa\u00f1a [A model for evaluating the quality of tests used in Spain]","volume":"77","author":"Prieto","year":"2000","journal-title":"Papeles del Psic\u00f3logo\/Psychologist Papers"},{"key":"ref_44","first-page":"106","article-title":"Duod\u00e9cima evaluaci\u00f3n de test editados en Espa\u00f1a [Twelfth review of tests published in Spain]","volume":"47","year":"2026","journal-title":"Papeles del Psic\u00f3logo\/Psychologist Papers"},{"key":"ref_45","unstructured":"Recio-Saboya, P., and Escorial, S. (, January July). Aplicaci\u00f3n del modelo CET-R en la evaluaci\u00f3n de test: Resultados recientes, impacto y retos metodol\u00f3gicos [Application of the CET-R model in test evaluation: Recent results, impact, and methodological challenges] [Symposium]. XIX Congreso de la Asociaci\u00f3n Espa\u00f1ola de Metodolog\u00eda de las Ciencias del Comportamiento (AEMCCO), Almer\u00eda, Spain."},{"key":"ref_46","unstructured":"Flanagan, D. P., and Harrison, P. L. (2012). The Cattell-Horn-Carroll model of intelligence. Contemporary intellectual assessment: Theories, tests, and issues, Guilford Press. [3rd ed.]."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Sommer, M., and Arendasy, M. (2025). Automatic- and transformer-based automatic item generation: A critical review. Journal of Intelligence, 13, (8).","DOI":"10.3390\/jintelligence13080102"},{"key":"ref_48","first-page":"1","article-title":"Octava evaluaci\u00f3n de test editados en Espa\u00f1a: Una experiencia participativa [Eighth review of tests published in Spain: A participatory experience]","volume":"42","author":"Viladrich","year":"2021","journal-title":"Papeles del Psic\u00f3logo\/Psychologist Papers"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"847","DOI":"10.1007\/s11336-018-9608-y","article-title":"Automated item generation with recurrent neural networks","volume":"83","year":"2018","journal-title":"Psychometrika"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Wechsler, D. (2014). Wechsler intelligence scale for children, Pearson. [5th ed.].","DOI":"10.1037\/t79359-000"},{"key":"ref_51","unstructured":"Weiss, D. J., and \u015eahin, A. (2024). Computerized adaptive testing: From concept to implementation, The Guilford Press."}],"container-title":["Journal of Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-3200\/14\/9\/224\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T09:40:41Z","timestamp":1790242841000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-3200\/14\/9\/224"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,18]]},"references-count":51,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2026,9]]}},"alternative-id":["jintelligence14090224"],"URL":"https:\/\/doi.org\/10.3390\/jintelligence14090224","relation":{},"ISSN":["2079-3200"],"issn-type":[{"value":"2079-3200","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,18]]}}}