{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T07:14:36Z","timestamp":1777706076710,"version":"3.51.4"},"reference-count":54,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2022,12,19]],"date-time":"2022-12-19T00:00:00Z","timestamp":1671408000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Commission\/EACEA, through the ERASMUS + Programme","award":["2020-1-EL01-KA203078797"],"award-info":[{"award-number":["2020-1-EL01-KA203078797"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Education Sciences"],"abstract":"<jats:p>This study presents and validates the psychometric characteristics of a short form of the Critical Thinking Self-assessment Scale (CTSAS). The original CTSAS was composed of six subscales representing the six components of Facione\u2019s conceptualisation of critical thinking. The CTSAS short form kept the same structures and reduced the number of items from 115 in the original version, to 60. The CTSAS short form was tested with a sample of 531 higher education students from five countries (Germany, Greece, Lithuania, Romania, and Portugal) enrolled in different disciplinary fields (Business Informatics, Teacher Education, English as a Foreign Language, Business and Economics, and Veterinary Medicine). The confirmatory analysis was used to test the new instrument reliability, internal consistency, and construct validity. Both the models that hypothesized the six factors to be correlated and to tap into a second-order factor representing the complex concept of critical thinking, had acceptable fit to the data. The instrument showed strong internal consistency (\u03b1 = 0.969) and strong positive correlations between skills and between the skills and the overall scale (p &lt; 0.05). Despite the unbalanced sex distribution in the population (close to 75% females), the instrument retained its factorial structure invariance across sexes. Therefore, the new instrument shows adequate goodness of fit and retained stability and reliability, and is proposed as a valid and reliable means to evaluate and monitor critical thinking in university students.<\/jats:p>","DOI":"10.3390\/educsci12120938","type":"journal-article","created":{"date-parts":[[2022,12,19]],"date-time":"2022-12-19T09:05:09Z","timestamp":1671440709000},"page":"938","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["Development and Validation of a Critical Thinking Assessment-Scale Short Form"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5225-4510","authenticated-orcid":false,"given":"Rita","family":"Payan-Carreira","sequence":"first","affiliation":[{"name":"CHRC\u2014Compreensive Health Research Centre, Department of Veterinary Medicine, Universidade de \u00c9vora Pole at Mitra, 7002-774 \u00c9vora, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8459-8104","authenticated-orcid":false,"given":"Ana","family":"Sacau-Fontenla","sequence":"additional","affiliation":[{"name":"Faculdade de Ci\u00eancias Humanas e Sociais, Universidade Fernando Pessoa (UFP), 4249-004 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5165-5280","authenticated-orcid":false,"given":"Hugo","family":"Rebelo","sequence":"additional","affiliation":[{"name":"CIEP\u2014Research Centre in Education and Psychology, Universidade de \u00c9vora Pole at Mitra, 7005-345 \u00c9vora, Portugal"}]},{"given":"Luis","family":"Sebasti\u00e3o","sequence":"additional","affiliation":[{"name":"CIEP\u2014Research Centre in Education and Psychology, Universidade de \u00c9vora Pole at Mitra, 7005-345 \u00c9vora, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9163-2155","authenticated-orcid":false,"given":"Dimitris","family":"Pnevmatikos","sequence":"additional","affiliation":[{"name":"Department of Primary Education, University of Western Macedonia\u2014UOWM, GR-53100 Florina, Greece"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,19]]},"reference":[{"key":"ref_1","unstructured":"Dumitru, D., Bigu, D., Elen, J., Jiang, L., Railien\u00e8, A., Penkauskien\u00e8, D., Papathanasiou, I.V., Tsaras, K., Fradelos, E.C., and Ahern, A. (2018). A European Collection of the Critical Thinking Skills and Dispositions Needed in Different Professional Fields for the 21st Century, UTAD."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"721","DOI":"10.1080\/07294360.2020.1785401","article-title":"What critical thinking skills and dispositions do new graduates need for professional life? Views from Portuguese employers in different fields","volume":"40","author":"Cruz","year":"2021","journal-title":"High. Educ. Res. Dev."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"156","DOI":"10.3389\/feduc.2020.00156","article-title":"Performance Assessment of Critical Thinking: Conceptualization, Design, and Implementation","volume":"5","author":"Braun","year":"2020","journal-title":"Front. Educ."},{"key":"ref_4","unstructured":"Cinque, M., Carretero, S., and Napierala, J. (2021). Non-Cognitive Skills and Other Related Concepts: Towards a Better Understanding of Similarities and Differences, Joint Research Centre, European Commission."},{"key":"ref_5","unstructured":"Pnevmatikos, D., Christodoulou, P., Georgiadou, T., Lithoxoidou, A., Dimitriadou, A., Payan Carreira, R., Sim\u00f5es, M., Ferreira, D., Rebelo, H., and Sebasti\u00e3o, L. (2021). THINK4JOBS TRAINING: Critical Thinking Training Packages for Higher Education Instructors and Labour Market Tutors, University of Western Macedonia."},{"key":"ref_6","unstructured":"Facione, P. (1990). Critical Thinking: A Statement of Expert Consensus for Purposes of Educational Assessment and Instruction (The Delphi Report), California Academic Press."},{"key":"ref_7","unstructured":"Dutton, J. (2022). How to Enhance Students\u2019 Self-Regulation. The Psychology of Self-Regulation, Nova Science Publishers, Inc.. (in press)."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"664","DOI":"10.1080\/02602938.2018.1526255","article-title":"One size fits all? The limitations of standardised assessment in critical thinking","volume":"44","author":"Rear","year":"2019","journal-title":"Assess. Eval. High. Educ."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2137","DOI":"10.1016\/j.sbspro.2015.02.013","article-title":"Enhancing Students\u2019 Critical Thinking Skills through Teaching and Learning by Inquiry-based Learning Activities Using Social Network and Cloud Computing","volume":"174","author":"Thaiposri","year":"2015","journal-title":"Procedia-Soc. Behav. Sci."},{"key":"ref_10","first-page":"40","article-title":"Critical Thinking: A Literature Review","volume":"6","author":"Lai","year":"2011","journal-title":"Pearson Res. Rep."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1080\/15305058.2018.1543309","article-title":"Assessment of University Students\u2019 Critical Thinking: Next Generation Performance Assessment","volume":"19","author":"Shavelson","year":"2019","journal-title":"Int. J. Test."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"892","DOI":"10.1080\/03075079.2019.1586340","article-title":"Promoting critical thinking in higher education through the values and knowledge education (VaKE) method","volume":"44","author":"Pnevmatikos","year":"2019","journal-title":"Stud. High. Educ."},{"key":"ref_13","first-page":"61","article-title":"The Disposition Toward Critical Thinking: Its Character, Measurement, and Relationship to Critical Thinking Skill","volume":"20","author":"Facione","year":"2000","journal-title":"Informal Log."},{"key":"ref_14","unstructured":"Ennis, R.H. (2022, November 17). The Nature of Critical Thinking: Outlines of General Critical Thinking Dispositions and Abilities. Available online: https:\/\/education.illinois.edu\/docs\/default-source\/faculty-documents\/robert-ennis\/thenatureofcriticalthinking_51711_000.pdf."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1037\/0003-066X.53.4.449","article-title":"Teaching critical thinking for transfer across domains. Dispositions, skills, structure training, and metacognitive monitoring","volume":"53","author":"Halpern","year":"1998","journal-title":"Am. Psychol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"131","DOI":"10.3928\/01484834-20120215-01","article-title":"A Conceptual Framework for Developing a Critical Thinking Self-Assessment Scale","volume":"52","author":"Nair","year":"2013","journal-title":"J. Nurs. Educ."},{"key":"ref_17","unstructured":"Rapps, A.M. (2017). Let the Seuss loose. Rutgers, The State University of New Jersey."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1080\/21568235.2020.1835517","article-title":"Twenty-first century skills: Meaning, usage and value","volume":"11","author":"Tight","year":"2021","journal-title":"Eur. J. High. Educ."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1097\/NNA.0b013e318243360b","article-title":"Objective Measurement of Critical-Thinking Ability in Registered Nurse Applicants","volume":"42","author":"Ryan","year":"2012","journal-title":"JONA J. Nurs. Adm."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"503","DOI":"10.3109\/0142159X.2013.774330","article-title":"Is the OSCE a feasible tool to assess competencies in undergraduate medical education?","volume":"35","author":"Fareleira","year":"2013","journal-title":"Med. Teach."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"101090","DOI":"10.1016\/j.stueduc.2021.101090","article-title":"The dynamic relationship between response processes and self-regulation in critical thinking assessments","volume":"71","author":"Hyytinen","year":"2021","journal-title":"Stud. Educ. Eval."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1080\/02602938.2018.1533519","article-title":"Comparison of standardized assessment methods: Logistics, costs, incentives and use of data","volume":"44","author":"Simper","year":"2019","journal-title":"Assess. Eval. High. Educ."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"198920","DOI":"10.1155\/2013\/198920","article-title":"The Assessment of Critical Thinking Critically Assessed in Higher Education: A Validation Study of the CCTT and the HCTA","volume":"2013","author":"Verburgh","year":"2013","journal-title":"Educ. Res. Int."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"100877","DOI":"10.1016\/j.tsc.2021.100877","article-title":"Exploring higher education students\u2019 critical thinking skills through content analysis","volume":"41","author":"Hart","year":"2021","journal-title":"Think. Ski. Creat."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1111\/j.1745-3992.2011.00223.x","article-title":"A Framework for Evaluation and Use of Automated Scoring","volume":"31","author":"Williamson","year":"2012","journal-title":"Educ. Meas. Issues Pract."},{"key":"ref_26","first-page":"127","article-title":"Teaching through Appraisal: Developing Critical Reading in Iranian EFL Learners","volume":"98","author":"Haromi","year":"2014","journal-title":"Proc. Int. Conf. Current Trends Elt"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.tsc.2009.02.001","article-title":"Assessing students\u2019 critical thinking performance: Urging for measurements using multi-response format","volume":"4","author":"Ku","year":"2009","journal-title":"Think. Ski. Creat."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/j.tsc.2015.04.001","article-title":"The Halpern Critical Thinking Assessment: Toward a Dutch appraisal of critical thinking","volume":"17","author":"Wilhelm","year":"2015","journal-title":"Think. Ski. Creat."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1002\/ets2.12035","article-title":"Assessing Critical Thinking in Higher Education: Current State and Directions for Next-Generation Assessment","volume":"2014","author":"Liu","year":"2014","journal-title":"ETS Res. Rep. Ser."},{"key":"ref_30","first-page":"29","article-title":"Which test? Whose scores? Comparing standardized critical thinking tests","volume":"2011","author":"Hatcher","year":"2011","journal-title":"New Dir. Inst. Res."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1007\/s11162-009-9160-9","article-title":"Accuracy of Self-reported SAT and ACT Test Scores: Implications for Research","volume":"51","author":"Cole","year":"2010","journal-title":"Res. High. Educ."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"211","DOI":"10.2147\/JMDH.S104807","article-title":"Information bias in health research: Definition, pitfalls, and adjustment methods","volume":"9","author":"Althubaiti","year":"2016","journal-title":"J. Multidiscip Healthc."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"829","DOI":"10.1080\/03075079.2019.1586330","article-title":"The effectiveness of critical thinking instructional strategies in health professions education: A systematic review","volume":"44","author":"Cruz","year":"2019","journal-title":"Stud. High. Educ."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2309","DOI":"10.3389\/fpsyg.2019.02309","article-title":"Controlling for Response Biases in Self-Report Scales: Forced-Choice vs. Psychometric Modeling of Likert Items","volume":"10","author":"Kreitchmann","year":"2019","journal-title":"Front. Psychol."},{"key":"ref_35","unstructured":"Nair, G. (2011). Preliminary Psychometric Characteristics of the Critical Thinking Self-Assessment Scale, University of Saskatchewan."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1891\/1061-3749.25.1.156","article-title":"Accumulation of Content Validation Evidence for the Critical Thinking Self-Assessment Scale","volume":"25","author":"Nair","year":"2017","journal-title":"J. Nurs. Meas."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1027\/1901-2276.61.2.29","article-title":"Guidelines for translating and adapting psychological instruments","volume":"61","author":"Gudmundsson","year":"2009","journal-title":"Nord. Psychol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"S80","DOI":"10.4103\/sja.SJA_203_17","article-title":"Guidelines for developing, translating, and validating a questionnaire in perioperative and pain medicine","volume":"11","author":"Tsang","year":"2017","journal-title":"Saudi J. Anaesth."},{"key":"ref_39","first-page":"685","article-title":"Educational effectiveness: Validation of an instrument to measure students\u2019 critical thinking and disposition","volume":"25","author":"Hansen","year":"2022","journal-title":"Int. J. Instr."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"466","DOI":"10.1037\/1082-989X.9.4.466","article-title":"An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data","volume":"9","author":"Flora","year":"2004","journal-title":"Psychol. Methods"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/10705519909540118","article-title":"Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives","volume":"6","author":"Hu","year":"1999","journal-title":"Struct. Equ. Model. A Multidiscip. J."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Hair, J.F., Page, M., and Brunsveld, N. (2019). Essentials of Business Research Methods, Routledge. [4th ed.].","DOI":"10.4324\/9780429203374"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1207\/S15328007SEM0902_5","article-title":"Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance","volume":"9","author":"Cheung","year":"2002","journal-title":"Struct. Equ. Model. A Multidiscip. J."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"464","DOI":"10.1080\/10705510701301834","article-title":"Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance","volume":"14","author":"Chen","year":"2007","journal-title":"Struct. Equ. Model. A Multidiscip. J."},{"key":"ref_45","unstructured":"Muth\u00e9n, L.K., and Muth\u00e9n, B.O. (2012). Mplus User\u2019s Guide, Muth\u00e9n & Muth\u00e9n."},{"key":"ref_46","unstructured":"Brown, T.A. (2015). Confirmatory Factor Analysis for Applied Research, Guiford Press. [2nd ed.]."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1037\/1082-989X.4.1.84","article-title":"Sample size in factor analysis","volume":"4","author":"MacCallum","year":"1999","journal-title":"Psychol. Methods"},{"key":"ref_48","unstructured":"Commission, E. (2022). Tertiary Education Statistics, Eurostat."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1177\/0049124108314720","article-title":"An Empirical Evaluation of the Use of Fixed Cutoff Points in RMSEA Test Statistic in Structural Equation Models","volume":"36","author":"Feinian","year":"2008","journal-title":"Sociol. Methods Res."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"320","DOI":"10.1504\/IJBHR.2011.043414","article-title":"Measuring bias in self-reported data","volume":"2","author":"Rosenman","year":"2011","journal-title":"Int. J. Behav. Healthc. Res."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1273","DOI":"10.1007\/s11165-016-9602-2","article-title":"The Use of Cronbach\u2019s Alpha When Developing and Reporting Research Instruments in Science Education","volume":"48","author":"Taber","year":"2018","journal-title":"Res. Sci. Educ."},{"key":"ref_52","unstructured":"Mar\u00f4co, J. (2014). An\u00e1lise de Equa\u00e7\u00f5es Estruturais\u2014Fundamentos Te\u00f3ricos, Software & Aplica\u00e7\u00f5es, ReportNumber, An\u00e1lise e Gest\u00e3o de Informa\u00e7\u00e3o, Ltd.. [2nd ed.]."},{"key":"ref_53","unstructured":"Maroco, J. (2018). An\u00e1lise Estat\u00edstica com o SPSS Statistics, ReportNumber-An\u00e1lise e gest\u00e3o de Informa\u00e7\u00e3o, Ltd.. [7th ed.]."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"1412","DOI":"10.1037\/pas0000626","article-title":"Constructing validity: New developments in creating objective measuring instruments","volume":"31","author":"Clark","year":"2019","journal-title":"Psychol. Assess."}],"container-title":["Education Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-7102\/12\/12\/938\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:44:00Z","timestamp":1760147040000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-7102\/12\/12\/938"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,19]]},"references-count":54,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["educsci12120938"],"URL":"https:\/\/doi.org\/10.3390\/educsci12120938","relation":{},"ISSN":["2227-7102"],"issn-type":[{"value":"2227-7102","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,19]]}}}