{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,15]],"date-time":"2026-09-15T04:26:09Z","timestamp":1789446369389,"version":"build-2803163510"},"reference-count":42,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2026,7,6]],"date-time":"2026-07-06T00:00:00Z","timestamp":1783296000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Intell."],"abstract":"<jats:p>The increasing use of Neural Language Models (NLMs) calls for strategic and metacognitive skills in prompt formulation, monitoring, and adaptation. This study presents the Strategic Prompting Scale (SPS), designed to measure the extent to which users apply planning, adaptation, and evaluation strategies during interactions with generative language models. After expert review and pilot testing, an exploratory factor analysis with 187 participants revealed a three-factor structure\u2014Planning, Adaptation, and Evaluation\u2014explaining 60.4% of the total variance. The final 15-item scale demonstrated good internal consistency. Confirmatory factor analysis with an independent sample of 406 participants supported the proposed factor structure. The SPS also showed theoretically expected associations with related constructs, including positive correlations with metacognition and critical thinking, and negative correlations with disengagement in AI interaction. Overall, the findings provide preliminary psychometric evidence for the SPS as a theory-driven instrument to assess metacognitive regulation and self-regulated behaviors in generative AI use, with potential applications in educational, professional, and research contexts.<\/jats:p>","DOI":"10.3390\/jintelligence14070141","type":"journal-article","created":{"date-parts":[[2026,7,6]],"date-time":"2026-07-06T08:05:38Z","timestamp":1783325138000},"page":"141","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["The Strategic Prompting Scale (SPS) for Measuring Metacognitive Regulation in Human\u2013AI Interaction"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3905-4893","authenticated-orcid":false,"given":"Rossella","family":"Suriano","sequence":"first","affiliation":[{"name":"Department of Cognitive, Psychological and Pedagogical Sciences and Cultural Studies, University of Messina, 98100 Messina, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3666-061X","authenticated-orcid":false,"given":"Alessio","family":"Plebe","sequence":"additional","affiliation":[{"name":"Department of Cognitive, Psychological and Pedagogical Sciences and Cultural Studies, University of Messina, 98100 Messina, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,7,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Acciai, A., Guerrisi, L., Perconti, P., Plebe, A., Suriano, R., and Velardi, A. (2025). Narrative coherence in neural language models. Frontiers in Psychology, 16.","DOI":"10.3389\/fpsyg.2025.1572076"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1074","DOI":"10.59075\/ja7dvy78","article-title":"The effect of AI based scaffolding on problem solving and metacognitive awareness in learners","volume":"3","author":"Akram","year":"2025","journal-title":"The Critical Review of Social Sciences Studies"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Bernava, G., Nucita, A., Iannizzotto, G., Capr\u00ec, T., and Fabio, R. A. (2021). Proteo: A framework for serious games in telerehabilitation. Applied Sciences, 11, (13).","DOI":"10.3390\/app11135935"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"100014","DOI":"10.1016\/j.chbah.2023.100014","article-title":"MAILS\u2014Meta AI literacy scale: Development and testing of an AI literacy questionnaire based on well-founded competency models and psychological change- and meta-competencies","volume":"1","author":"Carolus","year":"2023","journal-title":"Computers in Human Behavior: Artificial Humans"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1007\/BF02310555","article-title":"Coefficient alpha and the internal structure of tests","volume":"16","author":"Cronbach","year":"1951","journal-title":"Psychometrika"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Davis, R. O., and Lee, Y. J. (2023). Prompt: ChatGPT, create my course, please!. Education Sciences, 14, (1).","DOI":"10.3390\/educsci14010024"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Fabio, R. A., Antonietti, A., Iannello, P., and Suriano, R. (2025). Development and psychometric properties of the critical thinking attitude scale in Italian college students. Frontiers in Psychology, 16.","DOI":"10.3389\/fpsyg.2025.1599920"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Federiakin, D., Molerov, D., Zlatkin-Troitschanskaia, O., and Maur, A. (2024). Prompt engineering as a new 21st century skill. Frontiers in Education, 9.","DOI":"10.3389\/feduc.2024.1366434"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"906","DOI":"10.1037\/0003-066X.34.10.906","article-title":"Metacognition and cognitive monitoring: A new area of cognitive\u2013developmental inquiry","volume":"34","author":"Flavell","year":"1979","journal-title":"American Psychologist"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Gibreel, O., and Arpaci, I. (2025). Development and validation of the prompt engineering competence scale (PECS). Information Development, 1\u201312.","DOI":"10.1177\/02666669251336455"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Gil-G\u00f3mez, J. A., Manzano-Hern\u00e1ndez, P., Albiol-P\u00e9rez, S., Aula-Valero, C., Gil-G\u00f3mez, H., and Lozano-Quilis, J. A. (2017). USEQ: A short questionnaire for satisfaction evaluation of virtual rehabilitation systems. Sensors, 17, (7).","DOI":"10.3390\/s17071589"},{"key":"ref_12","first-page":"1","article-title":"Development and validation of the generative AI literacy for learning scale (GenAI-LLs)","volume":"41","author":"Kara","year":"2025","journal-title":"Australasian Journal of Educational Technology"},{"key":"ref_13","first-page":"038","article-title":"ChatGPT scaffolding in supporting metacognition for limit concepts in guided inquiry mathematics learning","volume":"24","author":"Huda","year":"2025","journal-title":"Journal of Information Technology Education: Research"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Jacobsen, L. J., and Weber, K. E. (2025). The promises and pitfalls of large language models as feedback providers: A study of prompt engineering and the quality of AI-driven feedback. AI, 6, (2).","DOI":"10.3390\/ai6020035"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1177\/001316447403400115","article-title":"Little jiffy, mark IV","volume":"34","author":"Kaiser","year":"1974","journal-title":"Educational and Psychological Measurement"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1207\/s15326985ep2701_8","article-title":"Facilitating elaborative learning through guided student-generated questioning","volume":"27","author":"King","year":"1992","journal-title":"Educational Psychologist"},{"key":"ref_17","first-page":"100225","article-title":"AI literacy and its implications for prompt engineering strategies","volume":"6","author":"Knoth","year":"2024","journal-title":"Computers and Education: Artificial Intelligence"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"25","DOI":"10.15678\/EBER.2023.110302","article-title":"Artificial intelligence prompt engineering as a new digital competence: Analysis of generative AI technologies such as ChatGPT","volume":"11","author":"Korzynski","year":"2023","journal-title":"Entrepreneurial Business and Economics Review"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"18992","DOI":"10.1007\/s12144-024-05723-0","article-title":"Development and validation of ChatGPT literacy scale","volume":"43","author":"Lee","year":"2024","journal-title":"Current Psychology"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1628","DOI":"10.1109\/TLT.2024.3392896","article-title":"Scaffolding computational thinking with ChatGPT","volume":"17","author":"Liao","year":"2024","journal-title":"IEEE Transactions on Learning Technologies"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"235","DOI":"10.7358\/ecps-2015-012-mang","article-title":"The development and psychometric properties of the \u00abSelf-Regulated Knowledge Scale\u2013University\u00bb (SRKS-U)","volume":"12","author":"Manganelli","year":"2015","journal-title":"Journal of Educational, Cultural and Psychological Studies"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Marvin, G., Hellen, N., Jjingo, D., and Nakatumba-Nabende, J. (2023). Prompt engineering in large language models. International conference on data intelligence and cognitive informatics, Springer Nature.","DOI":"10.1007\/978-981-99-7962-2_30"},{"key":"ref_23","unstructured":"McDonald, R. P. (1999). Test theory: A unified treatment, Lawrence Erlbaum Associates."},{"key":"ref_24","unstructured":"Pintrich, P. R., Smith, D. A. F., Garcia, T., and McKeachie, W. J. (1991). A manual for the use of the motivated strategies for learning questionnaire (MSLQ), National Center for Research to Improve Postsecondary Teaching and Learning."},{"key":"ref_25","unstructured":"Schraw, G. (2001). Promoting general metacognitive awareness. Metacognition in learning and instruction: Theory, research and practice, Springer."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1006\/ceps.1994.1033","article-title":"Assessing metacognitive awareness","volume":"19","author":"Schraw","year":"1994","journal-title":"Contemporary Educational Psychology"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"672","DOI":"10.1002\/pra2.1287","article-title":"Enhancing critical thinking in generative AI search with metacognitive prompts","volume":"62","author":"Singh","year":"2025","journal-title":"Proceedings of the Association for Information Science and Technology"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1007\/s12144-025-08798-5","article-title":"Do neural language models critically reason about moral issues like humans?","volume":"45","author":"Suriano","year":"2026","journal-title":"Current Psychology"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"102011","DOI":"10.1016\/j.learninstruc.2024.102011","article-title":"Student interaction with ChatGPT can promote complex critical thinking skills","volume":"95","author":"Suriano","year":"2025","journal-title":"Learning and Instruction"},{"key":"ref_30","first-page":"49","article-title":"Validation study of the Italian version of the Self-regulation for Learning Online (SRL-O) questionnaire in university students","volume":"82","author":"Tarchi","year":"2024","journal-title":"Applied Psychology Bulletin"},{"key":"ref_31","unstructured":"Tolzin, A., Knoth, N., and Janson, A. (2026, February 24). Leveraging prompting guides as worked examples for advanced prompt engineering strategies, Available online: https:\/\/aisel.aisnet.org\/icis2024\/learnandiscurricula\/learnandiscurricula\/1\/."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"e477","DOI":"10.3109\/01421590903193521","article-title":"Metacognitive awareness and self-regulated learning skills of medical students in different medical curricula","volume":"31","author":"Turan","year":"2009","journal-title":"Medical Teacher"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"101345","DOI":"10.1016\/j.tsc.2023.101345","article-title":"How can we measure metacognition in creative problem-solving? Standardization of the MCPS scale","volume":"49","author":"Urban","year":"2023","journal-title":"Thinking Skills and Creativity"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1186\/s41239-024-00448-3","article-title":"Embracing the future of artificial intelligence in the classroom: The relevance of AI literacy, prompt engineering, and critical thinking in modern education","volume":"21","author":"Walter","year":"2024","journal-title":"International Journal of Educational Technology in Higher Education"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Wang, B., Deng, X., and Sun, H. (2022). Iteratively prompt pre-trained language models for chain of thought. Proceedings of the 2022 conference on empirical methods in natural language processing, Association for Computational Linguistics.","DOI":"10.18653\/v1\/2022.emnlp-main.174"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Wang, Y., and Zhao, Y. (2024). Metacognitive prompting improves understanding in large language models. Proceedings of the 2024 conference of the North American chapter of the association for computational linguistics: Human language technologies (Volume 1: Long papers), Association for Computational Linguistics.","DOI":"10.18653\/v1\/2024.naacl-long.106"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"24824","DOI":"10.52202\/068431-1800","article-title":"Chain-of-thought prompting elicits reasoning in large language models","volume":"35","author":"Wei","year":"2022","journal-title":"Advances in Neural Information Processing Systems"},{"key":"ref_38","first-page":"593","article-title":"Development of a self-rating scale of self-directed learning","volume":"27","author":"Williamson","year":"2007","journal-title":"Nurse Education Today"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"95","DOI":"10.46328\/ijces.176","article-title":"The self-regulation for AI-based learning scale: Psychometric properties and validation","volume":"4","author":"Yurt","year":"2025","journal-title":"International Journal of Current Educational Studies"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"e70077","DOI":"10.1111\/jcal.70077","article-title":"Exploring ChatGPT-facilitated scaffolding in undergraduates\u2019 mathematical problem solving","volume":"41","author":"Zhou","year":"2025","journal-title":"Journal of Computer Assisted Learning"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1207\/s15430421tip4102_2","article-title":"Becoming a self-regulated learner: An overview","volume":"41","author":"Zimmerman","year":"2002","journal-title":"Theory into Practice"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Zimmerman, B. J. (2013). Theories of self-regulated learning and academic achievement: An overview and analysis. Self-regulated learning and academic achievement, Taylor & Francis Group.","DOI":"10.4324\/9781410601032"}],"container-title":["Journal of Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-3200\/14\/7\/141\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,6]],"date-time":"2026-07-06T09:46:56Z","timestamp":1783331216000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-3200\/14\/7\/141"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,7,6]]},"references-count":42,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2026,7]]}},"alternative-id":["jintelligence14070141"],"URL":"https:\/\/doi.org\/10.3390\/jintelligence14070141","relation":{},"ISSN":["2079-3200"],"issn-type":[{"value":"2079-3200","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,7,6]]}}}