{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T14:57:29Z","timestamp":1781621849219,"version":"3.54.5"},"reference-count":208,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2025,12,19]],"date-time":"2025-12-19T00:00:00Z","timestamp":1766102400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004329","name":"The Slovenian Research and Innovation Agency","doi-asserted-by":"publisher","award":["J5-4573"],"award-info":[{"award-number":["J5-4573"]}],"id":[{"id":"10.13039\/501100004329","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004329","name":"The Slovenian Research and Innovation Agency","doi-asserted-by":"publisher","award":["P5-0451"],"award-info":[{"award-number":["P5-0451"]}],"id":[{"id":"10.13039\/501100004329","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>This study examined whether the systems thinking approach integrating information and communication technology (ICT) and digital tools (hereafter referred to as the STICT approach) improves technological and engineering literacy (TEL) and related outcomes for pre-service preschool teachers. Although there is an expectation for preschool teachers to develop TEL, evidence-based models that systematically combine systems thinking with digital tools and ICT support remain scarce. Using a quasi-experimental design (n = 44; one-semester experiment), the experimental group explicitly integrated systems thinking and digital tools, while the comparison control group followed the traditional approach to teaching design, technology, and engineering (DTE) content; both groups focused on making products for preschoolers. The outcomes included multidimensional literacy, attitudes towards DTE, self-reported systems thinking, aspects of engagement, and focus group reflection. The analyses (ANCOVA\/MANCOVA, regression\/PLS, multi-group tests, thematic analysis) revealed notable results, including a higher post-test literacy for the experimental group and a lower perceived difficulty with technology. Both groups improved in the self-assessment of systems thinking, with no differences between them. The qualitative findings supported the educational value of the approach. In this pilot classroom experiment (n = 44), findings are consistent with an advantage of the STICT approach on the TEL composite and with lower perceived difficulty of technology, whereas self-assessed systems thinking improved similarly in both groups. Given the small sample and multiple outcomes, estimates carry considerable uncertainty and should be read as preliminary. We theorise that TEL gains arise primarily from systems thinking processes applied during design\/evaluation, with ICT functioning as a cognitive-and-motivational scaffold that makes relations\/feedback explicit and reduces perceived difficulty; self-assessed systems thinking improved in both groups.<\/jats:p>","DOI":"10.3390\/systems14010005","type":"journal-article","created":{"date-parts":[[2025,12,19]],"date-time":"2025-12-19T14:27:16Z","timestamp":1766154436000},"page":"5","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Systems Thinking in the Role of Fostering Technological and Engineering Literacy"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-3350-7593","authenticated-orcid":false,"given":"Brina","family":"Kurent","sequence":"first","affiliation":[{"name":"Faculty of Education, University of Ljubljana, 1000 Ljubljana, Slovenia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0487-8115","authenticated-orcid":false,"given":"Stanislav","family":"Avsec","sequence":"additional","affiliation":[{"name":"Faculty of Education, University of Ljubljana, 1000 Ljubljana, Slovenia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,12,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1763","DOI":"10.1007\/s10798-025-09973-2","article-title":"Teaching Technology to Young Learners: Teachers\u2019 Individual Competencies","volume":"35","author":"Korkeaniemi","year":"2025","journal-title":"Int. J. Technol. Des. Educ."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"454","DOI":"10.1002\/jee.20174","article-title":"Engineering Thinking in Prekindergarten Children: A Systematic Literature Review","volume":"106","author":"Lippard","year":"2017","journal-title":"J. Eng. Educ."},{"key":"ref_3","first-page":"107","article-title":"Preschool Teachers\u2019 Experiences of Technical Concepts in Relation to Everyday Situations in the Preschool","volume":"28","author":"Svensson","year":"2023","journal-title":"Des. Technol. Educ. Int. J."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1007\/s10763-023-10362-1","article-title":"Teaching Approaches for STEM Integration in Pre- and Primary School: A Systematic Qualitative Literature Review","volume":"21","author":"Larkin","year":"2023","journal-title":"Int. J. Sci. Math. Educ."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2783","DOI":"10.1007\/s10643-024-01794-7","article-title":"Integrated STEM Education in Early Childhood Classrooms: Voices from the Field","volume":"53","author":"Wang","year":"2025","journal-title":"Early Child. Educ. J."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Leung, J.K.L., Ng, D.T.K., and Tsui, C.-Y. (2024). A Primer for Design and Systems Thinkers: A First-Year Engineering Course for Mindset Development. Educ. Sci., 14.","DOI":"10.3390\/educsci14010086"},{"key":"ref_7","unstructured":"Yao, S. (2020, January 10\u201311). An Interactive Model of Theory and Practice in the Promotion of Scientific and Technological Literacy of Chinese Kindergarten Teachers. Proceedings of the 2020 International Conference on Economic Development and Education Innovation (EDEI 2020): Education Innovation, Kunming, China."},{"key":"ref_8","first-page":"112","article-title":"Engineering Curriculum in the Preschool Classroom: The Teacher\u2019s Experience","volume":"23","author":"Bagiati","year":"2015","journal-title":"Eur. Early Child. Educ. Res. J."},{"key":"ref_9","unstructured":"(2025, July 01). Kurikulum za Vrtce; Ministrstvo za Vzgoji in Izobra\u017eevanje, Zavod Republike Slovenije za \u0160olstvo, Ljubljana, 2025, Available online: https:\/\/www.gov.si\/assets\/ministrstva\/MVI\/Dokumenti\/Sektor-za-predsolsko-vzgojo\/Dokumenti-smernice\/KURIKULUM-ZA-VRTCE-2025.pdf."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Avsec, S., Jagie\u0142\u0142o-Kowalczyk, M., \u017babicka, A., Gawlak, A., and Gil-Mastalerczyk, J. (2023). Leveraging Systems Thinking, Engagement, and Digital Competencies to Enhance First-Year Architecture Students\u2019 Achievement in Design-Based Learning. Sustainability, 15.","DOI":"10.3390\/su152015115"},{"key":"ref_11","unstructured":"Kreiling, L., and Paunov, C. (2021). Knowledge Co-Creation in the 21st Century: A Cross-Country Experience-Based Policy Report, OECD Science, Technology and Industry Policy Papers, No. 115."},{"key":"ref_12","unstructured":"International Technology and Engineering Educators Association (2020). Standards for Technological and Engineering Literacy: The Role of Technology and Engineering in STEM Education, ITEEA. Available online: https:\/\/www.iteea.org\/stel."},{"key":"ref_13","unstructured":"(2017). Education for Sustainable Development Goals: Learning Objectives, UNESCO. Available online: https:\/\/www.unesco.org\/en\/articles\/education-sustainable-development-goals-learning-objectives."},{"key":"ref_14","unstructured":"(2022). Project: Developing the Twenty-First-Century Skills Needed for Sustainable Development and Quality Education in the Era of Rapid Technology-Enhanced Changes in the Economic, Social and Natural Environment (Grant no. J5-4573), University of Ljubljana. Available online: https:\/\/www.pef.uni-lj.si\/razvijanje_vescin_21_stoletja\/."},{"key":"ref_15","unstructured":"(2024). Program: Strategies for Education for Sustainable Development Applying Innovative Student-Centred Educational Approaches (ID: P5-0451), University of Ljubljana. Available online: https:\/\/www.pef.uni-lj.si\/raziskovanje-in-umetnost\/projekti\/."},{"key":"ref_16","unstructured":"(2025, July 20). Project: ULTRA 5.02-1554 Improving Digital Skills and Competences of (Future) Educators for Quality Educational Work with Younger Children, Available online: https:\/\/www.pef.uni-lj.si\/vkljucevanje-didakticne-uporabe-ikt-pv\/."},{"key":"ref_17","unstructured":"Pacey, A. (1983). The Culture of Technology, MIT Press."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1023\/A:1008919120846","article-title":"The Politics of Technological Literacy","volume":"10","author":"Petrina","year":"2000","journal-title":"Int. J. Technol. Des. Educ."},{"key":"ref_19","unstructured":"Krupczak, J., Blake, J.W., Disney, K.A., Hilgarth, C.O., Libros, R., Mina, M., and Walk, S.R. (2012, January 10\u201313). Defining Engineering and Technological Literacy. Proceedings of the 2012 ASEE Annual Conference & Exposition, San Antonio, TX, USA."},{"key":"ref_20","first-page":"1","article-title":"Defining Technological and Engineering Literacy","volume":"80","author":"Hoepfl","year":"2020","journal-title":"Technol. Eng. Teach."},{"key":"ref_21","unstructured":"Garmire, E., and Pearson, G. (2006). Tech Tally: Approaches to Assessing Technological Literacy, The National Academies Press."},{"key":"ref_22","unstructured":"International Technology Education Association (2007). Standards for Technological Literacy: Content for the Study of Technology, ITEA. [2nd ed.]. Available online: https:\/\/blogs.ubc.ca\/dandt\/files\/2014\/08\/TechLitStandards.pdf."},{"key":"ref_23","unstructured":"Heywood, J., and Matthews, P. (1986). Issues in the Preparation of Teachers for Teaching Robotics in Schools. Technology, Society and the School Curriculum, Roundthorn Publishing."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1007\/s10798-010-9129-1","article-title":"Concepts and contexts in engineering and technology education: An international and interdisciplinary Delphi study","volume":"21","author":"Rossouw","year":"2011","journal-title":"Int. J. Technol. Des. Educ."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1007\/s10763-019-09971-6","article-title":"Development and Validation of a Technological Literacy Survey","volume":"17","author":"Gu","year":"2019","journal-title":"Int. J. Sci. Math. Educ."},{"key":"ref_26","first-page":"8","article-title":"Reconstructing the Pupils\u2019 Attitude Towards Technology Survey","volume":"18","author":"Ardies","year":"2013","journal-title":"Des. Technol. Educ. Int. J."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1495","DOI":"10.1007\/s10798-021-09653-x","article-title":"The ethical implications of collecting data in educational settings: Discussion on the technology and engineering attitude scale (TEAS) and its psychometric validation for assessing a pre-engineering design program","volume":"32","author":"Miranda","year":"2022","journal-title":"Int. J. Technol. Des. Educ."},{"key":"ref_28","unstructured":"Eagly, A.H., and Chaiken, S. (1993). The Psychology of Attitudes, Harcourt Brace Jovanovich College Publishers."},{"key":"ref_29","first-page":"1049","article-title":"Pre-Service Teachers\u2019 Attitudes Towards Technology, Engagement in Active Learning, and Creativity as Predictors of Ability to Innovate","volume":"34","author":"Avsec","year":"2018","journal-title":"Int. J. Eng. Educ."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2111","DOI":"10.1007\/s10798-021-09686-2","article-title":"Technology Teachers\u2019 Professional Attitudes Towards Technology: An Investigation of Chinese High School General Technology Teachers","volume":"32","author":"Xu","year":"2022","journal-title":"Int. J. Technol. Des. Educ."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"592","DOI":"10.1109\/TSMC.1974.4309376","article-title":"General Systems Theory: Foundations, Developments, Applications","volume":"SMC-4","author":"Sutherland","year":"1974","journal-title":"IEEE Trans. Syst. Man. Cybern."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1002\/sdr.4260100211","article-title":"System Dynamics, Systems Thinking, and Soft OR","volume":"10","author":"Forrester","year":"1994","journal-title":"Syst. Dyn. Rev."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Hossain, N.U.I., Dayaratha, V.L., Nagahi, M., and Jaradat, R. (2020). Systems Thinking: A Review and Bibliometric Analysis. Systems, 8.","DOI":"10.3390\/systems8030023"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1007\/s41979-023-00087-9","article-title":"Characterising the Literature on the Teaching and Learning of System Thinking and Complexity in STEM Education: A Bibliometric Analysis and Research Synthesis","volume":"6","author":"Bielik","year":"2023","journal-title":"J. STEM Educ. Res."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"205","DOI":"10.15390\/EB.2024.12634","article-title":"Systems Thinking in Education: A Bibliometric Analysis","volume":"49","author":"Bozkurt","year":"2024","journal-title":"Educ. Sci."},{"key":"ref_36","unstructured":"UNESCO (2016). Education 2030: Incheon Declaration and Framework for Action for the Implementation of Sustainable Development Goal 4: Ensure Inclusive and Equitable Quality Education and Promote Lifelong Learning Opportunities for All, UNESCO. Available online: https:\/\/unesdoc.unesco.org\/ark:\/48223\/pf0000245656."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"669","DOI":"10.1016\/j.procs.2015.03.050","article-title":"A Definition of Systems Thinking: A Systems Approach","volume":"44","author":"Arnold","year":"2015","journal-title":"Procedia Comput. Sci."},{"key":"ref_38","unstructured":"Cabrera, D. (2006). Systems Thinking. [Ph.D. Dissertation, Cornell University]. Available online: https:\/\/ecommons.cornell.edu\/server\/api\/core\/bitstreams\/cf21d0ca-48de-4540-8914-4629f975bdcd\/content."},{"key":"ref_39","unstructured":"Spector, J.M., Lockee, B., and Childress, M. (2019). What Is Systems Thinking?. Learning, Design, and Technology, Springer Nature."},{"key":"ref_40","unstructured":"Moore, S.M., Dolansky, M.A., Singh, M., Palmieri, P., and Alemi, F. (2025, July 18). The Systems Thinking Scale, 2010. (Unpublished Manuscript). Available online: https:\/\/case.edu\/nursing\/sites\/default\/files\/2018-04\/STS_Manual.pdf."},{"key":"ref_41","unstructured":"Canva Pty Ltd (2025, August 16). Canva [Computer Software], Available online: https:\/\/www.canva.com\/."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1253","DOI":"10.1002\/tea.20383","article-title":"Four Case Studies, Six Years Later: Developing System Thinking Skills in Junior High School and Sustaining Them over Time","volume":"47","author":"Orion","year":"2010","journal-title":"J. Res. Sci. Teach."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1007\/s11251-016-9392-y","article-title":"Systems Learning with a Conceptual Representation: A Quasi-Experimental Study","volume":"45","author":"Jordan","year":"2017","journal-title":"Instr. Sci."},{"key":"ref_44","unstructured":"Next Generation Science Standards (NGSS) (2013). Topic Arrangements of the NGSS, The National Academies Press. Available online: https:\/\/www.nextgenscience.org\/standards."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"2314","DOI":"10.1007\/s11606-020-05830-1","article-title":"Development and Validation of the Systems Thinking Scale","volume":"35","author":"Dolansky","year":"2020","journal-title":"J. Gen. Intern. Med."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1002\/sres.2371","article-title":"The Relationship between Systems Thinking and the New Ecological Paradigm","volume":"33","author":"Davis","year":"2016","journal-title":"Syst. Res. Behav. Sci."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1002\/sys.20140","article-title":"Assessing the interest for systems engineering positions and other engineering positions\u2019 required capacity for engineering systems thinking (CEST)","volume":"13","author":"Frank","year":"2009","journal-title":"Syst. Eng."},{"key":"ref_48","unstructured":"Jaradat, R.M. (2014). An Instrument to Assess Individual Capacity for System Thinking. [Ph.D. Dissertation, Old Dominion University]."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"2147","DOI":"10.1080\/09500693.2012.716549","article-title":"Assessing System Thinking through Different Concept-Mapping Practices","volume":"34","author":"Harms","year":"2012","journal-title":"Int. J. Sci. Educ."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Tomko, M.E., Linsey, J., Nagel, R., and Alem\u00e1n, M.W. (2017, January 18\u201321). Exploring Meaning-Making and Innovation in Makerspaces: An Ethnographic Study of Student and Faculty Perspectives. Proceedings of the 2017 IEEE Frontiers in Education Conference (FIE), Indianapolis, IN, USA.","DOI":"10.1109\/FIE.2017.8190580"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"19","DOI":"10.21061\/jte.v17i1.a.2","article-title":"A Systems Approach for Developing Technological Literacy","volume":"17","author":"Frank","year":"2005","journal-title":"J. Technol. Educ."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Feriver, \u015e., Olgan, R., Teks\u00f6z, G., and Barth, M. (2019). Systems Thinking Skills of Preschool Children in Early Childhood Education Contexts from Turkey and Germany. Sustainability, 11.","DOI":"10.3390\/su11051478"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"50","DOI":"10.3991\/ijep.v12i3.25035","article-title":"The Case for Systems Thinking in Undergraduate Engineering Education","volume":"12","author":"Monat","year":"2022","journal-title":"Int. J. Eng. Pedagog."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Gua\u00f1a-Moya, J., Arteaga-Alc\u00edvar, Y., Criollo-C, S., and Cajamarca-Carrazco, D. (2024). Use of Interactive Technologies to Increase Motivation in University Online Courses. Educ. Sci., 14.","DOI":"10.3390\/educsci14121406"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Zou, Y., Kuek, F., Feng, W., and Cheng, X. (2025). Digital Learning in the 21st Century: Trends, Challenges, and Innovations in Technology Integration. Front. Educ., 10.","DOI":"10.3389\/feduc.2025.1562391"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Alam, T.M., Stoica, G.A., Sharma, K., and \u00d6zg\u00f6bek, \u00d6. (2025). Digital Technologies in the Classrooms in the Last Decade (2014\u20132023): A Bibliometric Analysis. Front. Educ., 10.","DOI":"10.3389\/feduc.2025.1533588"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Gabrov\u0161ek, R., and Rihtar\u0161i\u010d, D. (2025). Custom Generative Artificial Intelligence Tutors in Action: An Experimental Evaluation of Prompt Strategies in STEM Education. Sustainability, 17.","DOI":"10.3390\/su17219508"},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"957","DOI":"10.1007\/s10639-019-09998-w","article-title":"Disengagement, Engagement and Digital Skills in Technology-Enhanced Learning","volume":"25","author":"Bergdahl","year":"2020","journal-title":"Educ. Inf. Technol."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/15391523.2020.1799455","article-title":"Using Digital Technology to Promote Higher Education Learning: The Importance of Different Learning Activities and Their Relations to Learning Outcomes","volume":"54","author":"Wekerle","year":"2020","journal-title":"J. Res. Technol. Educ."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"59","DOI":"10.3102\/00346543074001059","article-title":"School Engagement: Potential of the Concept, State of the Evidence","volume":"74","author":"Fredricks","year":"2004","journal-title":"Rev. Educ. Res."},{"key":"ref_61","first-page":"419","article-title":"Beyond Classroom Academics: A School-Wide and Multi-Contextual Perspective on Student Engagement in School","volume":"5","author":"Wang","year":"2020","journal-title":"Adolesc. Res. Rev."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1007\/s11423-007-9060-7","article-title":"Aesthetic Principles for Instructional Design","volume":"57","author":"Parrish","year":"2009","journal-title":"Educ. Technol. Res. Dev."},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1007\/s10648-025-09989-z","article-title":"Specialized Purpose of Each Type of Student Engagement: A Meta-Analysis","volume":"37","author":"Reeve","year":"2025","journal-title":"Educ. Psychol. Rev."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/j.chb.2015.07.008","article-title":"Moving beyond cognitive elements of ICT literacy: First evidence on the structure of ICT engagement","volume":"53","author":"Zylka","year":"2015","journal-title":"Comput. Hum. Behav."},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Deci, E.L., and Ryan, R.M. (1985). Intrinsic Motivation and Self-Determination in Human Behavior, Plenum Press.","DOI":"10.1007\/978-1-4899-2271-7"},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"518","DOI":"10.2224\/sbp.7054","article-title":"Relationships between student engagement and academic achievement: A meta-analysis","volume":"46","author":"Lei","year":"2018","journal-title":"Soc. Behav. Pers."},{"key":"ref_67","unstructured":"Damon, W., and Lerner, R. (1998). The Ecology of Developmental Processes. Handbook of Child Psychology: Theoretical Models of Human Development, John Wiley & Sons, Inc.. [5th ed.]."},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Kurent, B., and Avsec, S. (2024). Synergizing Systems Thinking and Technology-Enhanced Learning for Sustainable Education Using the Flow Theory Framework. Sustainability, 16.","DOI":"10.20944\/preprints202409.0174.v1"},{"key":"ref_69","doi-asserted-by":"crossref","unstructured":"Kefalis, C., Skordoulis, C., and Drigas, A. (2025). Digital Simulations in STEM Education: Insights from Recent Empirical Studies, a Systematic Review. Encyclopedia, 5.","DOI":"10.3390\/encyclopedia5010010"},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"98","DOI":"10.37934\/araset.51.1.98115","article-title":"A Systematic Review: Digital Learning in STEM Education","volume":"51","author":"Khalid","year":"2023","journal-title":"J. Adv. Res. Appl. Sci. Eng. Technol."},{"key":"ref_71","unstructured":"Gilliot, J.-M., Garlatti, S., and Simon, G. (2010, January 15\u201318). Impact of Digital Literacy on The Engineering Curriculum. Proceedings of the 6th International CDIO Conference; \u00c9cole Polytechnique, Montr\u00e9al, QC, Canada. Available online: https:\/\/www.cdio.org\/knowledge-library\/documents\/impact-digital-literacy-engineering-curriculum."},{"key":"ref_72","first-page":"914","article-title":"Exploring the Research Trends of Technological Literacy Studies in Education: A Systematic Review Using Bibliometric Analysis","volume":"13","author":"Suyanto","year":"2023","journal-title":"Int. J. Inf. Educ. Technol."},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"3878","DOI":"10.1021\/acs.jchemed.5c00196","article-title":"A Pedagogical Model for Teaching Systems Thinking in a Sustainable Chemistry Course: A Design-Based Research Approach","volume":"102","author":"Vuorio","year":"2025","journal-title":"J. Chem. Educ."},{"key":"ref_74","unstructured":"Raspini, J.P., da Silva, M.A.G., and Mendibil, K. (2025, January 11\u201312). How Is Systems Thinking Taught? A Literature Review. Proceedings of the 27th International Conference on Engineering and Product Design Education, University of Malta, San Gwann, Malta. Available online: https:\/\/www.designsociety.org\/download-publication\/48626\/how_is_systems_thinking_taught_a_literature_review."},{"key":"ref_75","doi-asserted-by":"crossref","unstructured":"Fisher, D.M., and Systems Thinking Association (2023). Systems thinking activities used in K-12 for up to two decades. Front. Educ., 8.","DOI":"10.3389\/feduc.2023.1059733"},{"key":"ref_76","first-page":"100870","article-title":"Exploring student engagement in technology-based education in relation to gamification, online\/distance learning, and other factors: A systematic literature review","volume":"9","author":"Balalle","year":"2024","journal-title":"Soc. Sci. Humanit. Open"},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"1337","DOI":"10.1080\/09500693.2011.605182","article-title":"Computer Simulations to Support Science Instruction and Learning: A critical review of the literature","volume":"34","author":"Smetana","year":"2011","journal-title":"Int. J. Sci. Educ."},{"key":"ref_78","first-page":"338","article-title":"Digital Teaching and Learning Scaffolding in Education: A Systematic Review Using Bibliometric Analysis","volume":"5","author":"Safahi","year":"2025","journal-title":"Int. J. Eng. Sci. Inf. Technol."},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"3052","DOI":"10.1080\/10494820.2024.2436943","article-title":"Can the Utilization of Technology-Enhanced Learning Spaces Lead to Improved Learning Outcomes? A Meta-Analysis Based on 39 Experimental and Quasi-Experimental Studies","volume":"33","author":"Hu","year":"2024","journal-title":"Interact. Learn. Environ."},{"key":"ref_80","doi-asserted-by":"crossref","unstructured":"Darmawansah, D., Hwang, G.-J., Chen, M.-R.A., and Liang, J.-C. (2023). Trends and Research Foci of Robotics-Based STEM Education: A Systematic Review from Diverse Angles Based on the Technology-Based Learning Model. Int. J. STEM Educ., 10.","DOI":"10.1186\/s40594-023-00400-3"},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1186\/s40594-024-00503-5","article-title":"Exploring Instructional Design in K\u201312 STEM Education: A Systematic Literature Review","volume":"11","author":"Halawa","year":"2024","journal-title":"Int. J. STEM Educ."},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1007\/s10648-024-09908-8","article-title":"Confounded or Controlled? A Systematic Review of Media Comparison Studies Involving Immersive Virtual Reality for STEM Education","volume":"36","author":"Lawson","year":"2024","journal-title":"Educ. Psychol. Rev."},{"key":"ref_83","doi-asserted-by":"crossref","unstructured":"Ormanci, U., and \u00c7epni, S. (2025). The Effect of Web-Assisted Guided Inquiry Approach on Students\u2019 Systems Thinking Skills. J. Sci. Educ. Technol.","DOI":"10.1007\/s10956-025-10238-9"},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1186\/s40594-024-00487-2","article-title":"The Impact of Virtual Reality on Practical Skills for Students in Science and Engineering Education: A Meta-Analysis","volume":"11","author":"Yang","year":"2024","journal-title":"Int. J. STEM Educ."},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"1359","DOI":"10.1177\/07356331231176741","article-title":"Does Motion-Sensing Technology Enhance Students\u2019 Learning? A Meta-Analysis","volume":"61","author":"Yu","year":"2023","journal-title":"J. Educ. Comput. Res."},{"key":"ref_86","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1007\/s10956-023-10072-x","article-title":"Teaching and Assessing Thinking Skills and Applying Educational Technologies in Higher Education","volume":"32","author":"Dori","year":"2023","journal-title":"J. Sci. Educ. Technol."},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"904","DOI":"10.1007\/s10956-025-10215-2","article-title":"Design-Based STEM Activities in Teacher Education and Its Effect on Pre-Service Science Teachers\u2019 Design Thinking Skills","volume":"34","year":"2025","journal-title":"J. Sci. Educ. Technol."},{"key":"ref_88","first-page":"431","article-title":"Integrating Computational Thinking into Scaffolding Learning: An Innovative Approach to Enhance Science, Technology, Engineering, and Mathematics Hands-On Learning","volume":"62","author":"Lee","year":"2023","journal-title":"J. Educ. Comput. Res."},{"key":"ref_89","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1186\/s40594-023-00453-4","article-title":"Authentic STEM Education through Modelling: An International Delphi Study","volume":"10","year":"2023","journal-title":"Int. J. STEM Educ."},{"key":"ref_90","first-page":"133","article-title":"A Systematic Review of Digital Innovations in Technology-Enhanced Learning Designs in Higher Education","volume":"39","author":"Harman","year":"2023","journal-title":"Australas. J. Educ. Technol."},{"key":"ref_91","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1186\/s40594-024-00484-5","article-title":"Understanding Science Data Literacy: A Conceptual Framework and Assessment Tool for College Students Majoring in STEM","volume":"11","author":"Qiao","year":"2024","journal-title":"Int. J. STEM Educ."},{"key":"ref_92","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1186\/s40594-024-00517-z","article-title":"What Shapes Statistical and Data Literacy Research in K\u201312 STEM Education? A Systematic Review of Metrics and Instructional Strategies","volume":"11","author":"Friedrich","year":"2024","journal-title":"Int. J. STEM Educ."},{"key":"ref_93","doi-asserted-by":"crossref","first-page":"1292","DOI":"10.1177\/07356331251342081","article-title":"Learning About AI: A Systematic Review of Reviews on AI Literacy","volume":"63","author":"Zhang","year":"2025","journal-title":"J. Educ. Comput. Res."},{"key":"ref_94","doi-asserted-by":"crossref","first-page":"840","DOI":"10.1002\/sres.2808","article-title":"Systems Thinking Assessments in Engineering: A Systematic Literature Review","volume":"39","author":"Dugan","year":"2022","journal-title":"Syst. Res. Behav. Sci."},{"key":"ref_95","first-page":"100053","article-title":"Learning Effectiveness of Immersive Virtual Reality in Education and Training: A Systematic Review of Findings","volume":"4","author":"Conrad","year":"2024","journal-title":"Comput. Educ. X Real."},{"key":"ref_96","doi-asserted-by":"crossref","first-page":"102446","DOI":"10.1016\/j.lindif.2024.102446","article-title":"Learning Activities in Technology-Enhanced Learning: A Systematic Review of Meta-Analyses and Second-Order Meta-Analysis in Higher Education","volume":"112","author":"Sailer","year":"2024","journal-title":"Learn. Individ. Differ."},{"key":"ref_97","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1186\/s40594-025-00554-2","article-title":"Concept Mapping in STEM Education: A Meta-Analysis of Its Impact on Students\u2019 Achievement (2004\u20132023)","volume":"12","author":"Wang","year":"2025","journal-title":"Int. J. STEM Educ."},{"key":"ref_98","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1080\/00461520.2014.965823","article-title":"The ICAP Framework: Linking Cognitive Engagement to Active Learning Outcomes","volume":"49","author":"Chi","year":"2014","journal-title":"Educ. Psychol."},{"key":"ref_99","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1111\/jcal.12885","article-title":"The Effect of Virtual Reality Learning on Students\u2019 Motivation: A Scoping Review","volume":"40","author":"Jiang","year":"2024","journal-title":"J. Comput. Assist. Learn."},{"key":"ref_100","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1007\/s11412-024-09418-3","article-title":"Effects of Group Awareness Support in CSCL on Students\u2019 Learning Performance: A Three-Level Meta-Analysis","volume":"19","author":"Chen","year":"2024","journal-title":"Int. J. Comput. Support. Collab. Learn."},{"key":"ref_101","unstructured":"Creswell, J.W., and Creswell, J.L. (2023). Research Design: Qualitative, Quantitative, and Mixed Methods Approaches, Sage. [6th ed.]. Available online: https:\/\/s1.papyruspub.com\/files\/demos\/products\/ebooks\/academicbooks\/applied-linguistics\/Preview-Research-Design-Qualitative-Quantitative-and-Mixed-Methods.pdf."},{"key":"ref_102","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1111\/isj.12131","article-title":"Minimum Sample Size Estimation in PLS-SEM: The Inverse Square Root and Gamma-Exponential Methods","volume":"28","author":"Kock","year":"2018","journal-title":"Inf. Syst. J."},{"key":"ref_103","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1007\/s12564-024-09981-2","article-title":"Quasi-experimental designs for causal inference: An overview","volume":"25","author":"Cham","year":"2024","journal-title":"Asia Pac. Educ. Rev."},{"key":"ref_104","unstructured":"University of Ljubljana, Faculty of Education (2024). Technology Education Curriculum for Preschool Education Students [Internal curriculum], University of Ljubljana, Faculty of Education. Available online: https:\/\/vispef.uni-lj.si\/."},{"key":"ref_105","unstructured":"Miro Inc (2025, August 29). Miro [Computer Software], Available online: https:\/\/www.miro.com\/."},{"key":"ref_106","unstructured":"Puentedura, R.R. (2025, August 25). SAMR\u2014A Research Perspective. Hippasus. Available online: https:\/\/hippasus.com\/rrpweblog\/archives\/2020\/01\/SAMR_AResearchPerspective.pdf."},{"key":"ref_107","doi-asserted-by":"crossref","first-page":"2883","DOI":"10.1007\/s11218-024-09948-6","article-title":"Instructor mindset beliefs and behaviors: How do students and instructors perceive them?","volume":"27","author":"Muenks","year":"2024","journal-title":"Soc. Psychol. Educ."},{"key":"ref_108","unstructured":"Ringle, C.M., Wende, S., and Becker, J.-M. (2025, August 10). SmartPLS 4, Available online: https:\/\/www.smartpls.com."},{"key":"ref_109","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1007\/s10798-016-9382-z","article-title":"A path model of factors affecting secondary school students\u2019 technological literacy","volume":"28","author":"Avsec","year":"2018","journal-title":"Int. J. Technol. Des. Educ."},{"key":"ref_110","unstructured":"Cohen, R., and Swerdlik, M. (2009). Psychological Testing and Assessment: An Introduction to Tests and Measurement, McGraw Hill. [7th ed.]."},{"key":"ref_111","doi-asserted-by":"crossref","unstructured":"Meyer, J.P. (2014). Applied Measurement with jMetrik, Routledge.","DOI":"10.4324\/9780203115190"},{"key":"ref_112","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1177\/0265532220927487","article-title":"A comprehensive review of Rasch measurement in language assessment: Recommendations and guidelines for research","volume":"38","author":"Aryadoust","year":"2020","journal-title":"Lang. Test."},{"key":"ref_113","unstructured":"Linacre, J.M. (2025). A User\u2019s Guide to Winsteps\/Ministep: Rasch-Model Computer Programs, Winsteps.com. Available online: https:\/\/www.winsteps.com\/winman\/copyright.htm."},{"key":"ref_114","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing","volume":"57","author":"Benjamini","year":"1995","journal-title":"J. R. Stat. Soc. Ser. B"},{"key":"ref_115","first-page":"100132","article-title":"A multinational assessment of AI literacy among university students in Germany, the UK, and the US","volume":"4","author":"Hornberger","year":"2025","journal-title":"Comput. Hum. Behav."},{"key":"ref_116","unstructured":"The Jamovi Project (2025, July 25). Jamovi [Computer Software], Available online: https:\/\/www.jamovi.org."},{"key":"ref_117","unstructured":"Seol, H. (2025, July 25). Seolmatrix: Correlations Suite for Jamovi (Version 4.0.1) [Jamovi Module]. Available online: https:\/\/github.com\/hyunsooseol\/seolmatrix."},{"key":"ref_118","unstructured":"Brown, T.A. (2015). Confirmatory Factor Analysis for Applied Research, Guilford Press. [2nd ed.]."},{"key":"ref_119","doi-asserted-by":"crossref","first-page":"806","DOI":"10.1177\/0011000006288127","article-title":"Scale Development Research: A Content Analysis and Recommendations for Best Practices","volume":"34","author":"Worthington","year":"2006","journal-title":"Couns. Psychol."},{"key":"ref_120","doi-asserted-by":"crossref","unstructured":"Pituch, K.A., and Stevens, J.P. (2015). Applied Multivariate Statistics for the Social Sciences: Analyses with SAS and IBM\u2019s SPSS, Routledge. [6th ed.].","DOI":"10.4324\/9781315814919"},{"key":"ref_121","doi-asserted-by":"crossref","first-page":"745","DOI":"10.1007\/s10490-023-09871-y","article-title":"Reporting reliability, convergent and discriminant validity with structural equation modeling: A review and best-practice recommendations","volume":"41","author":"Cheung","year":"2024","journal-title":"Asia Pac. J. Manag."},{"key":"ref_122","unstructured":"Tabachnick, B.G., and Fidell, L.S. (2019). Using Multivariate Statistics, Pearson Education. [7th ed.]."},{"key":"ref_123","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1177\/1094428120968614","article-title":"An updated guideline for assessing discriminant validity","volume":"25","author":"Cho","year":"2022","journal-title":"Organ. Res. Methods"},{"key":"ref_124","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1007\/s11747-014-0403-8","article-title":"A New Criterion for Assessing Discriminant Validity in Variance-Based Structural Equation Modeling","volume":"43","author":"Henseler","year":"2015","journal-title":"J. Acad. Mark. Sci."},{"key":"ref_125","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1111\/bjet.12565","article-title":"Investigating the Impact of Teacher Education Strategies on Preservice Teachers\u2019 TPACK","volume":"50","author":"Baran","year":"2019","journal-title":"Br. J. Educ. Technol."},{"key":"ref_126","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1080\/00219266.2019.1609564","article-title":"Teachers\u2019 and Educators\u2019 Perspectives on Systems Thinking and Its Implementation in Dutch Biology Education","volume":"54","author":"Gilissen","year":"2020","journal-title":"J. Biol. Educ."},{"key":"ref_127","doi-asserted-by":"crossref","first-page":"2689","DOI":"10.1021\/acs.jchemed.9b00368","article-title":"Navigating Complexity Using Systems Thinking in Chemistry, with Implications for Chemistry Education","volume":"96","author":"Constable","year":"2019","journal-title":"J. Chem. Educ."},{"key":"ref_128","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1159\/000088251","article-title":"The Development of Strategic Thinking: Learning to Impact Human Systems in a Youth Activism Program","volume":"48","author":"Larson","year":"2005","journal-title":"Hum. Dev."},{"key":"ref_129","first-page":"70","article-title":"Interdisciplinary systems thinking and the ICT self-concept in higher education","volume":"22","author":"Kurent","year":"2024","journal-title":"World Trans. Eng. Technol. Educ."},{"key":"ref_130","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1108\/01437730510607844","article-title":"Improving Strategic Thinking: A Multilevel Approach","volume":"26","author":"Bonn","year":"2005","journal-title":"Leadersh. Organ. Dev. J."},{"key":"ref_131","doi-asserted-by":"crossref","unstructured":"Avsec, S. (2023). Design thinking to envision more sustainable technology-enhanced teaching for effective knowledge transfer. Sustainability, 15.","DOI":"10.3390\/su15021163"},{"key":"ref_132","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1007\/BF02293557","article-title":"Determining the number of components from the matrix of partial correlations","volume":"41","author":"Velicer","year":"1976","journal-title":"Psychometrika"},{"key":"ref_133","doi-asserted-by":"crossref","unstructured":"Amerstorfer, C.M., and M\u00fcnster-Kistner, C.F.V. (2021). Student Perceptions of Academic Engagement and Student\u2013Teacher Relationships in Problem-Based Learning. Front. Psychol., 12.","DOI":"10.3389\/fpsyg.2021.713057"},{"key":"ref_134","doi-asserted-by":"crossref","first-page":"997","DOI":"10.1080\/07294360.2021.1901666","article-title":"Analogues of Engagement: Assessing Tertiary Student Engagement in Contemporary Face-to-Face and Blended Learning Contexts","volume":"41","author":"Bowden","year":"2021","journal-title":"High. Educ. Res. Dev."},{"key":"ref_135","doi-asserted-by":"crossref","unstructured":"Lin, X.P., Li, B.B., Yao, Z.N., Yang, Z., and Zhang, M. (2024). The Impact of Virtual Reality on Student Engagement in the Classroom\u2014A Critical Review of the Literature. Front. Psychol., 15.","DOI":"10.3389\/fpsyg.2024.1360574"},{"key":"ref_136","doi-asserted-by":"crossref","first-page":"514","DOI":"10.1080\/00221325.2022.2094211","article-title":"Teacher\u2013Student Interaction, Student\u2013Student Interaction and Social Presence: Their Impacts on Learning Engagement in Online Learning Environments","volume":"183","author":"Miao","year":"2022","journal-title":"J. Genet. Psychol."},{"key":"ref_137","doi-asserted-by":"crossref","unstructured":"Li, R. (2021). The Role of Teacher\u2013Student Interpersonal Relations in Flipped Learning on Student Engagement. Front. Psychol., 12.","DOI":"10.3389\/fpsyg.2021.741810"},{"key":"ref_138","first-page":"S31","article-title":"Student Engagement in K\u201312 Online Education During the Pandemic: The Case of Turkey","volume":"54","author":"Kurt","year":"2021","journal-title":"J. Res. Technol. Educ."},{"key":"ref_139","doi-asserted-by":"crossref","first-page":"1410","DOI":"10.1021\/acs.jchemed.1c01145","article-title":"Development and Evaluation of a Survey to Measure Student Engagement at the Activity Level in General Chemistry","volume":"99","author":"Naibert","year":"2022","journal-title":"J. Chem. Educ."},{"key":"ref_140","doi-asserted-by":"crossref","first-page":"303","DOI":"10.3200\/JRLP.142.3.303-332","article-title":"Engagement with Beauty: Appreciating Natural, Artistic, and Moral Beauty","volume":"142","author":"Diessner","year":"2008","journal-title":"J. Psychol."},{"key":"ref_141","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1186\/s40536-020-00084-z","article-title":"ICT Engagement: A new construct and its assessment in PISA 2015","volume":"8","author":"Goldhammer","year":"2020","journal-title":"Large-Scale Assess. Educ."},{"key":"ref_142","doi-asserted-by":"crossref","first-page":"345","DOI":"10.3102\/0034654316669434","article-title":"Longitudinal and Contextual Associations Between Teacher\u2013Student Relationships and Student Engagement","volume":"87","author":"Quin","year":"2017","journal-title":"Rev. Educ. Res."},{"key":"ref_143","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1123\/jtpe.2017-0065","article-title":"Psychological Needs and the Quality of Student Engagement in Physical Education: Teachers as Key Facilitators","volume":"36","author":"Curran","year":"2017","journal-title":"J. Teach. Phys. Educ."},{"key":"ref_144","unstructured":"Field, A. (2017). Discovering Statistics Using IBM SPSS Statistics, Sage. [5th ed.]."},{"key":"ref_145","unstructured":"Gallucci, M. (2015, August 10). GAMLj: General Analyses for Linear Models [Jamovi Module]. Available online: https:\/\/gamlj.github.io\/."},{"key":"ref_146","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1191\/1478088706qp063oa","article-title":"Using Thematic Analysis in Psychology","volume":"3","author":"Braun","year":"2006","journal-title":"Qual. Res. Psychol."},{"key":"ref_147","unstructured":"Vogrinc, J. (2008). Kvalitativno Raziskovanje na Pedago\u0161kem Podro\u010dju, University of Ljubljana, Faculty of Education."},{"key":"ref_148","unstructured":"Cohen, J., Cohen, P., West, S.G., and Aiken, L.S. (2003). Applied Multiple Regression\/Correlation Analysis for the Behavioral Sciences, Routledge. [3rd ed.]."},{"key":"ref_149","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1037\/1082-989X.8.4.434","article-title":"Generalized Eta and Omega Squared Statistics: Measures of Effect Size for Some Common Research Designs","volume":"8","author":"Olejnik","year":"2003","journal-title":"Psychol. Methods"},{"key":"ref_150","doi-asserted-by":"crossref","unstructured":"Hair, J.F., Sarstedt, M., Ringle, C.M., and Gudergan, S.P. (2024). Advanced Issues in Partial Least Squares Structural Equation Modeling, Sage Publications. [2nd ed.].","DOI":"10.1007\/978-3-319-05542-8_15-3"},{"key":"ref_151","first-page":"195","article-title":"Multigroup Analysis in Partial Least Squares (PLS) Path Modeling: Alternative Methods and Empirical Results","volume":"22","author":"Sarstedt","year":"2011","journal-title":"Adv. Int. Mark."},{"key":"ref_152","first-page":"311","article-title":"Predictive Model Assessment in PLS-SEM: Guidelines for Using PLSpredict","volume":"119","author":"Hair","year":"2019","journal-title":"J. Bus. Res."},{"key":"ref_153","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1108\/IMR-09-2014-0304","article-title":"Testing measurement invariance of composites using partial least squares","volume":"33","author":"Henseler","year":"2016","journal-title":"Int. Mark. Rev."},{"key":"ref_154","doi-asserted-by":"crossref","unstructured":"Azad, A., and Moore, E. (2023, January 17\u201321). Lessons Learned from Teaching System Thinking to Engineering Students. Proceedings of the Canadian Engineering Education Association (CEEA), Kelowna, BC, Canada.","DOI":"10.24908\/pceea.2023.17007"},{"key":"ref_155","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1080\/02635143.2017.1336707","article-title":"Teaching Strategies to Promote Concept Learning by Design Challenges","volume":"35","year":"2017","journal-title":"Res. Sci. Technol. Educ."},{"key":"ref_156","unstructured":"Jazizadeh, F., Shealy, T., and Garvin, M.J. (2022, January 9\u201312). Concept Maps Lead to Better Problem Statements: An Empirical Study Measuring the Effects of Priming Students to Think in Systems. Proceedings of the Construction Research Congress 2022: Health and Safety, Workforce, and Education, Arlington, VA, USA."},{"key":"ref_157","doi-asserted-by":"crossref","unstructured":"Green, C., Molloy, O., and Duggan, J. (2022). An Empirical Study of the Impact of Systems Thinking and Simulation on Sustainability Education. Sustainability, 14.","DOI":"10.20944\/preprints202111.0299.v1"},{"key":"ref_158","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1007\/s10734-004-9448-9","article-title":"Windows into the Mind","volume":"49","author":"Shavelson","year":"2005","journal-title":"High. Educ."},{"key":"ref_159","first-page":"118","article-title":"Integrating Digital Tools in Engineering Education: Social Impact of Technological Integration","volume":"58","author":"Bunjaku","year":"2024","journal-title":"IFAC-Pap"},{"key":"ref_160","unstructured":"National Assessment of Educational Progress (NAEP) (2025, August 25). Technology and Engineering Literacy Framework 2014, Available online: https:\/\/www.nagb.gov\/content\/dam\/nagb\/en\/documents\/publications\/frameworks\/technology\/2014-technology-framework-abridged.pdf."},{"key":"ref_161","first-page":"45","article-title":"The Effect of Scaffolding Strategies on Learning Outcomes in Science Learning: A Systematic Literature Review","volume":"11","author":"Azzaroiha","year":"2025","journal-title":"J. Penelit. Pendidik. IPA JPPIPA"},{"key":"ref_162","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/s10798-024-09899-1","article-title":"Do Attitudes Matter? An Investigation into Students\u2019 Attitudes Toward Engineering and Learning Performances Through Engineering-Focused STEM Curricula","volume":"35","author":"Tzeng","year":"2025","journal-title":"Int. J. Technol. Des. Educ."},{"key":"ref_163","first-page":"48","article-title":"The Relationship Between Student Attitudes Towards Technology and Technological Literacy","volume":"17","author":"Rupnik","year":"2019","journal-title":"World Trans. Eng. Technol. Educ."},{"key":"ref_164","doi-asserted-by":"crossref","first-page":"1805","DOI":"10.1007\/s10798-024-09883-9","article-title":"The impact of STEM curriculum on students\u2019 engineering design abilities and attitudes toward STEM","volume":"34","author":"Cheng","year":"2024","journal-title":"Int. J. Technol. Des. Educ."},{"key":"ref_165","doi-asserted-by":"crossref","unstructured":"Klemen, T., and Devetak, I. (2025). Introduction of Hydrosphere Environmental Problems in Lower Secondary School Chemistry Lessons. Educ. Sci., 15.","DOI":"10.3390\/educsci15010111"},{"key":"ref_166","doi-asserted-by":"crossref","unstructured":"Baptista, M., Pinho, A.S., and Alves, A.R. (2025). Students\u2019 Learning for Action through Inquiry-Based Science Education on a Local Environmental Problem. Sustainability, 17.","DOI":"10.3390\/su17093907"},{"key":"ref_167","first-page":"29","article-title":"The role of equipment and accessories in the early teaching of robotics","volume":"10","year":"2012","journal-title":"World Trans. Eng. Technol. Educ."},{"key":"ref_168","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1007\/s10648-006-9029-9","article-title":"The Control-Value Theory of Achievement Emotions: Assumptions, Corollaries, and Implications for Educational Research and Practice","volume":"18","author":"Pekrun","year":"2006","journal-title":"Educ. Psychol. Rev."},{"key":"ref_169","unstructured":"Csikszentmihalyi, M. (1991). Flow: The Psychology of Optimal Experience, Harper & Row."},{"key":"ref_170","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1177\/14639491221116907","article-title":"Redefining engineering for early childhood educators through professional development","volume":"25","author":"Xu","year":"2024","journal-title":"Contemp. Issues Early Child."},{"key":"ref_171","doi-asserted-by":"crossref","unstructured":"Chang, W.-C. (2023, January 4\u20138). The Impact of Preschool Teacher Training on STEAM Education: Professional Preparedness and Confidence. Proceedings of the 31st International Conference on Computers in Education, Matsue, Shimane Prefecture, Japan.","DOI":"10.58459\/icce.2023.1378"},{"key":"ref_172","doi-asserted-by":"crossref","first-page":"622","DOI":"10.1177\/0734282915571160","article-title":"The Development and Validation of a Measure of Student Attitudes Toward Science, Technology, Engineering, and Math (S-STEM)","volume":"33","author":"Unfried","year":"2015","journal-title":"J. Psychoeduc. Assess."},{"key":"ref_173","doi-asserted-by":"crossref","first-page":"050304","DOI":"10.1177\/016146811711900507","article-title":"The Importance of Early Attitudes Toward Mathematics and Science","volume":"119","author":"Ing","year":"2017","journal-title":"Teach. Coll. Rec."},{"key":"ref_174","doi-asserted-by":"crossref","first-page":"1253","DOI":"10.1080\/09500693.2020.1755741","article-title":"Bringing Systems Thinking into the Classroom","volume":"42","author":"Gilissen","year":"2020","journal-title":"Int. J. Sci. Educ."},{"key":"ref_175","doi-asserted-by":"crossref","unstructured":"Kordova, S.K., Frank, M., and Miller, A.N. (2018). Systems Thinking Education\u2014Seeing the Forest through the Trees. Systems, 6.","DOI":"10.3390\/systems6030029"},{"key":"ref_176","doi-asserted-by":"crossref","first-page":"518","DOI":"10.1002\/tea.20061","article-title":"Development of System Thinking Skills in the Context of Earth System Education","volume":"42","author":"Orion","year":"2005","journal-title":"J. Res. Sci. Teach."},{"key":"ref_177","doi-asserted-by":"crossref","first-page":"571","DOI":"10.1007\/s11251-022-09586-5","article-title":"Concept Map as a Tool to Assess and Enhance Students\u2019 System Thinking Skills","volume":"50","author":"Khajeloo","year":"2022","journal-title":"Instr. Sci."},{"key":"ref_178","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1063\/1.3070889","article-title":"The Physical World of the Child","volume":"25","author":"Piaget","year":"1972","journal-title":"Phys. Today"},{"key":"ref_179","unstructured":"Gauvain, M., and Cole, M. (2001). Interaction Between Learning and Development. Readings on the Development of Children, Worth. [3rd ed.]. (Original work published 1978)."},{"key":"ref_180","unstructured":"Twomey Lamb, C.T., Nightingale, D.J., and Rhodes, D.H. (2008). Collaborative Systems Thinking: Towards an Understanding of Team-Level Systems Thinking, Massachusetts Institute of Technology. Available online: https:\/\/dspace.mit.edu\/handle\/1721.1\/84133."},{"key":"ref_181","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.tsc.2018.03.003","article-title":"Assessing Systems Thinking: A Tool to Measure Complex Reasoning through Ill-Structured Problems","volume":"28","author":"Grohs","year":"2018","journal-title":"Think. Ski. Creat."},{"key":"ref_182","doi-asserted-by":"crossref","first-page":"799","DOI":"10.3102\/0034654318791584","article-title":"The Role of Collaboration, Computer Use, Learning Environments, and Supporting Strategies in CSCL: A Meta-Analysis","volume":"88","author":"Chen","year":"2018","journal-title":"Rev. Educ. Res."},{"key":"ref_183","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1186\/s41239-019-0176-8","article-title":"Mapping Research in Student Engagement and Educational Technology in Higher Education: A Systematic Evidence Map","volume":"17","author":"Bond","year":"2020","journal-title":"Int. J. Educ. Technol. High. Educ."},{"key":"ref_184","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/s11412-020-09316-4","article-title":"Good for Learning, Bad for Motivation? A Meta-Analysis on the Effects of Computer-Supported Collaboration Scripts","volume":"15","author":"Radkowitsch","year":"2020","journal-title":"Int. J. Comput.-Support. Collab. Learn."},{"key":"ref_185","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1037\/0003-066X.55.1.68","article-title":"Self-Determination Theory and the Facilitation of Intrinsic Motivation, Social Development, and Well-Being","volume":"55","author":"Ryan","year":"2000","journal-title":"Am. Psychol."},{"key":"ref_186","doi-asserted-by":"crossref","first-page":"100075","DOI":"10.1016\/j.caeo.2022.100075","article-title":"Aesthetic design of app interfaces and their impact on secondary students\u2019 interest and learning","volume":"3","author":"Ruf","year":"2022","journal-title":"Comput. Educ. Open"},{"key":"ref_187","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.compedu.2018.09.009","article-title":"The technology acceptance model (TAM): A meta-analytic structural equation modeling approach to explaining teachers\u2019 adoption of digital technology in education","volume":"128","author":"Scherer","year":"2019","journal-title":"Comput. Educ."},{"key":"ref_188","first-page":"1398","article-title":"Systems Thinking in Engineering Design: Differences in Expert vs. Novice","volume":"37","author":"Luo","year":"2021","journal-title":"Int. J. Eng. Educ."},{"key":"ref_189","doi-asserted-by":"crossref","first-page":"1591","DOI":"10.1007\/s10763-022-10308-z","article-title":"Students Do Not Always Mean What We Think They Mean: A Questioning Strategy to Elicit the Reasoning Behind Unexpected Causal Patterns in Student System Models","volume":"21","author":"Stephens","year":"2023","journal-title":"Int. J. Sci. Math. Educ."},{"key":"ref_190","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1126\/science.1230579","article-title":"Physical and Virtual Laboratories in Science and Engineering Education","volume":"340","author":"Linn","year":"2013","journal-title":"Science"},{"key":"ref_191","doi-asserted-by":"crossref","first-page":"102001","DOI":"10.1016\/j.learninstruc.2024.102001","article-title":"Complexity Affects Performance, Cognitive Load, and Awareness","volume":"94","author":"Zeitlhofer","year":"2024","journal-title":"Learn. Instr."},{"key":"ref_192","doi-asserted-by":"crossref","unstructured":"Barker, S.G. Evaluating Student Perspectives on Understanding of Complex Systems. Proceedings of the Barcelona Conference on Education (BCE 2022), Barcelona, Spain, 20\u201323 September 2022, IAFOR. Official Conference Proceedings.","DOI":"10.22492\/issn.2435-9467.2022.38"},{"key":"ref_193","first-page":"8410","article-title":"Active Learning Increases Student Performance in Science, Engineering, and Mathematics","volume":"111","author":"Freeman","year":"2014","journal-title":"Psychol. Cogn. Sci."},{"key":"ref_194","doi-asserted-by":"crossref","first-page":"21","DOI":"10.3102\/00346543069001021","article-title":"Effects of Small-Group Learning on Undergraduates in Science, Mathematics, Engineering, and Technology: A Meta-Analysis","volume":"69","author":"Springer","year":"1999","journal-title":"Rev. Educ. Res."},{"key":"ref_195","doi-asserted-by":"crossref","unstructured":"Wei, L., Zhang, W., and Lin, C. (2023). The study of the effectiveness of design-based engineering learning: The mediating role of cognitive engagement and the moderating role of modes of engagement. Front. Psychol., 14.","DOI":"10.3389\/fpsyg.2023.1151610"},{"key":"ref_196","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1146\/annurev.psych.53.100901.135153","article-title":"Motivational Beliefs, Values, and Goals","volume":"53","author":"Eccles","year":"2002","journal-title":"Annu. Rev. Psychol."},{"key":"ref_197","unstructured":"Meijers, A. (2009). Aesthetic Values in Technology and Engineering Design. Philosophy of Technology and Engineering Sciences, Elsevier."},{"key":"ref_198","unstructured":"Kolb, D.A. (1984). Experiential Learning: Experience as the Source of Learning and Development, Prentice-Hall. Available online: https:\/\/www.researchgate.net\/publication\/235701029."},{"key":"ref_199","first-page":"37","article-title":"Preschool Teacher\u2019s Beliefs about Creativity and Children\u2019s Creativeness","volume":"10","year":"2022","journal-title":"J. Educ. Gift. Young Sci."},{"key":"ref_200","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1177\/002205741319300302","article-title":"Those Who Understand: Knowledge Growth in Teaching","volume":"193","author":"Shulman","year":"2013","journal-title":"J. Educ."},{"key":"ref_201","doi-asserted-by":"crossref","first-page":"1306","DOI":"10.12688\/f1000research.25753.1","article-title":"The Effects of Touch-Screen Technology Usage on Hand Skills among Preschool Children: A Case\u2013Control Study","volume":"9","author":"Daud","year":"2020","journal-title":"F1000Research"},{"key":"ref_202","doi-asserted-by":"crossref","first-page":"930","DOI":"10.30998\/rdje.v10i2.25217","article-title":"Preparing Pre-School Children with Sensorial and Practical Life Class","volume":"10","author":"Anggini","year":"2024","journal-title":"Res. Dev. J. Educ."},{"key":"ref_203","doi-asserted-by":"crossref","first-page":"100652","DOI":"10.1016\/j.ijcci.2024.100652","article-title":"Digital Play in the Early Years: A Systematic Review","volume":"40","author":"Chu","year":"2024","journal-title":"Int. J. Child-Comput. Interact."},{"key":"ref_204","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1016\/j.chb.2019.08.003","article-title":"Teachers\u2019 Beliefs about Technology Integration in Early Childhood Education: A Meta-Ethnographical Synthesis of Qualitative Research","volume":"101","author":"Mertala","year":"2019","journal-title":"Comput. Hum. Behav."},{"key":"ref_205","first-page":"210","article-title":"Digital Competence of Early Childhood Education Teachers: Attitude, Knowledge and Use of ICT","volume":"43","year":"2019","journal-title":"Eur. J. Teach. Educ."},{"key":"ref_206","doi-asserted-by":"crossref","unstructured":"Kumar, S. (2024). Ethical Considerations in Digital Education. Online and Digital Education, Crosby Books. Available online: https:\/\/www.researchgate.net\/publication\/382017625_Ethical_Considerations_in_Digital_Education.","DOI":"10.62381\/O242701"},{"key":"ref_207","unstructured":"UNESCO (2022). The ICT Competency Framework for Teachers: Harnessing OER Project\u2014Digital Skills Development for Teachers, UNESCO. Available online: https:\/\/unesdoc.unesco.org\/ark:\/48223\/pf0000383206."},{"key":"ref_208","doi-asserted-by":"crossref","first-page":"2742","DOI":"10.1021\/acs.jchemed.9b00261","article-title":"Applications of Systems Thinking in STEM Education","volume":"96","author":"York","year":"2019","journal-title":"J. Chem. Educ."}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/14\/1\/5\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,26]],"date-time":"2025-12-26T05:13:07Z","timestamp":1766725987000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/14\/1\/5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,19]]},"references-count":208,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,1]]}},"alternative-id":["systems14010005"],"URL":"https:\/\/doi.org\/10.3390\/systems14010005","relation":{},"ISSN":["2079-8954"],"issn-type":[{"value":"2079-8954","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,19]]}}}