{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,11]],"date-time":"2026-02-11T12:32:14Z","timestamp":1770813134756,"version":"3.50.1"},"posted":{"date-parts":[[2026]]},"group-title":"SSRN","reference-count":39,"publisher":"Elsevier BV","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:p>Context: Software testing is an often used method to ensure software quality, with developers spending a significant amount of time on it. However, software testing education is underrepresented in curricula, particularly with regard to Conceptual Modelling (CM), where model-level validation is important. As a consequence, graduate students are insufficiently prepared for industry-level testing.\u00a0Objective: We want to understand students&amp;apos; behavioural patterns during model testing and their relationship to testing effectiveness.Method: We use process mining to analyze 554 interaction logs from students using a conceptual model simulation tool.Results: We identify three strategies: the coverage chaser (using feedback iteratively), the problem solver (balancing feedback with requirements focus), and the disconnected tester (avoiding feedback-driven iteration). High-coverage students integrated feedback into test loops; low-coverage students did not. Notably, high and average-coverage students achieved similar grades, suggesting a plateau where systematic testing enables sufficient educational performance without requiring maximum coverage.Conclusions: Our findings highlight the importance of teaching students to systematically use coverage feedback to guide test design in CM contexts.<\/jats:p>","DOI":"10.2139\/ssrn.6211639","type":"posted-content","created":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T14:41:26Z","timestamp":1770734486000},"source":"Crossref","is-referenced-by-count":0,"title":["Identifying Testing Strategies in Conceptual Modelling Education"],"prefix":"10.2139","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0037-3865","authenticated-orcid":true,"given":"Felix","family":"Cammaerts","sequence":"first","affiliation":[]},{"given":"Porfirio","family":"Tramontana","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8258-0226","authenticated-orcid":true,"given":"Nuno","family":"Flores","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0680-4443","authenticated-orcid":true,"given":"Niels","family":"Doorn","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7116-019X","authenticated-orcid":true,"given":"Anna Rita","family":"Fasolino","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8025-0023","authenticated-orcid":true,"given":"Beatriz","family":"Marin","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3431-8060","authenticated-orcid":true,"given":"Ana  C. R.","family":"Paiva","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6003-9113","authenticated-orcid":true,"given":"Tanja E. J.","family":"Vos","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3824-3214","authenticated-orcid":true,"given":"Monique","family":"Snoeck","sequence":"additional","affiliation":[]}],"member":"78","reference":[{"key":"ref1","article-title":"Foundations of software testing: ISTQB certification","author":"D Graham","year":"2006","journal-title":"Cengage Learning EMEA"},{"key":"ref2","author":"B Thalheim","year":"2011","journal-title":"Handbook of conceptual modeling: Theory, practice, and research challenges"},{"key":"ref3","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1007\/s11219-011-9136-9","article-title":"A conceptual modeling quality framework","volume":"20","author":"H J Nelson","year":"2012","journal-title":"Software Quality Journal"},{"key":"ref4","doi-asserted-by":"crossref","DOI":"10.1016\/j.jss.2020.110570","article-title":"Software-testing education: A systematic literature mapping","volume":"165","author":"V Garousi","year":"2020","journal-title":"Journal of Systems and Software"},{"key":"ref5","first-page":"59","author":"P Tramontana","year":"2024","journal-title":"State of the Practice in Software Testing Teaching in Four European Countries"},{"key":"ref6","first-page":"1","volume":"26","author":"A R Fasolino","year":"2025","journal-title":"Teachers' Perspective on Software Testing Education"},{"key":"ref7","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1145\/3287324.3287384","article-title":"Software testing in introductory programming courses a systematic mapping study","author":"L P Scatalon","year":"2019","journal-title":"SIGCSE 2019 -Proceedings of the 50th ACM Technical Symposium on Computer Science Education, ACM"},{"key":"ref8","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/j.infsof.2016.11.001","article-title":"Assessing the influence of feedback-inclusive rapid prototyping on understanding the semantics of parallel uml statecharts by novice modellers","volume":"82","author":"G Sedrakyan","year":"2017","journal-title":"Information and Software Technology"},{"issue":"3","key":"ref9","doi-asserted-by":"crossref","first-page":"323","DOI":"10.2190\/B48U-7186-2786-5429","article-title":"Experiential learning methods, simulation complexity and their effects on different target groups","volume":"36","author":"A Kluge","year":"2007","journal-title":"Journal of educational computing research"},{"key":"ref10","first-page":"140","article-title":"Investigating the Effectiveness of Feedback-Driven Exercises on Deadlock Detection Skills in Conceptual Modelling","author":"V Mekhryukova","year":"2024","journal-title":"IFIP Working Conference on The Practice of Enterprise Modeling"},{"key":"ref11","author":"A Causevic","journal-title":"Factors limiting industrial adoption of test driven development: A systematic review"},{"key":"ref12","first-page":"337","year":"2011","journal-title":"Fourth IEEE International Conference on Software Testing, Verification and Validation"},{"issue":"12","key":"ref13","first-page":"4925","article-title":"How developers engineer test cases: An observational study","volume":"48","author":"M Aniche","year":"2021","journal-title":"IEEE Transactions on Software Engineering"},{"key":"ref14","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1109\/QRS-C51114.2020.00053","article-title":"Towards a model of testers' cognitive processes: Software testing as a problem solving approach","author":"E Enoiu","year":"2020","journal-title":"2020 IEEE 20th International Conference on Software Quality, Reliability and Security Companion (QRS-C)"},{"issue":"1","key":"ref15","article-title":"A model of how students engineer test cases with feedback","volume":"24","author":"A M Shin","year":"2024","journal-title":"ACM Trans. Comput. Educ"},{"issue":"6","key":"ref16","doi-asserted-by":"crossref","first-page":"598","DOI":"10.1016\/j.datak.2010.02.002","article-title":"An approach to testing conceptual schemas","volume":"69","author":"A Tort","year":"2010","journal-title":"Data & Knowledge Engineering"},{"issue":"1","key":"ref17","first-page":"167","article-title":"Modeling difficulties in creating conceptual data models: Multimodal studies on individual modeling processes","volume":"22","author":"K Rosenthal","year":"2023","journal-title":"Software and Systems Modeling"},{"issue":"4","key":"ref18","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1080\/08993408.2019.1642699","article-title":"An empirical study to evaluate students' conceptual modeling skills using UML","volume":"29","author":"H Aljumaily","year":"2019","journal-title":"Computer Science Education"},{"key":"ref19","doi-asserted-by":"crossref","DOI":"10.1016\/j.infsof.2020.106484","article-title":"On deriving conceptual models from user requirements: An empirical study","volume":"131","author":"F Dalpiaz","year":"2021","journal-title":"Information and Software Technology"},{"key":"ref20","first-page":"1","author":"A Metzner","year":"2024","journal-title":"Systematic Teaching of UML and Behavioral Diagrams, in: 2024 36th International Conference on Software Engineering Education and Training (CSEE&T)"},{"key":"ref21","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1016\/j.compedu.2014.06.014","article-title":"Assessing the effectiveness of feedback enabled simulation in teaching conceptual modeling","volume":"78","author":"G Sedrakyan","year":"2014","journal-title":"Computers & Education"},{"issue":"1","key":"ref22","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1080\/08993408.2018.1462000","article-title":"Teaching UML and OCL models and their validation to software engineering students: an experience report","volume":"28","author":"L Burgue\ufffdo","year":"2018","journal-title":"Computer Science Education"},{"key":"ref23","author":"M Snoeck","year":"2025","journal-title":"Teaching conceptual modelling in the age of llms: shifting from model creation to model evaluation skills, Software and Systems ModelingAccepted for Publication. Available online since 2025-06-06"},{"key":"ref24","first-page":"257","article-title":"How are LLMs used for conceptual modeling? An exploratory study on interaction behavior and user perception","author":"S J Ali","year":"2024","journal-title":"International Conference on Conceptual Modeling"},{"key":"ref25","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1007\/978-3-030-02302-7_21","article-title":"Discovering the impact of students' modeling behavior on their final performance","author":"G Deeva","year":"2018","journal-title":"IFIP Working Conference on The Practice of Enterprise Modeling"},{"issue":"1","key":"ref26","first-page":"147","article-title":"A visual analysis of the process of process modeling, Information Systems and e","volume":"13","author":"J Claes","year":"2015","journal-title":"Business Management"},{"key":"ref27","first-page":"118","article-title":"Exploring How Students Test Models in Conceptual Modelling","author":"F Cammaerts","year":"2025","journal-title":"2025 IEEE\/ACM 37th International Conference on Software Engineering Education and Training (CSEE&T)"},{"key":"ref28","first-page":"1","article-title":"Analysis of Learning Behavior in a Programming Course using Process Mining and Sequential Pattern Mining","author":"E M Real","year":"2021","journal-title":"2021 IEEE Frontiers in Education Conference (FIE)"},{"issue":"2","key":"ref29","doi-asserted-by":"crossref","first-page":"897","DOI":"10.1007\/s10758-023-09677-3","article-title":"Using Sequential Pattern Mining to Understand How Students Use Guidance While Doing Scientific Calculations","volume":"29","author":"S Verstege","year":"2024","journal-title":"Technology, Knowledge and Learning"},{"issue":"1","key":"ref30","article-title":"An Education Process Mining Framework: Unveiling Meaningful Information for Understanding Students","volume":"13","author":"H Alqaheri","year":"2022","journal-title":"Learning Behavior and Improving Teaching Quality, Information"},{"key":"ref31","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-642-29044-2","volume":"236","author":"C Wohlin","year":"2012","journal-title":"Experimentation in software engineering"},{"key":"ref32","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1007\/978-3-319-12256-4_32","article-title":"Lightweight semantic prototyper for conceptual modeling","volume":"33","author":"G Sedrakyan","year":"2014","journal-title":"Advances in Conceptual Modeling: ER 2014 Workshops"},{"key":"ref33","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1007\/978-3-030-50316-1_18","article-title":"Tescav: an approach for learning model-based testing and coverage in practice","volume":"14","author":"B Mar\ufffdn","year":"2020","journal-title":"Research Challenges in Information Science: 14th International Confer-ence, RCIS 2020"},{"issue":"1","key":"ref34","article-title":"Automatic Generation of Test Cases from UML Models","volume":"21","author":"C P\ufffdrez","year":"2018","journal-title":"CLEI Electronic Journal"},{"key":"ref35","first-page":"40","article-title":"Disco: Discover your processes","author":"C W G\ufffdnther","year":"2012","journal-title":"Demonstration Track of the 10th International Conference on Business Process Management"},{"key":"ref36","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-662-49851-4","author":"W Aalst","year":"2016","journal-title":"Process Mining: Data Science in Action"},{"issue":"293","key":"ref37","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1080\/01621459.1961.10482090","article-title":"Multiple Comparisons Among Means","volume":"56","author":"O J Dunn","year":"1961","journal-title":"Journal of the American Statistical Association"},{"issue":"260","key":"ref38","doi-asserted-by":"crossref","DOI":"10.1080\/01621459.1952.10483441","article-title":"Use of ranks in one-criterion variance analysis","volume":"47","author":"W H Kruskal","year":"1952","journal-title":"J. Am. Stat. Assoc"},{"key":"ref39","first-page":"202","article-title":"Puzzle-based learning for developing software testing skills","author":"N Doorn","year":"2025","journal-title":"Proceedings of the 2025 29th International Conference on Evaluation and Assessment in Software Engineering Companion, EASE Companion '25"}],"container-title":[],"original-title":[],"deposited":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T14:45:52Z","timestamp":1770734752000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ssrn.com\/abstract=6211639"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026]]},"references-count":39,"URL":"https:\/\/doi.org\/10.2139\/ssrn.6211639","relation":{},"subject":[],"published":{"date-parts":[[2026]]},"subtype":"preprint"}}