{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,22]],"date-time":"2025-07-22T11:09:39Z","timestamp":1753182579301,"version":"3.37.3"},"reference-count":26,"publisher":"Springer Science and Business Media LLC","issue":"9","license":[{"start":{"date-parts":[[2023,10,25]],"date-time":"2023-10-25T00:00:00Z","timestamp":1698192000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,10,25]],"date-time":"2023-10-25T00:00:00Z","timestamp":1698192000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100010790","name":"Erasmus+","doi-asserted-by":"publisher","award":["2018-1-NLOI-KA203-038925"],"award-info":[{"award-number":["2018-1-NLOI-KA203-038925"]}],"id":[{"id":"10.13039\/501100010790","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Educ Inf Technol"],"published-print":{"date-parts":[[2024,6]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Between 2018\u20132021, eight European medical schools took part in a study to develop a medical knowledge Online Adaptive International Progress Test. Here we discuss participants\u2019 self-perception to evaluate the acceptability of adaptive vs non-adaptive testing. Study participants, students from across Europe at all stages of undergraduate medical education with varying levels of prior experience with progress testing, sat remotely invigilated tests using the online QuizOne\u00ae platform. Participants completed online feedback questionnaires on their experiences and perceptions of adaptive and non-adaptive tests. Overall satisfaction with the organisation and delivery of remote online tests was high regardless of previous experience with progress testing, differences in stages, programmes, and to some degree language. In statements probing the appropriateness of the level and the length of testing, differences were observed between adaptive and non-adaptive tests. There was a high level of agreement that the adaptive test was a good measure of personal knowledge and increased participants\u2019 motivation for study. Students\u2019 self-perception of the assessment is an important factor in evaluation of acceptability of the exam and its further development. In our study, the adaptive test algorithm adjusted the level of difficulty for the individual student in real-time, leading to positive perceptions of the length of the test and promoting students\u2019 engagement. The assessment increases student motivation for learning and in turn, has the potential to improve their performance.<\/jats:p>","DOI":"10.1007\/s10639-023-12269-4","type":"journal-article","created":{"date-parts":[[2023,10,25]],"date-time":"2023-10-25T08:02:46Z","timestamp":1698220966000},"page":"11323-11338","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Medical students' perceptions of a novel international adaptive progress test"],"prefix":"10.1007","volume":"29","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3959-0787","authenticated-orcid":false,"given":"Jolanta","family":"Kisielewska","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9725-7846","authenticated-orcid":false,"given":"Paul","family":"Millin","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9718-1316","authenticated-orcid":false,"given":"Neil","family":"Rice","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9497-6543","authenticated-orcid":false,"given":"Jose Miguel","family":"Pego","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0222-605X","authenticated-orcid":false,"given":"Steven","family":"Burr","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6128-4700","authenticated-orcid":false,"given":"Michal","family":"Nowakowski","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4551-5860","authenticated-orcid":false,"given":"Thomas","family":"Gale","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,10,25]]},"reference":[{"issue":"3","key":"12269_CR1","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1111\/eje.12149","volume":"20","author":"K Ali","year":"2016","unstructured":"Ali, K., Coombes, L., Kay, E., Tredwin, C., Jones, G., Ricketts, C., & Bennett, J. (2016). Progress testing in undergraduate dental education: The Peninsula experience and future opportunities. European Journal of Dental Education, 20(3), 129\u2013134. https:\/\/doi.org\/10.1111\/eje.12149","journal-title":"European Journal of Dental Education"},{"issue":"2","key":"12269_CR2","doi-asserted-by":"publisher","first-page":"130","DOI":"10.21815\/JDE.018.015","volume":"82","author":"K Ali","year":"2018","unstructured":"Ali, K., Zahra, D., Tredwin, C., Mcilwaine, C., & Jones, G. (2018). Use of progress testing in a UK dental therapy and hygiene educational program. Journal of Dental Education, 82(2), 130\u2013136. https:\/\/doi.org\/10.21815\/JDE.018.015","journal-title":"Journal of Dental Education"},{"issue":"5","key":"12269_CR3","doi-asserted-by":"publisher","first-page":"502","DOI":"10.1111\/opo.12131","volume":"34","author":"RA Armstrong","year":"2014","unstructured":"Armstrong, R. A. (2014). When to use the Bonferroni correction. Ophthalmic and Physiological Optics, 34(5), 502\u2013508. https:\/\/doi.org\/10.1111\/opo.12131","journal-title":"Ophthalmic and Physiological Optics"},{"key":"12269_CR4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/02602938.2015.1018133","volume":"41","author":"D Boud","year":"2015","unstructured":"Boud, D., & Soler, R. (2015). Sustainable assessment revisited. Assessment and Evaluation in Higher Education, 41, 1\u201314. https:\/\/doi.org\/10.1080\/02602938.2015.1018133","journal-title":"Assessment and Evaluation in Higher Education"},{"issue":"1","key":"12269_CR5","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1080\/09695940701876003","volume":"15","author":"GTL Brown","year":"2008","unstructured":"Brown, G. T. L., & Hirschfeld, G. H. F. (2008). Students\u2019 conceptions of assessment: Links to outcomes. Assessment in Education: Principles, Policy & Practice, 15(1), 3. https:\/\/doi.org\/10.1080\/09695940701876003","journal-title":"Assessment in Education: Principles, Policy & Practice"},{"key":"12269_CR6","volume-title":"Statistical power analysis for the behavioural sciences","author":"J Cohen","year":"1988","unstructured":"Cohen, J. (1988). Statistical power analysis for the behavioural sciences (2nd ed.). Lawrence Erlbaum Associates, Publishers.","edition":"2"},{"issue":"2","key":"12269_CR7","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1111\/medu.13648","volume":"53","author":"CF Collares","year":"2019","unstructured":"Collares, C. F., & Cecilio-Fernandes, D. (2019). When I say \u2026 computerised adaptive testing. Medical Education, 53(2), 115\u2013116. https:\/\/doi.org\/10.1111\/medu.13648","journal-title":"Medical Education"},{"key":"12269_CR8","unstructured":"Common European Framework of Reference for Languages (CEFR) (2018). The CEFR Levels. [online] Common European Framework of Reference for Languages (CEFR). Retrieved June 2018 from https:\/\/www.coe.int\/en\/web\/common-european-framework-reference-languages\/level-descriptions"},{"key":"12269_CR9","unstructured":"DeMars, C. E., & Erwin, T. D. (2005). Neutral or unsure: Is there a difference? Poster presented at the annual meeting of the American Psychological Association, Washington, DC, https:\/\/commons.lib.jmu.edu\/gradpsych\/30\/ Accessed Jan 2023."},{"key":"12269_CR10","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1186\/s12909-015-0428-9","volume":"15","author":"OP Devine","year":"2015","unstructured":"Devine, O. P., Harborne, A. C., & McManus, I. C. (2015). Assessment at UK medical schools varies substantially in volume, type and intensity and correlates with postgraduate attainment. BMC Medical Education, 15, 146. https:\/\/doi.org\/10.1186\/s12909-015-0428-9","journal-title":"BMC Medical Education"},{"issue":"1","key":"12269_CR11","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1111\/j.1467-8535.2012.01300.x","volume":"44","author":"ER Griff","year":"2013","unstructured":"Griff, E. R., & Matter, S. F. (2013). Evaluation of an adaptive online learning system. British Journal of Educational Technology, 44(1), 170\u2013176. https:\/\/doi.org\/10.1111\/j.1467-8535.2012.01300.x","journal-title":"British Journal of Educational Technology"},{"issue":"5","key":"12269_CR12","doi-asserted-by":"publisher","first-page":"674","DOI":"10.1177\/0193945916661302","volume":"39","author":"GWK Ho","year":"2017","unstructured":"Ho, G. W. K. (2017). Examining perceptions and attitudes: A review of likert-type scales versus Q-Methodology. Western Journal of Nursing Research, 39(5), 674\u2013689.","journal-title":"Western Journal of Nursing Research"},{"key":"12269_CR13","doi-asserted-by":"publisher","unstructured":"Hoffmeyer-Zlotnik, J. H. P. (2016). Standardisation and Harmonisation of Socio-Demographic Variables (Version 2.0).\u00a0GESIS Survey Guidelines. Mannheim, Germany: GESIS \u2013 Leibniz Institute for the Social Sciences. https:\/\/doi.org\/10.15465\/gesis-sg_en_012","DOI":"10.15465\/gesis-sg_en_012"},{"key":"12269_CR14","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1186\/s12909-021-02521-1","volume":"21","author":"A Jaap","year":"2021","unstructured":"Jaap, A., Dewar, A., Duncan, C., et al. (2021). Effect of remote online exam delivery on student experience and performance in applied knowledge tests. BMC Medical Education, 21, 86. https:\/\/doi.org\/10.1186\/s12909-021-02521-1","journal-title":"BMC Medical Education"},{"issue":"1","key":"12269_CR15","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1037\/edu0000205","volume":"10","author":"AJ Martin","year":"2018","unstructured":"Martin, A. J., & Lazendic, G. (2018). Computer-adaptive testing: Implications for students\u2019 achievement, motivation, engagement, and subjective test experience. Journal of Educational Psychology, 10(1), 27\u201345. https:\/\/doi.org\/10.1037\/edu0000205","journal-title":"Journal of Educational Psychology"},{"issue":"58","key":"12269_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.6092\/issn.1825-8670\/9891","volume":"24","author":"L Mohebi","year":"2020","unstructured":"Mohebi, L., & Bailey, F. (2020). Exploring Bem\u2019s Self perception theory in educational context. Encyclopaideia, 24(58), 1\u201310. https:\/\/doi.org\/10.6092\/issn.1825-8670\/9891","journal-title":"Encyclopaideia"},{"issue":"2","key":"12269_CR17","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1080\/00221309.2014.994590","volume":"142","author":"JT Nadler","year":"2015","unstructured":"Nadler, J. T., Weston, R., & Voyles, E. C. (2015). Stuck in the middle: The use and interpretation of mid-points in items on questionnaires. The Journal of General Psychology, 142(2), 71\u201389. https:\/\/doi.org\/10.1080\/00221309.2014.994590","journal-title":"The Journal of General Psychology"},{"key":"12269_CR18","unstructured":"R Core Team (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Retrieved June 2021 from http:\/\/www.r-project.org\/index.html"},{"key":"12269_CR19","doi-asserted-by":"publisher","first-page":"10083","DOI":"10.1016\/j.caeai.2022.100083","volume":"3","author":"N Rice","year":"2022","unstructured":"Rice, N., P\u00eago, J. M., Collares, C. F., Kisielewska, J., & Gale, T. (2022). The development and implementation of a computer adaptive progress test across European countries. Computers & Education: Artificial Intelligence, 3, 10083. https:\/\/doi.org\/10.1016\/j.caeai.2022.100083","journal-title":"Computers & Education: Artificial Intelligence"},{"key":"12269_CR20","doi-asserted-by":"publisher","first-page":"589","DOI":"10.1111\/j.1365-2923.2009.03372.x","volume":"43","author":"C Ricketts","year":"2009","unstructured":"Ricketts, C., Freeman, A., & Coombes, L. (2009). Standard setting for progress tests: Combining external and internal standards. Medical Education, 43, 589\u2013593. https:\/\/doi.org\/10.1111\/j.1365-2923.2009.03372.x","journal-title":"Medical Education"},{"key":"12269_CR21","first-page":"30","volume":"15","author":"B Ross","year":"2018","unstructured":"Ross, B., Chase, A. M., Robbie, D., Oates, G., & Absalom, Y. (2018). Adaptive quizzes to increase motivation, engagement and learning outcomes in a first year accounting unit. International Journal of Educational Technology, 15, 30.","journal-title":"International Journal of Educational Technology"},{"issue":"4","key":"12269_CR22","doi-asserted-by":"publisher","first-page":"541","DOI":"10.4300\/JGME-5-4-18","volume":"5","author":"GM Sullivan","year":"2013","unstructured":"Sullivan, G. M., & Artino, A. R., Jr. (2013). Analyzing and interpreting data from likert-type scales. Journal of Graduate Medical Education, 5(4), 541\u2013542. https:\/\/doi.org\/10.4300\/JGME-5-4-18","journal-title":"Journal of Graduate Medical Education"},{"key":"12269_CR23","doi-asserted-by":"publisher","first-page":"103","DOI":"10.3109\/01421599609034142","volume":"18","author":"C Van der Vleuten","year":"1996","unstructured":"Van der Vleuten, C., Verwijnen, G., & Wijnen, W. (1996). Fifteen years of experience with progress testing in a problem-based learning curriculum. Medical Teacher, 18, 103\u2013109. https:\/\/doi.org\/10.3109\/01421599609034142","journal-title":"Medical Teacher"},{"key":"12269_CR24","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1007\/s10648-006-9017-0","volume":"18","author":"R Vollmeyer","year":"2006","unstructured":"Vollmeyer, R., & Rheinberg, F. (2006). Motivational effects on self-regulated learning with different tasks. Educational Psychology Review, 18, 239\u2013253. https:\/\/doi.org\/10.1007\/s10648-006-9017-0","journal-title":"Educational Psychology Review"},{"key":"12269_CR25","doi-asserted-by":"crossref","unstructured":"Wainer, H., Dorans, N. J., Flaugher, R., Green, B. F., Mislevy, R. J., Steinberg, L., & Thissen, D. (2000). Computerized adaptive testing: A primer. Mahwah, NJ: Lawrence Erlbaum Associates (2nd ed).","DOI":"10.4324\/9781410605931"},{"key":"12269_CR26","doi-asserted-by":"publisher","first-page":"683","DOI":"10.3109\/0142159X.2012.704437","volume":"34","author":"W Wrigley","year":"2012","unstructured":"Wrigley, W., Van der Vleuten, C. P., Freeman, A., & Muijtjens, A. (2012). A systemic framework for the progress test: Strengths, constraints and issues. AMEE Guide No. 71. Medical Teacher, 34, 683\u2013697. https:\/\/doi.org\/10.3109\/0142159X.2012.704437","journal-title":"Medical Teacher"}],"container-title":["Education and Information Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10639-023-12269-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10639-023-12269-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10639-023-12269-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,10]],"date-time":"2024-07-10T08:36:48Z","timestamp":1720600608000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10639-023-12269-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,25]]},"references-count":26,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2024,6]]}},"alternative-id":["12269"],"URL":"https:\/\/doi.org\/10.1007\/s10639-023-12269-4","relation":{},"ISSN":["1360-2357","1573-7608"],"issn-type":[{"type":"print","value":"1360-2357"},{"type":"electronic","value":"1573-7608"}],"subject":[],"published":{"date-parts":[[2023,10,25]]},"assertion":[{"value":"26 May 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 October 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 October 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This research has been approved by the Netherlands Association for Medical Education (NVMO) Ethical Review Board, Maastricht, NERB dossier number: 2019.4.2 (25.06.2019).","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"The authors declare they have no financial interests to disclose.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Financial interests"}}]}}