{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T07:43:14Z","timestamp":1773042194582,"version":"3.50.1"},"publisher-location":"Cham","reference-count":40,"publisher":"Springer International Publishing","isbn-type":[{"value":"9783030577162","type":"print"},{"value":"9783030577179","type":"electronic"}],"license":[{"start":{"date-parts":[[2020,1,1]],"date-time":"2020-01-01T00:00:00Z","timestamp":1577836800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,9,7]],"date-time":"2020-09-07T00:00:00Z","timestamp":1599436800000},"content-version":"vor","delay-in-days":250,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper presents the results of a study, carried out as part of the design-based development of an online self-assessment for prospective students in higher online education. The self-assessment consists of a set of tests \u2013 predictive of completion \u2013 and is meant to improve informed decision making prior to enrolment. The rationale being that better decision making will help to address the ongoing concern of non-completion in higher online education. A prototypical design of the self-assessment was created based on an extensive literature review and correlational research, aimed at investigating validity evidence concerning the predictive value of the tests. The present study focused on investigating validity evidence regarding the content of the self-assessment (including the feedback it provides) from a user perspective. Results from a survey among prospective students (<jats:italic>N<\/jats:italic>\u2009=\u200966) indicated that predictive validity and content validity of the self-assessment are somewhat at odds: three out of the five tests included in the current prototype were considered relevant by prospective students. Moreover, students rated eleven additionally suggested tests \u2013 currently not included \u2013 as relevant concerning their study decision. Expectations regarding the feedback to be provided in connection with the tests include an explanation of the measurement and advice for further preparation. A comparison of the obtained scores to a reference group (i.e., other test-takers or successful students) is not expected. Implications for further development and evaluation of the self-assessment are discussed.<\/jats:p>","DOI":"10.1007\/978-3-030-57717-9_6","type":"book-chapter","created":{"date-parts":[[2020,9,6]],"date-time":"2020-09-06T23:02:41Z","timestamp":1599433361000},"page":"74-86","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Designing an Online Self-assessment for Informed Study Decisions: The User Perspective"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6363-5714","authenticated-orcid":false,"given":"L. E. C.","family":"Delnoij","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5104-7648","authenticated-orcid":false,"given":"J. P. W.","family":"Janssen","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8014-0916","authenticated-orcid":false,"given":"K. J. H.","family":"Dirkx","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7193-8125","authenticated-orcid":false,"given":"R. L.","family":"Martens","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,9,7]]},"reference":[{"issue":"8","key":"6_CR1","doi-asserted-by":"publisher","first-page":"855","DOI":"10.1080\/0142159X.2017.1396306","volume":"40","author":"C Boscardin","year":"2018","unstructured":"Boscardin, C., Fergus, K.B., Hellevig, B., Hauer, K.E.: Twelve tips to promote successful development of a learner performance dashboard within a medical education program. Med. Teach. 40(8), 855\u2013861 (2018)","journal-title":"Med. Teach."},{"key":"6_CR2","doi-asserted-by":"publisher","unstructured":"Broos, T., Verbert, K., Langie, G., Van Soom, C., De Laet, T.: Multi-institutional positioning test feedback dashboard for aspiring students: lessons learnt from a case study in Flanders. In: Proceedings of the 8th International Conference on learning Analytics and Knowledge, pp. 51\u201355 (2018). https:\/\/doi.org\/10.1145\/3170358.3170419","DOI":"10.1145\/3170358.3170419"},{"key":"6_CR3","doi-asserted-by":"publisher","unstructured":"Broos, T., Pinxten, M., Delporte, M., Verbert, K., De Laet, T.: Learning dashboards at scale: early warning and overall first year experience. Assessment & Evaluation in Higher Education, pp. 1\u201320 (2019). https:\/\/doi.org\/10.1080\/02602938.2019.1689546","DOI":"10.1080\/02602938.2019.1689546"},{"issue":"5","key":"6_CR4","doi-asserted-by":"publisher","first-page":"732","DOI":"10.1177\/0013164410379323","volume":"70","author":"GJ Cizek","year":"2010","unstructured":"Cizek, G.J., Bowen, D., Church, K.: Sources of validity evidence for educational and psychological tests: a follow-up study. Educ. Psychol. Measur. 70(5), 732\u2013743 (2010). https:\/\/doi.org\/10.1177\/0013164410379323","journal-title":"Educ. Psychol. Measur."},{"key":"6_CR5","volume-title":"Educational research: planning, conducting, and evaluating quantitative and qualitative research","author":"JW Creswell","year":"2014","unstructured":"Creswell, J.W.: Educational research: planning, conducting, and evaluating quantitative and qualitative research. Prentice Hall, Upper Saddle River (2014)"},{"key":"6_CR6","doi-asserted-by":"publisher","first-page":"100313","DOI":"10.1016\/j.edurev.2020.100313","volume":"29","author":"LEC Delnoij","year":"2020","unstructured":"Delnoij, L.E.C., Dirkx, K.J.H., Janssen, J.P.W., Martens, R.L.: Predicting and resolving non-completion in higher (online) education \u2013 a literature review. Educ. Res. Rev. 29, 100313 (2020). https:\/\/doi.org\/10.1016\/j.edurev.2020.100313","journal-title":"Educ. Res. Rev."},{"key":"6_CR7","doi-asserted-by":"crossref","unstructured":"Delnoij, L.E.C., et al.: Predicting completion \u2013 the road to informed study decisions in higher online education\/Manuscript submitted for publication (2020)","DOI":"10.3389\/feduc.2021.668922"},{"key":"6_CR8","doi-asserted-by":"publisher","first-page":"828","DOI":"10.3102\/0034654308321210","volume":"78","author":"P Dijkstra","year":"2008","unstructured":"Dijkstra, P., Kuyper, H., van der Werf, G., Buunk, A.P., van der Zee, Y.G.: Social comparison in the classroom: a review. Rev. Educ. Res. 78, 828\u2013879 (2008). https:\/\/doi.org\/10.3102\/0034654308321210","journal-title":"Rev. Educ. Res."},{"issue":"4","key":"6_CR9","doi-asserted-by":"publisher","first-page":"519","DOI":"10.1177\/1069072712475283","volume":"21","author":"GN Essig","year":"2013","unstructured":"Essig, G.N., Kelly, K.R.: Comparison of the effectiveness of two assessment feedback models in reducing career indecision. J. Career Assess. 21(4), 519\u2013536 (2013). https:\/\/doi.org\/10.1177\/1069072712475283","journal-title":"J. Career Assess."},{"issue":"2","key":"6_CR10","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1177\/001872675400700202","volume":"7","author":"L Festinger","year":"1954","unstructured":"Festinger, L.: A theory of social comparison processes. Hum. Relat. 7(2), 117\u2013140 (1954). https:\/\/doi.org\/10.1177\/001872675400700202","journal-title":"Hum. Relat."},{"key":"6_CR11","first-page":"56","volume":"2","author":"L Fonteyne","year":"2015","unstructured":"Fonteyne, L., Duyck, W.: Vraag het aan SIMON! [Dutch]. Thema Hoger Onderwijs 2, 56\u201360 (2015)","journal-title":"Thema Hoger Onderwijs"},{"key":"6_CR12","doi-asserted-by":"crossref","unstructured":"Jivet, I., et al.: From students with love: an empirical study on learner goals, self-regulated learning and sense-making of learning analytics in higher education (2020)","DOI":"10.1016\/j.iheduc.2020.100758"},{"issue":"2","key":"6_CR13","doi-asserted-by":"publisher","first-page":"244","DOI":"10.5858\/arpa.2018-0058-RA","volume":"143","author":"R Jug","year":"2019","unstructured":"Jug, R., Jiang, X., Bean, S.M.: Giving and receiving effective feedback. Arch. Pathol. Lab. Med. 143(2), 244\u2013251 (2019). https:\/\/doi.org\/10.5858\/arpa.2018-0058-RA","journal-title":"Arch. Pathol. Lab. Med."},{"issue":"6","key":"6_CR14","doi-asserted-by":"publisher","first-page":"740","DOI":"10.1016\/j.im.2006.05.003","volume":"43","author":"WR King","year":"2006","unstructured":"King, W.R., He, J.: A meta-analysis of the technology acceptance model. Inf. Manag. 43(6), 740\u2013755 (2006). https:\/\/doi.org\/10.1016\/j.im.2006.05.003","journal-title":"Inf. Manag."},{"key":"6_CR15","first-page":"9","volume-title":"Self-Assessment: Theorie und Konzepte","author":"KD Kubinger","year":"2012","unstructured":"Kubinger, K.D., Frebort, M., M\u00fcller, C.: Self-assessments im Rahmen der Studientberatung: M\u00f6glichkeiten und Grenzen. In: Kubinger, K.D., Frebort, M., Khorramdel, L., Weitensfelder, L. (eds.) Self-Assessment: Theorie und Konzepte, pp. 9\u201324. Pabst Science Publishers, Lengerich (2012). [German]"},{"key":"6_CR16","unstructured":"McGrath, C., et al.: Higher education entrance qualifications and exams in Europe: a comparison (2014). http:\/\/www.rand.org\/pubs\/research_reports\/RR574"},{"key":"6_CR17","doi-asserted-by":"publisher","DOI":"10.4324\/9781315105642","volume-title":"Conducting Educational Design Research","author":"S McKenney","year":"2018","unstructured":"McKenney, S., Reeves, T.C.: Conducting Educational Design Research, 2nd edn. Routledge, London (2018)","edition":"2"},{"key":"6_CR18","unstructured":"Microsoft Corporation. Microsoft Visio (2018). https:\/\/products.office.com\/en\/visio\/flowchart-software"},{"key":"6_CR19","doi-asserted-by":"publisher","first-page":"19","DOI":"10.28945\/4182","volume":"18","author":"PS Muljana","year":"2019","unstructured":"Muljana, P.S., Luo, T.: Factors contributing to student retention in online learning and recommended strategies for improvement: a systematic literature review. J. Inf. Technol. Educ. Res. 18, 19\u201357 (2019). https:\/\/doi.org\/10.28945\/4182","journal-title":"J. Inf. Technol. Educ. Res."},{"issue":"3","key":"6_CR20","doi-asserted-by":"publisher","first-page":"335","DOI":"10.1080\/02602930802255139","volume":"34","author":"DJ Nicol","year":"2009","unstructured":"Nicol, D.J.: Assessment for learner self-regulation: enhancing achievement in the first year using learning technologies. Assess. Eval. High. Educ. 34(3), 335\u2013352 (2009). https:\/\/doi.org\/10.1080\/02602930802255139","journal-title":"Assess. Eval. High. Educ."},{"issue":"2","key":"6_CR21","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1080\/03075070600572090","volume":"31","author":"DJ Nicol","year":"2006","unstructured":"Nicol, D.J., Macfarlane-Dick, D.: Formative assessment and self-regulated learning: a model and seven principles of good feedback practice. Stud. High. Educ. 31(2), 199\u2013218 (2006). https:\/\/doi.org\/10.1080\/03075070600572090","journal-title":"Stud. High. Educ."},{"issue":"4","key":"6_CR22","doi-asserted-by":"publisher","first-page":"e0153663","DOI":"10.1371\/journal.pone.0153663","volume":"11","author":"ASM Niessen","year":"2016","unstructured":"Niessen, A.S.M., Meijer, R.R., Tendeiro, J.N.: Predicting performance in higher education using proximal predictors. PloS One 11(4), e0153663 (2016). https:\/\/doi.org\/10.1371\/journal.pone.0153663","journal-title":"PloS One"},{"key":"6_CR23","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1016\/j.paid.2016.11.014","volume":"106","author":"ASM Niessen","year":"2017","unstructured":"Niessen, A.S.M., Meijer, R.R., Tendeiro, J.N.: Measuring noncognitive predictors in high-stakes contexts: the effect of self-presentation on self-report instruments used in admission to higher education. Pers. Individ. Differ. 106, 183\u2013189 (2017). https:\/\/doi.org\/10.1016\/j.paid.2016.11.014","journal-title":"Pers. Individ. Differ."},{"issue":"6","key":"6_CR24","doi-asserted-by":"publisher","first-page":"e0198746","DOI":"10.1371\/journal.pone.0198746","volume":"13","author":"ASM Niessen","year":"2018","unstructured":"Niessen, A.S.M., Meijer, R.R., Tendeiro, J.N.: Admission testing for higher education: a multi-cohort study on the validity of high-fidelity curriculum-sampling tests. PloS One 13(6), e0198746 (2018)","journal-title":"PloS One"},{"key":"6_CR25","unstructured":"Nolden, P., Wosnitza, M.: Webgest\u00fctzte Selbstreflexion von Abbruchrisiken bei Studierenden. Empirische P\u00e4dagog6ik 30(3\/4), 576\u2013603 (2016). [German]"},{"key":"6_CR26","unstructured":"Nolden, P., et al.: Enhancing student self-reflection on the situation at university. The SRT scale inventory (2019). https:\/\/www.researchgate.net\/publication\/338343147_Enhancing_student_self-reflection_The_SRT_scale_inventory. Accessed 06 Apr 2020"},{"key":"6_CR27","unstructured":"Oppedisano, V.: Open University admission policies and drop out rates in Europe (2009). https:\/\/ideas.repec.org\/p\/ucd\/wpaper\/200944.html"},{"key":"6_CR28","unstructured":"O\u2019Regan, L., Brown, M., Harding, N., McDermott, G., Ryan, S.: Technology-enabled feedback in the first year: a synthesis of the literature (2016). http:\/\/y1feedback.ie\/wp-content\/uploads\/2016\/04\/SynthesisoftheLiterature2016.pdf"},{"key":"6_CR29","unstructured":"R Core Team, R: A language and environment for statistical computing (2018). [Computer software]. https:\/\/cran.r-project.org\/"},{"issue":"1","key":"6_CR30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/S1096-7516(02)00158-6","volume":"6","author":"AP Rovai","year":"2003","unstructured":"Rovai, A.P.: In search of higher persistence rates in distance education online programs. Internet High. Educ. 6(1), 1\u201316 (2003). https:\/\/doi.org\/10.1016\/S1096-7516(02)00158-6","journal-title":"Internet High. Educ."},{"key":"6_CR31","doi-asserted-by":"publisher","first-page":"567","DOI":"10.2147\/AMEP.S139492","volume":"8","author":"KD Royal","year":"2017","unstructured":"Royal, K.D.: Four tenets of modern validity theory for medical education assessment and evaluation. Adv. Med. Educ. Pract. 8, 567 (2017). https:\/\/doi.org\/10.2147\/AMEP.S139492","journal-title":"Adv. Med. Educ. Pract."},{"key":"6_CR32","unstructured":"Sandoval, W.: Educational design research in the 21st century. In: Handbook of Design in Educational Technology, pp. 388\u2013396 (2013)"},{"key":"6_CR33","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1016\/j.jvlc.2018.11.002","volume":"50","author":"G Sedrakyan","year":"2019","unstructured":"Sedrakyan, G., Mannens, E., Verbert, K.: Guiding the choice of learning dashboard visualizations: linking dashboard design and data visualization concepts. J. Comput. Lang. 50, 19\u201338 (2019). https:\/\/doi.org\/10.1016\/j.jvlc.2018.11.002","journal-title":"J. Comput. Lang."},{"key":"6_CR34","first-page":"1","volume":"47","author":"O Simpson","year":"2010","unstructured":"Simpson, O.: 22%-can we do better? CWP Retention Lit. Rev. 47, 1\u201347 (2010)","journal-title":"CWP Retention Lit. Rev."},{"issue":"2","key":"6_CR35","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1080\/02680513.2013.847363","volume":"28","author":"O Simpson","year":"2013","unstructured":"Simpson, O.: Student retention in distance education: are we failing our students? Open Learn. J. Open Dist. e-Learn. 28(2), 105\u2013119 (2013). https:\/\/doi.org\/10.1080\/02680513.2013.847363","journal-title":"Open Learn. J. Open Dist. e-Learn."},{"key":"6_CR36","unstructured":"The jamovi project. Jamovi. (Version 1.0) [Computer Software] (2019). https:\/\/www.jamovi.org"},{"key":"6_CR37","unstructured":"Vossensteyn, H., et al.: Dropout and completion in higher education in Europe main report (2015). http:\/\/ec.europa.eu\/dgs\/education_culture\/repository\/education\/library\/study\/2015\/dropout-completion-he-summary_en.pdf"},{"key":"6_CR38","volume-title":"Praktisch UML [Dutch]","author":"J Warmer","year":"2001","unstructured":"Warmer, J., Kleppe, A.: Praktisch UML [Dutch], 2nd edn. Addison Wesley\/Pearson Education, Amsterdam (2001)","edition":"2"},{"key":"6_CR39","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1007\/s10212-011-0081-6","volume":"27","author":"M Wosnitza","year":"2012","unstructured":"Wosnitza, M., Beltman, S.: Learning and motivation in multiple contexts: the development of a heuristic framework. Eur. J. Psychol. Educ. 27, 117\u2013193 (2012). https:\/\/doi.org\/10.1007\/s10212-011-0081-6","journal-title":"Eur. J. Psychol. Educ."},{"issue":"3","key":"6_CR40","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1080\/13562517.2012.719154","volume":"18","author":"M Yang","year":"2013","unstructured":"Yang, M., Carless, D.: The feedback triangle and the enhancement of dialogic feedback processes. Teach. High. Educ. 18(3), 285\u2013297 (2013). https:\/\/doi.org\/10.1080\/13562517.2012.719154","journal-title":"Teach. High. Educ."}],"container-title":["Lecture Notes in Computer Science","Addressing Global Challenges and Quality Education"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/978-3-030-57717-9_6","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,16]],"date-time":"2022-11-16T23:13:25Z","timestamp":1668640405000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/978-3-030-57717-9_6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020]]},"ISBN":["9783030577162","9783030577179"],"references-count":40,"URL":"https:\/\/doi.org\/10.1007\/978-3-030-57717-9_6","relation":{},"ISSN":["0302-9743","1611-3349"],"issn-type":[{"value":"0302-9743","type":"print"},{"value":"1611-3349","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020]]},"assertion":[{"value":"7 September 2020","order":1,"name":"first_online","label":"First Online","group":{"name":"ChapterHistory","label":"Chapter History"}},{"value":"EC-TEL","order":1,"name":"conference_acronym","label":"Conference Acronym","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"European Conference on Technology Enhanced Learning","order":2,"name":"conference_name","label":"Conference Name","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Heidelberg","order":3,"name":"conference_city","label":"Conference City","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Germany","order":4,"name":"conference_country","label":"Conference Country","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"2020","order":5,"name":"conference_year","label":"Conference Year","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"14 September 2020","order":7,"name":"conference_start_date","label":"Conference Start Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"18 September 2020","order":8,"name":"conference_end_date","label":"Conference End Date","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"15","order":9,"name":"conference_number","label":"Conference Number","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"ectel2020","order":10,"name":"conference_id","label":"Conference ID","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"http:\/\/ectel2020.httc.de","order":11,"name":"conference_url","label":"Conference URL","group":{"name":"ConferenceInfo","label":"Conference Information"}},{"value":"Double-blind","order":1,"name":"type","label":"Type","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"easychair","order":2,"name":"conference_management_system","label":"Conference Management System","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"91","order":3,"name":"number_of_submissions_sent_for_review","label":"Number of Submissions Sent for Review","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"24","order":4,"name":"number_of_full_papers_accepted","label":"Number of Full Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"0","order":5,"name":"number_of_short_papers_accepted","label":"Number of Short Papers Accepted","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"26% - The value is computed by the equation \"Number of Full Papers Accepted \/ Number of Submissions Sent for Review * 100\" and then rounded to a whole number.","order":6,"name":"acceptance_rate_of_full_papers","label":"Acceptance Rate of Full Papers","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"3+1","order":7,"name":"average_number_of_reviews_per_paper","label":"Average Number of Reviews per Paper","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"2","order":8,"name":"average_number_of_papers_per_reviewer","label":"Average Number of Papers per Reviewer","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"Yes","order":9,"name":"external_reviewers_involved","label":"External Reviewers Involved","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}},{"value":"Due to the Corona pandemic EC-TEL 2020 was held as an virtual event.","order":10,"name":"additional_info_on_review_process","label":"Additional Info on Review Process","group":{"name":"ConfEventPeerReviewInformation","label":"Peer Review Information (provided by the conference organizers)"}}]}}