{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T17:18:32Z","timestamp":1772126312011,"version":"3.50.1"},"reference-count":36,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,11,14]],"date-time":"2019-11-14T00:00:00Z","timestamp":1573689600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,11,14]],"date-time":"2019-11-14T00:00:00Z","timestamp":1573689600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Smart Learn. Environ."],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>In Smart Learning Environments, students need to be aware of their academic performance so they can self-regulate their learning process. Likewise, the teaching process can also be improved if instructors are able to supervise the progress of students, both individually and globally, and anticipate proper pedagogical strategies. Thus, effective Student Models, capable of identifying and predicting the level of knowledge of students, are a key requirement in modern educational systems. In this article, we revisit OSM-V, an Open Student Model with Information Visualization capabilities that allow students and instructors to assess performance-related information in educational systems. We detail its architecture and how it was integrated into Classroom eXperience, a Smart Learning Environment with multimedia capture capabilities. We also present extended results from experiments that evaluate both the perception of utility and behavioral changes in students who used OSM-V, showing that it can positively impact students\u2019 learning and positively influence their study habits.<\/jats:p>","DOI":"10.1186\/s40561-019-0096-z","type":"journal-article","created":{"date-parts":[[2019,11,14]],"date-time":"2019-11-14T12:02:32Z","timestamp":1573732952000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Technology-enhanced assessment visualization for smart learning environments"],"prefix":"10.1186","volume":"6","author":[{"given":"Hiran","family":"Ferreira","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guilherme P.","family":"de Oliveira","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rafael","family":"Ara\u00fajo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fabiano","family":"Dor\u00e7a","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9993-8469","authenticated-orcid":false,"given":"Renan","family":"Cattelan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2019,11,14]]},"reference":[{"key":"96_CR1","doi-asserted-by":"publisher","unstructured":"Ara\u00fajo, R.D., Brant-Ribeiro, T., Cattelan, R.G., de Amo, S.A., Ferreira, H.N.M. (2013). Personalization of interactive digital media in ubiquitous educational environments. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics. https:\/\/doi.org\/10.1109\/SMC.2013.675, (pp. 3955\u20133960).","DOI":"10.1109\/SMC.2013.675"},{"key":"96_CR2","first-page":"133","volume":"20","author":"R.D. Ara\u00fajo","year":"2017","unstructured":"Ara\u00fajo, R.D., Ribeiro, T.B., Mendon\u00e7a, I.E., Mendes, M.M., Dor\u00e7a, F.A., Cattelan, R.G. (2017). Social and collaborative interactions for educational content enrichment in ULEs. Journal of Educational Technology & Society, 20, 133\u2013144.","journal-title":"Journal of Educational Technology & Society"},{"key":"96_CR3","doi-asserted-by":"crossref","unstructured":"Becheru, A., Calota, A., Popescu, E. (2018). Analyzing students\u2019collaboration patterns in a social learning environment using studentviz platform. Smart Learning Environments, 18(5).","DOI":"10.1186\/s40561-018-0063-0"},{"issue":"1-2","key":"96_CR4","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1023\/A:1011143116306","volume":"11","author":"P. Brusilovsky","year":"2001","unstructured":"Brusilovsky, P. (2001). Adaptive hypermedia. User Modeling and User-Adapted Interaction, 11(1-2), 87\u2013110.","journal-title":"User Modeling and User-Adapted Interaction"},{"key":"96_CR5","first-page":"349","volume-title":"Open Learner Models as Drivers for Metacognitive Processes","year":"2013","unstructured":"Bull, S., & Kay, J. (2013) In Azevedo, R., & Aleven, V. (Eds.), Open Learner Models as Drivers for Metacognitive Processes, (pp. 349\u2013365). New York: Springer."},{"issue":"02","key":"96_CR6","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1017\/S0958344015000282","volume":"28","author":"S. Bull","year":"2016","unstructured":"Bull, S., & Wasson, B. (2016). Competence visualisation: Making sense of data from 21 st-century technologies in language learning. ReCALL, 28(02), 147\u2013165.","journal-title":"ReCALL"},{"issue":"7","key":"96_CR7","doi-asserted-by":"publisher","first-page":"8066","DOI":"10.1016\/j.eswa.2010.12.146","volume":"38","author":"J. Clemente","year":"2011","unstructured":"Clemente, J., Ram\u00edrez, J., de Antonio, A. (2011). A proposal for student modeling based on ontologies and diagnosis rules. Expert Systems with Application, 38(7), 8066\u20138078.","journal-title":"Expert Systems with Application"},{"issue":"01","key":"96_CR8","first-page":"01","volume":"27","author":"D.A.G. De Los Reyes","year":"2019","unstructured":"De Los Reyes, D.A.G., Thomas, E.A., da Rosa, L.L., Neto, W.P.G. (2019). Student success prediction: An analysis of the demand for a transfer learning approach. Brazilian Journal of Computers in Education - RBIE, 27(01), 01.","journal-title":"Brazilian Journal of Computers in Education - RBIE"},{"issue":"1","key":"96_CR9","doi-asserted-by":"publisher","first-page":"45","DOI":"10.15388\/infedu.2016.03","volume":"15","author":"F.A. Dor\u00e7a","year":"2016","unstructured":"Dor\u00e7a, F.A., Ara\u00fajo, R.D., Carvalho, V., Resende, D., Cattelan, R.G. (2016). An automatic and dynamic approach for personalized recommendation of learning objects considering students learning styles: an experimental analysis. Informatics in Education, 15(1), 45\u201362.","journal-title":"Informatics in Education"},{"key":"96_CR10","doi-asserted-by":"publisher","unstructured":"Ferreira, H.N.M., Ribeiro, T.B., Ara\u00fajo, R.D., Dor\u00e7a, F.A., Cattelan, R.G. (2016). An automatic and dynamic student modeling approach for adaptive and intelligent educational systems using ontologies and bayesian networks. In Proceedings of the 28th International Conference on Tools with Artificial Intelligence. https:\/\/doi.org\/10.1109\/ICTAI.2016.0116, (pp. 738\u2013745).","DOI":"10.1109\/ICTAI.2016.0116"},{"key":"96_CR11","doi-asserted-by":"publisher","unstructured":"Ferreira, H.N.M., Ara\u00fajo, R.D., Dor\u00e7a, F.A., Cattelan, R.G. (2017a). Open student modeling for academic performance visualization in ubiquitous learning environments. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics. https:\/\/doi.org\/10.1109\/SMC.2017.8122679, (pp. 641\u2013646).","DOI":"10.1109\/SMC.2017.8122679"},{"key":"96_CR12","doi-asserted-by":"publisher","unstructured":"Ferreira, H.N.M., de Oliveira, G.P., Ara\u00fajo, R.D., Dor\u00e7a, F.A., Cattelan, R.G. (2019). An open model for student assessment visualization. In Proceedings of the 19th IEEE International Conference on Advanced Learning Technologies. https:\/\/doi.org\/10.1109\/ICALT.2019.00117, (pp. 375\u2013379).","DOI":"10.1109\/ICALT.2019.00117"},{"key":"96_CR13","doi-asserted-by":"publisher","unstructured":"Ferreira, H.N.M., Ribeiro, T.B., Ara\u00fajo, R.D., Dor\u00e7a, F.A., Cattelan, R.G. (2017b). An automatic and dynamic knowledge assessment module for adaptive educational systems. In Proceedings of the 17th International Conference on Advanced Learning Technologies. https:\/\/doi.org\/10.1109\/ICALT.2017.86, (pp. 517\u2013521).","DOI":"10.1109\/ICALT.2017.86"},{"issue":"8","key":"96_CR14","doi-asserted-by":"publisher","first-page":"578","DOI":"10.1093\/comjnl\/41.8.578","volume":"41","author":"C. Fraley","year":"1998","unstructured":"Fraley, C., & Raftery, A.E. (1998). How many clusters? which clustering method? answers via model-based cluster analysis. The Computer Journal, 41(8), 578\u2013588.","journal-title":"The Computer Journal"},{"key":"96_CR15","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1007\/978-3-319-39583-8_34","volume-title":"Intelligent Tutoring Systems","author":"Blandine Ginon","year":"2016","unstructured":"Ginon, B., Boscolo, C., Johnson, M.D., Bull, S. (2016). Persuading an open learner model in the context of a university course: An exploratory study. In Proceedings of the 13th International Conference on Intelligent Tutoring Systems. https:\/\/doi.org\/10.1007\/978-3-319-39583-8_34, (pp. 307\u2013313)."},{"key":"96_CR16","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1016\/j.chb.2016.02.095","volume":"61","author":"S. Greiff","year":"2016","unstructured":"Greiff, S., Niepel, C., Scherer, R., Martin, R. (2016). Understanding students\u2019 performance in a computer-based assessment of complex problem solving: An analysis of behavioral data from computer-generated log files. Computers in Human Behavior, 61, 36\u201346.","journal-title":"Computers in Human Behavior"},{"key":"96_CR17","doi-asserted-by":"publisher","unstructured":"Guerra, J., Hosseini, R., Somyurek, S., Brusilovsky, P. (2016). An intelligent interface for learning content: Combining an open learner model and social comparison to support self-regulated learning and engagement. In Proceedings of the 21st International Conference on Intelligent User Interfaces. https:\/\/doi.org\/10.1145\/2856767.2856784, (pp. 152\u2013163).","DOI":"10.1145\/2856767.2856784"},{"key":"96_CR18","unstructured":"Hair, J., Anderson, R., Babin, B. (2009). Multivariate Data Analysis, 7th edn: Prentice Hall."},{"key":"96_CR19","doi-asserted-by":"publisher","unstructured":"Harris, S.C., & Kumar, V. (2018). Identifying student difficulty in a digital learning environment. In Proceedings of the IEEE 18th International Conference on Advanced Learning Technologies. https:\/\/doi.org\/10.1109\/icalt.2018.00054, (pp. 199\u2013201).","DOI":"10.1109\/icalt.2018.00054"},{"key":"96_CR20","doi-asserted-by":"publisher","first-page":"453","DOI":"10.1007\/3-540-47987-2_48","volume-title":"Intelligent Tutoring Systems","author":"Danita Hartley","year":"2002","unstructured":"Hartley, D., & Mitrovic, A. (2002). Supporting learning by opening the student model. In Proceedings of the 6th International Conference on Intelligent Tutoring Systems. https:\/\/doi.org\/10.1007\/3-540-47987-2_48, (pp. 453\u2013462)."},{"issue":"2","key":"96_CR21","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1080\/13614568.2013.806960","volume":"19","author":"I.-H. Hsiao","year":"2013","unstructured":"Hsiao, I.-H., Bakalov, F., Brusilovsky, P., K\u00f6nig-Ries, B. (2013). Progressor: social navigation support through open social student modeling. New Review of Hypermedia and Multimedia, 19(2), 112\u2013131.","journal-title":"New Review of Hypermedia and Multimedia"},{"key":"96_CR22","doi-asserted-by":"publisher","unstructured":"Ilves, K., Leinonen, J., Hellas, A. (2018). Supporting self-regulated learning with visualizations in online learning environments. In Proceedings of the 49th ACM Technical Symposium on Computer Science Education. SIGCSE \u201918. https:\/\/doi.org\/10.1145\/3159450.3159509, (pp. 257\u2013262).","DOI":"10.1145\/3159450.3159509"},{"key":"96_CR23","unstructured":"Jacovina, M.E., Snow, E.L., Allen, L.K., Roscoe, R.D., Weston, J.L., Dai, J., McNamara, D.S. (2015). How to visualize success: Presenting complex data in a writing strategy tutor. In Proceedings of the 8th International Conference on Educational Data Mining, (pp. 594\u2013595)."},{"issue":"8","key":"96_CR24","doi-asserted-by":"publisher","first-page":"651","DOI":"10.1016\/j.patrec.2009.09.011","volume":"31","author":"A.K. Jain","year":"2010","unstructured":"Jain, A.K. (2010). Data clustering: 50 years beyond k-means. Pattern Recognition Letters, 31(8), 651\u2013666.","journal-title":"Pattern Recognition Letters"},{"issue":"1","key":"96_CR25","doi-asserted-by":"publisher","first-page":"159","DOI":"10.2307\/2529310","volume":"33","author":"J.R. Landis","year":"1977","unstructured":"Landis, J.R., & Koch, G.G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159\u2013174.","journal-title":"Biometrics"},{"key":"96_CR26","unstructured":"Li, N., Cohen, W.W., Koedinger, K.R., Matsuda, N. (2011). A machine learning approach for automatic student model discovery. In Proceedings of the 4th International Conference on Educational Data Mining, (pp. 31\u201340)."},{"key":"96_CR27","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1007\/978-3-642-04636-0_9","volume-title":"Lecture Notes in Computer Science","author":"Stefanie N. Lindstaedt","year":"2009","unstructured":"Lindstaedt, S.N., Beham, G., Kump, B., Ley, T. (2009). Getting to know your user \u2013 unobtrusive user model maintenance within work-integrated learning environments. In Proceedings of the 4th European Conference on Technology Enhanced Learning. https:\/\/doi.org\/10.1007\/978-3-642-04636-0_9, (pp. 73\u201387)."},{"key":"96_CR28","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1007\/978-3-642-39112-5_23","volume-title":"Lecture Notes in Computer Science","author":"Yanjin Long","year":"2013","unstructured":"Long, Y., & Aleven, V. (2013). Supporting students\u2019 self-regulated learning with an open learner model in a linear equation tutor. In International Conference on Artificial Intelligence in Education. https:\/\/doi.org\/10.1007\/978-3-642-39112-5_23, (pp. 219\u2013228)."},{"issue":"1","key":"96_CR29","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1007\/s11257-016-9186-6","volume":"27","author":"Yanjin Long","year":"2016","unstructured":"Long, Y., & Aleven, V. (2016). Enhancing learning outcomes through self-regulated learning support with an open learner model. User Modeling and User-Adapted Interaction, 1\u201334. https:\/\/doi.org\/10.1007\/s11257-016-9186-6.","journal-title":"User Modeling and User-Adapted Interaction"},{"key":"96_CR30","doi-asserted-by":"publisher","first-page":"481","DOI":"10.1007\/11774303_48","volume-title":"Intelligent Tutoring Systems","author":"Andrew Mabbott","year":"2006","unstructured":"Mabbott, A., & Bull, S. (2006). Student preferences for editing, persuading, and negotiating the open learner model. In Proceedings of the 8th International Conference on Intelligent Tutoring Systems. https:\/\/doi.org\/10.1007\/11774303_48, (pp. 481\u2013490)."},{"key":"96_CR31","doi-asserted-by":"publisher","first-page":"296","DOI":"10.1007\/3-540-47952-X_31","volume-title":"Proceedings of the 2nd International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems","author":"A. Mitrovic","year":"2002","unstructured":"Mitrovic, A., & Martin, B. (2002). Evaluating the effects of open student models on learning. In Proceedings of the 2nd International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems. Springer, Berlin, (pp. 296\u2013305)."},{"issue":"2","key":"96_CR32","first-page":"121","volume":"17","author":"A. Mitrovic","year":"2007","unstructured":"Mitrovic, A., & Martin, B. (2007). Evaluating the effect of open student models on self-assessment. International Journal of Artificial Intelligence in Education, 17(2), 121\u2013144.","journal-title":"International Journal of Artificial Intelligence in Education"},{"issue":"01","key":"96_CR33","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1142\/S1793206810000797","volume":"05","author":"DAVID THOMSON","year":"2010","unstructured":"Mitrovic, A., & Thomson, D. (2009). Towards a negotiable student model for constraint-based ITSs. In Proceedings of the 17th International Conference on Computers in Education. https:\/\/doi.org\/10.1142\/s1793206810000797, (pp. 83\u201390).","journal-title":"Research and Practice in Technology Enhanced Learning"},{"key":"96_CR34","doi-asserted-by":"publisher","first-page":"703","DOI":"10.1016\/j.chb.2017.03.028","volume":"76","author":"Q. Nguyen","year":"2017","unstructured":"Nguyen, Q., Rienties, B., Toetenel, L., Ferguson, R., Whitelock, D. (2017). Examining the designs of computer-based assessment and its impact on student engagement, satisfaction, and pass rates. Computers in Human Behavior, 76, 703\u2013714.","journal-title":"Computers in Human Behavior"},{"key":"96_CR35","first-page":"1","volume":"41","author":"J.A. Self","year":"1990","unstructured":"Self, J.A. (1990). Bypassing the intractable problem of student modelling. Intelligent tutoring systems: At the crossroads of artificial intelligence and education, 41, 1\u201326.","journal-title":"Intelligent tutoring systems: At the crossroads of artificial intelligence and education"},{"key":"96_CR36","doi-asserted-by":"crossref","unstructured":"Vesin, B., Mangaroska, K., Giannakos, M. (2018). Learning in smart environments: user-centered design and analytics of an adaptive learning system. Smart Learning Environments, 24(5).","DOI":"10.1186\/s40561-018-0071-0"}],"container-title":["Smart Learning Environments"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s40561-019-0096-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s40561-019-0096-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s40561-019-0096-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,13]],"date-time":"2020-11-13T00:10:39Z","timestamp":1605226239000},"score":1,"resource":{"primary":{"URL":"https:\/\/slejournal.springeropen.com\/articles\/10.1186\/s40561-019-0096-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,14]]},"references-count":36,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["96"],"URL":"https:\/\/doi.org\/10.1186\/s40561-019-0096-z","relation":{},"ISSN":["2196-7091"],"issn-type":[{"value":"2196-7091","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,14]]},"assertion":[{"value":"22 August 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 October 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 November 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"14"}}