{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,23]],"date-time":"2026-06-23T03:11:22Z","timestamp":1782184282776,"version":"3.54.5"},"reference-count":52,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2024,8,26]],"date-time":"2024-08-26T00:00:00Z","timestamp":1724630400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>The benefits of teacher-facing dashboards are incontestable, yet their evidence is finite in terms of long-term use, meaningful usability, and maturity level. Thus, this paper uses design science research and critical theory to design and develop TEADASH to support teachers in making decisions on teaching and learning. Three cycles of design science research and multiple small loops were implemented to develop the dashboard. The tool was then deployed and evaluated in real time with the authentic courses. Five courses from two Swedish universities were included in this study. The co-design with teachers is crucial to the applicability of this dashboard, while letting teachers use the tool during their courses is more important to help them to recognize the features they actually use and the tool\u2019s usefulness for their teaching practices. TEADASH can address the prior matters, align with the learning design, and meet teachers\u2019 needs. The technical and co-design aspects, as well as the advantages and challenges of applying TEADASH in practice, are also discussed here.<\/jats:p>","DOI":"10.3390\/informatics11030061","type":"journal-article","created":{"date-parts":[[2024,8,26]],"date-time":"2024-08-26T07:53:37Z","timestamp":1724658817000},"page":"61","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["TEADASH: Implementing and Evaluating a Teacher-Facing Dashboard Using Design Science Research"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7034-2143","authenticated-orcid":false,"given":"Ngoc Buu Cat","family":"Nguyen","sequence":"first","affiliation":[{"name":"Department of Media and Design, School of Business, Economics and IT, University West, 461 32 Trollh\u00e4ttan, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0794-0009","authenticated-orcid":false,"given":"Marcus","family":"Lithander","sequence":"additional","affiliation":[{"name":"Department of Learning in Engineering Sciences, Royal Institute of Technology (KTH), 114 28 Stockholm, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christian Master","family":"\u00d6stlund","sequence":"additional","affiliation":[{"name":"Department of Media and Design, School of Business, Economics and IT, University West, 461 32 Trollh\u00e4ttan, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6854-785X","authenticated-orcid":false,"given":"Thashmee","family":"Karunaratne","sequence":"additional","affiliation":[{"name":"Department of Learning in Engineering Sciences, Royal Institute of Technology (KTH), 114 28 Stockholm, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2378-5432","authenticated-orcid":false,"given":"William","family":"Jobe","sequence":"additional","affiliation":[{"name":"Informatics Department, School of Business, Economics and IT, University West, 461 32 Trollh\u00e4ttan, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,8,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Alhamadi, M., Alghamdi, O., Clinch, S., and Vigo, M. (2022, January 8\u201312). Data Quality, Mismatched Expectations, and Moving Requirements: The Challenges of User-Centred Dashboard Design. Proceedings of the Nordic Human-Computer Interaction Conference, Aarhus, Denmark.","DOI":"10.1145\/3546155.3546708"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"806","DOI":"10.1016\/j.chb.2007.05.012","article-title":"Measurement and assessment in computer-supported collaborative learning","volume":"26","author":"Gress","year":"2010","journal-title":"Comput. Hum. Behav."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Dourado, R.A., Rodrigues, R.L., Ferreira, N., Mello, R.F., Gomes, A.S., and Verbert, K. (2021, January 12\u201316). A teacher-facing learning analytics dashboard for process-oriented feedback in online learning. Proceedings of the LAK21: 11th International Learning Analytics and Knowledge Conference, Irvine, CA, USA.","DOI":"10.1145\/3448139.3448187"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"937","DOI":"10.1007\/s10758-022-09598-7","article-title":"CADA: A teacher-facing learning analytics dashboard to foster teachers\u2019 awareness of students\u2019 participation and discourse patterns in online discussions","volume":"28","author":"Kaliisa","year":"2023","journal-title":"Technol. Knowl. Learn."},{"key":"ref_5","first-page":"53","article-title":"Teaching with analytics: Towards a situated model of instructional decision-making","volume":"6","author":"Wise","year":"2019","journal-title":"J. Learn. Anal."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1186\/s41239-020-00201-6","article-title":"Teaching analytics, value and tools for teacher data literacy: A systematic and tripartite approach","volume":"17","author":"Ndukwe","year":"2020","journal-title":"Int. J. Educ. Technol. High. Educ."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Kaliisa, R., Misiejuk, K., L\u00f3pez-Pernas, S., Khalil, M., and Saqr, M. (2024, January 18\u201322). Have Learning Analytics Dashboards Lived Up to the Hype? A Systematic Review of Impact on Students\u2019 Achievement, Motivation, Participation and Attitude. Proceedings of the 14th Learning Analytics and Knowledge Conference, Kyoto, Japan.","DOI":"10.1145\/3636555.3636884"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1186\/s41239-021-00313-7","article-title":"Learning analytics dashboard: A tool for providing actionable insights to learners","volume":"19","author":"Susnjak","year":"2022","journal-title":"Int. J. Educ. Technol. High. Educ."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Macfadyen, L.P., and Myers, A. (2023). The \u201cIKEA Model\u201d for Pragmatic Development of a Custom Learning Analytics Dashboard, ASCILITE Publications.","DOI":"10.14742\/apubs.2023.465"},{"key":"ref_10","unstructured":"Keim, D., Andrienko, G., Fekete, J.-D., G\u00f6rg, C., Kohlhammer, J., and Melan\u00e7on, G. (2008). Visual Analytics: Definition, Process, and Challenges, Springer."},{"key":"ref_11","first-page":"225","article-title":"Learning Analytics and Adaptive Instructional Design Strategies","volume":"6","author":"Khine","year":"2020","journal-title":"Int. J. Learn."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1285","DOI":"10.1007\/s11858-021-01310-w","article-title":"Connecting a teacher dashboard to a student digital collaborative environment: Supporting teacher enactment of problem-based mathematics curriculum","volume":"53","author":"Edson","year":"2021","journal-title":"ZDM-Math. Educ."},{"key":"ref_13","first-page":"73","article-title":"Exploratory versus explanatory visual learning analytics: Driving teachers\u2019 attention through educational data storytelling","volume":"5","author":"Echeverria","year":"2018","journal-title":"J. Learn. Anal."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1080\/0960085X.2020.1816144","article-title":"Design principles for learning analytics information systems in higher education","volume":"30","author":"Nguyen","year":"2021","journal-title":"Eur. J. Inf. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"151","DOI":"10.34190\/ejel.20.2.2189","article-title":"Technology Enhanced Learning Analytics Dashboard in Higher Education","volume":"20","author":"Jayashanka","year":"2022","journal-title":"Electron. J. e-Learn."},{"key":"ref_16","unstructured":"Corrin, L., Kennedy, G., De Barba, P., Bakharia, A., Lockyer, L., Ga\u0161evi\u0107, D., Williams, D., Dawson, S., and Copeland, S. (December, January 30). Loop: A learning analytics tool to provide teachers with useful data visualisation. Proceedings of the Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education, Perth, Australia."},{"key":"ref_17","unstructured":"de Menezes, D.A.T., Flor\u00eancio, D.L., Silva, R.E.D., Nunes, I.D., Schiel, U., and de Aquino, M.S. (2017, January 3\u20137). David\u2014A model of data visualization for the instructional design. Proceedings of the 2017 IEEE 17th International Conference on Advanced Learning Technologies (ICALT), Timisoara, Romania."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Nguyen, Q., Huptych, M., and Rienties, B. (2018, January 7\u20139). Linking students\u2019 timing of engagement to learning design and academic performance. Proceedings of the 8th International Conference on Learning Analytics and Knowledge, Sydney, NSW, Australia.","DOI":"10.1145\/3170358.3170398"},{"key":"ref_19","unstructured":"Molenaar, I., and Knoop-van Campen, C. (2017). Teacher dashboards in practice: Usage and impact. Data Driven Approaches in Digital Education: Proceedings of the 12th European Conference on Technology Enhanced Learning, EC-TEL 2017, Tallinn, Estonia, 12\u201315 September 2017, Springer. Proceedings 12."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"265","DOI":"10.18608\/jla.2022.7643","article-title":"FoLA 2\u2014A Method for Co-Creating Learning Analytics-Supported Learning Design","volume":"9","author":"Schmitz","year":"2022","journal-title":"J. Learn. Anal."},{"key":"ref_21","first-page":"71","article-title":"Contextualising learning analytics with classroom observations: A case study","volume":"44","author":"Eradze","year":"2020","journal-title":"IDA Interact. Des. Archit. (S)"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Schmitz, M., Scheffel, M., van Limbeek, E., Bemelmans, R., and Drachsler, H. (2018). \u201cMake It Personal!\u201d\u2014Gathering Input from Stakeholders for a Learning Analytics-Supported Learning DesignTool. Lifelong Technology-Enhanced Learning: Proceedings of the 13th European Conference on Technology Enhanced Learning, EC-TEL 2018, Leeds, UK, 3\u20135 September 2018, Springer. Proceedings 13.","DOI":"10.1007\/978-3-319-98572-5_23"},{"key":"ref_23","unstructured":"D\u00f6rk, M., Feng, P., Collins, C., and Carpendale, S. (May, January 27). Critical InfoVis: Exploring the politics of visualization. Proceedings of the CHI\u201913 Extended Abstracts on Human Factors in Computing Systems, Paris, France."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Echeverria, V., Martinez-Maldonado, R., Granda, R., Chiluiza, K., Conati, C., and Buckingham Shum, S. (2018, January 7\u20139). Driving data storytelling from learning design. Proceedings of the 8th International Conference on Learning Analytics and Knowledge, Sydney, NSW, Australia.","DOI":"10.1145\/3170358.3170380"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"45","DOI":"10.2753\/MIS0742-1222240302","article-title":"A design science research methodology for information systems research","volume":"24","author":"Peffers","year":"2007","journal-title":"J. Manag. Inf. Syst."},{"key":"ref_26","first-page":"2","article-title":"Research perspectives: The anatomy of a design principle","volume":"21","author":"Gregor","year":"2020","journal-title":"J. Assoc. Inf. Syst."},{"key":"ref_27","unstructured":"Semyonovich, V.L. (1978). Mind in society. The Development of Higher Psychological Processes, Harvard University Press."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1207\/S15326985EP3801_1","article-title":"Cognitive load theory and instructional design: Recent developments","volume":"38","author":"Paas","year":"2003","journal-title":"Educ. Psychol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1007\/s10648-012-9210-2","article-title":"The value of applied research: Retrieval practice improves classroom learning and recommendations from a teacher, a principal, and a scientist","volume":"24","author":"Agarwal","year":"2012","journal-title":"Educ. Psychol. Rev."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.tics.2010.09.003","article-title":"The critical role of retrieval practice in long-term retention","volume":"15","author":"Roediger","year":"2011","journal-title":"Trends Cogn. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"19251","DOI":"10.1073\/pnas.1821936116","article-title":"Measuring actual learning versus feeling of learning in response to being actively engaged in the classroom","volume":"116","author":"Deslauriers","year":"2019","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1007\/s10648-014-9256-4","article-title":"Integrating cognitive science and technology improves learning in a STEM classroom","volume":"26","author":"Butler","year":"2014","journal-title":"Educ. Psychol. Rev."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1038\/s41539-019-0046-0","article-title":"What we learned from creating one of the world\u2019s most popular MOOCs","volume":"4","author":"Oakley","year":"2019","journal-title":"NPJ Sci. Learn."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1002\/acp.3482","article-title":"Thirty years of research on online learning","volume":"33","author":"Mayer","year":"2019","journal-title":"Appl. Cogn. Psychol."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1379","DOI":"10.1007\/s10648-021-09606-9","article-title":"Five strategies for optimizing instructional materials: Instructor-and learner-managed cognitive load","volume":"33","author":"Fiorella","year":"2021","journal-title":"Educ. Psychol. Rev."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Nguyen, N.B.C., and Karunaratne, T. (2024). Learning Analytics with Small Datasets\u2014State of the Art and Beyond. Educ. Sci., 14.","DOI":"10.3390\/educsci14060608"},{"key":"ref_37","unstructured":"Nguyen, N.B.C. (2022, January 27\u201328). Improving Online Learning Design for Employed Adult Learners. Proceedings of the European Conference on e-Learning, Brighton, UK."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"75","DOI":"10.2307\/25148625","article-title":"Design science in information systems research","volume":"2004","author":"Hevner","year":"2004","journal-title":"MIS Q."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"133","DOI":"10.18608\/jla.2021.7279","article-title":"Intelligent Learning Analytics Dashboards: Automated Drill-Down Recommendations to Support Teacher Data Exploration","volume":"8","author":"Khosravi","year":"2021","journal-title":"J. Learn. Anal."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Gibson, A., and Kitto, K. (2015, January 16\u201320). Analysing reflective text for learning analytics: An approach using anomaly recontextualisation. Proceedings of the Fifth International Conference on Learning Analytics and Knowledge, Poughkeepsie, NY, USA.","DOI":"10.1145\/2723576.2723635"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Schmitz, M., Scheffel, M., van Limbeek, E., van Halem, N., Cornelisz, I., van Klaveren, C., Bemelmans, R., and Drachsler, H. (2018). Investigating the relationships between online activity, learning strategies and grades to create learning analytics-supported learning designs. Lifelong Technology-Enhanced Learning: Proceedings of the 13th European Conference on Technology Enhanced Learning, EC-TEL 2018, Leeds, UK, 3\u20135 September 2018, Springer. Proceedings 13.","DOI":"10.1007\/978-3-319-98572-5_24"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"34","DOI":"10.24059\/olj.v23i3.2057","article-title":"Learning Analytics to Inform the Learning Design: Supporting Instructors\u2019 Inquiry into Student Learning in Unsupervised Technology-Enhanced Platforms","volume":"23","author":"Harindranathan","year":"2019","journal-title":"Online Learn."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1186\/s41239-020-00217-y","article-title":"Impact of using learning analytics in asynchronous online discussions in higher education","volume":"17","year":"2020","journal-title":"Int. J. Educ. Technol. High. Educ."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Nguyen, Q., Rienties, B., and Toetenel, L. (2017, January 13\u201317). Unravelling the dynamics of instructional practice: A longitudinal study on learning design and VLE activities. Proceedings of the Seventh International Learning Analytics & Knowledge Conference, Vancouver, BC, Canada.","DOI":"10.1145\/3027385.3027409"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Aslan, S., Alyuz, N., Tanriover, C., Mete, S.E., Okur, E., D\u2019Mello, S.K., and Arslan Esme, A. (2019, January 4\u20139). Investigating the impact of a real-time, multimodal student engagement analytics technology in authentic classrooms. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Glasgow, UK.","DOI":"10.1145\/3290605.3300534"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Garnett, T., and Button, D. (2016, January 27\u201330). A case study exploring video access by students: Wrangling and visualising data for measuring digital behaviour. Proceedings of the 33rd International Conference of Innovation, Practice and Research in the Use of Educational Technologies in Tertiary Education, Adelaide, Australia.","DOI":"10.14742\/apubs.2016.862"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1186\/s41239-023-00394-6","article-title":"A checklist to guide the planning, designing, implementation, and evaluation of learning analytics dashboards","volume":"20","author":"Kaliisa","year":"2023","journal-title":"Int. J. Educ. Technol. High. Educ."},{"key":"ref_48","first-page":"1","article-title":"Learning analytics for collaborative language learning in classrooms","volume":"24","author":"Wen","year":"2021","journal-title":"Educ. Technol. Soc."},{"key":"ref_49","unstructured":"Lockyer, L., and Dawson, S. (March, January 27). Learning designs and learning analytics. Proceedings of the 1st International Conference on Learning Analytics and Knowledge, Banff, AB, Canada."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"516","DOI":"10.1109\/TLT.2018.2868673","article-title":"Learning analytics for learning design: A systematic literature review of analytics-driven design to enhance learning","volume":"12","author":"Mangaroska","year":"2018","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_51","unstructured":"Laurillard, D. (2013). Teaching as a Design Science: Building Pedagogical Patterns for Learning and Technology, Routledge."},{"key":"ref_52","unstructured":"Mangaroska, K., and Giannakos, M. (2017). Learning analytics for learning design: Towards evidence-driven decisions to enhance learning. Data Driven Approaches in Digital Education: Proceedings of the 12th European Conference on Technology Enhanced Learning, EC-TEL 2017, Tallinn, Estonia, 12\u201315 September 2017, Springer. Proceedings 12."}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/11\/3\/61\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:42:52Z","timestamp":1760110972000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/11\/3\/61"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,26]]},"references-count":52,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2024,9]]}},"alternative-id":["informatics11030061"],"URL":"https:\/\/doi.org\/10.3390\/informatics11030061","relation":{},"ISSN":["2227-9709"],"issn-type":[{"value":"2227-9709","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,26]]}}}