{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,3]],"date-time":"2025-12-03T18:06:18Z","timestamp":1764785178488,"version":"build-2065373602"},"reference-count":35,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2023,7,17]],"date-time":"2023-07-17T00:00:00Z","timestamp":1689552000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62177022","xtzdwt2022\u2013001"],"award-info":[{"award-number":["62177022","xtzdwt2022\u2013001"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Co-Innovation Center for Educational Informatization and Balanced Development of Basic Education","award":["62177022","xtzdwt2022\u2013001"],"award-info":[{"award-number":["62177022","xtzdwt2022\u2013001"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Systems"],"abstract":"<jats:p>Although instructional feedback plays an essential role in regulating learning and improving performance, few studies have systematically investigated the needs of teachers and students for instructional feedback systems or developed designs and experiments, especially at the high school level. To address this research need, the present study investigated the needs of selected students and teachers in a high school in Hubei Province, China, and designed and developed a diagnostic visual feedback system for an experimental study with 125 students from a 10th-grade biology class in the same high school. The results showed that this diagnostic visual feedback report improved student performance (ES = 0.37) and that functions such as misconception location, knowledge diagnosis, and knowledge alert were well received by students. These findings have multiple implications for facilitating the design and development of diagnostic visual feedback systems.<\/jats:p>","DOI":"10.3390\/systems11070364","type":"journal-article","created":{"date-parts":[[2023,7,18]],"date-time":"2023-07-18T01:35:16Z","timestamp":1689644116000},"page":"364","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Designing Effective Instructional Feedback Using a Diagnostic and Visualization System: Evidence from a High School Biology Class"],"prefix":"10.3390","volume":"11","author":[{"given":"Lin","family":"Ma","sequence":"first","affiliation":[{"name":"Faculty of Artificial Intelligence in Education, Central China Normal University, Wuhan 430079, China"}]},{"given":"Xuedi","family":"Zhang","sequence":"additional","affiliation":[{"name":"Faculty of Artificial Intelligence in Education, Central China Normal University, Wuhan 430079, China"}]},{"given":"Zhifeng","family":"Wang","sequence":"additional","affiliation":[{"name":"Faculty of Artificial Intelligence in Education, Central China Normal University, Wuhan 430079, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6551-8885","authenticated-orcid":false,"given":"Heng","family":"Luo","sequence":"additional","affiliation":[{"name":"Faculty of Artificial Intelligence in Education, Central China Normal University, Wuhan 430079, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,7,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1023\/B:TRUC.0000021811.66966.1d","article-title":"Decreasing cognitive load for novice students: Effects of explanatory versus corrective feedback in discovery-based multimedia","volume":"32","author":"Moreno","year":"2004","journal-title":"Instr. Sci."},{"key":"ref_2","unstructured":"Narciss, S., and Huth, K. (2004). Instructional Design for Multimedia Learning, Waxmann."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"444","DOI":"10.1006\/ceps.1995.1030","article-title":"Control of practice and level of feedback in computer-based instruction","volume":"20","author":"Pridemore","year":"1995","journal-title":"Contemp. Educ. Psychol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"81","DOI":"10.3102\/003465430298487","article-title":"The power of feedback","volume":"77","author":"Hattie","year":"2007","journal-title":"Rev. Educ. Res."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Stobart, G. (2008). Testing Times: The Uses and Abuses of Assessment, Routledge.","DOI":"10.4324\/9780203930502"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"70","DOI":"10.3102\/0034654312474350","article-title":"Making sense of assessment feedback in higher education","volume":"83","author":"Evans","year":"2013","journal-title":"Rev. Educ. Res."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Mayer, R.E., and Alexander, P.A. (2010). Handbook of Research on Learning and Instruction, Routledge.","DOI":"10.4324\/9780203839089"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1177\/1074295618799354","article-title":"Instructional feedback: An effective, efficient, low-intensity strategy to support student success","volume":"27","author":"Oakes","year":"2018","journal-title":"Beyond Behav."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"104028","DOI":"10.1016\/j.compedu.2020.104028","article-title":"Tell me that I can do it better. The effect of attributional feedback from a learning technology on achievement emotions and performance and the moderating role of individual adaptive reactions to errors","volume":"161","author":"Schrader","year":"2021","journal-title":"Comput. Educ."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1080\/02602930801895711","article-title":"Strategies for using feedback students bring to higher education","volume":"34","author":"Burke","year":"2009","journal-title":"Assess. Eval. High. Educ."},{"key":"ref_11","first-page":"79","article-title":"Performance improvement efforts in response to negative feedback: The roles of source power and recipient self-esteem","volume":"27","author":"Fedor","year":"2001","journal-title":"J. Manag."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"254","DOI":"10.1037\/0033-2909.119.2.254","article-title":"The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory","volume":"119","author":"Kluger","year":"1996","journal-title":"Psychol. Bull."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"100027","DOI":"10.1016\/j.caeai.2021.100027","article-title":"Automatic feedback in online learning environments: A systematic literature review","volume":"2","author":"Cavalcanti","year":"2021","journal-title":"Comput. Educ. Artif. Intell."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1080\/03075079.2012.709494","article-title":"Review of assessment feedback","volume":"39","author":"Li","year":"2014","journal-title":"J. Stud. High. Educ."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"153","DOI":"10.3102\/0034654307313795","article-title":"Focus on formative feedback","volume":"78","author":"Shute","year":"2008","journal-title":"Rev. Educ. Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1080\/03075070600572090","article-title":"Formative assessment and self-regulated learning: A model and seven principles of good feedback practice","volume":"31","author":"Nicol","year":"2006","journal-title":"Stud. High. Educ."},{"key":"ref_17","unstructured":"Brookhart, S.M. (2010). Formative Assessment Strategies for Every Classroom: An ASCD Action Tool, ASCD."},{"key":"ref_18","unstructured":"Keeley, P.D. (2008). Science Formative Assessment. Volume 1: 75 Practical Strategies for Linking Assessment, Instruction, and Learning, Corwin Press."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kebodeaux, K., Field, M., and Hammond, T. (2011, January 5\u20137). Defining precise measurements with sketched annotations. Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling, Vancouver, BC, Canada.","DOI":"10.1145\/2021164.2021179"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Alem\u00e1n, J.L.F., Palmer-Brown, D., and Draganova, C. (2010, January 5\u20137). Evaluating student response driven feedback in a programming course. Proceedings of the 2010 10th IEEE International Conference on Advanced Learning Technologies, Sousse, Tunisia.","DOI":"10.1109\/ICALT.2010.82"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"104339","DOI":"10.1016\/j.compedu.2021.104339","article-title":"Do feedback strategies improve students\u2019 learning gain?\u2014Results of a randomized experiment using polling technology in physics classrooms","volume":"175","author":"Molin","year":"2021","journal-title":"Comput. Educ."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1016\/S0883-0355(99)00015-4","article-title":"The role of motivation in promoting and sustaining self-regulated learning","volume":"31","author":"Pintrich","year":"1999","journal-title":"Int. J. Educ. Res."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1080\/01587910500081269","article-title":"Student barriers to online learning: A factor analytic study","volume":"26","author":"Muilenburg","year":"2005","journal-title":"Distance Educ."},{"key":"ref_24","first-page":"1","article-title":"Online Self-Regulatory Learning Behaviors as a Mediator in the Relationship between Online Course Perceptions with Achievement","volume":"9","author":"Barnard","year":"2008","journal-title":"Int. Rev. Res. Open Dis."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1002\/tl.37219956304","article-title":"Understanding self-regulated learning","volume":"1995","author":"Pintrich","year":"1995","journal-title":"New Dir. Teach. Learn."},{"key":"ref_26","unstructured":"Pintrich, P.R., and Zusho, A. (2007). The Scholarship of Teaching and Learning in Higher Education: An Evidence-Based Perspective, Springer."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Singh, R., Gulwani, S., and Solar-Lezama, A. (2013, January 16\u201323). Automated feedback generation for introductory programming assignments. Proceedings of the 34th ACM SIGPLAN Conference on Programming Language Design and Implementation, Orlando, FL, USA.","DOI":"10.1145\/2491956.2462195"},{"key":"ref_28","unstructured":"Ellis, R., Allen, T., and Petridis, M. (2007). Applications and Innovations in Intelligent Systems XV, Proceedings of AI-2007, 27th SGAI International Conference on Innovative Techniques and Applications of Artificial Intelligence, Cambridge, UK, 10\u201312 December 2007, Springer."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"572","DOI":"10.1007\/s12528-018-9186-0","article-title":"The design, development, and implementation of student-facing learning analytics dashboards","volume":"30","author":"Bodily","year":"2018","journal-title":"J. Comput. High. Educ."},{"key":"ref_30","unstructured":"Arnold, K.E., and Pistilli, M.D. (May, January 29). Course signals at purdue: Using learning analytics to increase student success. Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, Vancouver, BC, Canada."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1007\/s11412-014-9190-y","article-title":"PolyCAFe\u2014Automatic support for the polyphonic analysis of CSCL chats","volume":"9","author":"Dascalu","year":"2014","journal-title":"Int. J. Comput. Support. Collab. Learn."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Ono, Y., Ishihara, M., and Yamashiro, M. (September, January 31). Preliminary construction of instant qualitative feedback system in foreign language teaching. Proceedings of the 2013 Second IIAI International Conference on Advanced Applied Informatics, Los Alamitos, CA, USA.","DOI":"10.1109\/IIAI-AAI.2013.70"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1561\/1500000019","article-title":"The probabilistic relevance framework: BM25 and beyond","volume":"3","author":"Robertson","year":"2009","journal-title":"Found. Trends Inf. Retr."},{"key":"ref_34","unstructured":"Zimmerman, B.J., and Schunk, D.H. (2011). Handbook of Self-Regulation of Learning and Performance, Routledge."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"304","DOI":"10.1007\/978-1-4419-1428-6_217","article-title":"ARCS model of motivation","volume":"65","author":"Keller","year":"2012","journal-title":"Encycl. Sci. Learn."}],"container-title":["Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-8954\/11\/7\/364\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:13:38Z","timestamp":1760127218000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-8954\/11\/7\/364"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,17]]},"references-count":35,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2023,7]]}},"alternative-id":["systems11070364"],"URL":"https:\/\/doi.org\/10.3390\/systems11070364","relation":{},"ISSN":["2079-8954"],"issn-type":[{"type":"electronic","value":"2079-8954"}],"subject":[],"published":{"date-parts":[[2023,7,17]]}}}