{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T20:52:09Z","timestamp":1776804729694,"version":"3.51.2"},"reference-count":31,"publisher":"Emerald","issue":"3","license":[{"start":{"date-parts":[[2009,8,20]],"date-time":"2009-08-20T00:00:00Z","timestamp":1250726400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.emerald.com\/insight\/site-policies"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2009,8,20]]},"abstract":"<jats:sec><jats:title content-type=\"abstract-heading\">Purpose<\/jats:title><jats:p>The purpose of this paper is to propose and demonstrate an evidence\u2010based scenario design framework for assessment\u2010based computer games.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Design\/methodology\/approach<\/jats:title><jats:p>The evidence\u2010based scenario design framework is presented and demonstrated by using BELLA, a new assessment\u2010based gaming environment aimed at supporting student learning of vocabulary and math. BELLA integrates assessment and learning into an interactive gaming system that includes written conversations, math activities, oral and written feedback in both English and Spanish, and a visible psychometric model that is used to adaptively select activities as well as feedback levels. This paper also reports on a usability study carried out in a public middle school in New York City.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Findings<\/jats:title><jats:p>The evidence\u2010based, scenario design framework proves to be instrumental in helping combine game and assessment requirements. BELLA demonstrates how advances in artificial intelligence in education, cognitive science, educational measurement, and video games can be harnessed and integrated into valid instructional tools for the classroom.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Research limitations\/implications<\/jats:title><jats:p>This paper provides initial evidence of the potential of these kinds of assessment\u2010based gaming tools to enhance teaching and learning. Future work involves exploring student learning effects in randomized controlled studies and comparing the internal assessment models to more traditional assessment instruments.<\/jats:p><\/jats:sec><jats:sec><jats:title content-type=\"abstract-heading\">Originality\/value<\/jats:title><jats:p>BELLA is the first step toward achieving engaging, assessment\u2010based, gaming environments for a variety of Science, Technology, Engineering and Math (STEM)\u2010related areas with explicit support for English language learners.<\/jats:p><\/jats:sec>","DOI":"10.1108\/17415650911005384","type":"journal-article","created":{"date-parts":[[2009,10,17]],"date-time":"2009-10-17T07:02:25Z","timestamp":1255762945000},"page":"173-188","source":"Crossref","is-referenced-by-count":8,"title":["Combining learning and assessment in assessment\u2010based gaming environments"],"prefix":"10.1108","volume":"6","author":[{"given":"Diego","family":"Zapata\u2010Rivera","sequence":"first","affiliation":[]},{"given":"Waverely","family":"VanWinkle","sequence":"additional","affiliation":[]},{"given":"Bryan","family":"Doyle","sequence":"additional","affiliation":[]},{"given":"Alyssa","family":"Buteux","sequence":"additional","affiliation":[]},{"given":"Malcolm","family":"Bauer","sequence":"additional","affiliation":[]}],"member":"140","reference":[{"key":"key2022020920451191900_b1","doi-asserted-by":"crossref","unstructured":"Aleven, V. and Koedinger, K.R. (2002), \u201cAn effective meta\u2010cognitive strategy: Learning by doing and explaining with a computer\u2010based cognitive tutor\u201d, Cognitive Science, Vol. 26 No. 2, pp. 147\u201079.","DOI":"10.1207\/s15516709cog2602_1"},{"key":"key2022020920451191900_b2","doi-asserted-by":"crossref","unstructured":"Anderson, J.R. (2002), \u201cSpanning seven orders of magnitude: a challenge for cognitive modeling\u201d, Cognitive Science, Vol. 26 No. 1, pp. 85\u2010112.","DOI":"10.1207\/s15516709cog2601_3"},{"key":"key2022020920451191900_b3","doi-asserted-by":"crossref","unstructured":"Baker, R.S.J.D., Corbett, A.T., Roll, I. and Koedinger, K.R. (2008), \u201cDeveloping a generalizable detector of when students game the system\u201d, User Modeling and User\u2010Adapted Interaction, Vol. 18 No. 3, pp. 287\u2010314.","DOI":"10.1007\/s11257-007-9045-6"},{"key":"key2022020920451191900_b4","doi-asserted-by":"crossref","unstructured":"Black, P. and Wiliam, D. (1998), \u201cAssessment and classroom learning\u201d, Assessment in Education, Vol. 5 No. 1, pp. 7\u201074.","DOI":"10.1080\/0969595980050102"},{"key":"key2022020920451191900_b5","unstructured":"Bransford, J.D., Brown, A.L. and Cocking, R.R. (1999), How People Learn: Brain, Mind, Experience, and School, Committee on Developments in the Science of Learning Commission on Behavioral and Social Sciences and Education, NR Council, National Academy Press, Washington, DC."},{"key":"key2022020920451191900_b6","unstructured":"Bull, S. (1994), \u201cHandling native and non\u2010native language transfer in CALL: theory and practice\u201d, available at: www.eee.bham.ac.uk\/bull\/papers\u2010pdf\/LangHE95.pdf (accessed 28 March 2008)."},{"key":"key2022020920451191900_b7","unstructured":"Calder\u00f3n, M. (2007), Teaching Reading to English Language Learners, Grades 6\u201012: A Framework for Improving Achievement in the Content Areas, Corwin Press, Thousand Oaks, CA."},{"key":"key2022020920451191900_b8","unstructured":"Csikszentmihalyi, M. (1990), Flow: The Psychology of Optimal Experience, Harper and Row, New York, NY."},{"key":"key2022020920451191900_b9","unstructured":"Falmagne, J.C., Cosyn, E., Doignon, J.P. and Thiery, N. (2004), \u201cThe assessment of knowledge, in theory and in practice\u201d, available at: www.aleks.com\/about_aleks\/Science_Behind_ALEKS.pdf (accessed 28 March 2008)."},{"key":"key2022020920451191900_b10","doi-asserted-by":"crossref","unstructured":"Gee, J.P. (2003), What Video Games Have to Teach Us About Learning and Literacy, Palgrave MacMillan, New York, NY.","DOI":"10.1145\/950566.950595"},{"key":"key2022020920451191900_b11","unstructured":"Graesser, A.C., Person, N., Harter, D. and the Tutor Research Group (2001), \u201cTeaching tactics and dialog in AutoTutor\u201d, International Journal of Artificial Intelligence in Education, Vol. 12, pp. 257\u201079."},{"key":"key2022020920451191900_b12","unstructured":"Johnson, W.L., Rickel, J.W. and Lester, J.C. (2000), \u201cAnimated pedagogical agents: Face\u2010to\u2010face interaction in interactive learning environments\u201d, International Journal of Artificial Intelligence in Education, Vol. 11 No. 1, pp. 47\u201078."},{"key":"key2022020920451191900_b13","unstructured":"Kirsch, I., Braun, H., Yamamoto, K. and Sum, A. (2007), America's Perfect Storm: Three Forces Changing Our Nation's Future, Educational Testing Service, Princeton, NJ."},{"key":"key2022020920451191900_b14","unstructured":"Koedinger, K.R., Anderson, J.R., Hadley, W.H. and Mark, M.A. (1997), \u201cIntelligent tutoring goes to school in the big city\u201d, International Journal of Artificial Intelligence in Education, Vol. 8, pp. 30\u201043."},{"key":"key2022020920451191900_b15","unstructured":"Kuha, M. (1999), \u201cThe influence of interaction and instructions on speech act data\u201d, unpublished doctoral dissertation, Indiana University, Bloomington, IN."},{"key":"key2022020920451191900_b16","unstructured":"Melis, E., Andres, E., B\u00fcdenberder, J., Frishauf, A., Goguadse, G., Libbrecht, P., et al. (2001), \u201cA generic and adaptive web\u2010based learning environment\u201d, International Journal of Artificial Intelligence in Education, Vol. 12, pp. 385\u2010407."},{"key":"key2022020920451191900_b17","doi-asserted-by":"crossref","unstructured":"Messick, S. (1994), \u201cThe interplay of evidence and consequences in the validation of performance assessments\u201d, Educational Researcher, Vol. 23 No. 2, pp. 13\u201023.","DOI":"10.3102\/0013189X023002013"},{"key":"key2022020920451191900_b18","doi-asserted-by":"crossref","unstructured":"Mislevy, R.J., Steinberg, L.S. and Almond, R.G. (2003), \u201cOn the structure of educational assessment (with discussion)\u201d, Measurement: Interdisciplinary Research and Perspective, Vol. 1, pp. 3\u201062.","DOI":"10.1207\/S15366359MEA0101_02"},{"key":"key2022020920451191900_b19","doi-asserted-by":"crossref","unstructured":"Pearl, J. (1988), Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, Morgan Kaufmann, San Mateo, CA.","DOI":"10.1016\/B978-0-08-051489-5.50008-4"},{"key":"key2022020920451191900_b20","doi-asserted-by":"crossref","unstructured":"Pellegrino, J.W., Baxter, G.P. and Glaser, R. (1999), \u201cAddressing the \u2018two disciplines\u2018 problem: linking theories of cognition and learning with assessment and instructional practice\u201d, in Iran\u2010Nejad, A. and Pearson, P.D. (Eds), Review of Research in Education, Vol. 24, American Educational Research Association, Washington, DC, pp. 307\u201053.","DOI":"10.2307\/1167273"},{"key":"key2022020920451191900_b21","unstructured":"Prensky, M. (2001), Digital Game\u2010Based Learning, McGraw\u2010Hill, New York, NY."},{"key":"key2022020920451191900_b22","unstructured":"Razzaq, L., Feng, M., Nuzzo\u2010Jones, G., Heffernan, N.T., Koedinger, K.R., Junker, B., et al. (2005), \u201cThe Assistment project: blending assessment and assisting\u201d, in Looi, C.K., McCalla, G., Bredeweg, B. and Breuker, J. (Eds), Proceedings of the 12th Artificial Conference on Intelligence in Education, ISO Press, Amsterdam, pp. 555\u201062."},{"key":"key2022020920451191900_b23","unstructured":"Read, T., Barcena, E., Barros, B. and Verdejo, F. (2002), \u201cAdaptive modelling of student diagnosis and material selection for on\u2010line language learning\u201d, Journal of Intelligent & Fuzzy Systems, Vol. 12, pp. 135\u201049."},{"key":"key2022020920451191900_b24","doi-asserted-by":"crossref","unstructured":"Sadler, R. (1989), \u201cFormative assessment and the design of instructional systems\u201d, Instructional Science, Vol. 18, pp. 119\u201044.","DOI":"10.1007\/BF00117714"},{"key":"key2022020920451191900_b25","doi-asserted-by":"crossref","unstructured":"Shute, V.J., Hansen, E.G. and Almond, R.G. (2007), An Assessment for Learning System Called ACED: Designing for Learning Effectiveness and Accessibility, [RR\u201007\u201027], Educational Testing Service, Princeton, NJ.","DOI":"10.1002\/j.2333-8504.2007.tb02068.x"},{"key":"key2022020920451191900_b26","unstructured":"Snow, C.E. and Biancarosa, G. (2003), Adolescent Literacy and the Achievement Gap: What Do We Know and Where Do We Go from Here?, Carnegie Corporation of New York, New York, NY."},{"key":"key2022020920451191900_b27","doi-asserted-by":"crossref","unstructured":"Snow, R.E. and Mandinach, E.B. (1991), Integrating Assessment and Instruction: A Research and Development Agenda, [RR\u201091\u201008], Educational Testing Service, Princeton, NJ.","DOI":"10.1002\/j.2333-8504.1991.tb01374.x"},{"key":"key2022020920451191900_b28","unstructured":"Squire, K. (2003), \u201cVideo games in education\u201d, International Journal of Intelligent Simulations and Gaming, Vol. 2 No. 1, pp. 49\u201062."},{"key":"key2022020920451191900_b29","doi-asserted-by":"crossref","unstructured":"White, B.Y. and Frederiksen, J.R. (1998), \u201cInquiry, modeling, and metacognition: making science accessible to all students\u201d, Cognition and Instruction, Vol. 16 No. 1, pp. 3\u2010118.","DOI":"10.1207\/s1532690xci1601_2"},{"key":"key2022020920451191900_b30","unstructured":"Zapata\u2010Rivera, D. (2007), \u201cIndirectly visible Bayesian student models\u201d, in Laskey, K.B., Mahoney, S.M. and Goldsmith, J.A. (Eds), Proceedings of the Fifth UAI Bayesian Modelling Applications Workshop, CEUR Workshop Proceedings, Vol. 268."},{"key":"key2022020920451191900_b31","unstructured":"Zapata\u2010Rivera, D., VanWinkle, W., Shute, V., Underwood, J. and Bauer, M. (2007), \u201cEnglish ABLE\u201d, in Luckin, R., Koedinger, K. and Greer, J. (Eds), Artificial Intelligence in Education \u2013 Building Technology Rich Learning Contexts that Work, Vol. 158, pp. 323\u201030."}],"container-title":["Interactive Technology and Smart Education"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.emeraldinsight.com\/doi\/full-xml\/10.1108\/17415650911005384","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/17415650911005384\/full\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.emerald.com\/insight\/content\/doi\/10.1108\/17415650911005384\/full\/html","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T00:21:28Z","timestamp":1753402888000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.emerald.com\/itse\/article\/6\/3\/173-188\/430883"}},"subtitle":["A case study from a New York City school"],"short-title":[],"issued":{"date-parts":[[2009,8,20]]},"references-count":31,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2009,8,20]]}},"alternative-id":["10.1108\/17415650911005384"],"URL":"https:\/\/doi.org\/10.1108\/17415650911005384","relation":{},"ISSN":["1741-5659"],"issn-type":[{"value":"1741-5659","type":"print"}],"subject":[],"published":{"date-parts":[[2009,8,20]]}}}