{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T15:38:34Z","timestamp":1781105914894,"version":"3.54.1"},"reference-count":48,"publisher":"IGI Global Scientific Publishing","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2012,7,1]]},"abstract":"<p>In the past decade the serious games initiative has produced a number of games being used today as adjuncts to institutional training. Many of the games produced through the serious games initiative do not incorporate adaptive assessment to assure the acquisition of real-world skills from virtual training. Detailed performance assessment techniques are often lacking. Successful performance assessment in virtual training requires that students are placed into multiple simulated contexts and are challenged with different tasks to perform under various conditions, to specified standards. The aggregate of training situations must adequately cover the space of real-world situations. This article discusses important concepts related to virtual training performance assessment including critical tasks, performance criteria, forward recommendation, errors of commission, red screen alerts, reusable competency definitions, ill-structured domains, violent domains, and other game design templating. By integrating these concepts into serious game design, trainers can develop sufficiently varying simulated tasks to ensure that serious games meet real-world adaptive needs.<\/p>","DOI":"10.4018\/jgcms.2012070104","type":"journal-article","created":{"date-parts":[[2013,2,6]],"date-time":"2013-02-06T11:31:54Z","timestamp":1360150314000},"page":"49-64","source":"Crossref","is-referenced-by-count":2,"title":["Serious Assessments in Serious Games"],"prefix":"10.4018","volume":"4","author":[{"given":"Robert","family":"Hubal","sequence":"first","affiliation":[{"name":"RTI International, Research Triangle Park, NC, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jamie","family":"Pina","sequence":"additional","affiliation":[{"name":"RTI International, Research Triangle Park, NC, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"2432","reference":[{"key":"jgcms.2012070104-0","author":"C.Aldrich","year":"2005","journal-title":"Learning by doing: A comprehensive guide to simulations, computer games, and pedagogy in e-learning and other educational experiences"},{"key":"jgcms.2012070104-1","doi-asserted-by":"publisher","DOI":"10.1093\/bja\/88.3.369"},{"key":"jgcms.2012070104-2","first-page":"1001","article-title":"The influence of video games on social, cognitive, and affective information processing","author":"K.Bailey","year":"2011","journal-title":"Handbook of social neuroscience"},{"key":"jgcms.2012070104-3","doi-asserted-by":"publisher","DOI":"10.4018\/978-1-59904-808-6.ch063"},{"key":"jgcms.2012070104-4","first-page":"322","article-title":"Making the implicit explicit: Embedded measurement in serious games","author":"G.Bente","year":"2009","journal-title":"Serious games: Mechanisms and effects"},{"key":"jgcms.2012070104-5","doi-asserted-by":"publisher","DOI":"10.1016\/j.actpsy.2008.09.005"},{"key":"jgcms.2012070104-6","author":"D. W.Brinkerhoff","year":"2009","journal-title":"Guide to rebuilding public sector services in stability operations: A role for the military"},{"key":"jgcms.2012070104-7","doi-asserted-by":"publisher","DOI":"10.1037\/10278-000"},{"key":"jgcms.2012070104-8","doi-asserted-by":"crossref","unstructured":"Chalmers, A., & Debattista, K. (2009, March 23-24). Level of realism for serious games. In Proceedings of the Conference in Games and Virtual Worlds for Serious Applications (pp. 225-232). Washington, DC: IEEE Computer Society.","DOI":"10.1109\/VS-GAMES.2009.43"},{"issue":"3","key":"jgcms.2012070104-9","first-page":"439","article-title":"Eliciting self-explanations improves understanding.","volume":"18","author":"M. T. H.Chi","year":"1994","journal-title":"Cognitive Science"},{"key":"jgcms.2012070104-10","doi-asserted-by":"publisher","DOI":"10.1016\/j.actpsy.2010.10.003"},{"key":"jgcms.2012070104-11","first-page":"105","article-title":"The virtual pediatric standardized patient application: Formative evaluation findings","author":"R.Deterding","year":"2005","journal-title":"The magical next becomes the medical now"},{"key":"jgcms.2012070104-12","doi-asserted-by":"crossref","unstructured":"Dreyfus, S. E., & Dreyfus, H. L. (1980). A five-stage model of the mental activities involved in directed skill acquisition. Retrieved May 2, 2011, from http:\/\/handle.dtic.mil\/100.2\/ADA084551","DOI":"10.21236\/ADA084551"},{"key":"jgcms.2012070104-13","doi-asserted-by":"publisher","DOI":"10.3109\/0142159X.2011.535047"},{"key":"jgcms.2012070104-14","unstructured":"Evens, N., Whiteford, B., Frank, G., & Hubal, R. (2006). User interface lessons learned from distributed simulations. In Proceedings of the Interservice\/Industry Training, Simulation and Education Conference (pp. 1276-1285). Arlington, VA: National Defense Industrial Association."},{"key":"jgcms.2012070104-15","unstructured":"Frank, G., Gemeinhardt, D., & Ostyn, C. (2005). Linking reusable competency definitions to learning activities. In Proceedings of the Interservice\/Industry Training, Simulation and Education Conference (pp. 936-944). Arlington, VA: National Defense Industrial Association."},{"key":"jgcms.2012070104-16","unstructured":"Frank, G., Gemeinhardt, D., & Scott, B. (2008). Semantic web technology for training to meet a changing threat. In Proceedings of the Interservice\/Industry Training, Simulation and Education Conference (pp. 205-213). Arlington, VA: National Defense Industrial Association."},{"key":"jgcms.2012070104-17","unstructured":"Frank, G., Guinn, C., Hubal, R., Pope, P., Stanford, M., & Lamm-Weisel, D. (2002). JUST-TALK: An application of responsive virtual human technology. In Proceedings of the Interservice\/Industry Training, Simulation and Education Conference (pp. 773-779). Arlington, VA: National Defense Industrial Association."},{"key":"jgcms.2012070104-18","unstructured":"Frank, G., Hubal, R., & O\u2019Bea, M. (2007). Using competency definitions to adapt training for mission success. In Proceedings of the Interservice\/Industry Training, Simulation and Education Conference (pp. 1262-1270). Arlington, VA: National Defense Industrial Association."},{"key":"jgcms.2012070104-19","unstructured":"Frank, G., Whiteford, B., Hubal, R., Sonker, P., Perkins, K., & Arnold, P. \u2026 Meeds, H. (2004). Performance assessment for distributed learning using after action review reports generated by simulations. In Proceedings of the Interservice\/Industry Training, Simulation and Education Conference (pp. 808-817). Arlington, VA: National Defense Industrial Association."},{"key":"jgcms.2012070104-20","unstructured":"Grasso, B. C., Shore, M. F., Clary, C. M., Eng, B., Huckshorn, K. A., Parks, J. J., \u2026 Golash, T. J. (2007). Medication errors and patient safety in mental health. Medscape Psychiatry."},{"key":"jgcms.2012070104-21","doi-asserted-by":"publisher","DOI":"10.1177\/0956797611403320"},{"key":"jgcms.2012070104-22","unstructured":"Guinn, C., & Hubal, R. (2006). Augmented transition networks (ATNs) for dialog control: A longitudinal study. In Proceedings of the International Conference on Computational Intelligence Special Session on Natural Language Processing for Real Life Applications (No. 523-815, pp. 395-400). Calgary, AB: Acta Press."},{"key":"jgcms.2012070104-23","doi-asserted-by":"crossref","unstructured":"Hubal, R. (2005). Design and usability of military maintenance skills simulation training systems. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (pp. 2110-2114). Santa Monica, CA: Human Factors and Ergonomics Society.","DOI":"10.1177\/154193120504902409"},{"key":"jgcms.2012070104-24","unstructured":"Hubal, R., & FitzGerald, D. P. (in press). Situated assessment of social competency using embodied conversational agents: Design, testing, and extensions."},{"key":"jgcms.2012070104-25","unstructured":"Hubal, R., & Frank, G. (2008). Enticing mistakes: A strategy within simulation training of soft skills. In Proceedings of the Interservice\/Industry Training, Simulation and Education Conference (pp. 57-66). Arlington, VA: National Defense Industrial Association."},{"key":"jgcms.2012070104-26","doi-asserted-by":"publisher","DOI":"10.1016\/j.chb.2007.03.010"},{"key":"jgcms.2012070104-27","year":"2000","journal-title":"To err is human: Building a safer health system"},{"key":"jgcms.2012070104-28","year":"2012","journal-title":"International Standard Classification of Occupations 2008 (ISCO-08)"},{"key":"jgcms.2012070104-29","first-page":"223","article-title":"Virtual simulation-enhanced triage training for Iraqi medical personnel.","volume":"125","author":"P. N.Kizakevich","year":"2007","journal-title":"Studies in Health Technology and Informatics"},{"key":"jgcms.2012070104-30","first-page":"164","article-title":"Chemical agent simulator for emergency preparedness training.","volume":"98","author":"P. N.Kizakevich","year":"2004","journal-title":"Studies in Health Technology and Informatics"},{"key":"jgcms.2012070104-31","first-page":"165","article-title":"Virtual simulated patients for bioterrorism preparedness training.","volume":"94","author":"P. N.Kizakevich","year":"2003","journal-title":"Studies in Health Technology and Informatics"},{"key":"jgcms.2012070104-32","unstructured":"Krizowsky, P., Waters, H., Wright, M., Hubal, R., & Frank, G. (2008). Dynamically configured scenarios for training adaptive network system operators. In Proceedings of the Interservice\/Industry Training, Simulation and Education Conference (pp. 1392-1399). Arlington, VA: National Defense Industrial Association."},{"key":"jgcms.2012070104-33","first-page":"701","article-title":"Performance measurement in virtual environments","author":"D. R.Lampton","year":"2002","journal-title":"Handbook of virtual environments: Design, implementation and applications"},{"key":"jgcms.2012070104-34","doi-asserted-by":"publisher","DOI":"10.1007\/s10964-010-9558-x"},{"key":"jgcms.2012070104-35","doi-asserted-by":"publisher","DOI":"10.1080\/10447310902963944"},{"key":"jgcms.2012070104-36","author":"J.McGonigal","year":"2011","journal-title":"Reality is broken: Why games make us better and how they can change the world"},{"key":"jgcms.2012070104-37","unstructured":"Mills, K. C., & Hubal, R. C. (2001). Correlational data that support a constructive assessment of driving skills. In Proceedings of the Interservice\/Industry Training, Simulation and Education Conference (pp. 435-446). Arlington, VA: National Defense Industrial Association."},{"issue":"4","key":"jgcms.2012070104-38","first-page":"33","article-title":"The uncanny valley.","volume":"7","author":"M.Mori","year":"1970","journal-title":"Energy"},{"key":"jgcms.2012070104-39","doi-asserted-by":"publisher","DOI":"10.1007\/s10111-003-0143-x"},{"key":"jgcms.2012070104-40","unstructured":"Pierce, L., & Dixon, M. (2006, May 8-9). Improving multicultural teamwork to combat terrorism. In Proceedings of the Tactical Decision-Making and Situational Awareness for Defense Against Terrorism Workshop, Brussels, Belgium: North Atlantic Treaty Organization Systems."},{"key":"jgcms.2012070104-41","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1613\/jair.2989","article-title":"Narrative planning: Balancing plot and character.","volume":"39","author":"M. O.Riedl","year":"2010","journal-title":"Journal of Artificial Intelligence Research"},{"key":"jgcms.2012070104-42","doi-asserted-by":"crossref","unstructured":"Rowe, J. P., Shores, L. R., Mott, B. W., & Lester, J. C. (2010). Integrating learning and engagement in narrative-centered learning environments. In Proceedings of ITS 2010 (LNCS 6095, pp. 166-177).","DOI":"10.1007\/978-3-642-13437-1_17"},{"issue":"5","key":"jgcms.2012070104-43","first-page":"567","article-title":"Noise-induced stress as a predictor of burnout in critical care nurses.","volume":"17","author":"M.Topf","year":"1988","journal-title":"Heart & Lung"},{"key":"jgcms.2012070104-44","doi-asserted-by":"publisher","DOI":"10.1080\/17482798.2011.558258"},{"key":"jgcms.2012070104-45","author":"L. S.Vygotsky","year":"1978","journal-title":"Mind in society: The development of higher psychological processes"},{"key":"jgcms.2012070104-46","doi-asserted-by":"crossref","unstructured":"Zhang, J., Patel, V. L., & Johnson, T. R. (2002). Medical error: Is the solution medical or cognitive? Journal of the American Medical Informatics Association, 9(6,S1), s75-s77.","DOI":"10.1197\/jamia.M1232"},{"key":"jgcms.2012070104-47","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2005.297"}],"container-title":["International Journal of Gaming and Computer-Mediated Simulations"],"original-title":[],"language":"ng","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=74793","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,6,1]],"date-time":"2022-06-01T18:22:42Z","timestamp":1654107762000},"score":1,"resource":{"primary":{"URL":"https:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/jgcms.2012070104"}},"subtitle":[""],"short-title":[],"issued":{"date-parts":[[2012,7,1]]},"references-count":48,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2012,7]]}},"URL":"https:\/\/doi.org\/10.4018\/jgcms.2012070104","relation":{},"ISSN":["1942-3888","1942-3896"],"issn-type":[{"value":"1942-3888","type":"print"},{"value":"1942-3896","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,7,1]]}}}