{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:36:04Z","timestamp":1750221364376,"version":"3.41.0"},"reference-count":36,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2018,4,10]],"date-time":"2018-04-10T00:00:00Z","timestamp":1523318400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Comput. Entertain."],"published-print":{"date-parts":[[2018,4,10]]},"abstract":"<jats:p>Virtual simulation offers a viable alternative to traditional educational and training practices, offering trainees the opportunity to train until they reach a specific competency level in a safe and cost-effective manner. One of the benefits of virtual simulation is the ability to provide the trainee with feedback regarding his or her performance in the simulation, thus providing the trainee the opportunity to monitor and adapt progress toward the goal. With respect to learning and development, it has been long known that feedback plays a vital role in learning; we learn faster and more effectively when we know how we are doing and what must be changed to improve our performance. Taking advantage of the benefits afforded by peer-feedback, here we present a preliminary study that examined the application of a customized social educational network\u2014the Observational Practice and Educational Network (OPEN)\u2014to facilitate peer-feedback with respect to recorded performances of a gamified virtual simulation session developed specifically for medical-based cultural competence training. A virtual simulation session was recorded and uploaded to OPEN, which then facilitated peer-feedback by allowing the peers and educators\/experts to evaluate, provide comments, and generally discuss the recorded virtual simulation sessions. Questionnaires were employed to gauge the feasibility of a social educational network (OPEN in particular) to facilitate peer-feedback, as well as participant satisfaction with using and interacting with OPEN (i.e., examining the usability of OPEN).<\/jats:p>","DOI":"10.1145\/3180659","type":"journal-article","created":{"date-parts":[[2018,4,11]],"date-time":"2018-04-11T12:31:03Z","timestamp":1523449863000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Using a Social Educational Network to Facilitate Peer-Feedback for a Virtual Simulation"],"prefix":"10.1145","volume":"16","author":[{"given":"Zain","family":"Khan","sequence":"first","affiliation":[{"name":"University of Ontario Institute of Technology, Onatrio, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Rojas","sequence":"additional","affiliation":[{"name":"University of Toronto, Ontario, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bill","family":"Kapralos","sequence":"additional","affiliation":[{"name":"University of Ontario Institute of Technology, Onatrio, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lawrence","family":"Grierson","sequence":"additional","affiliation":[{"name":"McMaster University, Hamilton, ON"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Adam","family":"Dubrowski","sequence":"additional","affiliation":[{"name":"Memorial University, Labrador, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,4,10]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"S. Brown and P. Knight. 1994. Assessing Learners in Higher Education. London Kogan Page.  S. Brown and P. Knight. 1994. Assessing Learners in Higher Education. London Kogan Page."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1186\/1472-6920-13-79"},{"key":"e_1_2_1_3_1","first-page":"337","article-title":"Giving feedback in clinical settings","volume":"2008","author":"Cantillon P.","year":"2008","unstructured":"P. Cantillon and J. Sargeant . 2008 . Giving feedback in clinical settings . British Medical Journal 2008 , 337 . P. Cantillon and J. Sargeant. 2008. Giving feedback in clinical settings. British Medical Journal 2008, 337.","journal-title":"British Medical Journal"},{"key":"e_1_2_1_4_1","first-page":"71","article-title":"The use of Web-based learning for simulation-based education and training of central venous catheterization in novice learners","volume":"184","author":"Cheung J. J. H.","year":"2012","unstructured":"J. J. H. Cheung , J. Koh , K. Mackinnon , C. Brett , D. J. B\u00e4gli , B. Kapralos , and A. Dubrowski . 2012 . The use of Web-based learning for simulation-based education and training of central venous catheterization in novice learners . Studies in Health Technology and Informatics 184 , 71 -- 77 . J. J. H. Cheung, J. Koh, K. Mackinnon, C. Brett, D. J. B\u00e4gli, B. Kapralos, and A. Dubrowski. 2012. The use of Web-based learning for simulation-based education and training of central venous catheterization in novice learners. Studies in Health Technology and Informatics 184, 71--77.","journal-title":"Studies in Health Technology and Informatics"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1002\/chp.21153"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1111\/medu.12631"},{"key":"e_1_2_1_7_1","unstructured":"I. Dunwell S. de Freitas and S. Jarvis. 2011. Four-dimensional consideration of feedback in serious games. In Digital Games and Learning S. de Freitas and P. Maharg (Eds.). Continuum International Publishing Group London UK 42--62.  I. Dunwell S. de Freitas and S. Jarvis. 2011. Four-dimensional consideration of feedback in serious games. In Digital Games and Learning S. de Freitas and P. Maharg (Eds.). Continuum International Publishing Group London UK 42--62."},{"key":"e_1_2_1_8_1","unstructured":"English Club. 2015. Home Page. Retrieved February 7 2018 from https:\/\/www.englishclub.com\/english-for-work\/medical-diagnosis.htm.  English Club. 2015. Home Page. Retrieved February 7 2018 from https:\/\/www.englishclub.com\/english-for-work\/medical-diagnosis.htm."},{"key":"e_1_2_1_9_1","doi-asserted-by":"crossref","unstructured":"K. A. Ericsson R. T. Krampe and C. Tesch-R\u00f6mer. The role of deliberate practice in the acquisition of expert performance. Psychological Review 100 3 363.  K. A. Ericsson R. T. Krampe and C. Tesch-R\u00f6mer. The role of deliberate practice in the acquisition of expert performance. Psychological Review 100 3 363.","DOI":"10.1037\/0033-295X.100.3.363"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.326.7388.543"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10459-014-9504-x"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2923.2011.04196.x"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1080\/10401334.2012.664528"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1542\/peds.106.4.e45"},{"volume-title":"Higher Education and the Lifecourse","author":"Hounsell D.","key":"e_1_2_1_15_1","unstructured":"D. Hounsell . 2003. Student feedback, learning and development . In Higher Education and the Lifecourse , M. Slowey and D. Watson (Eds.). Open University Press , Glasgow, UK , 67--78. D. Hounsell. 2003. Student feedback, learning and development. In Higher Education and the Lifecourse, M. Slowey and D. Watson (Eds.). Open University Press, Glasgow, UK, 67--78."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1080\/07294360701658765"},{"volume-title":"A Low-Fidelity Serious Game Authoring Tool and Educational Network to Facilitate Medical-Based Cultural Competence Education. Master's Thesis","author":"Khan Z. T.","key":"e_1_2_1_17_1","unstructured":"Z. T. Khan . 2015. A Low-Fidelity Serious Game Authoring Tool and Educational Network to Facilitate Medical-Based Cultural Competence Education. Master's Thesis . University of Ontario Institute of Technology , Oshawa, Canada . Z. T. Khan. 2015. A Low-Fidelity Serious Game Authoring Tool and Educational Network to Facilitate Medical-Based Cultural Competence Education. Master's Thesis. University of Ontario Institute of Technology, Oshawa, Canada."},{"volume-title":"Proceedings of the 7th International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN\u201915)","author":"Khan Z.","key":"e_1_2_1_18_1","unstructured":"Z. Khan and B. Kapralos . 2015. Fydlyty: A low-fidelity serious game for medical-based cultural competence education . In Proceedings of the 7th International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN\u201915) . Z. Khan and B. Kapralos. 2015. Fydlyty: A low-fidelity serious game for medical-based cultural competence education. In Proceedings of the 7th International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN\u201915)."},{"key":"e_1_2_1_19_1","first-page":"135","article-title":"Feedback theory through the lens of social net-working","volume":"25","author":"Kio S. I.","year":"2015","unstructured":"S. I. Kio . 2015 . Feedback theory through the lens of social net-working . Issues in Educational Research 25 , 2, 135 -- 152 . S. I. Kio. 2015. Feedback theory through the lens of social net-working. Issues in Educational Research 25, 2, 135--152.","journal-title":"Issues in Educational Research"},{"key":"e_1_2_1_20_1","first-page":"4","article-title":"Peer feedback","volume":"7","author":"Kitay A.","year":"2005","unstructured":"A. Kitay . 2005 . Peer feedback . American Medical Association Journal of Ethics 7 , 4 . A. Kitay. 2005. Peer feedback. American Medical Association Journal of Ethics 7, 4.","journal-title":"American Medical Association Journal of Ethics"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-2923.2003.01440.x"},{"key":"e_1_2_1_22_1","volume-title":"Rethinking University Teaching: A Conversational Framework for the Effective Use of Learning Technologies","author":"Laurillard D.","unstructured":"D. Laurillard . 2002. Rethinking University Teaching: A Conversational Framework for the Effective Use of Learning Technologies ( 2 nd ed.). Routledge , London, UK . D. Laurillard. 2002. Rethinking University Teaching: A Conversational Framework for the Effective Use of Learning Technologies (2nd ed.). Routledge, London, UK.","edition":"2"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1177\/001872089403600215"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/169059.169166"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1080\/1356251042000216642"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10459-009-9191-1"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.resuscitation.2007.01.005"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1080\/09588220903184690"},{"key":"e_1_2_1_29_1","first-page":"393","article-title":"An online practice and educational networking system for technical skills: Learning experience in expert facilitated vs. independent learning communities","volume":"173","author":"Rojas D.","year":"2012","unstructured":"D. Rojas , J. J. H. Cheung , B. Weber , B. Kapralos , H. Carnahan , D. J B\u00e4gli , and A. Dubrowski . 2012 . An online practice and educational networking system for technical skills: Learning experience in expert facilitated vs. independent learning communities . Studies in Health Technology and Informatics 173 , 393 -- 397 . D. Rojas, J. J. H. Cheung, B. Weber, B. Kapralos, H. Carnahan, D. J B\u00e4gli, and A. Dubrowski. 2012. An online practice and educational networking system for technical skills: Learning experience in expert facilitated vs. independent learning communities. Studies in Health Technology and Informatics 173, 393--397.","journal-title":"Studies in Health Technology and Informatics"},{"key":"e_1_2_1_30_1","first-page":"329","article-title":"The role of game elements in online learning within health professions education","volume":"220","author":"Rojas D.","year":"2016","unstructured":"D. Rojas , B. Kapralos , and A. Dubrowski . 2016 . The role of game elements in online learning within health professions education . Studies in Health Technology and Informatics 220 , 329 -- 334 . D. Rojas, B. Kapralos, and A. Dubrowski. 2016. The role of game elements in online learning within health professions education. Studies in Health Technology and Informatics 220, 329--334.","journal-title":"Studies in Health Technology and Informatics"},{"key":"e_1_2_1_31_1","volume-title":"Designing the User Interface","author":"Shneiderman B.","unstructured":"B. Shneiderman . 1998. Designing the User Interface ( 3 rd ed.). Addison Wesley Longman , Reading, MA . B. Shneiderman. 1998. Designing the User Interface (3rd ed.). Addison Wesley Longman, Reading, MA.","edition":"3"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1080\/01443410500345172"},{"key":"e_1_2_1_33_1","unstructured":"C. W. Turner J. R. Lewis and J. Nielson. 2006. Determining usability test sample size. In International Encyclopedia of Ergonomics and Human Factors (2nd ed.; Vol. 3) W. Karwowski (Ed.). CRC Press Boca Raton FL 3084--3088.  C. W. Turner J. R. Lewis and J. Nielson. 2006. Determining usability test sample size. In International Encyclopedia of Ergonomics and Human Factors (2nd ed.; Vol. 3) W. Karwowski (Ed.). CRC Press Boca Raton FL 3084--3088."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1177\/001872089203400407"},{"volume-title":"Proceedings of the Canadian Conference on Medical Education.","author":"Welsher A.","key":"e_1_2_1_35_1","unstructured":"A. Welsher , L. E. M. Grierson , D. Rojas , Z. Khan , L. Vanderbeek , R. Brydges , B. Kapralos , and A. Dubrowski . 2015. The flexible application of observational practice and educational networking (OPEN) across a distributed medical education network . In Proceedings of the Canadian Conference on Medical Education. A. Welsher, L. E. M. Grierson, D. Rojas, Z. Khan, L. Vanderbeek, R. Brydges, B. Kapralos, and A. Dubrowski. 2015. The flexible application of observational practice and educational networking (OPEN) across a distributed medical education network. In Proceedings of the Canadian Conference on Medical Education."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1080\/01421590500126718"}],"container-title":["Computers in Entertainment"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3180659","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3180659","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:26:22Z","timestamp":1750213582000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3180659"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,4,10]]},"references-count":36,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2018,4,10]]}},"alternative-id":["10.1145\/3180659"],"URL":"https:\/\/doi.org\/10.1145\/3180659","relation":{},"ISSN":["1544-3574"],"issn-type":[{"type":"electronic","value":"1544-3574"}],"subject":[],"published":{"date-parts":[[2018,4,10]]},"assertion":[{"value":"2017-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2017-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-04-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}