{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,11]],"date-time":"2025-11-11T22:29:06Z","timestamp":1762900146547,"version":"3.41.0"},"reference-count":86,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2021,4,13]],"date-time":"2021-04-13T00:00:00Z","timestamp":1618272000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100005992","name":"Woodrow Wilson National Fellowship Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100005992","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["ACI-1443068, DRL-1740798"],"award-info":[{"award-number":["ACI-1443068, DRL-1740798"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,4,13]]},"abstract":"<jats:p>Practice is essential for learning. However, for many interpersonal skills, there often are not enough opportunities and venues for novices to repeatedly practice. Role-playing simulations offer a promising framework to advance practice-based professional training for complex communication skills, in fields such as teaching. In this work, we introduce ELK (Eliciting Learner Knowledge), a role-playing simulation system that helps K-12 teachers develop effective questioning strategies to elicit learners' prior knowledge. We evaluate ELK with 75 pre-service teachers through a mixed-method study. We find that teachers demonstrate a modest increase in effective questioning strategies and develop sympathy towards students after using ELK for 3 rounds. We implement a supplementary activity in ELK in which users evaluate transcripts generated from past role-play sessions. We have tentative evidence that a combination of role-play and evaluating conversation moves may be more effective for learning. We contribute design implications of using role-play systems for communication strategy training.<\/jats:p>","DOI":"10.1145\/3449125","type":"journal-article","created":{"date-parts":[[2021,4,22]],"date-time":"2021-04-22T17:47:23Z","timestamp":1619113643000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Practice-Based Teacher Questioning Strategy Training with ELK"],"prefix":"10.1145","volume":"5","author":[{"given":"Xu","family":"Wang","sequence":"first","affiliation":[{"name":"University of Michigan, Ann Arbor, MI, USA"}]},{"given":"Meredith","family":"Thompson","sequence":"additional","affiliation":[{"name":"Massachusetts Institute of Technology, Cambridge, MA, USA"}]},{"given":"Kexin","family":"Yang","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}]},{"given":"Dan","family":"Roy","sequence":"additional","affiliation":[{"name":"Massachusetts Institute of Technology, Cambridge, MA, USA"}]},{"given":"Kenneth R.","family":"Koedinger","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}]},{"given":"Carolyn P.","family":"Rose","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}]},{"given":"Justin","family":"Reich","sequence":"additional","affiliation":[{"name":"Massachusetts Institute of Technology, Cambridge, MA, USA"}]}],"member":"320","published-online":{"date-parts":[[2021,4,22]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351229"},{"key":"e_1_2_1_2_1","volume-title":"Chelsea Johnson Martinez, and Eric J Knuth","author":"Alibali Martha W","year":"2014","unstructured":"Martha W Alibali, Mitchell J Nathan, Matthew S Wolfgram, R Breckinridge Church, Steven A Jacobs, Chelsea Johnson Martinez, and Eric J Knuth. 2014. How teachers link ideas in mathematics instruction using speech and gesture: A corpus analysis. Cognition and instruction, Vol. 32, 1 (2014), 65--100."},{"volume-title":"How learning works: Seven research-based principles for smart teaching","author":"Ambrose Susan A","key":"e_1_2_1_3_1","unstructured":"Susan A Ambrose, Michael W Bridges, Michele DiPietro, Marsha C Lovett, and Marie K Norman. 2010a. How learning works: Seven research-based principles for smart teaching. John Wiley & Sons."},{"volume-title":"How learning works: Seven research-based principles for smart teaching","author":"Ambrose Susan A","key":"e_1_2_1_4_1","unstructured":"Susan A Ambrose, Michael W Bridges, Michele DiPietro, Marsha C Lovett, and Marie K Norman. 2010b. How learning works: Seven research-based principles for smart teaching. John Wiley & Sons."},{"key":"e_1_2_1_5_1","volume-title":"Classroom discussions in math: A facilitator's guide to support professional learning of discourse and the Common Core","author":"Anderson NC","year":"2012","unstructured":"NC Anderson, SH Chapin, and CO O'Connor. 2012. Classroom discussions in math: A facilitator's guide to support professional learning of discourse and the Common Core. Sausalito, CA: Math Solutions (2012)."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-2648.1993.18050808.x"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300534"},{"key":"e_1_2_1_8_1","volume-title":"Developing practice, developing practitioners: Toward a practice-based theory of professional education. Teaching as the learning profession: Handbook of policy and practice","author":"Ball Deborah Loewenberg","year":"1999","unstructured":"Deborah Loewenberg Ball and David K Cohen. 1999. Developing practice, developing practitioners: Toward a practice-based theory of professional education. Teaching as the learning profession: Handbook of policy and practice, Vol. 1 (1999), 3--22."},{"key":"e_1_2_1_9_1","volume-title":"et almbox","author":"Bransford John D","year":"2000","unstructured":"John D Bransford, Ann L Brown, Rodney R Cocking, et almbox. 2000. How people learn. Vol. 11. Washington, DC: National academy press."},{"key":"e_1_2_1_10_1","volume-title":"Using thematic analysis in psychology. Qualitative research in psychology","author":"Braun Virginia","year":"2006","unstructured":"Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology, Vol. 3, 2 (2006), 77--101."},{"key":"e_1_2_1_11_1","first-page":"E6","article-title":"Science communication to the general public: why we need to teach undergraduate and graduate students this skill as part of their formal scientific training","volume":"12","author":"Brownell Sara E","year":"2013","unstructured":"Sara E Brownell, Jordan V Price, and Lawrence Steinman. 2013. Science communication to the general public: why we need to teach undergraduate and graduate students this skill as part of their formal scientific training. Journal of undergraduate neuroscience education, Vol. 12, 1 (2013), E6.","journal-title":"Journal of undergraduate neuroscience education"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173868"},{"key":"e_1_2_1_13_1","first-page":"141","article-title":"Comparison the effect of teaching of SBAR technique with role play and lecturing on communication skill of nurses","volume":"3","author":"Chaharsoughi Narges Toghian","year":"2014","unstructured":"Narges Toghian Chaharsoughi, Shahnaz Ahrari, and Shahnaz Alikhah. 2014. Comparison the effect of teaching of SBAR technique with role play and lecturing on communication skill of nurses. Journal of caring sciences, Vol. 3, 2 (2014), 141.","journal-title":"Journal of caring sciences"},{"key":"e_1_2_1_14_1","volume-title":"Project Challenge: Using challenging curriculum and mathematical discourse to help all students learn. High-expectation curricula: Helping all students succeed with powerful learning","author":"Chapin S","year":"2012","unstructured":"S Chapin and Catherine O'Connor. 2012. Project Challenge: Using challenging curriculum and mathematical discourse to help all students learn. High-expectation curricula: Helping all students succeed with powerful learning (2012), 113--127."},{"key":"e_1_2_1_15_1","volume-title":"9: Researching the Impact of Educational Development: Basis for Informed Practice. To improve the academy","author":"Note Chism Nancy Van","year":"2012","unstructured":"Nancy Van Note Chism, Matthew Holley, and Cameron J Harris. 2012. 9: Researching the Impact of Educational Development: Basis for Informed Practice. To improve the academy, Vol. 31, 1 (2012), 129--145."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3116595.3116632"},{"key":"e_1_2_1_17_1","volume-title":"mbox","author":"National Research Council et al","year":"2004","unstructured":"National Research Council et almbox. 2004. How students learn: History, mathematics, and science in the classroom. National Academies Press."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1009999016764"},{"key":"e_1_2_1_19_1","unstructured":"Brent Duckor and Carrie Holmberg. 2017. Mastering formative assessment moves: 7 high-leverage practices to advance student learning. ASCD."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3230977.3231000"},{"key":"e_1_2_1_21_1","volume-title":"The role of deliberate practice in the acquisition of expert performance. Psychological review","author":"Ericsson K Anders","year":"1993","unstructured":"K Anders Ericsson, Ralf T Krampe, and Clemens Tesch-R\u00f6mer. 1993. The role of deliberate practice in the acquisition of expert performance. Psychological review, Vol. 100, 3 (1993), 363."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/pfi.20175"},{"key":"e_1_2_1_23_1","volume-title":"Glasser","author":"Furtak Erin Marie","year":"2016","unstructured":"Erin Marie Furtak and Howard M. Glasser. 2016. Using Formative Assessment Data for Science Teaching and Learning. (2016)."},{"volume-title":"Towards a framework for smart classrooms that teach instructors to teach","author":"Gerritsen David","key":"e_1_2_1_25_1","unstructured":"David Gerritsen, John Zimmerman, and Amy Ogan. 2018. Towards a framework for smart classrooms that teach instructors to teach. International Society of the Learning Sciences, Inc.[ISLS]."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2807442.2807495"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2699751"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/0732-3123(95)90014-4"},{"volume-title":"Video research in the learning sciences","author":"Goldman Ricki","key":"e_1_2_1_29_1","unstructured":"Ricki Goldman, Roy Pea, Brigid Barron, and Sharon J Derry. 2014. Video research in the learning sciences. Routledge."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10763-015-9623-8"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1177\/016146810911100905"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijme.2017.11.003"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.lcsi.2015.12.001"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-93843-1_12"},{"volume-title":"Teaching community: A pedagogy of hope","author":"Hooks Bell","key":"e_1_2_1_35_1","unstructured":"Bell Hooks. 2003. Teaching community: A pedagogy of hope. Vol. 36. Psychology Press."},{"volume-title":"Teaching to transgress","author":"Hooks Bell","key":"e_1_2_1_36_1","unstructured":"Bell Hooks. 2014. Teaching to transgress. Routledge."},{"key":"e_1_2_1_37_1","unstructured":"IES. 2020. Teacher characteristics and trends. https:\/\/nces.ed.gov\/fastfacts\/display.asp?id=28"},{"key":"e_1_2_1_38_1","volume-title":"The Mirage: Confronting the Hard Truth about Our Quest for Teacher Development. TNTP","author":"Jacob Andy","year":"2015","unstructured":"Andy Jacob and Kate McGovern. 2015. The Mirage: Confronting the Hard Truth about Our Quest for Teacher Development. TNTP (2015)."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376418"},{"key":"e_1_2_1_40_1","volume-title":"Teaching medical students using role play: twelve tips for successful role plays. Medical teacher","author":"Joyner Beres","year":"2006","unstructured":"Beres Joyner and Louise Young. 2006. Teaching medical students using role play: twelve tips for successful role plays. Medical teacher, Vol. 28, 3 (2006), 225--229."},{"key":"e_1_2_1_41_1","volume-title":"National research council, et almbox","author":"Kilpatrick Jeremy","year":"2001","unstructured":"Jeremy Kilpatrick, Jane Swafford, Bradford Findell, National research council, et almbox. 2001. Adding it up: Helping children learn mathematics. Vol. 2101. Citeseer."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647389"},{"key":"e_1_2_1_44_1","unstructured":"Paul A Kirschner and Jeroen Van Merri\u00ebnboer. 2008. Ten steps to complex learning a new approach to instruction and instructional design."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.5951\/MTMS.6.5.0320"},{"key":"e_1_2_1_46_1","volume-title":"I won't learn from you! Confronting student resistance. Rethinking our classrooms: Teaching for equity and justice","author":"Kohl Herbert","year":"1994","unstructured":"Herbert Kohl. 1994. I won't learn from you! Confronting student resistance. Rethinking our classrooms: Teaching for equity and justice, Vol. 1 (1994), 134--135."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675166"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2724660.2724670"},{"key":"e_1_2_1_49_1","volume-title":"Toward a theory of culturally relevant pedagogy. American educational research journal","author":"Ladson-Billings Gloria","year":"1995","unstructured":"Gloria Ladson-Billings. 1995. Toward a theory of culturally relevant pedagogy. American educational research journal, Vol. 32, 3 (1995), 465--491."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1177\/0022487112473837"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1002\/sce.21022"},{"key":"e_1_2_1_52_1","unstructured":"Arthur Levine. 2006. Educating school teachers. Education Schools Project(2006)."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173961"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0360-1315(02)00168-9"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1525\/aeq.1993.24.4.04x0063k"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1177\/0022487113493807"},{"key":"e_1_2_1_57_1","volume-title":"Conceptualizing talk moves as tools: Professional development approaches for academically productive discussion. Socializing intelligence through talk and dialogue","author":"Michaels Sarah","year":"2015","unstructured":"Sarah Michaels and Catherine O'Connor. 2015. Conceptualizing talk moves as tools: Professional development approaches for academically productive discussion. Socializing intelligence through talk and dialogue (2015), 347--362."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijer.2013.05.003"},{"volume-title":"The Stanislavski system: Professional Traning of an Actor","author":"Moore Sonia","key":"e_1_2_1_59_1","unstructured":"Sonia Moore. 1984. The Stanislavski system: Professional Traning of an Actor. Viking Penguin Inc."},{"key":"e_1_2_1_60_1","unstructured":"NSF Inquiry Project. 2020. Talk Science Professional Development. https:\/\/inquiryproject.terc.edu\/prof_dev\/pathway5\/index.html"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1159\/000106415"},{"key":"e_1_2_1_62_1","volume-title":"Shifting participant frameworks: Orchestrating thinking practices in group discussion. Discourse, learning, and schooling","author":"O'Connor Mary Catherine","year":"1996","unstructured":"Mary Catherine O'Connor and Sarah Michaels. 1996. Shifting participant frameworks: Orchestrating thinking practices in group discussion. Discourse, learning, and schooling, Vol. 63 (1996), 103."},{"key":"e_1_2_1_63_1","volume-title":"Cognitive load theory and instructional design: Recent developments. Educational psychologist","author":"Paas Fred","year":"2003","unstructured":"Fred Paas, Alexander Renkl, and John Sweller. 2003. Cognitive load theory and instructional design: Recent developments. Educational psychologist, Vol. 38, 1 (2003), 1--4."},{"key":"e_1_2_1_64_1","unstructured":"Poskin Jamie and Coker Berk. 2020. TeachFX. https:\/\/teachfx.com\/"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/FG.2019.8756529"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1177\/1046878107308063"},{"key":"e_1_2_1_67_1","volume-title":"Kevin Robinson, Dan Roy, and Meredith Thompson.","author":"Reich Justin","year":"2018","unstructured":"Justin Reich, Yoon Jeon Kim, Kevin Robinson, Dan Roy, and Meredith Thompson. 2018. Exploring Authenticity and Playfulness in Teacher Practice Spaces. (2018)."},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.3102\/0002831213477680"},{"key":"e_1_2_1_69_1","first-page":"20","article-title":"Pupils'and Teachers' Perceptions of a Language Board Game, Challenge","volume":"3","author":"Sasidharan Anisha","year":"2017","unstructured":"Anisha Sasidharan and Kok Eng Tan. 2017. Pupils'and Teachers' Perceptions of a Language Board Game, Challenge. The English Teacher 3 (2017), 20.","journal-title":"The English Teacher"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1177\/0022487117702574"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415224"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.3102\/0002831212448095"},{"key":"e_1_2_1_73_1","volume-title":"Instructional development for teachers in higher education: Impact on teaching approach. Higher education","author":"Stes Ann","year":"2010","unstructured":"Ann Stes, Liesje Coertjens, and Peter Van Petegem. 2010. Instructional development for teachers in higher education: Impact on teaching approach. Higher education, Vol. 60, 2 (2010), 187--204."},{"key":"e_1_2_1_74_1","volume-title":"24 Expertise and Expert Performance in Teaching","author":"Stigler James W","year":"2018","unstructured":"James W Stigler and Kevin F Miller. 2018. 24 Expertise and Expert Performance in Teaching. The Cambridge handbook of expertise and expert performance (2018), 431."},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1080\/21532974.2019.1587727"},{"key":"e_1_2_1_76_1","unstructured":"University of Michigan. 2020. TeachingWorks. http:\/\/www.teachingworks.org\/"},{"key":"e_1_2_1_77_1","unstructured":"University of Washington. 2020. Tools for Ambitious Science Teaching. https:\/\/ambitiousscienceteaching.org\/tools\/"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445045"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/3330430.3333614"},{"volume-title":"Contrasting explicit and implicit support for transactive exchange in team oriented project based learning","author":"Wang Xu","key":"e_1_2_1_80_1","unstructured":"Xu Wang, Miaomiao Wen, and Carolyn Rose. 2017. Contrasting explicit and implicit support for transactive exchange in team oriented project based learning. Philadelphia, PA: International Society of the Learning Sciences."},{"volume-title":"Using the LENA in Teacher Training: Promoting Student Involement through automated feedback","author":"Wang Zuowei","key":"e_1_2_1_81_1","unstructured":"Zuowei Wang, Kevin Miller, and Kai Cortina. 2013. Using the LENA in Teacher Training: Promoting Student Involement through automated feedback. Vol. 4. na."},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1159\/000106414"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134744"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1145\/2876034.2876042"},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-66610-5_23"},{"key":"e_1_2_1_86_1","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.2702397"},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1145\/3357236.3395528"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.nedt.2017.04.002"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3449125","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3449125","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3449125","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:17:46Z","timestamp":1750191466000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3449125"}},"subtitle":["A Role-Playing Simulation for Eliciting Learner Knowledge"],"short-title":[],"issued":{"date-parts":[[2021,4,13]]},"references-count":86,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2021,4,13]]}},"alternative-id":["10.1145\/3449125"],"URL":"https:\/\/doi.org\/10.1145\/3449125","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2021,4,13]]},"assertion":[{"value":"2021-04-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}