{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,3]],"date-time":"2025-09-03T10:06:35Z","timestamp":1756893995978,"version":"3.41.0"},"reference-count":27,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2016,3,21]],"date-time":"2016-03-21T00:00:00Z","timestamp":1458518400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2016,7,14]]},"abstract":"<jats:p>Virtual human interactions provide an important avenue for training as emergent opportunities arise. In response to a new training need, we propose a framework to rapidly create experiential learning opportunities in the form of a question--answer chat interaction with virtual humans. This framework takes quickly generated case documents and breaks down the case into small tasks that can be crowdsourced by nonexperts. This framework can serve as a first step to rapidly bootstrapping new virtual humans. We have applied our framework to the task of preparing health care students and professionals to infrequent, but high-stakes, situations such as infectious diseases, cranial nerve disorders, and stroke.<\/jats:p>\n          <jats:p>Our framework was utilized by medical professionals interested in providing new training experiences to students and colleagues. Over the course of two months, these professionals created seven scenarios on a diverse range of topics that included Ebola, cancer, and neurological disorders. These scenarios were developed for multiple target audiences such as medical students, residents, and fellows. As a first step, each scenario utilized our framework and crowdsourced workers to create an initial corpus over the course of two days.<\/jats:p>\n          <jats:p>From these seven cases, we selected two to evaluate the quality of the resulting virtual-human corpuses. The two scenarios were compared to preexisting reference scenarios that have been in curricular use for several years. We found a reduction in author time commitment of at least 92% while creating a character that was at least 75% as accurate as its reference counterparts. The commitment reduction and accuracy achieved by our framework represents a first step towards rapid development of a virtual human. Our framework can then be combined with other creation processes for further virtual-human development in order to create a mature virtual human. As part of a virtual-human development process, our framework can help to rapidly develop new scenarios in response to emergent training opportunities.<\/jats:p>","DOI":"10.1145\/2897366","type":"journal-article","created":{"date-parts":[[2016,3,21]],"date-time":"2016-03-21T18:56:20Z","timestamp":1458586580000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Rapid Low-Cost Virtual Human Bootstrapping via the Crowd"],"prefix":"10.1145","volume":"7","author":[{"given":"Michael","family":"Borish","sequence":"first","affiliation":[{"name":"University of Florida, Gainesville, FL"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Benjamin","family":"Lok","sequence":"additional","affiliation":[{"name":"University of Florida, Gainesville, FL"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2016,3,21]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"crossref","unstructured":"Gilles Adda Joseph Mariani Laurent Besacier and Hadrien Gelas. 2013. Economic and ethical background of crowdsourcing for speech. In Crowdsourcing for Speech Processing: Applications to Data Collection. 303--334.  Gilles Adda Joseph Mariani Laurent Besacier and Hadrien Gelas. 2013. Economic and ethical background of crowdsourcing for speech. In Crowdsourcing for Speech Processing: Applications to Data Collection. 303--334.","DOI":"10.1002\/9781118541241.ch11"},{"volume-title":"Szilagyi","year":"2012","author":"Bickley Lynn","key":"e_1_2_1_2_1"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.5555\/1866696.1866731"},{"volume-title":"Timothy Bickmore, Dirk Heylen, and Catherine Pelachaud.","year":"2014","author":"Cafaro Angelo","key":"e_1_2_1_4_1"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.5555\/1866696.1866697"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2923.2008.03286.x"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjsurg.2007.01.021"},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","unstructured":"Arno Hartholt David Traum Stacy Marsella Ari Shapiro Giota Stratou Louis-Philippe Morency and Jonathan Gratch. 2013. All together now introducing the virtual human toolkit. Intelligent Virtual Agents 368--381.  Arno Hartholt David Traum Stacy Marsella Ari Shapiro Giota Stratou Louis-Philippe Morency and Jonathan Gratch. 2013. All together now introducing the virtual human toolkit. Intelligent Virtual Agents 368--381.","DOI":"10.1007\/978-3-642-40415-3_33"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0b013e31803e8a0a"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/1240624.1240784"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2501988.2502057"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v32i2.2347"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1008636108"},{"volume-title":"Polavieja","year":"2014","author":"Madirolas Gabriel","key":"e_1_2_1_14_1"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1809400.1809422"},{"volume-title":"Proceedings of the 27th International Flairs Conference. 196--201","author":"Mcclendon Jerome L.","key":"e_1_2_1_16_1"},{"key":"e_1_2_1_17_1","doi-asserted-by":"crossref","unstructured":"Margaret Mitchell and Dan Bohus. 2014. Crowdsourcing language generation templates for dialogue systems. In INLG. 172--180.  Margaret Mitchell and Dan Bohus. 2014. Crowdsourcing language generation templates for dialogue systems. In INLG. 172--180.","DOI":"10.3115\/v1\/W14-5003"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1553-2712.2010.00985.x"},{"key":"e_1_2_1_19_1","first-page":"39","article-title":"The restaurant game: Learning social behavior and language from thousands of players online","volume":"3","author":"Orkin Jeff","year":"2007","journal-title":"Game Development"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.5555\/1870658.1870671"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.5555\/1889075.1889123"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2011.11.004"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/1613715.1613751"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjsurg.2006.03.002"},{"key":"e_1_2_1_25_1","unstructured":"Hao Su Jia Deng and Li Fei-fei. 2012. Crowdsourcing annotations for visual object detection. In AAAI Human Computation. 40--46.  Hao Su Jia Deng and Li Fei-fei. 2012. Crowdsourcing annotations for visual object detection. In AAAI Human Computation. 40--46."},{"key":"e_1_2_1_26_1","unstructured":"Marc M. Triola Ned Campion James B. Mcgee Susan Albright Peter Greene Valerie Smothers Rachel Ellaway and D Ph. 2007. An XML standard for virtual patients: Exchanging case-based simulations in medical education. In AMIA. 741--745.  Marc M. Triola Ned Campion James B. Mcgee Susan Albright Peter Greene Valerie Smothers Rachel Ellaway and D Ph. 2007. An XML standard for virtual patients: Exchanging case-based simulations in medical education. In AMIA. 741--745."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.3109\/0142159X.2012.638010"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897366","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2897366","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:39:02Z","timestamp":1750221542000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2897366"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,3,21]]},"references-count":27,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2016,7,14]]}},"alternative-id":["10.1145\/2897366"],"URL":"https:\/\/doi.org\/10.1145\/2897366","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"type":"print","value":"2157-6904"},{"type":"electronic","value":"2157-6912"}],"subject":[],"published":{"date-parts":[[2016,3,21]]},"assertion":[{"value":"2015-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-11-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-03-21","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}