{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,9]],"date-time":"2025-11-09T03:46:25Z","timestamp":1762659985067},"reference-count":41,"publisher":"World Scientific Pub Co Pte Ltd","issue":"03","funder":[{"DOI":"10.13039\/100006754","name":"the U.S. Army Research Laboratory","doi-asserted-by":"crossref","award":["W911NF-14-D-0005"],"award-info":[{"award-number":["W911NF-14-D-0005"]}],"id":[{"id":"10.13039\/100006754","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Semantic Computing"],"published-print":{"date-parts":[[2020,9]]},"abstract":"<jats:p>We present an extension of the Virtual Human Toolkit to include a range of computing platforms, including mobile, web, Virtual Reality (VR) and Augmented Reality (AR). The Toolkit uses a mix of in-house and commodity technologies to support audio-visual sensing, speech recognition, natural language processing, nonverbal behavior generation and realization, text-to-speech generation and rendering. It has been extended to support computing platforms beyond Windows by leveraging microservices. The resulting framework maintains the modularity of the underlying architecture, allows re-use of both logic and content through cloud services, and is extensible by porting lightweight clients. We present the current state of the framework, discuss how we model and animate our characters, and offer lessons learned through several use cases, including expressive character animation in seated VR, shared space and navigation in room-scale VR, autonomous AI in mobile AR, and real-time user performance feedback leveraging mobile sensors in headset AR.<\/jats:p>","DOI":"10.1142\/s1793351x20400127","type":"journal-article","created":{"date-parts":[[2020,11,2]],"date-time":"2020-11-02T09:26:41Z","timestamp":1604309201000},"page":"315-332","source":"Crossref","is-referenced-by-count":4,"title":["Multi-Platform Expansion of the Virtual Human Toolkit: Ubiquitous Conversational Agents"],"prefix":"10.1142","volume":"14","author":[{"given":"Arno","family":"Hartholt","sequence":"first","affiliation":[{"name":"Institute for Creative Technologies, University of Southern California, 12015 Waterfront Drive, Los Angeles, CA 90094, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ed","family":"Fast","sequence":"additional","affiliation":[{"name":"Institute for Creative Technologies, University of Southern California, 12015 Waterfront Drive, Los Angeles, CA 90094, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Adam","family":"Reilly","sequence":"additional","affiliation":[{"name":"Institute for Creative Technologies, University of Southern California, 12015 Waterfront Drive, Los Angeles, CA 90094, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wendy","family":"Whitcup","sequence":"additional","affiliation":[{"name":"Institute for Creative Technologies, University of Southern California, 12015 Waterfront Drive, Los Angeles, CA 90094, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matt","family":"Liewer","sequence":"additional","affiliation":[{"name":"Institute for Creative Technologies, University of Southern California, 12015 Waterfront Drive, Los Angeles, CA 90094, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sharon","family":"Mozgai","sequence":"additional","affiliation":[{"name":"Institute for Creative Technologies, University of Southern California, 12015 Waterfront Drive, Los Angeles, CA 90094, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2020,10,29]]},"reference":[{"key":"S1793351X20400127BIB001","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1007\/978-3-319-03161-3_35","volume-title":"Advances in Computer Entertainment","author":"Anderson K.","year":"2013"},{"key":"S1793351X20400127BIB002","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1007\/978-3-319-67401-8_3","volume-title":"Int. Conf. Intelligent Virtual Agents","author":"Avramova V.","year":"2017"},{"key":"S1793351X20400127BIB003","first-page":"133","volume":"17","author":"Bacca J.","year":"2014","journal-title":"Educat. Technol. Soc."},{"key":"S1793351X20400127BIB004","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1109\/MS.2016.64","volume":"33","author":"Balalaie A.","year":"2016","journal-title":"IEEE Software"},{"key":"S1793351X20400127BIB005","first-page":"6","volume":"92","author":"Bickmore T.","year":"2013","journal-title":"Pat. Educat. Counsel."},{"issue":"1","key":"S1793351X20400127BIB006","doi-asserted-by":"crossref","first-page":"e1","DOI":"10.2196\/jmir.5239","volume":"18","author":"Bickmore T. W.","year":"2016","journal-title":"J. Med. Internet. Res."},{"issue":"3","key":"S1793351X20400127BIB007","doi-asserted-by":"crossref","first-page":"905","DOI":"10.1007\/s10803-017-3374-z","volume":"48","author":"Burke S. L.","year":"2018","journal-title":"J. Autism Development. Disorders"},{"key":"S1793351X20400127BIB008","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1007\/978-3-319-67401-8_8","volume-title":"Intelligent Virtual Agents","author":"Cafaro A.","year":"2017"},{"key":"S1793351X20400127BIB009","series-title":"International Foundation for Autonomous Agents and Multiagent Systems","first-page":"93","volume-title":"Proc. Int. Conf. Autonomous Agents and Multi-agent Systems","author":"Callejas Z.","year":"2014"},{"issue":"4","key":"S1793351X20400127BIB010","volume":"2","author":"Debevec P.","year":"2012","journal-title":"SIGGRAPH Asia"},{"key":"S1793351X20400127BIB011","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1007\/978-3-319-67425-4_12","volume-title":"Present and Ulterior Software Engineering","author":"Dragoni N.","year":"2017"},{"issue":"3","key":"S1793351X20400127BIB012","doi-asserted-by":"crossref","first-page":"94","DOI":"10.1109\/MS.2016.68","volume":"33","author":"Ebert C.","year":"2016","journal-title":"IEEE Software"},{"key":"S1793351X20400127BIB013","volume-title":"Joint Proceedings of the ACM IUI 2019 Workshops Co-located with the 24th ACM Conference on Intelligent User Interfaces (ACM IUI 2019)","author":"Gordon C.","year":"2019"},{"key":"S1793351X20400127BIB014","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1109\/VR.2018.8446130","volume-title":"IEEE Conf. Virtual Reality and 3D User Interfaces","author":"Habgood M. J.","year":"2018"},{"key":"S1793351X20400127BIB016","first-page":"308","volume-title":"IEEE Int. Conf. Artificial Intelligence and Virtual Reality","author":"Hartholt A.","year":"2019"},{"key":"S1793351X20400127BIB017","first-page":"205","volume-title":"Proc. of 7th Int. Conf. Human-Agent Interaction","author":"Hartholt A.","year":"2019"},{"key":"S1793351X20400127BIB018","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1007\/978-3-642-40415-3_33","volume-title":"International Workshop on Intelligent Virtual Agents","author":"Hartholt A.","year":"2013"},{"issue":"1","key":"S1793351X20400127BIB019","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/S0003-6870(98)00041-6","volume":"30","author":"Howarth P.","year":"1999","journal-title":"Appl. Ergonom."},{"key":"S1793351X20400127BIB020","first-page":"I","volume-title":"IEEE Int. Conf. Acoustics Speech and Signal Processing","author":"Huggins-Daines D.","year":"2006"},{"key":"S1793351X20400127BIB022","first-page":"1","volume-title":"Southeast Conference 2016","author":"Jaramillo D.","year":"2016"},{"issue":"3","key":"S1793351X20400127BIB023","doi-asserted-by":"crossref","first-page":"48","DOI":"10.2352\/ISSN.2470-1173.2017.3.ERVR-097","volume":"2017","author":"Kemeny A.","year":"2017","journal-title":"Electron. Imag."},{"key":"S1793351X20400127BIB024","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1007\/11821830_17","volume-title":"International Workshop on Intelligent Virtual Agents","author":"Kopp S.","year":"2006"},{"key":"S1793351X20400127BIB025","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1007\/11821830_20","volume-title":"Int. Workshop on Intelligent Virtual Agents","author":"Lee J.","year":"2006"},{"key":"S1793351X20400127BIB026","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1007\/978-3-540-74997-4_27","volume-title":"Int. Workshop on Intelligent Virtual Agents","author":"Lee J.","year":"2007"},{"key":"S1793351X20400127BIB030","doi-asserted-by":"crossref","first-page":"55","DOI":"10.3115\/v1\/P14-5010","volume-title":"Proc. 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations","author":"Manning C.","year":"2014"},{"key":"S1793351X20400127BIB031","first-page":"1079","volume-title":"IEEE Int. Conf. Multimedia and Expo","author":"McKeown G.","year":"2010"},{"key":"S1793351X20400127BIB032","first-page":"289","volume-title":"Proc. Conf. Companion Publication on Designing Interactive Systems","author":"McVeigh-Schultz J.","year":"2018"},{"issue":"5","key":"S1793351X20400127BIB033","doi-asserted-by":"crossref","first-page":"e0216290","DOI":"10.1371\/journal.pone.0216290","volume":"14","author":"Miller M. R.","year":"2019","journal-title":"Plos One"},{"key":"S1793351X20400127BIB034","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1007\/978-3-319-67401-8_37","volume-title":"Intelligent Virtual Agents","author":"Mozgai S.","year":"2017"},{"issue":"4","key":"S1793351X20400127BIB035","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1007\/s10879-015-9306-3","volume":"45","author":"Rizzo A.","year":"2015","journal-title":"J. Contemp. Psychother."},{"issue":"3","key":"S1793351X20400127BIB036","first-page":"311","volume":"9","author":"Rizzo A.","year":"2016","journal-title":"J. Pain Management"},{"key":"S1793351X20400127BIB037","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1007\/978-3-642-33197-8_47","volume-title":"Int. Conf. Intelligent Virtual Agents","author":"Scherer S.","year":"2012"},{"key":"S1793351X20400127BIB038","first-page":"8","volume-title":"Pacific Rim Int. Conf. Artificial Intelligence","author":"Schuster M.","year":"2010"},{"key":"S1793351X20400127BIB039","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1007\/978-3-642-25090-3_9","volume-title":"Int. Conf. Motion in Games","author":"Shapiro A.","year":"2011"},{"issue":"3","key":"S1793351X20400127BIB040","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1002\/cav.1579","volume":"25","author":"Shapiro A.","year":"2014","journal-title":"Comput. Animat. Virtual Worlds"},{"key":"S1793351X20400127BIB041","first-page":"187","volume-title":"Int. Conf. Computational Science and Computational Intelligence","author":"Sharma S.","year":"2014"},{"issue":"3","key":"S1793351X20400127BIB043","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1111\/bjop.12305","volume":"109","author":"Slater M.","year":"2018","journal-title":"British J. Psychol."},{"key":"S1793351X20400127BIB044","volume-title":"ActiveMQ in Action","volume":"47","author":"Snyder B.","year":"2011"},{"issue":"1","key":"S1793351X20400127BIB045","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/97.736233","volume":"6","author":"Sohn J.","year":"1999","journal-title":"IEEE Signal Process. Lett."},{"key":"S1793351X20400127BIB046","first-page":"491","volume-title":"Proc. Twenty-Ninth Int. Flairs Conf.","author":"Swartout W.","year":"2016"},{"key":"S1793351X20400127BIB047","first-page":"151","volume-title":"AAMAS08: 7th International Conference on Autonomous Agents and Multi Agent Systems","author":"Thiebaux M.","year":"2008"}],"container-title":["International Journal of Semantic Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S1793351X20400127","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,26]],"date-time":"2022-11-26T04:28:58Z","timestamp":1669436938000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S1793351X20400127"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9]]},"references-count":41,"journal-issue":{"issue":"03","published-print":{"date-parts":[[2020,9]]}},"alternative-id":["10.1142\/S1793351X20400127"],"URL":"https:\/\/doi.org\/10.1142\/s1793351x20400127","relation":{},"ISSN":["1793-351X","1793-7108"],"issn-type":[{"value":"1793-351X","type":"print"},{"value":"1793-7108","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9]]}}}