{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T14:22:01Z","timestamp":1754144521023,"version":"3.41.2"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"4","funder":[{"DOI":"10.13039\/501100002739","name":"Aarhus University Research Foundation","doi-asserted-by":"crossref","award":["AUFF-F-2021-7-2"],"award-info":[{"award-number":["AUFF-F-2021-7-2"]}],"id":[{"id":"10.13039\/501100002739","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2025,6,30]]},"abstract":"<jats:p>\n            Prototyping multimodal interaction in XR (Augmented\/Virtual Reality) is challenging for non-technical designers. Moreover, existing XR prototyping tools do not support concurrent multimodal interaction and lack an overall view of the interaction design of the experience. We created\n            <jats:sc>Mucho<\/jats:sc>\n            , a novel no-coding immersive tool for prototyping interactive multimodal XR experiences.\n            <jats:sc>Mucho<\/jats:sc>\n            supports three modes: In recording, designers can demonstrate input examples to populate a timeline representation with events. In playback, designers can create a video prototype based on the timeline while adding system actions at the corresponding timeframes. In live mode,\n            <jats:sc>Mucho<\/jats:sc>\n            creates a\n            <jats:italic toggle=\"yes\">state machine<\/jats:italic>\n            to test the interactive experience in runtime. We present an evaluation by demonstration to illustrate how\n            <jats:sc>Mucho<\/jats:sc>\n            can prototype a diverse set of examples including modalities such as hand gestures, proximity, speech, and gaze. Finally, we discuss the limitations of our approach and outline future directions to support immersive prototyping of multimodal XR experiences.\n          <\/jats:p>","DOI":"10.1145\/3734185","type":"journal-article","created":{"date-parts":[[2025,6,27]],"date-time":"2025-06-27T07:35:59Z","timestamp":1751009759000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Mucho: A Timeline-Based Immersive Tool for Prototyping Interactive Multimodal  XR Experiences"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4307-9567","authenticated-orcid":false,"given":"Germ\u00e1n","family":"Leiva","sequence":"first","affiliation":[{"name":"Aarhus University","place":["Aarhus, Denmark"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0884-991X","authenticated-orcid":false,"given":"Vittoria","family":"Frau","sequence":"additional","affiliation":[{"name":"Aarhus University","place":["Aarhus, Denmark"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1175-732X","authenticated-orcid":false,"given":"Unnikrishnan","family":"Radhakrishnan","sequence":"additional","affiliation":[{"name":"Aarhus University","place":["Aarhus, Denmark"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5829-2208","authenticated-orcid":false,"given":"Mille Skovhus","family":"Lunding","sequence":"additional","affiliation":[{"name":"Aarhus University","place":["Aarhus, Denmark"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,6,27]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","unstructured":"C. Appert and M. Beaudouin-Lafon. 2008. SwingStates: adding state machines to Java and the Swing toolkit. Software: Practice and Experience 38 11 (2008) 1149\u20131182. 10.1002\/spe.867 arXiv:https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/spe.867","DOI":"10.1002\/spe.867"},{"key":"e_1_3_3_3_2","unstructured":"Apple Inc.2025. Apple Vision Pro. https:\/\/www.apple.com\/apple-vision-pro\/. Accessed: 2025-02-17."},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","unstructured":"Valentino Artizzu Gianmarco Cherchi Davide Fara Vittoria Frau Riccardo Macis Luca Pitzalis Alessandro Tola Ivan Blecic and Lucio\u00a0Davide Spano. 2022. Defining Configurable Virtual Reality Templates for End Users. Proc. ACM Hum.-Comput. Interact. 6 EICS Article 163 (jun 2022) 35\u00a0pages. 10.1145\/3534517","DOI":"10.1145\/3534517"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376722"},{"key":"e_1_3_3_6_2","doi-asserted-by":"crossref","unstructured":"Ronald\u00a0T Azuma. 1997. A survey of augmented reality. Presence: teleoperators & virtual environments 6 4 (1997) 355\u2013385.","DOI":"10.1162\/pres.1997.6.4.355"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1145\/1936652.1936676"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/1133265.1133275"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/800250.807503"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/1029632.1029678"},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICEEI.2015.7352470"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1145\/266180.266328"},{"key":"e_1_3_3_13_2","volume-title":"About face: the essentials of interaction design","author":"Cooper Alan","year":"2014","unstructured":"Alan Cooper, Robert Reimann, David Cronin, and Christopher Noessel. 2014. About face: the essentials of interaction design. John Wiley & Sons."},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/3472749.3474797"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","unstructured":"Vittoria Frau Lucio\u00a0Davide Spano Valentino Artizzu and Michael Nebeling. 2023. XRSpotlight: Example-based Programming of XR Interactions using a Rule-based Approach. Proc. ACM Hum.-Comput. Interact. 7 EICS Article 185 (jun 2023) 28\u00a0pages. 10.1145\/3593237","DOI":"10.1145\/3593237"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1145\/3301019.3325158"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445335"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-46616-9_27"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173610"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","unstructured":"Gun\u00a0A. Lee and Gerard\u00a0J. Kim. 2009. Immersive authoring of Tangible Augmented Reality content: A user study. Journal of Visual Languages & Computing 20 2 (2009) 61\u201379. 10.1016\/j.jvlc.2008.07.001","DOI":"10.1016\/j.jvlc.2008.07.001"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","unstructured":"Gun\u00a0A. Lee Gerard\u00a0J. Kim and Mark Billinghurst. 2005. Immersive Authoring: What You EXperience Is What You Get (WYXIWYG). Commun. ACM 48 7 (jul 2005) 76\u201381. 10.1145\/1070838.1070840","DOI":"10.1145\/1070838.1070840"},{"key":"e_1_3_3_22_2","doi-asserted-by":"crossref","unstructured":"Minkyung Lee Mark Billinghurst Woonhyuk Baek Richard Green and Woontack Woo. 2013. A usability study of multimodal input in an augmented reality environment. Virtual Reality 17 (2013) 293\u2013305.","DOI":"10.1007\/s10055-013-0230-0"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3242587.3242613"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3472749.3474761"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","unstructured":"Germ\u00e1n Leiva Nolwenn Maudet Wendy Mackay and Michel Beaudouin-Lafon. 2019. Enact: Reducing Designer\u2013Developer Breakdowns When Prototyping Custom Interactions. ACM Trans. Comput.-Hum. Interact. 26 3 Article 19 (May 2019) 48\u00a0pages. 10.1145\/3310276","DOI":"10.1145\/3310276"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376160"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/RO-MAN57019.2023.10309582"},{"key":"e_1_3_3_28_2","doi-asserted-by":"publisher","unstructured":"Mathias\u00a0N. Lystb\u00e6k Peter Rosenberg Ken Pfeuffer Jens\u00a0Emil Gr\u00f8nb\u00e6k and Hans Gellersen. 2022. Gaze-Hand Alignment: Combining Eye Gaze and Mid-Air Pointing for Interacting with Menus in Augmented Reality. Proc. ACM Hum.-Comput. Interact. 6 ETRA Article 145 (may 2022) 18\u00a0pages. 10.1145\/3530886","DOI":"10.1145\/3530886"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","unstructured":"Sandra Malpica Ana Serrano Diego Guti\u00e9rrez and Bel\u00e9n Masia. 2020. Auditory stimuli degrade visual performance in virtual reality. Scientific Reports 10 1 (23 Jul 2020) 12363. 10.1038\/s41598-020-69135-3","DOI":"10.1038\/s41598-020-69135-3"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","unstructured":"Daniel Martin Sandra Malpica Diego Gutierrez Belen Masia and Ana Serrano. 2022. Multimodality in VR: A Survey. ACM Comput. Surv. 54 10s Article 216 (sep 2022) 36\u00a0pages. 10.1145\/3508361","DOI":"10.1145\/3508361"},{"key":"e_1_3_3_31_2","unstructured":"Paul Milgram and Fumio Kishino. 1994. A taxonomy of mixed reality visual displays. IEICE TRANSACTIONS on Information and Systems 77 12 (1994) 1321\u20131329."},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581449"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445560"},{"key":"e_1_3_3_34_2","doi-asserted-by":"crossref","unstructured":"Brad\u00a0A Myers Richard McDaniel and David Wolber. 2000. Programming by example: intelligence in demonstrational interfaces. Commun. ACM 43 3 (2000) 82\u201389.","DOI":"10.1145\/330534.330545"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376637"},{"key":"e_1_3_3_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300826"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173927"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR-Adjunct.2018.00098"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.5555\/530589"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647358"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3131277.3132180"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3586183.3606736"},{"key":"e_1_3_3_43_2","volume-title":"Augmented reality: principles and practice","author":"Schmalstieg Dieter","year":"2016","unstructured":"Dieter Schmalstieg and Tobias Hollerer. 2016. Augmented reality: principles and practice. Addison-Wesley Professional."},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300767"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1109\/VRAIS.1996.490524"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/3379350.3416155"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/1180995.1181012"},{"key":"e_1_3_3_48_2","unstructured":"Unity Technologies. 2005. Unity. https:\/\/unity.com\/."},{"key":"e_1_3_3_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3472749.3474769"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-49695-1_16"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580750"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1109\/VL\/HCC51201.2021.9576372"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/2909132.2926067"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-48746-5_46"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/3379337.3415824"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3734185","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,15]],"date-time":"2025-07-15T16:13:21Z","timestamp":1752596001000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3734185"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,27]]},"references-count":54,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,6,30]]}},"alternative-id":["10.1145\/3734185"],"URL":"https:\/\/doi.org\/10.1145\/3734185","relation":{},"ISSN":["2573-0142"],"issn-type":[{"type":"electronic","value":"2573-0142"}],"subject":[],"published":{"date-parts":[[2025,6,27]]},"assertion":[{"value":"2025-06-27","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}