{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,17]],"date-time":"2026-08-17T11:24:28Z","timestamp":1786965868290,"version":"build-2736575974"},"reference-count":41,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2026,8,17]],"date-time":"2026-08-17T00:00:00Z","timestamp":1786924800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/legalcode"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Interact. Intell. Syst."],"published-print":{"date-parts":[[2026,9,30]]},"abstract":"<jats:p>\n                    Recent research has demonstrated the potential for representing intelligent guidance using multi-modal cues, yet few guidelines or processes exist to guide the design of such a system. In this article, we seek to address this gap by investigating the design of multi-modal assistant systems for setting the optimal parameters in industrial plants. We present the results of two user studies conducted with a total of 37 participants to evaluate the effectiveness and experience of different combinations of visual (\n                    <jats:italic toggle=\"yes\">Highlights<\/jats:italic>\n                    and\n                    <jats:italic toggle=\"yes\">Ambient<\/jats:italic>\n                    lights) and haptic (\n                    <jats:italic toggle=\"yes\">Clicks<\/jats:italic>\n                    and\n                    <jats:italic toggle=\"yes\">Vibration<\/jats:italic>\n                    ) modalities for providing intelligent dynamic guidance. Our findings demonstrate that providing the intelligent guidance with the multi-modality of\n                    <jats:italic toggle=\"yes\">Highlights+Ambient<\/jats:italic>\n                    resulted in shorter task duration and higher practicality than\n                    <jats:italic toggle=\"yes\">Ambient<\/jats:italic>\n                    lights alone. Regarding task accuracy, the\n                    <jats:italic toggle=\"yes\">Highlights<\/jats:italic>\n                    and\n                    <jats:italic toggle=\"yes\">Vibration outside-zone<\/jats:italic>\n                    guidance resulted in no failed attempts. Moreover,\n                    <jats:italic toggle=\"yes\">Highlights+Ambient+Vibration<\/jats:italic>\n                    guidance was rated as having lower usability than\n                    <jats:italic toggle=\"yes\">Highlights+Ambient<\/jats:italic>\n                    , and higher mental demand than merely\n                    <jats:italic toggle=\"yes\">Highlights<\/jats:italic>\n                    .\n                  <\/jats:p>","DOI":"10.1145\/3830236","type":"journal-article","created":{"date-parts":[[2026,7,18]],"date-time":"2026-07-18T13:16:50Z","timestamp":1784380610000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Sense the Machine: Using Multi-Modal Cues for Providing Intelligent Guidance"],"prefix":"10.1145","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4940-1764","authenticated-orcid":false,"given":"Setareh","family":"Zafari","sequence":"first","affiliation":[{"name":"Center for Technology Experience, Austrian Institute of Technology GmbH, Vienna, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-6990-9578","authenticated-orcid":false,"given":"Lukas","family":"Kroeninger","sequence":"additional","affiliation":[{"name":"Center for Technology Experience, Austrian Institute of Technology GmbH, Vienna, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4985-626X","authenticated-orcid":false,"given":"Jaison","family":"Puthenkalam","sequence":"additional","affiliation":[{"name":"Center for Technology Experience, Austrian Institute of Technology GmbH, Vienna, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6056-7285","authenticated-orcid":false,"given":"Manfred","family":"Tscheligi","sequence":"additional","affiliation":[{"name":"Center for Technology Experience, Austrian Institute of Technology GmbH, Vienna, Austria and Paris Lodron Universit\u00e4t Salzburg, Salzburg, Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2026,8,17]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10111-011-0192-5"},{"issue":"1","key":"e_1_3_3_3_2","doi-asserted-by":"crossref","first-page":"27","DOI":"10.3390\/asi5010027","article-title":"State of industry 5.0\u2014Analysis and identification of current research trends","volume":"5","author":"Akundi Aditya","year":"2022","unstructured":"Aditya Akundi, Daniel Euresti, Sergio Luna, Wilma Ankobiah, Amit Lopes, and Immanuel Edinbarough. 2022. State of industry 5.0\u2014Analysis and identification of current research trends. Applied System Innovation 5, 1 (2022), 27.","journal-title":"Applied System Innovation"},{"key":"e_1_3_3_4_2","doi-asserted-by":"publisher","DOI":"10.3390\/pr11010193"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2025.1598968"},{"key":"e_1_3_3_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2017.7989773"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.20965\/ijat.2012.p0369"},{"issue":"3","key":"e_1_3_3_8_2","first-page":"189","article-title":"SUS: A quick and dirty usability","volume":"189","author":"Brooke John","year":"1996","unstructured":"John Brooke. 1996. SUS: A quick and dirty usability. Usability Evaluation in Industry 189, 3 (1996), 189\u2013194.","journal-title":"Usability Evaluation in Industry"},{"key":"e_1_3_3_9_2","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1145\/1180995.1181017","volume-title":"Proceedings of the 8th International Conference on Multimodal Interfaces","author":"Burke Jennifer L.","year":"2006","unstructured":"Jennifer L. Burke, Matthew S. Prewett, Ashley A. Gray, Liuquin Yang, Frederick R. B. Stilson, Michael D. Coovert, Linda R. Elliot, and Elizabeth Redden. 2006. Comparing the effects of visual-auditory and visual-tactile feedback on user performance: A meta-analysis. In Proceedings of the 8th International Conference on Multimodal Interfaces, 108\u2013117."},{"key":"e_1_3_3_10_2","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1109\/3DUI.2012.6184199","volume-title":"Proceedings of the 2012 IEEE Symposium on 3D User Interfaces (3DUI)","author":"de Barros Paulo G.","year":"2012","unstructured":"Paulo G. de Barros and Robert W. Lindeman. 2012. Poster: Comparing vibro-tactile feedback modes for collision proximity feedback in USAR virtual robot teleoperation. In Proceedings of the 2012 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 137\u2013138."},{"key":"e_1_3_3_11_2","first-page":"1","volume-title":"Proceedings of the International Conference on Advanced Visual Interfaces","author":"Di Martino Sergio","year":"2020","unstructured":"Sergio Di Martino and Vincenzo Norman Vitale. 2020. An haptic interface for industrial high-precision manufacturing tasks. In Proceedings of the International Conference on Advanced Visual Interfaces, 1\u20133."},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.3390\/mti9010006"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302262"},{"issue":"1","key":"e_1_3_3_14_2","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1109\/TVCG.2006.11","article-title":"Predictive haptic guidance: Intelligent user assistance for the control of dynamic tasks","volume":"12","author":"Forsyth Benjamin A. C.","year":"2005","unstructured":"Benjamin A. C. Forsyth and Karon E. MacLean. 2005. Predictive haptic guidance: Intelligent user assistance for the control of dynamic tasks. IEEE Transactions on Visualization and Computer Graphics 12, 1 (2005), 103\u2013113.","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"e_1_3_3_15_2","doi-asserted-by":"crossref","first-page":"2533","DOI":"10.1007\/s00221-017-4986-4","article-title":"Trust in haptic assistance: Weighting visual and haptic cues based on error history","volume":"235","author":"Gibo Tricia L.","year":"2017","unstructured":"Tricia L. Gibo, Winfred Mugge, and David A. Abbink. 2017. Trust in haptic assistance: Weighting visual and haptic cues based on error history. Experimental Brain Research 235 (2017), 2533\u20132546.","journal-title":"Experimental Brain Research"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ymssp.2020.106630"},{"key":"e_1_3_3_17_2","first-page":"1","volume-title":"Proceedings of the 2022 IEEE Symposium on Computers and Communications (ISCC)","author":"Han Bin","year":"2022","unstructured":"Bin Han and Hans D. Schotten. 2022. Multi-sensory HMI for human-centric industrial digital twins: A 6G vision of future industry. In Proceedings of the 2022 IEEE Symposium on Computers and Communications (ISCC). IEEE, 1\u20137."},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1177\/154193120605000909"},{"key":"e_1_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/2468356.2468389"},{"key":"e_1_3_3_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/TOH.2024.3350929"},{"key":"e_1_3_3_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/2993148.2993163"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1518\/001872008X250638"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1979403"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1186\/1743-0003-3-20"},{"key":"e_1_3_3_25_2","first-page":"012021","article-title":"The enlightenment of the theory model of audio-visual integration to human-computer interaction technology","volume":"1631","author":"Lu Hong","year":"2020","unstructured":"Hong Lu and Chaochao Pan. 2020. The enlightenment of the theory model of audio-visual integration to human-computer interaction technology. Journal of Physics: Conference Series 1631 (2020), 012021.","journal-title":"Journal of Physics: Conference Series"},{"key":"e_1_3_3_26_2","first-page":"1","volume-title":"Proceedings of the 2021 IEEE 2nd International Conference on Human-Machine Systems (ICHMS)","author":"Mbanisi Kenechukwu C.","year":"2021","unstructured":"Kenechukwu C. Mbanisi, Michael Gennert, and Zhi Li. 2021. SocNavAssist: A haptic shared autonomy framework for social navigation assistance of mobile telepresence robots. In Proceedings of the 2021 IEEE 2nd International Conference on Human-Machine Systems (ICHMS). IEEE, 1\u20133."},{"key":"e_1_3_3_27_2","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1145\/3316782.3322751","volume-title":"Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments","author":"Miclaus Andrei","year":"2019","unstructured":"Andrei Miclaus, Erik Pescara, Alexander M\u00e4dche, and Michael Beigl. 2019. Drive by maintenance: Towards adaptive work environments with improved industrial HCI. In Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive Environments, 382\u2013388."},{"key":"e_1_3_3_28_2","first-page":"212","volume-title":"Proceedings of the Research Challenges in Information Science: 14th International Conference (RCIS \u201920)","author":"Naiseh Mohammad","year":"2020","unstructured":"Mohammad Naiseh, Nan Jiang, Jianbing Ma, and Raian Ali. 2020. Explainable recommendations in intelligent systems: Delivery methods, modalities and risks. In Proceedings of the Research Challenges in Information Science: 14th International Conference (RCIS \u201920), Springer, 212\u2013228."},{"key":"e_1_3_3_29_2","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1145\/1180995.1181057","volume-title":"Proceedings of the 8th International Conference on Multimodal Interfaces","author":"Prewett Matthew S.","year":"2006","unstructured":"Matthew S. Prewett, Liuquin Yang, Frederick R. B. Stilson, Ashley A. Gray, Michael D. Coovert, Jennifer Burke, Elizabeth Redden, and Linda R. Elliot. 2006. The benefits of multimodal information: A meta-analysis comparing visual and visual-tactile feedback. In Proceedings of the 8th International Conference on Multimodal Interfaces, 333\u2013338."},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3319853"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.9781\/ijimai.2017.09.001"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3122986.3123011"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.1145\/2449396.2449451"},{"issue":"1","key":"e_1_3_3_34_2","doi-asserted-by":"crossref","first-page":"5224","DOI":"10.1038\/s41467-022-32745-8","article-title":"Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions","volume":"13","author":"Sun Zhongda","year":"2022","unstructured":"Zhongda Sun, Minglu Zhu, Xuechuan Shan, and Chengkuo Lee. 2022. Augmented tactile-perception and haptic-feedback rings as human-machine interfaces aiming for immersive interactions. Nature Communications 13, 1 (2022), 5224.","journal-title":"Nature Communications"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/WHC.2009.4810863"},{"issue":"3","key":"e_1_3_3_36_2","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/j.artmed.2008.07.006","article-title":"Intelligent decision support systems for mechanical ventilation","volume":"44","author":"Tehrani Fleur T.","year":"2008","unstructured":"Fleur T. Tehrani and James H. Roum. 2008. Intelligent decision support systems for mechanical ventilation. Artificial Intelligence in Medicine 44, 3 (2008), 171\u2013182.","journal-title":"Artificial Intelligence in Medicine"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.3390\/app14114650"},{"issue":"6","key":"e_1_3_3_38_2","doi-asserted-by":"crossref","first-page":"454","DOI":"10.1049\/iet-its.2017.0112","article-title":"Influence of haptic guidance on driving behaviour under degraded visual feedback conditions","volume":"12","author":"Wang Zheng","year":"2018","unstructured":"Zheng Wang, Rencheng Zheng, Tsutomu Kaizuka, and Kimihiko Nakano. 2018. Influence of haptic guidance on driving behaviour under degraded visual feedback conditions. IET Intelligent Transport Systems 12, 6 (2018), 454\u2013462.","journal-title":"IET Intelligent Transport Systems"},{"key":"e_1_3_3_39_2","doi-asserted-by":"publisher","DOI":"10.1518\/001872008X288394"},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1518\/001872095779049408"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12544-020-00427-5"},{"key":"e_1_3_3_42_2","doi-asserted-by":"publisher","DOI":"10.1007\/11890881_9"}],"container-title":["ACM Transactions on Interactive Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3830236","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,17]],"date-time":"2026-08-17T10:28:41Z","timestamp":1786962521000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3830236"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,17]]},"references-count":41,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,9,30]]}},"alternative-id":["10.1145\/3830236"],"URL":"https:\/\/doi.org\/10.1145\/3830236","relation":{},"ISSN":["2160-6455","2160-6463"],"issn-type":[{"value":"2160-6455","type":"print"},{"value":"2160-6463","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,17]]},"assertion":[{"value":"2025-01-17","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-06-25","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2026-08-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}