{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:17:47Z","timestamp":1750220267317,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":39,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,4,27]],"date-time":"2022-04-27T00:00:00Z","timestamp":1651017600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,4,27]]},"DOI":"10.1145\/3491101.3519793","type":"proceedings-article","created":{"date-parts":[[2022,4,29]],"date-time":"2022-04-29T16:49:48Z","timestamp":1651250988000},"page":"1-7","source":"Crossref","is-referenced-by-count":3,"title":["ONYX - User Interfaces for Assisting in Interactive Task Learning for Natural Language Interfaces of Data Visualization Tools"],"prefix":"10.1145","author":[{"given":"Marcel","family":"Ruoff","sequence":"first","affiliation":[{"name":"Institute of Information Systems and Marketing (IISM), Karlsruhe Institute of Technology (KIT), Germany"}]},{"given":"Brad A","family":"Myers","sequence":"additional","affiliation":[{"name":"Human-Computer Interaction Institute, Carnegie Mellon University, United States"}]},{"given":"Alexander","family":"Maedche","sequence":"additional","affiliation":[{"name":"Institute of Information Systems and Marketing (IISM), Karlsruhe Institute of Technology (KIT), Germany"}]}],"member":"320","published-online":{"date-parts":[[2022,4,28]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Proceedings of the National Conference on Artificial Intelligence, Vol.\u00a02. AAAI Press, 1514\u20131519","author":"Allen James","year":"2007","unstructured":"James Allen , Nathanael Chambers , George Ferguson , Lucian Galescu , Hyuckchul Jung , Mary Swift , and William Taysom . 2007 . PLOW: A collaborative task learning agent . In Proceedings of the National Conference on Artificial Intelligence, Vol.\u00a02. AAAI Press, 1514\u20131519 . https:\/\/doi.org\/10.5555\/1619797.1619888 James Allen, Nathanael Chambers, George Ferguson, Lucian Galescu, Hyuckchul Jung, Mary Swift, and William Taysom. 2007. PLOW: A collaborative task learning agent. In Proceedings of the National Conference on Artificial Intelligence, Vol.\u00a02. AAAI Press, 1514\u20131519. https:\/\/doi.org\/10.5555\/1619797.1619888"},{"key":"e_1_3_2_2_2_1","volume-title":"Interactive task learning via embodied corrective feedback. Autonomous Agents and Multi-Agent Systems 34, 2 (10","author":"Appelgren Mattias","year":"2020","unstructured":"Mattias Appelgren and Alex Lascarides . 2020. Interactive task learning via embodied corrective feedback. Autonomous Agents and Multi-Agent Systems 34, 2 (10 2020 ), 1\u201345. https:\/\/doi.org\/10.1007\/S10458-020-09481-8\/TABLES\/6 Mattias Appelgren and Alex Lascarides. 2020. Interactive task learning via embodied corrective feedback. Autonomous Agents and Multi-Agent Systems 34, 2 (10 2020), 1\u201345. https:\/\/doi.org\/10.1007\/S10458-020-09481-8\/TABLES\/6"},{"key":"e_1_3_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2018.1557972"},{"key":"e_1_3_2_2_4_1","doi-asserted-by":"crossref","unstructured":"Jo\u00eblle Coutaz Laurence Nigay Daniel Salber Ann Blandford Jon May and Richard\u00a0M. Young. 1995. Four Easy Pieces for Assessing the Usability of Multimodal Interaction: The Care Properties. In Human\u2014Computer Interaction. 115\u2013120. https:\/\/doi.org\/10.1007\/978-1-5041-2896-4_19  Jo\u00eblle Coutaz Laurence Nigay Daniel Salber Ann Blandford Jon May and Richard\u00a0M. Young. 1995. Four Easy Pieces for Assessing the Usability of Multimodal Interaction: The Care Properties. In Human\u2014Computer Interaction. 115\u2013120. https:\/\/doi.org\/10.1007\/978-1-5041-2896-4_19","DOI":"10.1007\/978-1-5041-2896-4_19"},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1011368926479"},{"key":"e_1_3_2_2_6_1","volume-title":"Analyza. In Proceedings of the 22nd International Conference on Intelligent User Interfaces. ACM","author":"Dhamdhere Kedar","year":"2017","unstructured":"Kedar Dhamdhere , Kevin\u00a0 S. McCurley , Ralfi Nahmias , Mukund Sundararajan , and Qiqi Yan . 2017 . Analyza. In Proceedings of the 22nd International Conference on Intelligent User Interfaces. ACM , New York, NY, USA, 493\u2013504. https:\/\/doi.org\/10.1145\/3025171.3025227 Kedar Dhamdhere, Kevin\u00a0S. McCurley, Ralfi Nahmias, Mukund Sundararajan, and Qiqi Yan. 2017. Analyza. In Proceedings of the 22nd International Conference on Intelligent User Interfaces. ACM, New York, NY, USA, 493\u2013504. https:\/\/doi.org\/10.1145\/3025171.3025227"},{"key":"e_1_3_2_2_7_1","volume-title":"Multimodal Interfaces: A Survey of Principles, Models and Frameworks. In Human Machine Interaction: Research Results of the MMI Program, Denis Lalanne and J\u00fcrg Kohlas (Eds.)","author":"Dumas Bruno","year":"2009","unstructured":"Bruno Dumas , Denis Lalanne , and Sharon Oviatt . 2009 . Multimodal Interfaces: A Survey of Principles, Models and Frameworks. In Human Machine Interaction: Research Results of the MMI Program, Denis Lalanne and J\u00fcrg Kohlas (Eds.) . Springer Berlin Heidelberg , Berlin, Heidelberg , 3\u201326. https:\/\/doi.org\/10.1007\/978-3-642-00437-7_1 Bruno Dumas, Denis Lalanne, and Sharon Oviatt. 2009. Multimodal Interfaces: A Survey of Principles, Models and Frameworks. In Human Machine Interaction: Research Results of the MMI Program, Denis Lalanne and J\u00fcrg Kohlas (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 3\u201326. https:\/\/doi.org\/10.1007\/978-3-642-00437-7_1"},{"key":"e_1_3_2_2_8_1","volume-title":"Iris. In Conference on Human Factors in Computing Systems - Proceedings. ACM Press","author":"Fast Ethan","year":"2018","unstructured":"Ethan Fast , Binbin Chen , Julia Mendelsohn , Jonathan Bassen , and Michael\u00a0 S. Bernstein . 2018 . Iris. In Conference on Human Factors in Computing Systems - Proceedings. ACM Press , New York, New York, USA, 1\u201312. https:\/\/doi.org\/10.1145\/3173574.3174047 Ethan Fast, Binbin Chen, Julia Mendelsohn, Jonathan Bassen, and Michael\u00a0S. Bernstein. 2018. Iris. In Conference on Human Factors in Computing Systems - Proceedings. ACM Press, New York, New York, USA, 1\u201312. https:\/\/doi.org\/10.1145\/3173574.3174047"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/BLOCKS.2015.7369000"},{"key":"e_1_3_2_2_10_1","volume-title":"DataTone. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST \u201915","author":"Gao Tong","year":"2015","unstructured":"Tong Gao , Mira Dontcheva , Eytan Adar , Zhicheng Liu , and Karrie\u00a0 G. Karahalios . 2015 . DataTone. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST \u201915 . ACM Press, New York, New York, USA, 489\u2013500. https:\/\/doi.org\/10.1145\/2807442.2807478 Tong Gao, Mira Dontcheva, Eytan Adar, Zhicheng Liu, and Karrie\u00a0G. Karahalios. 2015. DataTone. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST \u201915. ACM Press, New York, New York, USA, 489\u2013500. https:\/\/doi.org\/10.1145\/2807442.2807478"},{"key":"e_1_3_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/642611.642616"},{"key":"e_1_3_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3369838"},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445421"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2017.3121552"},{"key":"e_1_3_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v30i4.2262"},{"key":"e_1_3_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1561\/1100000081"},{"key":"e_1_3_2_2_17_1","volume-title":"Conference on Human Factors in Computing Systems - Proceedings, Vol.\u00a02017-May. ACM","author":"Jia\u00a0Jun Li Toby","year":"2017","unstructured":"Toby Jia\u00a0Jun Li , Amos Azaria , and Brad\u00a0 A. Myers . 2017 . SUGILITE: Creating multimodal smartphone automation by demonstration . In Conference on Human Factors in Computing Systems - Proceedings, Vol.\u00a02017-May. ACM , New York, NY, USA, 6038\u20136049. https:\/\/doi.org\/10.1145\/3025453.3025483 Toby Jia\u00a0Jun Li, Amos Azaria, and Brad\u00a0A. Myers. 2017. SUGILITE: Creating multimodal smartphone automation by demonstration. In Conference on Human Factors in Computing Systems - Proceedings, Vol.\u00a02017-May. ACM, New York, NY, USA, 6038\u20136049. https:\/\/doi.org\/10.1145\/3025453.3025483"},{"key":"e_1_3_2_2_18_1","volume-title":"2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL\/HCC), Vol.\u00a02018-Octob. IEEE, 105\u2013114","author":"Jia-Jun Li Toby","year":"2018","unstructured":"Toby Jia-Jun Li , Igor Labutov , Xiaohan\u00a0Nancy Li , Xiaoyi Zhang , Wenze Shi , Wanling Ding , Tom\u00a0 M. Mitchell , and Brad\u00a0 A. Myers . 2018 . APPINITE: A Multi-Modal Interface for Specifying Data Descriptions in Programming by Demonstration Using Natural Language Instructions . In 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL\/HCC), Vol.\u00a02018-Octob. IEEE, 105\u2013114 . https:\/\/doi.org\/10.1109\/VLHCC.2018.8506506 Toby Jia-Jun Li, Igor Labutov, Xiaohan\u00a0Nancy Li, Xiaoyi Zhang, Wenze Shi, Wanling Ding, Tom\u00a0M. Mitchell, and Brad\u00a0A. Myers. 2018. APPINITE: A Multi-Modal Interface for Specifying Data Descriptions in Programming by Demonstration Using Natural Language Instructions. In 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL\/HCC), Vol.\u00a02018-Octob. IEEE, 105\u2013114. https:\/\/doi.org\/10.1109\/VLHCC.2018.8506506"},{"key":"e_1_3_2_2_19_1","volume-title":"Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. ACM","author":"Jia-Jun Li Toby","year":"2019","unstructured":"Toby Jia-Jun Li , Marissa Radensky , Justin Jia , Kirielle Singarajah , Tom\u00a0 M. Mitchell , and Brad\u00a0 A. Myers . 2019 . PUMICE: A Multi-Modal Agent that Learns Concepts and Conditionals from Natural Language and Demonstrations . In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. ACM , New York, NY, USA, 577\u2013589. https:\/\/doi.org\/10.1145\/3332165.3347899 Toby Jia-Jun Li, Marissa Radensky, Justin Jia, Kirielle Singarajah, Tom\u00a0M. Mitchell, and Brad\u00a0A. Myers. 2019. PUMICE: A Multi-Modal Agent that Learns Concepts and Conditionals from Natural Language and Demonstrations. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 577\u2013589. https:\/\/doi.org\/10.1145\/3332165.3347899"},{"key":"e_1_3_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2021.3114848"},{"key":"e_1_3_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1868358.1868363"},{"key":"e_1_3_2_2_22_1","volume-title":"Mayer and Roxana Moreno","author":"E.","year":"2003","unstructured":"Richard\u00a0 E. Mayer and Roxana Moreno . 2003 . Nine Ways to Reduce Cognitive Load in Multimedia Learning. Educational Psychologist 38, 1 (3 2003), 43\u201352. https:\/\/doi.org\/10.1207\/S15326985EP3801_6 Richard\u00a0E. Mayer and Roxana Moreno. 2003. Nine Ways to Reduce Cognitive Load in Multimedia Learning. Educational Psychologist 38, 1 (3 2003), 43\u201352. https:\/\/doi.org\/10.1207\/S15326985EP3801_6"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450667"},{"key":"e_1_3_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2020.3030378"},{"key":"e_1_3_2_2_25_1","volume-title":"Guidelines for multimodal user interface design. Commun. ACM 47, 1 (1","author":"Reeves M.","year":"2004","unstructured":"Leah\u00a0 M. Reeves , Jennifer Lai , James\u00a0 A. Larson , Sharon Oviatt , T.\u00a0 S. Balaji , St\u00e9phanie Buisine , Penny Collings , Phil Cohen , Ben Kraal , Jean\u00a0Claude Martin , Michael McTear , T.\u00a0 V. Raman , Kay\u00a0 M. Stanney , Hui Su , and Qian\u00a0Ying Wang . 2004. Guidelines for multimodal user interface design. Commun. ACM 47, 1 (1 2004 ), 57\u201359. https:\/\/doi.org\/10.1145\/962081.962106 Leah\u00a0M. Reeves, Jennifer Lai, James\u00a0A. Larson, Sharon Oviatt, T.\u00a0S. Balaji, St\u00e9phanie Buisine, Penny Collings, Phil Cohen, Ben Kraal, Jean\u00a0Claude Martin, Michael McTear, T.\u00a0V. Raman, Kay\u00a0M. Stanney, Hui Su, and Qian\u00a0Ying Wang. 2004. Guidelines for multimodal user interface design. Commun. ACM 47, 1 (1 2004), 57\u201359. https:\/\/doi.org\/10.1145\/962081.962106"},{"key":"e_1_3_2_2_26_1","volume-title":"ECIS 2021 Research Papers (6 2021","author":"Ruoff Marcel","year":"2021","unstructured":"Marcel Ruoff and Ulrich Gnewuch . 2021 . Designing Multimodal BI&A Systems for Co-Located Team Interactions . ECIS 2021 Research Papers (6 2021 ). https:\/\/aisel.aisnet.org\/ecis2021_rp\/113 Marcel Ruoff and Ulrich Gnewuch. 2021. Designing Multimodal BI&A Systems for Co-Located Team Interactions. ECIS 2021 Research Papers (6 2021). https:\/\/aisel.aisnet.org\/ecis2021_rp\/113"},{"key":"e_1_3_2_2_27_1","volume-title":"Geno. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. ACM","author":"Sarmah Ritam\u00a0Jyoti","year":"2020","unstructured":"Ritam\u00a0Jyoti Sarmah , Yunpeng Ding , Di Wang , Cheuk Yin\u00a0Phipson Lee , Toby Jia-Jun Li , and Xiang\u00a0Anthony Chen . 2020 . Geno. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. ACM , New York, NY, USA, 1169\u20131181. https:\/\/doi.org\/10.1145\/3379337.3415848 Ritam\u00a0Jyoti Sarmah, Yunpeng Ding, Di Wang, Cheuk Yin\u00a0Phipson Lee, Toby Jia-Jun Li, and Xiang\u00a0Anthony Chen. 2020. Geno. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 1169\u20131181. https:\/\/doi.org\/10.1145\/3379337.3415848"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3299869.3320248"},{"key":"e_1_3_2_2_29_1","volume-title":"Eviza. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM","author":"Setlur Vidya","year":"2016","unstructured":"Vidya Setlur , Sarah\u00a0 E Battersby , Melanie Tory , Rich Gossweiler , and Angel\u00a0 X Chang . 2016 . Eviza. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM , New York, NY, USA, 365\u2013377. https:\/\/doi.org\/10.1145\/2984511.2984588 Vidya Setlur, Sarah\u00a0E Battersby, Melanie Tory, Rich Gossweiler, and Angel\u00a0X Chang. 2016. Eviza. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. ACM, New York, NY, USA, 365\u2013377. https:\/\/doi.org\/10.1145\/2984511.2984588"},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302270"},{"key":"e_1_3_2_2_31_1","volume-title":"InChorus: Designing Consistent Multimodal Interactions for Data Visualization on Tablet Devices. In Conference on Human Factors in Computing Systems - Proceedings. ACM","author":"Srinivasan Arjun","year":"2020","unstructured":"Arjun Srinivasan , Bongshin Lee , Nathalie Henry\u00a0Riche , Steven\u00a0 M. Drucker , and Ken Hinckley . 2020 . InChorus: Designing Consistent Multimodal Interactions for Data Visualization on Tablet Devices. In Conference on Human Factors in Computing Systems - Proceedings. ACM , New York, NY, USA, 1\u201313. https:\/\/doi.org\/10.1145\/3313831.3376782 Arjun Srinivasan, Bongshin Lee, Nathalie Henry\u00a0Riche, Steven\u00a0M. Drucker, and Ken Hinckley. 2020. InChorus: Designing Consistent Multimodal Interactions for Data Visualization on Tablet Devices. In Conference on Human Factors in Computing Systems - Proceedings. ACM, New York, NY, USA, 1\u201313. https:\/\/doi.org\/10.1145\/3313831.3376782"},{"key":"e_1_3_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445400"},{"key":"e_1_3_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2017.2745219"},{"key":"e_1_3_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2020.2986902"},{"key":"e_1_3_2_2_35_1","doi-asserted-by":"crossref","unstructured":"Yiwen Sun Jason Leigh Andrew Johnson and Sangyoon Lee. 2010. Articulate: A Semi-automated Model for Translating Natural Language Queries into Meaningful Visualizations. In Lecture Notes in Computer Science. Vol.\u00a06133 LNCS. 184\u2013195. https:\/\/doi.org\/10.1007\/978-3-642-13544-6_18  Yiwen Sun Jason Leigh Andrew Johnson and Sangyoon Lee. 2010. Articulate: A Semi-automated Model for Translating Natural Language Queries into Meaningful Visualizations. In Lecture Notes in Computer Science. Vol.\u00a06133 LNCS. 184\u2013195. https:\/\/doi.org\/10.1007\/978-3-642-13544-6_18","DOI":"10.1007\/978-3-642-13544-6_18"},{"key":"e_1_3_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1177\/1098214005283748"},{"key":"e_1_3_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3089799"},{"key":"e_1_3_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2019.2934668"},{"key":"e_1_3_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971648.2971696"}],"event":{"name":"CHI '22: CHI Conference on Human Factors in Computing Systems","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"],"location":"New Orleans LA USA","acronym":"CHI '22"},"container-title":["CHI Conference on Human Factors in Computing Systems Extended Abstracts"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3491101.3519793","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3491101.3519793","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:00Z","timestamp":1750188660000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3491101.3519793"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,27]]},"references-count":39,"alternative-id":["10.1145\/3491101.3519793","10.1145\/3491101"],"URL":"https:\/\/doi.org\/10.1145\/3491101.3519793","relation":{},"subject":[],"published":{"date-parts":[[2022,4,27]]}}}