{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T03:45:20Z","timestamp":1782791120836,"version":"3.54.5"},"reference-count":53,"publisher":"Association for Computing Machinery (ACM)","issue":"MHCI","license":[{"start":{"date-parts":[[2023,9,11]],"date-time":"2023-09-11T00:00:00Z","timestamp":1694390400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Italian Ministry of Education, University and Research","award":["PRIN 2017MX9T7H (EMPATHY)"],"award-info":[{"award-number":["PRIN 2017MX9T7H (EMPATHY)"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2023,9,11]]},"abstract":"<jats:p>Automations in the context of smart homes have been adopted more and more frequently; thus, users should be able to control them and create automations most suitable to their needs. Current solutions for this purpose are based on visual apps with conceptual representations of possible automation elements. However, they tend to be static, abstract, and detached from the user's real context. In this paper, we propose a novel solution based on mobile augmented reality, which provides situated, dynamic representations associated with the physical objects available in the current users' context while they are freely moving about. It allows direct interaction with the objects of interest, monitoring nearby objects' automations while moving, and creating new automations or modifying existing ones. It also supports users with recommendations of object and service configurations relevant to complete the editing of the new automations. The paper also reports on a user test, which provided positive feedback.<\/jats:p>","DOI":"10.1145\/3604242","type":"journal-article","created":{"date-parts":[[2023,9,13]],"date-time":"2023-09-13T15:16:20Z","timestamp":1694618180000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["A Mobile Augmented Reality App for Creating, Controlling, Recommending Automations in Smart Homes"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6766-7916","authenticated-orcid":false,"given":"Andrea","family":"Mattioli","sequence":"first","affiliation":[{"name":"CNR-ISTI &amp; University of Pisa, Pisa, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8355-6909","authenticated-orcid":false,"given":"Fabio","family":"Patern\u00f2","sequence":"additional","affiliation":[{"name":"CNR-ISTI, Pisa, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,9,13]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1080\/0144929X.2021.2017482"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376722"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cola.2020.100999"},{"key":"e_1_2_2_4_1","first-page":"149","volume-title":"Ubiquitous Computing: 5th International Conference","author":"Dey Anind","year":"2003","unstructured":"Barkhuus, Louise, and Anind Dey. \"Is context-aware computing taking control away from the user? Three levels of interactivity examined.\" In UbiComp 2003: Ubiquitous Computing: 5th International Conference, Seattle, WA, USA, October 12--15, 2003. Proceedings 5, pp. 149--156. Springer Berlin Heidelberg, 2003."},{"key":"e_1_2_2_5_1","doi-asserted-by":"crossref","unstructured":"Brackenbury Will Abhimanyu Deora Jillian Ritchey Jason Vallee Weijia He Guan Wang Michael L. Littman and Blase Ur. \"How users interpret bugs in trigger-action programming.\" In Proceedings of the 2019 CHI conference on human factors in computing systems pp. 1--12. 2019.","DOI":"10.1145\/3290605.3300782"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3057858"},{"key":"e_1_2_2_7_1","doi-asserted-by":"crossref","unstructured":"Castelli Nico Corinna Ogonowski Timo Jakobi Martin Stein Gunnar Stevens and Volker Wulf. \"What happened in my home? an end-user development approach for smart home data visualization.\" In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems pp. 853--866. 2017.","DOI":"10.1145\/3025453.3025485"},{"key":"e_1_2_2_8_1","volume-title":"Proceedings 3rd International Workshop on Empowering People in Dealing with Internet of Things Ecosystems, CEUR-WS.org","volume":"3172","author":"Gena Cristina","year":"2022","unstructured":"Cena, Federica, Cristina Gena, Claudio Mattutino, Michele Mioli, Barbara Treccani, Fabiana Vernero, and Massimo Zancanaro, Incorporating Personality Traits in User Modeling for EUD, Proceedings 3rd International Workshop on Empowering People in Dealing with Internet of Things Ecosystems, CEUR-WS.org, Vol. 3172, 2022."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3517235"},{"key":"e_1_2_2_10_1","volume-title":"Luigi De Russis, and Alberto Monge Roffarello","author":"Corno Fulvio","year":"2019","unstructured":"Fulvio Corno, Luigi De Russis, and Alberto Monge Roffarello. 2019. RecRules: Recommending IF-THEN Rules for End-User Development. ACM Trans. Intell. Syst. Technol. 10, 5, Article 58 (September 2019)"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3399715.3399905"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447264"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2016.24"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-4571(199009)41:6<391::AID-ASI1>3.0.CO;2-9"},{"key":"e_1_2_2_15_1","first-page":"125","volume-title":"a field study.\" In International Symposium on End User Development","author":"Caffiau Sybille","year":"2015","unstructured":"Demeure, Alexandre, Sybille Caffiau, Elena Elias, and Camille Roux. \"Building and using home automation systems: a field study.\" In International Symposium on End User Development, pp. 125--140. Springer, Cham, 2015."},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3057859"},{"key":"e_1_2_2_17_1","first-page":"194","volume-title":"22nd Conf. Distrib. Multimedia Syst.(DMS)","author":"Peroni Matteo","year":"2016","unstructured":"Fogli, Daniela, Matteo Peroni, and Claudia Stefini. \"Smart home control through unwitting trigger-action programming.\" In Proc. 22nd Conf. Distrib. Multimedia Syst.(DMS), pp. 194--201. 2016."},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvlc.2017.08.003"},{"key":"e_1_2_2_19_1","first-page":"1","volume-title":"Proceedings of the 2022 International Conference on Advanced Visual Interfaces","author":"Paterno Fabio","year":"2022","unstructured":"Gallo, Simone, and Fabio Paterno. \"A Conversational Agent for Creating Flexible Daily Automation.\" In Proceedings of the 2022 International Conference on Advanced Visual Interfaces, pp. 1--8. 2022."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3057861"},{"key":"e_1_2_2_21_1","volume-title":"Springer","author":"Shani Guy","year":"2022","unstructured":"Gunawardana, Asela, Guy Shani, and Sivan Yogev. \"Evaluating recommender systems.\" In Recommender systems handbook, pp. 547--601. Springer, New York, NY, 2022."},{"key":"e_1_2_2_22_1","unstructured":"Haines Will Melinda Gervasio Aaron Spaulding and Bart Peintner. \"Recommendations for end-user development.\" In Proceedings of the ACM RecSys 2010 Workshop on User-Centric Evaluation of Recommender Systems and Their Interfaces (UCERSTI) pp. 42--49. 2010."},{"key":"e_1_2_2_23_1","volume-title":"Reality Editor: Programming Smarter Objects. UbiComp (Adjunct Publication) 2013: 307--310J.","author":"Heun Valentin","year":"2013","unstructured":"Valentin Heun, James Hobin, Pattie Maes. 2013. Reality Editor: Programming Smarter Objects. UbiComp (Adjunct Publication) 2013: 307--310J."},{"key":"e_1_2_2_24_1","doi-asserted-by":"crossref","unstructured":"Huang Justin and Maya Cakmak. \"Supporting mental model accuracy in trigger-action programming.\" In Proceedings of the 2015 acm international joint conference on pervasive and ubiquitous computing pp. 215--225. 2015.","DOI":"10.1145\/2750858.2805830"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCE.2016.7613201"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517655"},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/1922649.1922658"},{"key":"e_1_2_2_28_1","doi-asserted-by":"crossref","unstructured":"Lau Jey Han and Timothy Baldwin. \"An empirical evaluation of doc2vec with practical insights into document embedding generation.\" arXiv preprint arXiv:1607.05368 (2016).","DOI":"10.18653\/v1\/W16-1609"},{"key":"e_1_2_2_29_1","first-page":"1188","volume-title":"Proceedings of the 31st International Conference on Machine Learning (ICML","author":"Le Quoc","year":"2014","unstructured":"Quoc Le and Tomas Mikolov. 2014. Distributed representations of sentences and documents. In Proceedings of the 31st International Conference on Machine Learning (ICML 2014), pages 1188--1196, Beijing, China."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3--319--58735--6_1"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/1--4020--5386-X_1"},{"key":"e_1_2_2_32_1","first-page":"64","volume-title":"OZCHI 2003","author":"Tuomela Urpo","year":"2003","unstructured":"M\u00e4ntyj\u00e4rvi, Jani, Urpo Tuomela, Ilkka K\u00e4ns\u00e4l\u00e4, and Jonna H\u00e4kkil\u00e4. \"Context studio: Tool for personalizing context-aware applications in mobile terminals.\" In Annual Conference of CHISIG, the Computer Human Interaction Special Interest Group of the Ergonomics Society of Australia, OZCHI 2003, pp. 64--73. University of Queensland Press, 2003."},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3399715.3399833"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1080\/0144929X.2021.1900396"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3338286.3340142"},{"key":"e_1_2_2_36_1","unstructured":"Rehurek Radim and Petr Sojka. \"Software framework for topic modelling with large corpora.\" In Proceedings of the LREC 2010 workshop on new challenges for NLP frameworks. 2010."},{"key":"e_1_2_2_37_1","doi-asserted-by":"crossref","unstructured":"Salovaara Antti Andrea Bellucci Andrea Vianello and Giulio Jacucci. \"Programmable smart home toolkits should better address households' social needs.\" In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems pp. 1--14. 2021.","DOI":"10.1145\/3411764.3445770"},{"key":"e_1_2_2_38_1","doi-asserted-by":"crossref","unstructured":"Ronny Seiger Maria Gohlke Uwe A\u00dfmann. 2019. Augmented Reality-Based Process Modelling for the Internet of Things with HoloFlows. BPMDS\/EMMSAD@CAiSE 2019: 115--129","DOI":"10.1007\/978-3-030-20618-5_8"},{"key":"e_1_2_2_39_1","volume-title":"Available at: https:\/\/www.alexandria.unisg.ch\/261944\/","author":"K\u00fchn Seiger","year":"2021","unstructured":"Seiger Ronny; K\u00fchn Romina; Korzetz Mandy & A\u00dfmann Uwe (2021) HoloFlows: modelling of processes for the Internet of Things in mixed reality. Software and Systems Modeling, Available at: https:\/\/www.alexandria.unisg.ch\/261944\/"},{"key":"e_1_2_2_40_1","first-page":"347","volume-title":"International conference on case-based reasoning","author":"McClave Paul","year":"2001","unstructured":"Smyth, Barry, and Paul McClave. \"Similarity vs. diversity.\" In International conference on case-based reasoning, pp. 347--361. Springer, Berlin, Heidelberg, 2001."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3191767"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3--662--61983--4_9"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10055-018-0366-z"},{"key":"e_1_2_2_44_1","first-page":"803","article-title":"\"Practical trigger-action programming in the smart home","author":"McManus Elyse","year":"2014","unstructured":"Ur, Blase, Elyse McManus, Melwyn Pak Yong Ho, and Michael L. Littman. \"Practical trigger-action programming in the smart home.\" In Proceedings of the SIGCHI conference on human factors in computing systems, pp. 803--812. 2014.","journal-title":"Proceedings of the SIGCHI conference on human factors in computing systems"},{"key":"e_1_2_2_45_1","doi-asserted-by":"crossref","unstructured":"Ur Blase Melwyn Pak Yong Ho Stephen Brawner Jiyun Lee Sarah Mennicken Noah Picard Diane Schulze and Michael L. Littman. \"Trigger-action programming in the wild: An analysis of 200 000 ifttt recipes.\" In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems pp. 3227--3231. 2016.","DOI":"10.1145\/2858036.2858556"},{"key":"e_1_2_2_46_1","first-page":"149","volume-title":"ASOCA, ISYyCC, CloTS, DDBS, and NLS4IoT, Hangzhou, China, November 12--15","author":"Cabrera Christian","year":"2018","unstructured":"White, Gary, Christian Cabrera, Andrei Palade, and Siobh\u00e1n Clarke. \"Augmented reality in IoT.\" In Service-Oriented Computing--ICSOC 2018 Workshops: ADMS, ASOCA, ISYyCC, CloTS, DDBS, and NLS4IoT, Hangzhou, China, November 12--15, 2018, Revised Selected Papers 16, pp. 149--160. Springer International Publishing, 2019."},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1007\/978--3-030--64694--3_12"},{"key":"e_1_2_2_48_1","first-page":"1","volume-title":"Jo\u00e3o Marcelo Evangelista Belo et al. \"XAIR: A Framework of Explainable AI in Augmented Reality.\" In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems","author":"Yu Anna","year":"2023","unstructured":"Xu, Xuhai, Anna Yu, Tanya R. Jonker, Kashyap Todi, Feiyu Lu, Xun Qian, Jo\u00e3o Marcelo Evangelista Belo et al. \"XAIR: A Framework of Explainable AI in Augmented Reality.\" In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, pp. 1--30. 2023."},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1145\/2493432.2493489"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3524610.3527922"},{"key":"e_1_2_2_51_1","first-page":"12","article-title":"Improving Mental Models in IoT End-User Development","author":"Gallitto Giuseppe","year":"2022","unstructured":"Zancanaro, Massimo, Giuseppe Gallitto, Dina Yem, and Barbara Treccani. \"Improving Mental Models in IoT End-User Development.\" HUMAN-CENTRIC COMPUTING AND INFORMATION SCIENCES 12 (2022).","journal-title":"HUMAN-CENTRIC COMPUTING AND INFORMATION SCIENCES"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411838"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1108\/JRIM-09-2021-0237"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3604242","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3604242","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:46:43Z","timestamp":1750178803000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3604242"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,11]]},"references-count":53,"journal-issue":{"issue":"MHCI","published-print":{"date-parts":[[2023,9,11]]}},"alternative-id":["10.1145\/3604242"],"URL":"https:\/\/doi.org\/10.1145\/3604242","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,11]]},"assertion":[{"value":"2023-09-13","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}