{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T03:45:19Z","timestamp":1782791119718,"version":"3.54.5"},"reference-count":44,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,12,21]],"date-time":"2022-12-21T00:00:00Z","timestamp":1671580800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2022,12,21]]},"abstract":"<jats:p>Trigger-action programming (TAP) empowers a wide array of users to automate Internet of Things (IoT) devices. However, it can be challenging for users to create completely correct trigger-action programs (TAPs) on the first try, necessitating debugging. While TAP has received substantial research attention, TAP debugging has not. In this paper, we present the first empirical study of users' end-to-end TAP debugging process, focusing on obstacles users face in debugging TAPs and how well users ultimately fix incorrect automations. To enable this study, we added TAP capabilities to an existing 3-D smart home simulator. Thirty remote participants spent a total of 84 hours debugging TAPs using this simulator. Without additional support, participants were often unable to fix buggy TAPs due to a series of obstacles we document. However, we also found that two novel tools we developed helped participants overcome many of these obstacles and more successfully debug TAPs. These tools collect either implicit or explicit feedback from users about automations that should or should not have happened in the past, using a SAT-solving-based algorithm we developed to automatically modify the TAPs to account for this feedback.<\/jats:p>","DOI":"10.1145\/3569506","type":"journal-article","created":{"date-parts":[[2023,1,11]],"date-time":"2023-01-11T15:34:01Z","timestamp":1673451241000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Helping Users Debug Trigger-Action Programs"],"prefix":"10.1145","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6559-9630","authenticated-orcid":false,"given":"Lefan","family":"Zhang","sequence":"first","affiliation":[{"name":"University of Chicago, Chicago, Illinois, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8768-0659","authenticated-orcid":false,"given":"Cyrus","family":"Zhou","sequence":"additional","affiliation":[{"name":"University of Chicago, Chicago, Illinois, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5596-1840","authenticated-orcid":false,"given":"Michael L.","family":"Littman","sequence":"additional","affiliation":[{"name":"Brown University, Providence, Rhode Island, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9365-3155","authenticated-orcid":false,"given":"Blase","family":"Ur","sequence":"additional","affiliation":[{"name":"University of Chicago, Chicago, Illinois, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0757-4600","authenticated-orcid":false,"given":"Shan","family":"Lu","sequence":"additional","affiliation":[{"name":"University of Chicago, Chicago, Illinois, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,1,11]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3395363.3397347"},{"key":"e_1_2_1_2_1","volume-title":"Bloom's taxonomy","author":"Anderson Lorin W","year":"1994","unstructured":"Lorin W Anderson and Lauren A Sosniak. Bloom's taxonomy. Univ. Chicago Press Chicago, IL, USA, 1994."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300782"},{"issue":"3","key":"e_1_2_1_4_1","first-page":"22","article-title":"Systematically ensuring the confidence of real-time home automation IoT systems","volume":"2","author":"Bu Lei","year":"2018","unstructured":"Lei Bu, Wen Xiong, Chieh-Jan Mike Liang, Shi Han, Dongmei Zhang, Shan Lin, and Xuandong Li. Systematically ensuring the confidence of real-time home automation IoT systems. ACM TCPS, 2(3):22, 2018.","journal-title":"ACM TCPS"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025485"},{"key":"e_1_2_1_6_1","volume-title":"Proc. USENIX ATC","author":"Celik Z. Berkay","year":"2018","unstructured":"Z. Berkay Celik, Patrick McDaniel, and Gang Tan. SOTERIA: Automated IoT safety and security analysis. In Proc. USENIX ATC, 2018."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDCSW.2017.30"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/DSN48063.2020.00056"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3432225"},{"key":"e_1_2_1_10_1","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","author":"Corno Fulvio","year":"2019","unstructured":"Fulvio Corno, Luigi De Russis, and Alberto Monge Roffarello. Empowering end users in debugging trigger-action rules. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2019."},{"key":"e_1_2_1_11_1","volume-title":"Luigi De Russis, and Alberto Monge Roffarello. From users' intentions to if-then rules in the internet of things. ACM Transactions on Information Systems (TOIS), 39(4):1--33","author":"Corno Fulvio","year":"2021","unstructured":"Fulvio Corno, Luigi De Russis, and Alberto Monge Roffarello. From users' intentions to if-then rules in the internet of things. ACM Transactions on Information Systems (TOIS), 39(4):1--33, 2021."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-24781-2_2"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/1792734.1792766"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3170427.3188641"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0020-7373(75)80005-8"},{"key":"e_1_2_1_16_1","volume-title":"End-user debugging strategies: A sensemaking perspective. ACM Transactions on Computer-Human Interaction (TOCHI), 19(1):1--28","author":"Grigoreanu Valentina","year":"2012","unstructured":"Valentina Grigoreanu, Margaret Burnett, Susan Wiedenbeck, Jill Cao, Kyle Rector, and Irwin Kwan. End-user debugging strategies: A sensemaking perspective. ACM Transactions on Computer-Human Interaction (TOCHI), 19(1):1--28, 2012."},{"key":"e_1_2_1_17_1","unstructured":"Home Assistant. https:\/\/www.home-assistant.io\/docs\/automation\/."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICWS53863.2021.00048"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2805830"},{"key":"e_1_2_1_20_1","volume-title":"TheNextWeb","author":"Hughes Matthew","year":"2018","unstructured":"Matthew Hughes. Mozilla's new Things Gateway is an open home for your smart devices. TheNextWeb, February 7, 2018."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.buildenv.2020.106983"},{"key":"e_1_2_1_22_1","volume-title":"Business Insider","author":"Intelligence Insider","year":"2020","unstructured":"Insider Intelligence. How IoT devices & smart home automation is entering our homes in 2020. Business Insider, Jan 6, 2020. https:\/\/www.businessinsider.com\/iot-smart-home-automation."},{"key":"e_1_2_1_23_1","first-page":"2021","article-title":"A rule chain recognition model based on multiple features","author":"Jiang Keyu","year":"2021","unstructured":"Keyu Jiang, Hanyi Zhang, Weiting Zhang, Liming Fang, Chunpeng Ge, Yuan Yuan, and Zhe Liu. Tapchain: A rule chain recognition model based on multiple features. Security and Communication Networks, 2021, 2021.","journal-title":"Security and Communication Networks"},{"key":"e_1_2_1_24_1","volume-title":"LifeHacker","author":"Klosowski Thorin","year":"2016","unstructured":"Thorin Klosowski. Automation showdown: IFTTT vs Zapier vs Microsoft Flow. LifeHacker, June 26, 2016."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2993422.2993426"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2018.11.005"},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the SIGCHI Conference on Human Factors in Computing Systems","author":"Mennicken Sarah","year":"2016","unstructured":"Sarah Mennicken, David Kim, and Elaine May Huang. Integrating the smart home into the digital calendar. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2016."},{"key":"e_1_2_1_28_1","volume-title":"Smart Things automates your house via sensors, app. Recode.net","author":"Mossberg Walt","year":"2014","unstructured":"Walt Mossberg. Smart Things automates your house via sensors, app. Recode.net, 2014."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2993600.2993601"},{"key":"e_1_2_1_30_1","unstructured":"openHAB. https:\/\/www.openhab.org\/."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/SPW.2019.00034"},{"key":"e_1_2_1_32_1","volume-title":"https:\/\/www.prolific.co\/","year":"2022","unstructured":"Prolific. https:\/\/www.prolific.co\/, 2022."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ifacol.2016.07.172"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3191767"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557420"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0020-7373(85)80054-7"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3319535.3345662"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2019.2959063"},{"key":"e_1_2_1_39_1","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1109\/COGINF.2004.1327473","volume-title":"Proceedings of the Third IEEE International Conference on Cognitive Informatics, 2004","author":"Xu Shaochun","year":"2004","unstructured":"Shaochun Xu and V\u00e1clav Rajlich. Cognitive process during program debugging. In Proceedings of the Third IEEE International Conference on Cognitive Informatics, 2004., pages 176--182. IEEE, 2004."},{"key":"e_1_2_1_40_1","volume-title":"Tapinspector: Safety and liveness verification of concurrent trigger-action iot systems. arXiv preprint arXiv:2102.01468","author":"Yu Yinbo","year":"2021","unstructured":"Yinbo Yu and Jiajia Liu. Tapinspector: Safety and liveness verification of concurrent trigger-action iot systems. arXiv preprint arXiv:2102.01468, 2021."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSE.2019.00043"},{"issue":"3","key":"e_1_2_1_42_1","first-page":"1","article-title":"Synthesizing trigger-action programs from traces of behavior. Proceedings of the ACM on Interactive, Mobile","volume":"4","author":"Zhang Lefan","year":"2020","unstructured":"Lefan Zhang, Weijia He, Olivia Morkved, Valerie Zhao, Michael L Littman, Shan Lu, and Blase Ur. Trace2tap: Synthesizing trigger-action programs from traces of behavior. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 4(3):1--26, 2020.","journal-title":"Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445567"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3334480.3382940"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3569506","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3569506","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,15]],"date-time":"2025-07-15T20:51:39Z","timestamp":1752612699000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3569506"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,21]]},"references-count":44,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,12,21]]}},"alternative-id":["10.1145\/3569506"],"URL":"https:\/\/doi.org\/10.1145\/3569506","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,21]]},"assertion":[{"value":"2023-01-11","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}