{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T23:16:31Z","timestamp":1780442191104,"version":"3.54.1"},"reference-count":73,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2020,12,17]],"date-time":"2020-12-17T00:00:00Z","timestamp":1608163200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100003130","name":"Fonds Wetenschappelijk Onderzoek","doi-asserted-by":"publisher","award":["G0E7317N"],"award-info":[{"award-number":["G0E7317N"]}],"id":[{"id":"10.13039\/501100003130","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2020,12,17]]},"abstract":"<jats:p>Ubiquitous environments, such as smart homes, are becoming more intelligent and autonomous. As a result, their behavior becomes harder to grasp and unintended behavior becomes more likely. Researchers have contributed tools to better understand and validate an environments' past behavior (e.g. logs, end-user debugging), and to prevent unintended behavior. There is, however, a lack of tools that help users understand the future behavior of such an environment. Information about the actions it will perform, and why it will perform them, remains concealed. In this paper, we contribute FORTNIoT, a well-defined approach that combines self-sustaining predictions (e.g. weather forecasts) and simulations of trigger-condition-action rules to deduce when these rules will trigger in the future and what state changes they will cause to connected smart home entities. We implemented a proof-of-concept of this approach, as well as a visual demonstrator that shows such predictions, including causes and effects, in an overview of a smart home's behavior. A between-subject evaluation with 42 participants indicates that FORTNIoT predictions lead to a more accurate understanding of the future behavior, more confidence in that understanding, and more appropriate trust in what the system will (not) do. We envision a wide variety of situations where predictions about the future are beneficial to inhabitants of smart homes, such as debugging unintended behavior and managing conflicts by exception, and hope to spark a new generation of intelligible tools for ubiquitous environments.<\/jats:p>","DOI":"10.1145\/3432225","type":"journal-article","created":{"date-parts":[[2020,12,18]],"date-time":"2020-12-18T15:39:14Z","timestamp":1608305954000},"page":"1-24","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":27,"title":["FORTNIoT"],"prefix":"10.1145","volume":"4","author":[{"given":"Sven","family":"Coppers","sequence":"first","affiliation":[{"name":"Hasselt University - tUL - Flanders Make, Expertise Centre for Digital Media, Diepenbeek, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Davy","family":"Vanacken","sequence":"additional","affiliation":[{"name":"Hasselt University - tUL - Flanders Make, Expertise Centre for Digital Media, Diepenbeek, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kris","family":"Luyten","sequence":"additional","affiliation":[{"name":"Hasselt University - tUL - Flanders Make, Expertise Centre for Digital Media, Diepenbeek, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,12,18]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3057857"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/1085777.1085780"},{"key":"e_1_2_2_3_1","volume-title":"End-User Development (Lecture Notes in Computer Science)","author":"Ardito Carmelo"},{"key":"e_1_2_2_4_1","volume-title":"Active, Scrutable Model Framework for Context-Aware Services","author":"Assad Mark","year":"2037"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-39653-6_12"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23771-3_5"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1207\/S15327051HCI16234_05"},{"key":"e_1_2_2_8_1","series-title":"Series B (Methodological) 57, 1","volume-title":"Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing. Journal of the Royal Statistical Society","author":"Benjamini Yoav","year":"1995"},{"key":"e_1_2_2_9_1","volume-title":"SUS: A quick and dirty usability scale.","author":"Brooke John","year":"1996"},{"key":"e_1_2_2_10_1","volume-title":"Home automation in the wild: challenges and opportunities","author":"Bernheim Brush A.J.","year":"1978"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3185501"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2018.06.035"},{"key":"e_1_2_2_13_1","doi-asserted-by":"crossref","volume-title":"What Happened in my Home?: An End-User Development Approach for Smart Home Data Visualization","author":"Castelli Nico","DOI":"10.1145\/3025453.3025485"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300789"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1017\/xps.2014.5"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2012.05.003"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331162"},{"key":"e_1_2_2_18_1","volume-title":"Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, Montreal QC, Canada, 1--13","author":"Coppers Sven"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300618"},{"key":"e_1_2_2_20_1","volume-title":"Luigi De Russis, and Alberto Monge Roffarello","author":"Corno Fulvio","year":"2019"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2016.24"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1006\/imms.1993.1061"},{"key":"e_1_2_2_23_1","volume-title":"A Debugging Approach for Trigger-Action Programming","author":"Russis Luigi De","year":"1886"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3057859"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/1868447.1868465"},{"key":"e_1_2_2_26_1","volume-title":"Donald, tell us how?: on the creation of meaning in interaction design through feedforward and inherent feedback","author":"Djajadiningrat Tom"},{"key":"e_1_2_2_27_1","unstructured":"E. S. Reetz D. Kuemper K. Moessner and R. Toenjes. 2013. How to Test IoT-based Services before Deploying them into Real World. In European Wireless 2013; 19th European Wireless Conference. 1--6.  E. S. Reetz D. Kuemper K. Moessner and R. Toenjes. 2013. How to Test IoT-based Services before Deploying them into Real World. In European Wireless 2013; 19th European Wireless Conference. 1--6."},{"key":"e_1_2_2_28_1","volume-title":"Grinter","author":"Keith Edwards W.","year":"2001"},{"key":"e_1_2_2_29_1","volume-title":"Ivy: Exploring Spatially Situated Visual Programming for Authoring and Understanding Intelligent Environments. Technical Report","author":"Ens Barrett","year":"2017"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3057861"},{"key":"e_1_2_2_31_1","volume-title":"Measuring the Quality of Explanations: The System Causability Scale (SCS). KI - K\u00fcnstliche Intelligenz (Jan","author":"Holzinger Andreas","year":"2020"},{"key":"e_1_2_2_32_1","unstructured":"Home Assistant 2020. Home Assistant. https:\/\/www.home-assistant.io\/ Accessed: 2020-05-06.  Home Assistant 2020. Home Assistant. https:\/\/www.home-assistant.io\/ Accessed: 2020-05-06."},{"key":"e_1_2_2_33_1","unstructured":"Home Assistant 2020. Home Assistant Automations. https:\/\/www.home-assistant.io\/docs\/automation\/ Accessed: 2020-08-12.  Home Assistant 2020. Home Assistant Automations. https:\/\/www.home-assistant.io\/docs\/automation\/ Accessed: 2020-08-12."},{"key":"e_1_2_2_34_1","unstructured":"Home Assistant 2020. Home Assistant History. https:\/\/www.home-assistant.io\/integrations\/history Accessed: 2020-07-28.  Home Assistant 2020. Home Assistant History. https:\/\/www.home-assistant.io\/integrations\/history Accessed: 2020-07-28."},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2805830"},{"key":"e_1_2_2_36_1","volume-title":"Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM","author":"Kenneth Huang Ting-Hao"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025799"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287049"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/tce.2015.7298088"},{"key":"e_1_2_2_40_1","doi-asserted-by":"crossref","unstructured":"L. Zhang W. He J. Martinez N. Brackenbury S. Lu and B. Ur. 2019. AutoTap: Synthesizing and Repairing Trigger-Action Programs Using LTL Properties. In 2019 IEEE\/ACM 41st International Conference on Software Engineering (ICSE). 281--291. https:\/\/doi.org\/10.1109\/ICSE.2019.00043 Journal Abbreviation: 2019 IEEE\/ACM 41st International Conference on Software Engineering (ICSE).  L. Zhang W. He J. Martinez N. Brackenbury S. Lu and B. Ur. 2019. AutoTap: Synthesizing and Repairing Trigger-Action Programs Using LTL Properties. In 2019 IEEE\/ACM 41st International Conference on Software Engineering (ICSE). 281--291. https:\/\/doi.org\/10.1109\/ICSE.2019.00043 Journal Abbreviation: 2019 IEEE\/ACM 41st International Conference on Software Engineering (ICSE).","DOI":"10.1109\/ICSE.2019.00043"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1080\/01449290500196963"},{"key":"e_1_2_2_42_1","volume-title":"Dey","author":"Lim Brian Y.","year":"2010"},{"key":"e_1_2_2_43_1","volume-title":"Dey","author":"Lim Brian Y.","year":"2011"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1518701.1519023"},{"key":"e_1_2_2_45_1","unstructured":"Brian Y Lim Qian Yang Ashraf M Abdul and Danding Wang. 2019. Why these Explanations? Selecting Intelligibility Types for Explanation Goals.  Brian Y Lim Qian Yang Ashraf M Abdul and Danding Wang. 2019. Why these Explanations? Selecting Intelligibility Types for Explanation Goals."},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2018.11.005"},{"key":"e_1_2_2_47_1","volume-title":"A magic lens for revealing device interactions in smart environments","author":"Mayer Simon"},{"key":"e_1_2_2_48_1","doi-asserted-by":"crossref","volume-title":"Program Understanding Behavior During Debugging of Large Scale Software","author":"von Mayrhauser Anneliese","DOI":"10.1145\/266399.266414"},{"key":"e_1_2_2_49_1","volume-title":"Huang","author":"Mennicken Sarah","year":"2012"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858168"},{"key":"e_1_2_2_51_1","volume-title":"Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing - UbiComp '14 Adjunct. ACM Press","author":"Mennicken Sarah","year":"2048"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3319499.3328239"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1080\/00140139408964957"},{"key":"e_1_2_2_54_1","first-page":"7","article-title":"Network virtualization: state of the art and research challenges","volume":"47","author":"Mosharaf Kabir Chowdhury N. M.","year":"2009","journal-title":"IEEE Communications Magazine"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2015.2498304"},{"key":"e_1_2_2_56_1","first-page":"1241","article-title":"The 'problem' with automation: inappropriate feedback and interaction, not 'over-automation'. Philosophical Transactions of the Royal Society of London. B","volume":"327","author":"Norman Donald A","year":"1990","journal-title":"Biological Sciences"},{"key":"e_1_2_2_57_1","volume-title":"Evaluating user interface systems research","author":"Olsen Dan R."},{"key":"e_1_2_2_58_1","unstructured":"World Health Organization. 2020. Coronavirus disease (COVID-19) Pandemic. https:\/\/www.who.int\/emergencies\/diseases\/novel-coronavirus-2019  World Health Organization. 2020. Coronavirus disease (COVID-19) Pandemic. https:\/\/www.who.int\/emergencies\/diseases\/novel-coronavirus-2019"},{"key":"e_1_2_2_59_1","doi-asserted-by":"crossref","volume-title":"A Distributed Test System Architecture for Open-source IoT Software","author":"Rosenkranz Philipp","DOI":"10.1145\/2753476.2753481"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.250914"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1145\/3331153"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/2047196.2047227"},{"key":"e_1_2_2_63_1","volume-title":"The Craft of Information Visualization, BENJAMIN B","author":"Shneiderman Ben"},{"key":"e_1_2_2_64_1","volume-title":"HUPS","author":"Ur Blase","year":"2013"},{"key":"e_1_2_2_65_1","volume-title":"Ambient Intelligence (Lecture Notes in Computer Science), Fabio Patern\u00f2, Boris de Ruyter, Panos Markopoulos, Carmen Santoro, Evert van Loenen","author":"Vermeulen Jo"},{"key":"e_1_2_2_66_1","volume-title":"Ambient Intelligence.","author":"Vermeulen Jo"},{"key":"e_1_2_2_67_1","unstructured":"Jo Vermeulen Geert Vanderhulst Karin Coninx and Kris Luyten. 2009. Answering Why and Why Not Questions in Ubiquitous Computing.  Jo Vermeulen Geert Vanderhulst Karin Coninx and Kris Luyten. 2009. Answering Why and Why Not Questions in Ubiquitous Computing."},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1109\/IE.2010.56"},{"key":"e_1_2_2_69_1","volume-title":"7th International Workshop on Design and Semantics of Form and Movement (DeSForM 2012)","author":"Vlist B. J. J.","year":"2012"},{"key":"e_1_2_2_70_1","volume-title":"Proceedings of the 2019 ACM SIGSAC Conference on Computer and Communications Security (CCS '19)","author":"Wang Qi","year":"1953"},{"key":"e_1_2_2_71_1","volume-title":"Internet of things","author":"Weber Rolf H"},{"key":"e_1_2_2_72_1","volume-title":"Proceedings of the 25th International Conference on Intelligent User Interfaces (IUI '20)","author":"Yang Fumeng"},{"key":"e_1_2_2_73_1","volume-title":"Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '13)","author":"Yang Rayoung"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3432225","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3432225","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:47:09Z","timestamp":1750193229000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3432225"}},"subtitle":["Intelligible Predictions to Improve User Understanding of Smart Home Behavior"],"short-title":[],"issued":{"date-parts":[[2020,12,17]]},"references-count":73,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2020,12,17]]}},"alternative-id":["10.1145\/3432225"],"URL":"https:\/\/doi.org\/10.1145\/3432225","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,17]]},"assertion":[{"value":"2020-12-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}