{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T18:16:46Z","timestamp":1780424206332,"version":"3.54.1"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2022,3,29]],"date-time":"2022-03-29T00:00:00Z","timestamp":1648512000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2022,3,29]]},"abstract":"<jats:p>The sensor-based recognition of Activities of Daily Living (ADLs) in smart-home environments is an active research area, with relevant applications in healthcare and ambient assisted living. The application of Explainable Artificial Intelligence (XAI) to ADLs recognition has the potential of making this process trusted, transparent and understandable. The few works that investigated this problem considered only interpretable machine learning models. In this work, we propose DeXAR, a novel methodology to transform sensor data into semantic images to take advantage of XAI methods based on Convolutional Neural Networks (CNN). We apply different XAI approaches for deep learning and, from the resulting heat maps, we generate explanations in natural language. In order to identify the most effective XAI method, we performed extensive experiments on two different datasets, with both a common-knowledge and a user-based evaluation. The results of a user study show that the white-box XAI method based on prototypes is the most effective.<\/jats:p>","DOI":"10.1145\/3517224","type":"journal-article","created":{"date-parts":[[2022,3,29]],"date-time":"2022-03-29T13:42:46Z","timestamp":1648561366000},"page":"1-30","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":39,"title":["DeXAR"],"prefix":"10.1145","volume":"6","author":[{"given":"Luca","family":"Arrotta","sequence":"first","affiliation":[{"name":"EveryWare Lab, Dept. of Computer Science, University of Milan, Milan, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gabriele","family":"Civitarese","sequence":"additional","affiliation":[{"name":"EveryWare Lab, Dept. of Computer Science, University of Milan, Milan, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Claudio","family":"Bettini","sequence":"additional","affiliation":[{"name":"Data Science Research Center and EveryWare Lab, Dept. of Computer Science, University of Milan, Milan, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,3,29]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Peeking inside the black-box: a survey on explainable artificial intelligence (XAI)","author":"Adadi Amina","year":"2018","unstructured":"Amina Adadi and Mohammed Berrada. 2018. Peeking inside the black-box: a survey on explainable artificial intelligence (XAI). IEEE access 6 (2018), 52138--52160."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2019.12.012"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIOT.2018.8325603"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-21671-3_9"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445717"},{"key":"e_1_2_1_6_1","volume-title":"Explainable Activity Recognition Over Interpretable Models. In 2021 IEEE International Conference on Pervasive Computing and Communications Workshops. IEEE, 32--37","author":"Bettini Claudio","year":"2021","unstructured":"Claudio Bettini, Gabriele Civitarese, and Michele Fiori. 2021. Explainable Activity Recognition Over Interpretable Models. In 2021 IEEE International Conference on Pervasive Computing and Communications Workshops. IEEE, 32--37."},{"key":"e_1_2_1_7_1","first-page":"153","article-title":"Explaining recommendations: Satisfaction vs. promotion. In Beyond personalization workshop","volume":"5","author":"Bilgic Mustafa","year":"2005","unstructured":"Mustafa Bilgic and Raymond J Mooney. 2005. Explaining recommendations: Satisfaction vs. promotion. In Beyond personalization workshop, IUI, Vol. 5.153.","journal-title":"IUI"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449287"},{"key":"e_1_2_1_9_1","volume-title":"Jonathan Su, and Cynthia Rudin.","author":"Chen Chaofan","year":"2018","unstructured":"Chaofan Chen, Oscar Li, Chaofan Tao, Alina Jade Barnett, Jonathan Su, and Cynthia Rudin. 2018. This looks like that: deep learning for interpretable image recognition. arXiv preprint arXiv:1806.10574 (2018)."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447744"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCC.2012.2198883"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2011.51"},{"key":"e_1_2_1_13_1","volume-title":"Assessing the quality of activities in a smart environment. Methods of information in medicine 48, 05","author":"Cook Diane J","year":"2009","unstructured":"Diane J Cook and Maureen Schmitter-Edgecombe. 2009. Assessing the quality of activities in a smart environment. Methods of information in medicine 48, 05 (2009), 480--485."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICECTA.2017.8252040"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20061779"},{"key":"e_1_2_1_16_1","volume-title":"A survey of methods for explaining black box models. ACM computing surveys (CSUR) 51, 5","author":"Guidotti Riccardo","year":"2018","unstructured":"Riccardo Guidotti, Anna Monreale, Salvatore Ruggieri, Franco Turini, Fosca Giannotti, and Dino Pedreschi. 2018. A survey of methods for explaining black box models. ACM computing surveys (CSUR) 51, 5 (2018), 1--42."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1609\/aimag.v40i2.2850"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2016.7727224"},{"key":"e_1_2_1_19_1","volume-title":"The promise and peril of human evaluation for model interpretability. arXiv preprint arXiv:1711.07414","author":"Herman Bernease","year":"2017","unstructured":"Bernease Herman. 2017. The promise and peril of human evaluation for model interpretability. arXiv preprint arXiv:1711.07414 (2017), 8."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.3390\/s18113910"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267305.3267517"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCE.2012.6311329"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2733373.2806333"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2007.11.016"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2020.10.030"},{"key":"e_1_2_1_26_1","volume-title":"Explainable AI: Interpreting, Explaining and Visualizing Deep Learning","author":"Kindermans Pieter-Jan","unstructured":"Pieter-Jan Kindermans, Sara Hooker, Julius Adebayo, Maximilian Alber, Kristof T Sch\u00fctt, Sven D\u00e4hne, Dumitru Erhan, and Been Kim. 2019. The (un) reliability of saliency methods. In Explainable AI: Interpreting, Explaining and Visualizing Deep Learning. Springer, 267--280."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/VLHCC.2010.15"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/SURV.2012.110112.00192"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1214\/15-AOAS848"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11771"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2020.06.004"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2994551.2994569"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2018.10.104"},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the 31st international conference on neural information processing systems. 4768--4777","author":"Lundberg Scott M","year":"2017","unstructured":"Scott M Lundberg and Su-In Lee. 2017. A unified approach to interpreting model predictions. In Proceedings of the 31st international conference on neural information processing systems. 4768--4777."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3387166"},{"key":"e_1_2_1_36_1","doi-asserted-by":"crossref","unstructured":"Nina Narodytska Alexey Ignatiev Filipe Pereira Joao Marques-Silva and IS RAS. 2018. Learning Optimal Decision Trees with SAT.. In IJCAI. 1362--1368.","DOI":"10.24963\/ijcai.2018\/189"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1609\/hcomp.v7i1.5284"},{"key":"e_1_2_1_38_1","volume-title":"A survey on ambient-assisted living tools for older adults","author":"Rashidi Parisa","year":"2012","unstructured":"Parisa Rashidi and Alex Mihailidis. 2012. A survey on ambient-assisted living tools for older adults. IEEE journal of biomedical and health informatics 17, 3 (2012), 579--590."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/BSN.2016.7516235"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2939672.2939778"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2015.12.001"},{"key":"e_1_2_1_42_1","volume-title":"IUI Workshops.","author":"Roy Chiradeep","year":"2019","unstructured":"Chiradeep Roy, Mahesh Shanbhag, Mahsan Nourani, Tahrima Rahman, Samia Kabir, Vibhav Gogate, Nicholas Ruozzi, and Eric D Ragan. 2019. Explainable Activity Recognition in Videos.. In IUI Workshops."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-019-0048-x"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-28954-6"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3053704"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.74"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2017.7966182"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.3233\/JIFS-169976"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/IECON43393.2020.9254361"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2018.2866806"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20205770"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2020.3035062"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2018.02.010"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302317"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2012.22"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3343031.3351040"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3517224","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3517224","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T04:24:54Z","timestamp":1752467094000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3517224"}},"subtitle":["Deep Explainable Sensor-Based Activity Recognition in Smart-Home Environments"],"short-title":[],"issued":{"date-parts":[[2022,3,29]]},"references-count":56,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,3,29]]}},"alternative-id":["10.1145\/3517224"],"URL":"https:\/\/doi.org\/10.1145\/3517224","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,29]]},"assertion":[{"value":"2022-03-29","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}