{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T23:20:11Z","timestamp":1776381611979,"version":"3.51.2"},"reference-count":59,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2023,9,1]],"date-time":"2023-09-01T00:00:00Z","timestamp":1693526400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Brest Metropole, the region of Brittany and the European Regional Development Fund (ERDF)"},{"name":"Delta Dore"},{"name":"National Association of Technical Research (ANRT)"},{"name":"AID Project ACoCaTherm"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>One of the challenges in the field of human activity recognition in smart homes based on IoT sensors is the variability in the recorded data. This variability arises from differences in home configurations, sensor network setups, and the number and habits of inhabitants, resulting in a lack of data that accurately represent the application environment. Although simulators have been proposed in the literature to generate data, they fail to bridge the gap between training and field data or produce diverse datasets. In this article, we propose a solution to address this issue by leveraging the concept of digital twins to reduce the disparity between training and real-world data and generate more varied datasets. We introduce the Virtual Smart Home, a simulator specifically designed for modeling daily life activities in smart homes, which is adapted from the Virtual Home simulator. To assess its realism, we compare a set of activity data recorded in a real-life smart apartment with its replication in the VirtualSmartHome simulator. Additionally, we demonstrate that an activity recognition algorithm trained on the data generated by the VirtualSmartHome simulator can be successfully validated using real-life field data.<\/jats:p>","DOI":"10.3390\/s23177586","type":"journal-article","created":{"date-parts":[[2023,9,1]],"date-time":"2023-09-01T09:12:22Z","timestamp":1693559542000},"page":"7586","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":25,"title":["A Smart Home Digital Twin to Support the Recognition of Activities of Daily Living"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3623-3626","authenticated-orcid":false,"given":"Damien","family":"Bouchabou","sequence":"first","affiliation":[{"name":"IMT Atlantique, 44300 Nantes, France"},{"name":"U2IS, ENSTA Paris, 91120 Palaiseau, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3800-0447","authenticated-orcid":false,"given":"Juliette","family":"Grosset","sequence":"additional","affiliation":[{"name":"IMT Atlantique, 44300 Nantes, France"},{"name":"ECAM Rennes, 35170 Bruz, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0929-0019","authenticated-orcid":false,"given":"Sao Mai","family":"Nguyen","sequence":"additional","affiliation":[{"name":"IMT Atlantique, 44300 Nantes, France"},{"name":"ECAM Rennes, 35170 Bruz, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0655-2880","authenticated-orcid":false,"given":"Christophe","family":"Lohr","sequence":"additional","affiliation":[{"name":"IMT Atlantique, 44300 Nantes, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xavier","family":"Puig","sequence":"additional","affiliation":[{"name":"FAIR, Menlo Park, CA 94025, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"107561","DOI":"10.1016\/j.patcog.2020.107561","article-title":"Sensor-based and vision-based human activity recognition: A comprehensive survey","volume":"108","author":"Dang","year":"2020","journal-title":"Pattern Recognit."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Bouchabou, D., Nguyen, S.M., Lohr, C., LeDuc, B., and Kanellos, I. (2021). A Survey of Human Activity Recognition in Smart Homes Based on IoT Sensors Algorithms: Taxonomies, Challenges, and Opportunities with Deep Learning. Sensors, 21.","DOI":"10.3390\/s21186037"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"9718","DOI":"10.1109\/JSEN.2018.2866806","article-title":"Multi-resident activity recognition in a smart home using RGB activity image and DCNN","volume":"18","author":"Tan","year":"2018","journal-title":"IEEE Sens. J."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Bouchabou, D., Nguyen, S.M., Lohr, C., Kanellos, I., and Leduc, B. (2021, January 7\u201315). Fully Convolutional Network Bootstrapped by Word Encoding and Embedding for Activity Recognition in Smart Homes. Proceedings of the IJCAI 2020 Workshop on Deep Learning for Human Activity Recognition, Yokohama, Japan.","DOI":"10.1007\/978-981-16-0575-8_9"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1016\/j.neucom.2018.10.104","article-title":"A Sequential Deep Learning Application for Recognising Human Activities in Smart Homes","volume":"396","author":"Liciotti","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_6","unstructured":"Hussain, Z., Sheng, Q., and Zhang, W.E. (2019). Different Approaches for Human Activity Recognition: A Survey. arXiv."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Tapia, E.M., Intille, S.S., and Larson, K. (2004, January 21\u201323). Activity recognition in the home using simple and ubiquitous sensors. Proceedings of the International Conference on Pervasive Computing, Vienna, Austria.","DOI":"10.1007\/978-3-540-24646-6_10"},{"key":"ref_8","unstructured":"van Kasteren, T.L., Englebienne, G., and Kr\u00f6se, B.J. (2011). Activity Recognition in Pervasive Intelligent Environments, Atlantis Press."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Alemdar, H., Ertan, H., Incel, O.D., and Ersoy, C. (2013, January 5\u20138). ARAS human activity datasets in multiple homes with multiple residents. Proceedings of the 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops, Venice, Italy.","DOI":"10.4108\/icst.pervasivehealth.2013.252120"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Cumin, J., Lefebvre, G., Ramparany, F., and Crowley, J.L. (2017, January 7\u201310). A dataset of routine daily activities in an instrumented home. Proceedings of the International Conference on Ubiquitous Computing and Ambient Intelligence, Philadelphia, PA, USA.","DOI":"10.1007\/978-3-319-67585-5_43"},{"key":"ref_11","unstructured":"Grieves, M. (2014). Digital Twin: Manufacturing Excellence through Virtual Factory Replication, Digital Twin Consortium. Digital Twin White Paper."},{"key":"ref_12","unstructured":"Grieves, M., and Vickers, J. (2017). Transdisciplinary Perspectives on Complex Systems, Springer."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"167653","DOI":"10.1109\/ACCESS.2019.2953499","article-title":"A survey on digital twin: Definitions, characteristics, applications, and design implications","volume":"7","author":"Barricelli","year":"2019","journal-title":"IEEE Access"},{"key":"ref_14","first-page":"304","article-title":"Digital Twin Approach to Building Information Management","volume":"2018","author":"Ito","year":"2018","journal-title":"Proc. Manuf. Syst. Div. Conf."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"147406","DOI":"10.1109\/ACCESS.2019.2946515","article-title":"Digital Twin: Vision, Benefits, Boundaries, and Creation for Buildings","volume":"7","author":"Khajavi","year":"2019","journal-title":"IEEE Access"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Puig, X., Ra, K., Boben, M., Li, J., Wang, T., Fidler, S., and Torralba, A. (2018, January 18\u201322). Virtualhome: Simulating Household Activities via Programs. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00886"},{"key":"ref_17","first-page":"48","article-title":"Evaluating machine learning techniques for activity classification in smart home environments","volume":"12","author":"Sedky","year":"2018","journal-title":"Int. J. Inf. Syst. Comput. Sci."},{"key":"ref_18","first-page":"693","article-title":"Unobtrusive activity recognition of elderly people living alone using anonymous binary sensors and DCNN","volume":"23","author":"Gochoo","year":"2018","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_19","unstructured":"Singh, D., Merdivan, E., Hanke, S., Kropf, J., Geist, M., and Holzinger, A. (2017). Towards Integrative Machine Learning and Knowledge Extraction, Proceedings of the BIRS Workshop, Banff, AB, Canada, 24\u201326 July 2015, Springer."},{"key":"ref_20","unstructured":"Singh, D., Merdivan, E., Psychoula, I., Kropf, J., Hanke, S., Geist, M., and Holzinger, A. (September, January 29). Human activity recognition using recurrent neural networks. Proceedings of the International Cross-Domain Conference for Machine Learning and Knowledge Extraction, Reggio, Italy."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/MC.2012.328","article-title":"CASAS: A Smart Home in a Box","volume":"46","author":"Cook","year":"2013","journal-title":"Computer"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"59192","DOI":"10.1109\/ACCESS.2018.2873502","article-title":"Sensor-based datasets for human activity recognition\u2014A systematic review of literature","volume":"6","author":"Quero","year":"2018","journal-title":"IEEE Access"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"8337","DOI":"10.1109\/JSEN.2022.3159205","article-title":"Smart Indoor Space Simulation Methodologies: A Review","volume":"22","author":"Golestan","year":"2022","journal-title":"IEEE Sens. J."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Bruneau, J., Consel, C., OMalley, M., Taha, W., and Hannourah, W.M. (2012, January 26\u201329). Virtual testing for smart buildings. Proceedings of the 2012 Eighth International Conference on Intelligent Environments, Guanajuato, Mexico.","DOI":"10.1109\/IE.2012.24"},{"key":"ref_25","unstructured":"Kolve, E., Mottaghi, R., Han, W., VanderBilt, E., Weihs, L., Herrasti, A., Gordon, D., Zhu, Y., Gupta, A., and Farhadi, A. (2019). AI2-THOR: An Interactive 3D Environment for Visual AI. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Xia, F., Zamir, A.R., He, Z., Sax, A., Malik, J., and Savarese, S. (2018, January 18\u201322). Gibson Env: Real-World Perception for Embodied Agents. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00945"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Roitberg, A., Schneider, D., Djamal, A., Seibold, C., Rei\u00df, S., and Stiefelhagen, R. (2021). Let\u2019s Play for Action: Recognizing Activities of Daily Living by Learning from Life Simulation Video Games. arXiv.","DOI":"10.1109\/IROS51168.2021.9636381"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Savva, M., Kadian, A., Maksymets, O., Zhao, Y., Wijmans, E., Jain, B., Straub, J., Liu, J., Koltun, V., and Malik, J. (2019). Habitat: A Platform for Embodied AI Research. arXiv.","DOI":"10.1109\/ICCV.2019.00943"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Alshammari, N., Alshammari, T., Sedky, M., Champion, J., and Bauer, C. (2017). OpenSHS: Open smart home simulator. Sensors, 17.","DOI":"10.3390\/s17051003"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Ho, B., Vogts, D., and Wesson, J. (2019, January 17\u201318). A smart home simulation tool to support the recognition of activities of daily living. Proceedings of the South African Institute of Computer Scientists and Information Technologists 2019, Skukuza, South Africa.","DOI":"10.1145\/3351108.3351132"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1243","DOI":"10.1109\/TASE.2015.2467353","article-title":"Persim 3D: Context-Driven Simulation and Modeling of Human Activities in Smart Spaces","volume":"12","author":"Lee","year":"2015","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_32","unstructured":"Patern\u00f2, F., de Ruyter, B., Markopoulos, P., Santoro, C., van Loenen, E., and Luyten, K. (2012, January 13\u201315). IE Sim\u2014A Flexible Tool for the Simulation of Data Generated within Intelligent Environments. Proceedings of the Ambient Intelligence, Pisa, Italy. Lecture Notes in Computer Science."},{"key":"ref_33","first-page":"13","article-title":"SIMACT: A 3D Open Source Smart Home Simulator for Activity Recognition with Open Database and Visual Editor","volume":"5","author":"Bouchard","year":"2012","journal-title":"Int. J. Hybrid Inf. Technol."},{"key":"ref_34","first-page":"53","article-title":"The User Activity Reasoning Model in a Virtual Living Space Simulator","volume":"9","author":"Park","year":"2015","journal-title":"Int. J. Softw. Eng. Its Appl."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Francillette, Y., Boucher, E., Bouzouane, A., and Gaboury, S. (2017). The Virtual Environment for Rapid Prototyping of the Intelligent Environment. Sensors, 17.","DOI":"10.3390\/s17112562"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1016\/j.procs.2011.07.014","article-title":"A simulator for generating and visualizing sensor data for ambient intelligence environments","volume":"5","author":"Buchmayr","year":"2011","journal-title":"Procedia Comput. Sci."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Armac, I., and Retkowitz, D. (2007, January 15\u201320). Simulation of smart environments. Proceedings of the IEEE International Conference on Pervasive Services, Istanbul, Turkey.","DOI":"10.1109\/PERSER.2007.4283924"},{"key":"ref_38","unstructured":"(2021, January 21). VirtualHome. Available online: http:\/\/www.virtual-home.org\/."},{"key":"ref_39","unstructured":"Savva, M., Chang, A.X., Dosovitskiy, A., Funkhouser, T., and Koltun, V. (2017). MINOS: Multimodal indoor simulator for navigation in complex environments. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Roberts, M., Ramapuram, J., Ranjan, A., Kumar, A., Bautista, M.A., Paczan, N., Webb, R., and Susskind, J.M. (2021). Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understanding. arXiv.","DOI":"10.1109\/ICCV48922.2021.01073"},{"key":"ref_41","unstructured":"Srivastava, S., Li, C., Lingelbach, M., Mart\u00edn-Mart\u00edn, R., Xia, F., Vainio, K., Lian, Z., Gokmen, C., Buch, S., and Liu, C.K. (2021). BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environments. arXiv."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Shridhar, M., Thomason, J., Gordon, D., Bisk, Y., Han, W., Mottaghi, R., Zettlemoyer, L., and Fox, D. (2020, January 13\u201319). Alfred: A benchmark for interpreting grounded instructions for everyday tasks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01075"},{"key":"ref_43","unstructured":"Puig, X., Shu, T., Li, S., Wang, Z., Liao, Y.H., Tenenbaum, J.B., Fidler, S., and Torralba, A. (2021, January 3\u20137). Watch-And-Help: A Challenge for Social Perception and Human-AI Collaboration. Proceedings of the International Conference on Learning Representations, Online."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Cao, Z., Gao, H., Mangalam, K., Cai, Q., Vo, M., and Malik, J. (2020, January 23\u201328). Long-term human motion prediction with scene context. Proceedings of the ECCV, Glasgow, UK.","DOI":"10.1007\/978-3-030-58452-8_23"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Varol, G., Romero, J., Martin, X., Mahmood, N., Black, M.J., Laptev, I., and Schmid, C. (2017, January 21\u201326). Learning from Synthetic Humans. Proceedings of the CVPR, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.492"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"14162","DOI":"10.3390\/s150614162","article-title":"Simulation of smart home activity datasets","volume":"15","author":"Synnott","year":"2015","journal-title":"Sensors"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/j.pmcj.2017.07.007","article-title":"MASSHA: An agent-based approach for human activity simulation in intelligent environments","volume":"40","author":"Azkune","year":"2017","journal-title":"Pervasive Mob. Comput."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1109\/MC.2005.107","article-title":"The gator tech smart house: A programmable pervasive space","volume":"38","author":"Helal","year":"2005","journal-title":"Computer"},{"key":"ref_49","unstructured":"Puig, X. (2021, January 25). VirtualHome Source Code. Available online: https:\/\/github.com\/xavierpuigf\/virtualhome_unity."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Liao, Y., Puig, X., Boben, M., Torralba, A., and Fidler, S. (2019, January 15\u201320). Synthesizing Environment-Aware Activities via Activity Sketches. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00645"},{"key":"ref_51","unstructured":"(2021, January 25). VirtualHome Source Code and API. Available online: https:\/\/github.com\/xavierpuigf\/virtualhome."},{"key":"ref_52","unstructured":"(2022, September 10). Sweet Home 3D-Draw Floor Plans and Arrange Furniture Freely. Available online: https:\/\/www.sweethome3d.com\/."},{"key":"ref_53","unstructured":"(2021, January 21). Experiment\u2019Haal, le Living Lab Sant\u00e9 Autonomie (LLSA). Available online: http:\/\/www.imt-atlantique.fr\/fr\/recherche-et-innovation\/plateformes-de-recherche\/experiment-haal."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Lohr, C., and Kerdreux, J. (2020). Improvements of the xAAL home automation system. Future Internet, 12.","DOI":"10.3390\/fi12060104"},{"key":"ref_55","unstructured":"Future-Shape (2021, December 06). SensFloor\u2014The Floor Becomes a Touch Screen. Available online: https:\/\/future-shape.com\/en\/system\/."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"721","DOI":"10.1111\/j.1532-5415.1983.tb03391.x","article-title":"Assessing self-maintenance: Activities of daily living, mobility, and instrumental activities of daily living","volume":"31","author":"Katz","year":"1983","journal-title":"J. Am. Geriatr. Soc."},{"key":"ref_57","unstructured":"(2021, August 17). Cross-Correlation. Available online: https:\/\/en.wikipedia.org\/w\/index.php?title=Cross-correlation&oldid=1031522391."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Sammut, C., and Webb, G.I. (2010). Encyclopedia of Machine Learning, Springer.","DOI":"10.1007\/978-0-387-30164-8"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/17\/7586\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:44:39Z","timestamp":1760129079000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/17\/7586"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,1]]},"references-count":59,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["s23177586"],"URL":"https:\/\/doi.org\/10.3390\/s23177586","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,1]]}}}