{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T12:12:50Z","timestamp":1767183170732,"version":"3.41.0"},"reference-count":46,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2024,12,23]],"date-time":"2024-12-23T00:00:00Z","timestamp":1734912000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2025,1,31]]},"abstract":"<jats:p>Training machine learning models to identify human behavior is a difficult yet essential task to develop autonomous and adaptive systems such as smart homes. These models require large and diversified amounts of labeled data to be trained effectively. Due to the high variety of home environments and occupant behaviors, collecting datasets that are representative of all possible homes is a major challenge. In addition, privacy and cost are major hurdles to collect real home data. To avoid these difficulties, one solution consists of training these models using purely synthetic data, which can be generated through the simulation of home and their occupants. Two challenges arise from this approach: designing a methodology with a simulation able to generate credible simulated data and evaluating this credibility. In this article, we explain the methodology used to generate diversified synthetic data of daily activities, through the combination of an agent model to simulate an occupant and a simulated 3D house enriched with sensors and effectors to produce such data. We demonstrate the credibility of the generated synthetic data by comparing their efficacy for training human context understanding models against the efficacy generated by real data. To achieve this, we replicate a real dataset collection setting with our smart home simulator. The occupant is replaced by an autonomous agent following the same experimental protocol used for the real dataset collection. This agent is a BDI-based model enhanced with a scheduler designed to offer a balance between control and autonomy. This balance is useful in synthetic data generation since strong constraints can be imposed on the agent to simulate desired situations while allowing autonomous behaviors outside these constraints to generate diversified data. In our case, the constraints are those imposed during the real dataset collection that we want to replicate. The simulated sensors and effectors were configured to react to the agent\u2019s behaviors similarly to the real ones. We experimentally show that data generated from this simulation are valuable for two human context understanding tasks: current human activity recognition and future human activity prediction. In particular, we show that models trained solely with simulated data can give reasonable predictions about real situations occurring in the original dataset. We also report experimental results regarding statistical analysis and C2ST to assess the credibility of generated data. We discuss the generality of our approach for evaluating the credibility of simulated data from their use as training data.<\/jats:p>","DOI":"10.1145\/3665331","type":"journal-article","created":{"date-parts":[[2024,5,22]],"date-time":"2024-05-22T18:01:28Z","timestamp":1716400888000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Generating and Evaluating Data of Daily Activities with an Autonomous Agent in a Virtual Smart Home"],"prefix":"10.1145","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1200-1057","authenticated-orcid":false,"given":"Lysa","family":"Gramoli","sequence":"first","affiliation":[{"name":"Univ Rennes, INSA Rennes, Inria, CNRS, Irisa, Rennes, France and Orange Innovation, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8846-5547","authenticated-orcid":false,"given":"Julien","family":"Cumin","sequence":"additional","affiliation":[{"name":"Orange Innovation, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3926-7768","authenticated-orcid":false,"given":"J\u00e9r\u00e9my","family":"Lacoche","sequence":"additional","affiliation":[{"name":"Orange Innovation, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8065-2524","authenticated-orcid":false,"given":"Anthony","family":"Foulonneau","sequence":"additional","affiliation":[{"name":"Orange Innovation, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2868-8826","authenticated-orcid":false,"given":"Bruno","family":"Arnaldi","sequence":"additional","affiliation":[{"name":"Univ Rennes, INSA Rennes, Inria, CNRS, Irisa, Rennes, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9351-2747","authenticated-orcid":false,"given":"Val\u00e9rie","family":"Gouranton","sequence":"additional","affiliation":[{"name":"Univ Rennes, INSA Rennes, Inria, CNRS, Irisa, Rennes, France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,12,23]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","unstructured":"Louis Airale Dominique Vaufreydaz and Xavier Alameda-Pineda. 2021. SocialInteractionGAN: Multi-person interaction sequence generation. CoRR abs\/2103.05916 (2021). arXiv:2103.05916. DOI: 10.1109\/TAFFC.2022.3171719","DOI":"10.1109\/TAFFC.2022.3171719"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.3390\/s17051003"},{"key":"e_1_3_2_4_2","volume-title":"5th International Conference on Agents and ARTificial intelligence (ICAART \u201913)","author":"Amouroux Edouard","year":"2013","unstructured":"Edouard Amouroux, Thomas Huraux, Fran\u00e7ois Semp\u00e9, Nicolas Sabouret, and Yvon Haradji. 2013. Simulating human activities to investigate household energy consumption. In 5th International Conference on Agents and ARTificial intelligence (ICAART \u201913)."},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-44440-5_12"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1186\/2193-1801-2-246"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1007\/10720181_9"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-67401-8_6"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3197768.3201522"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1109\/SEARIS.2015.7854099"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11116-004-8287-y"},{"key":"e_1_3_2_12_2","first-page":"1","volume-title":"Proceedings of the 24th International Conference on Artificial Reality and Telexistence, and the 19th Eurographics Symposium on Virtual Environments","author":"Claude Guillaume","year":"2014","unstructured":"Guillaume Claude, Val\u00e9rie Gouranton, Rozenn Bouville Berthelot, and Bruno Arnaldi. 2014. Short Paper: #SEVEN, a sensor effector based scenarios model for driving collaborative virtual environment. In Proceedings of the 24th International Conference on Artificial Reality and Telexistence, and the 19th Eurographics Symposium on Virtual Environments (Dec. 2014), 1\u20134."},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-67585-5_43"},{"issue":"1","key":"e_1_3_2_14_2","first-page":"1:1","article-title":"PSINES: Activity and availability prediction for adaptive ambient intelligence","volume":"15","author":"Cumin Julien","year":"2021","unstructured":"Julien Cumin, Gr\u00e9goire Lefebvre, Fano Ramparany, and James L. Crowley. 2021. PSINES: Activity and availability prediction for adaptive ambient intelligence. ACM Transactions on Autonomous and Adaptive Systems 15, 1 (2021), 1:1\u20131:12.","journal-title":"ACM Transactions on Autonomous and Adaptive Systems"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.5555\/1251973.1252505"},{"key":"e_1_3_2_16_2","first-page":"363","volume-title":"17th International Conference on Autonomous Agents and MultiAgent Systems","author":"de Silva Lavindra","year":"2018","unstructured":"Lavindra de Silva. 2018. HTN acting: A formalism and an algorithm. In 17th International Conference on Autonomous Agents and MultiAgent Systems. 363\u2013371."},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(71)90010-5"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","unstructured":"Ilche Georgievski and Marco Aiello. 2014. An overview of hierarchical task network planning. arXiv:1403.7426. DOI: 10.48550\/arXiv.1403.7426","DOI":"10.48550\/arXiv.1403.7426"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.3390\/s20247137"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1145\/3422622"},{"key":"e_1_3_2_21_2","first-page":"134","volume-title":"MARCH: Modeling and Animating Realistic Crowds and Humans) Workshop in 4th IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR)","author":"Gramoli Lysa","year":"2021","unstructured":"Lysa Gramoli, J\u00e9r\u00e9my Lacoche, Anthony Foulonneau, Val\u00e9rie Gouranton, and Bruno Arnaldi. 2021. Needs model for an autonomous agent during long-term simulations. In MARCH: Modeling and Animating Realistic Crowds and Humans) Workshop in 4th IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR). IEEE, 134\u2013138."},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-18192-4_17"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.5555\/3295222.3295408"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-020-04918-3"},{"key":"e_1_3_2_25_2","volume-title":"Space and Time Constrained Task Scheduling for Crowd Simulation","author":"Jorgensen Carl-Johan","year":"2014","unstructured":"Carl-Johan Jorgensen and Fabrice Lamarche. 2014. Space and Time Constrained Task Scheduling for Crowd Simulation. Research Report PI 2013."},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmcj.2017.07.007"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.autcon.2011.11.012"},{"key":"e_1_3_2_28_2","volume-title":"ICAT-EGVE 2019-International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments","author":"Lacoche J\u00e9r\u00e9my","year":"2019","unstructured":"J\u00e9r\u00e9my Lacoche, Morgan Le Ch\u00e9n\u00e9chal, Eric Villain, and Anthony Foulonneau. 2019. Model and tools for integrating iot into mixed reality environments: Towards a virtual-real seamless continuum. In ICAT-EGVE 2019-International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments."},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","unstructured":"John E. Laird. 2022. An analysis and comparison of ACT-R and Soar. arXiv:2201.09305. DOI: 10.48550\/arXiv.2201.09305","DOI":"10.48550\/arXiv.2201.09305"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/5.533956"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2015.04.130"},{"key":"e_1_3_2_32_2","unstructured":"David Lopez-Paz and Maxime Oquab. 2017. Revisiting classifier two-sample tests. In 5th International Conference on Learning Representations (ICLR \u201917) Conference Track Proceedings. OpenReview.net. Retrieved from https:\/\/openreview.net\/forum?id=SJkXfE5xx"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1037\/h0054346"},{"key":"e_1_3_2_34_2","volume-title":"5th Swiss Transport Research Conference (STRC \u201905)","author":"Meister Konrad","year":"2005","unstructured":"Konrad Meister, Martin Frick, and Kay W Axhausen. 2005. Generating daily activity schedules for households using Genetic Algorithms. In 5th Swiss Transport Research Conference (STRC \u201905). STRC."},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/356698.356702"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00886"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.5555\/3320516.3320621"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.5220\/0006189100670077"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.tra.2007.10.004"},{"key":"e_1_3_2_40_2","first-page":"2226","volume-title":"Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016","author":"Salimans Tim","year":"2016","unstructured":"Tim Salimans, Ian J. Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, and Xi Chen. 2016. Improved techniques for training GANs. In Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016. Daniel D. Lee, Masashi Sugiyama, Ulrike von Luxburg, Isabelle Guyon, and Roman Garnett (Eds.), 2226\u20132234."},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.26868\/25222708.2021.30273"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2020\/684"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4615-2263-8_7"},{"key":"e_1_3_2_44_2","first-page":"35","volume-title":"Rencontres des Jeunes Chercheurs en Intelligence Artificielle 2019","author":"Trentin Iago","year":"2019","unstructured":"Iago Trentin, Olivier Boissier, and Fano Ramparany. 2019. Insights about user-centric contextual online adaptation of coordinated multi-agent systems in smart homes. In Rencontres des Jeunes Chercheurs en Intelligence Artificielle 2019. 35\u201342."},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2018.10.004"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-00461-3_23"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/SEsCPS.2019.00011"}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3665331","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3665331","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T00:03:19Z","timestamp":1750291399000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3665331"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,23]]},"references-count":46,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,1,31]]}},"alternative-id":["10.1145\/3665331"],"URL":"https:\/\/doi.org\/10.1145\/3665331","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"type":"print","value":"1551-6857"},{"type":"electronic","value":"1551-6865"}],"subject":[],"published":{"date-parts":[[2024,12,23]]},"assertion":[{"value":"2023-03-22","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-05-14","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-12-23","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}