{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T17:14:06Z","timestamp":1773249246257,"version":"3.50.1"},"reference-count":72,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2024,5,13]],"date-time":"2024-05-13T00:00:00Z","timestamp":1715558400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2024,5,13]]},"abstract":"<jats:p>Ambient Intelligence (AmI) focuses on creating environments capable of proactively and transparently adapting to users and their activities. Traditionally, AmI focused on the availability of computational devices, the pervasiveness of networked environments, and means to interact with users. In this paper, we propose a renewed AmI architecture that takes into account current technological advancements while focusing on proactive adaptation for assisting and protecting users. This architecture consist of four phases: Perceive, Interpret, Decide, and Interact. The AmI systems we propose, called Digital Companions (DC), can be embodied in a variety of ways (e.g., through physical robots or virtual agents) and are structured according to these phases to assist and protect their users. We further categorize DCs into Expert DCs and Personal DCs, and show that this induces a favorable separation of concerns in AmI systems, where user concerns (including personal user data and preferences) are handled by Personal DCs and environment concerns (including interfacing with environmental artifacts) are assigned to Expert DCs; this separation has favorable privacy implications as well. Herein, we introduce this architecture and validate it through a prototype in an industrial scenario where robots and humans collaborate to perform a task.<\/jats:p>","DOI":"10.1145\/3659610","type":"journal-article","created":{"date-parts":[[2024,5,15]],"date-time":"2024-05-15T12:20:41Z","timestamp":1715775641000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["A Digital Companion Architecture for Ambient Intelligence"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4971-2944","authenticated-orcid":false,"given":"Kimberly","family":"Garcia","sequence":"first","affiliation":[{"name":"University of St.Gallen, St. Gallen, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-6231-4445","authenticated-orcid":false,"given":"Jonathan","family":"Vontobel","sequence":"additional","affiliation":[{"name":"University of St.Gallen, St. Gallen, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6367-3454","authenticated-orcid":false,"given":"Simon","family":"Mayer","sequence":"additional","affiliation":[{"name":"University of St.Gallen, St. Gallen, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,5,15]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"Knowledge-based systems","author":"Akerkar Rajendra","unstructured":"Rajendra Akerkar and Priti Sajja. 2009. Knowledge-based systems. Jones & Bartlett Publishers."},{"key":"e_1_2_1_2_1","volume-title":"Spice: Semantic propositional image caption evaluation. In Computer Vision-ECCV 2016: 14th European Conference","author":"Anderson Peter","year":"2016","unstructured":"Peter Anderson, Basura Fernando, Mark Johnson, and Stephen Gould. 2016. Spice: Semantic propositional image caption evaluation. In Computer Vision-ECCV 2016: 14th European Conference. Springer, 382--398."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1093\/database\/bay101"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-84628-943-9_11"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3588015.3588402"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2024.103909"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13218-021-00721-x"},{"key":"e_1_2_1_8_1","volume-title":"A Companion-System Architecture for Realizing Individualized and Situation-Adaptive User Assistance. Report Universit\u00e4t Ulm","author":"Bercher Pascal","year":"2018","unstructured":"Pascal Bercher, Felix Richter, Frank Honold, Florian Nielsen, Felix Schussel, Thomas Geier, Thilo Hornle, Stephan Reuter, Daniel Holler, Gregor Behnke, Klaus Dietmayer, Wolfgang Minker, Michael Weber, and Susanne Biundo. 2018. A Companion-System Architecture for Realizing Individualized and Situation-Adaptive User Assistance. Report Universit\u00e4t Ulm (2018)."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1038\/scientificamerican0501-34"},{"key":"e_1_2_1_10_1","volume-title":"YOLOv4: Optimal Speed and Accuracy of Object Detection. CoRR abs\/2004.10934","author":"Bochkovskiy Alexey","year":"2020","unstructured":"Alexey Bochkovskiy, Chien-Yao Wang, and Hong-Yuan Mark Liao. 2020. YOLOv4: Optimal Speed and Accuracy of Object Detection. CoRR abs\/2004.10934 (2020). arXiv:2004.10934 https:\/\/arxiv.org\/abs\/2004.10934"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.3233\/AO-210259"},{"key":"e_1_2_1_12_1","volume-title":"Lin (Eds.)","volume":"33","author":"Brown Tom","year":"2020","unstructured":"Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language Models are Few-Shot Learners. In Advances in Neural Information Processing Systems, H. Larochelle, M. Ranzato, R. Hadsell, M.F. Balcan, and H. Lin (Eds.), Vol. 33. Curran Associates, Inc., 1877--1901. https:\/\/proceedings.neurips.cc\/paper\/2020\/file\/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290607.3312821"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12652-016-0374-3"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.websem.2012.05.003"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2023.3268066"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmcj.2009.04.001"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.352"},{"key":"e_1_2_1_19_1","volume-title":"Garnett (Eds.)","volume":"29","author":"Dai Jifeng","year":"2016","unstructured":"Jifeng Dai, Yi Li, Kaiming He, and Jian Sun. 2016. R-FCN: Object Detection via Region-based Fully Convolutional Networks. In Advances in Neural Information Processing Systems, D. Lee, M. Sugiyama, U. Luxburg, I. Guyon, and R. Garnett (Eds.), Vol. 29. Curran Associates, Inc."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/CASE49997.2022.9926662"},{"key":"e_1_2_1_21_1","volume-title":"Scenarios for Ambient Intelligence","author":"Ducatel K","year":"2010","unstructured":"K Ducatel, M Bogdanowicz, F Scapolo, J Leijten, and J-C Burgelman. 2001. Scenarios for Ambient Intelligence in 2010. Union europ\u00e9enne. Technologies de la soci\u00e9t\u00e9 de l'information, Union europ\u00e9enne. Institut d'\u00e9tudes de prospectives technologiques, and Union europ\u00e9enne. Soci\u00e9t\u00e9 de l'information conviviale (2001). http:\/\/www.ist.hu\/doctar\/fp5\/istagscenarios2010.pdf"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447242"},{"key":"e_1_2_1_23_1","unstructured":"Roy T. Fielding. 2000. Architectural styles and the design of network -based software architectures. Ph. D. Dissertation. https:\/\/www.proquest.com\/dissertations-theses\/architectural-styles-design-network-based\/docview\/304591392\/se-2"},{"key":"e_1_2_1_24_1","doi-asserted-by":"crossref","unstructured":"Andrea Gaggioli Alois Ferscha Giuseppe Riva Stephen Dunne Isabell Viaud-Delmon et al. 2016. Human computer confluence: Transforming human experience through symbiotic technologies. Vol. 2016. De Gruyter Open Berlin Germany.","DOI":"10.1515\/9783110471137"},{"key":"e_1_2_1_25_1","volume-title":"Knowledge Engineering and Knowledge Management: Ontologies and the Semantic Web, Asunci\u00f3n G\u00f3mez-P\u00e9rez and V","author":"Gangemi Aldo","unstructured":"Aldo Gangemi, Nicola Guarino, Claudio Masolo, Alessandro Oltramari, and Luc Schneider. 2002. Sweetening Ontologies with DOLCE. In Knowledge Engineering and Knowledge Management: Ontologies and the Semantic Web, Asunci\u00f3n G\u00f3mez-P\u00e9rez and V. Richard Benjamins (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 166--181."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-023-10448-w"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3406324.3410544"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/CIC50333.2020.00017"},{"key":"e_1_2_1_29_1","volume-title":"Fast R-CNN. In Proceedings of the IEEE International Conference on Computer Vision (ICCV).","author":"Girshick Ross","year":"2015","unstructured":"Ross Girshick. 2015. Fast R-CNN. In Proceedings of the IEEE International Conference on Computer Vision (ICCV)."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICRA.2019.8793693"},{"key":"e_1_2_1_31_1","volume-title":"Reusable Knowledge Bases. KR 91","author":"Gruber Thomas R","year":"1991","unstructured":"Thomas R Gruber. 1991. The Role of Common Ontology in Achieving Sharable, Reusable Knowledge Bases. KR 91 (1991)."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00207"},{"key":"e_1_2_1_33_1","volume-title":"Towards the Web of Things. Web Mashups for Embedded Devices. In Workshop on Mashups, Enterprise Mashups and Lightweight Composition on the Web (MEM 2009). MEM 2009, Madrid.","author":"Guinard Dominique","year":"2009","unstructured":"Dominique Guinard and Vlad Trifa. 2009. Towards the Web of Things. Web Mashups for Embedded Devices. In Workshop on Mashups, Enterprise Mashups and Lightweight Composition on the Web (MEM 2009). MEM 2009, Madrid."},{"key":"e_1_2_1_34_1","volume-title":"Active: A unified platform for building intelligent assistant applications.","author":"Guzzoni Didier","year":"2007","unstructured":"Didier Guzzoni. 2007. Active: A unified platform for building intelligent assistant applications. (2007)."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1243441.1243469"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-05204-1_27"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00686"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-43665-4_22"},{"key":"e_1_2_1_39_1","volume-title":"CSKG: The CommonSense Knowledge Graph. In The Semantic Web ESWC","author":"Ilievski Filip","year":"2021","unstructured":"Filip Ilievski, Pedro Szekely, and Bin Zhang. 2021. CSKG: The CommonSense Knowledge Graph. In The Semantic Web ESWC 2021, Ruben Verborgh, Katja Hose, Heiko Paulheim, Pierre-Antoine Champin, Maria Maleshkova, Oscar Corcho, Petar Ristoski, and Mehwish Alam (Eds.). Springer International Publishing, Cham, 680--696."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","unstructured":"Eleni Ilkou and Maria Koutraki. 2020. Symbolic Vs Sub-symbolic AI Methods: Friends or Enemies? https:\/\/doi.org\/10.1145\/3340531.3414072","DOI":"10.1145\/3340531.3414072"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298990"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.2298\/CSIS220118046K"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308560.3316510"},{"key":"e_1_2_1_44_1","volume-title":"Situation Assessment for Social Intelligence. In AIC: Artificial Intelligence and Cognition. CEUR Workshop Proceedings (CEUR-WS.org), 140--147","author":"Pandey Amit Kumar","year":"2014","unstructured":"Amit Kumar Pandey, Rodolphe Gelin, Rachid Alami, Renaud Viry, Axel Buendia, Roland Meertens, Mohamed Chetouani, Laurence Devillers, Marie Tahon, David Filliat, Yves Grenier, Mounira Maazaoui, Abderrahmane Kheddar, Fr\u00e9d\u00e9ric Lerasle, and Laurent Fitte-Duval. 2014. Romeo2 Project: Humanoid Robot Assistant and Companion for Everyday Life: I. Situation Assessment for Social Intelligence. In AIC: Artificial Intelligence and Cognition. CEUR Workshop Proceedings (CEUR-WS.org), 140--147."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.766"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01246-5_21"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2021.3084827"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.100"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46448-0_51"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.91"},{"key":"e_1_2_1_51_1","volume-title":"YOLOv3: An Incremental Improvement. CoRR abs\/1804.02767","author":"Redmon Joseph","year":"2018","unstructured":"Joseph Redmon and Ali Farhadi. 2018. YOLOv3: An Incremental Improvement. CoRR abs\/1804.02767 (2018). arXiv:1804.02767 http:\/\/arxiv.org\/abs\/1804.02767"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12652-013-0184-9"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-023-01031-y"},{"key":"e_1_2_1_54_1","unstructured":"Andrei Vlad Sambra Essam Mansour Sandro Hawke Maged Zereba Nicola Greco Abdurrahman Ghanem Dmitri Zagidulin Ashraf Aboulnaga and Tim Berners-Lee. 2016. Solid: a platform for decentralized social applications based on linked data. MIT CSAIL & Qatar Computing Research Institute Tech. Rep. (2016)."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2016.2617341"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300647"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300767"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3494322.3494326"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","unstructured":"Steffen Staab and Rudi Studer (Eds.). 2009. Handbook on Ontologies. Springer Berlin Heidelberg Berlin Heidelberg. https:\/\/doi.org\/10.1007\/978-3-540-92673-3","DOI":"10.1007\/978-3-540-92673-3"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2019.1619259"},{"key":"e_1_2_1_61_1","volume-title":"Cognition and multi-agent interaction: From cognitive modeling to social simulation","author":"Sun Ron","unstructured":"Ron Sun. 2006. Cognition and multi-agent interaction: From cognitive modeling to social simulation. Cambridge University Press."},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/IECON.2016.7793744"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/1297231.1297259"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-011-9117-5"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581529"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.5555\/3545946.3598763"},{"key":"e_1_2_1_67_1","unstructured":"Chien-Yao Wang Alexey Bochkovskiy and Hong-Yuan Mark Liao. 2022. YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv:2207.02696 http:\/\/arxiv.org\/abs\/2207.02696"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3581783.3612283"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/329124.329126"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-34584-5_7"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45982-0_1"},{"key":"e_1_2_1_72_1","volume-title":"Digital Living Room Conference (June","author":"Zelkha E","year":"1998","unstructured":"E Zelkha, B Epstein, S Birrell, and C Dodsworth. 1998. From Devices to. In Ambient Intelligence\"\", Digital Living Room Conference (June 1998)."}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3659610","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3659610","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T17:04:27Z","timestamp":1755882267000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3659610"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,13]]},"references-count":72,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,5,13]]}},"alternative-id":["10.1145\/3659610"],"URL":"https:\/\/doi.org\/10.1145\/3659610","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,13]]},"assertion":[{"value":"2024-05-15","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}