{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,25]],"date-time":"2026-03-25T15:56:22Z","timestamp":1774454182095,"version":"3.50.1"},"reference-count":42,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2024,8,11]],"date-time":"2024-08-11T00:00:00Z","timestamp":1723334400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Regional Development Fund of the European Union","award":["T1EDK-02347"],"award-info":[{"award-number":["T1EDK-02347"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Today, Smart Assistants (SAs) are supported by significantly improved Natural Language Processing (NLP) and Natural Language Understanding (NLU) engines as well as AI-enabled decision support, enabling efficient information communication, easy appliance\/device control, and seamless access to entertainment services, among others. In fact, an increasing number of modern households are being equipped with SAs, which promise to enhance user experience in the context of smart environments through verbal interaction. Currently, the market in SAs is dominated by products manufactured by technology giants that provide well designed off-the-shelf solutions. However, their simple setup and ease of use come with trade-offs, as these SAs abide by proprietary and\/or closed-source architectures and offer limited functionality. Their enforced vendor lock-in does not provide (power) users with the ability to build custom conversational applications through their SAs. On the other hand, employing an open-source approach for building and deploying an SA (which comes with a significant overhead) necessitates expertise in multiple domains and fluency in the multimodal technologies used to build the envisioned applications. In this context, this paper proposes a methodology for developing and deploying conversational applications on the edge on top of an open-source software and hardware infrastructure via a multilayer architecture that simplifies low-level complexity and reduces learning overhead. The proposed approach facilitates the rapid development of applications by third-party developers, thereby enabling the establishment of a marketplace of customized applications aimed at the smart assisted living domain, among others. The supporting framework supports application developers, device owners, and ecosystem administrators in building, testing, uploading, and deploying applications, remotely controlling devices, and monitoring device performance. A demonstration of this methodology is presented and discussed focusing on health and assisted living applications for the elderly.<\/jats:p>","DOI":"10.3390\/s24165199","type":"journal-article","created":{"date-parts":[[2024,8,12]],"date-time":"2024-08-12T11:23:46Z","timestamp":1723461826000},"page":"5199","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["A Multilayer Architecture towards the Development and Distribution of Multimodal Interface Applications on the Edge"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8006-145X","authenticated-orcid":false,"given":"Nikolaos","family":"Malamas","sequence":"first","affiliation":[{"name":"Faculty of Engineering, Aristotle University of Thessaloniki, 541 24 Thessaloniki, Greece"},{"name":"Gnomon Informatics S.A., 570 01 Thessaloniki, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6407-6205","authenticated-orcid":false,"given":"Konstantinos","family":"Panayiotou","sequence":"additional","affiliation":[{"name":"Faculty of Engineering, Aristotle University of Thessaloniki, 541 24 Thessaloniki, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5349-8493","authenticated-orcid":false,"given":"Apostolia","family":"Karabatea","sequence":"additional","affiliation":[{"name":"Gnomon Informatics S.A., 570 01 Thessaloniki, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9034-4832","authenticated-orcid":false,"given":"Emmanouil","family":"Tsardoulias","sequence":"additional","affiliation":[{"name":"Faculty of Engineering, Aristotle University of Thessaloniki, 541 24 Thessaloniki, Greece"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0235-6046","authenticated-orcid":false,"given":"Andreas L.","family":"Symeonidis","sequence":"additional","affiliation":[{"name":"Faculty of Engineering, Aristotle University of Thessaloniki, 541 24 Thessaloniki, Greece"}]}],"member":"1968","published-online":{"date-parts":[[2024,8,11]]},"reference":[{"key":"ref_1","unstructured":"Yaqub, M. (2024, February 15). 10+ Voice Assistant Statistics: The Key Data and Numbers. Available online: https:\/\/www.onlinedasher.com\/voice-assistant-statistics\/."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Malamas, N., Papangelou, K., and Symeonidis, A.L. (2022). Upon Improving the Performance of Localized Healthcare Virtual Assistants. Healthcare, 10.","DOI":"10.3390\/healthcare10010099"},{"key":"ref_3","unstructured":"Holst, A. (2021). IoT Connected Devices Worldwide 2019\u20132030, Statista."},{"key":"ref_4","first-page":"1","article-title":"The internet of things: How the next evolution of the internet is changing everything","volume":"1","author":"Evans","year":"2011","journal-title":"CISCO White Pap."},{"key":"ref_5","unstructured":"Mosby, A. (2024, August 03). 69 Voice Search Statistics 2024 (Usage & Demographics). Available online: https:\/\/www.yaguara.co\/voice-search-statistics\/."},{"key":"ref_6","unstructured":"Thormundsson, B. (2023). Virtual Assistant Technology in the U.S.\u2014Statistics & Facts, Statista."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.4018\/IJSSOE.2018070101","article-title":"A Framework of Enhanced Performance: People\u2019s Interactions with Cognitive Assistants","volume":"8","author":"Siddike","year":"2018","journal-title":"Int. J. Syst. Serv. Oriented Eng."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1016\/j.procs.2021.08.012","article-title":"Embedding Rasa in edge Devices: Capabilities and Limitations","volume":"192","author":"Malamas","year":"2021","journal-title":"Procedia Comput. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Schadelbauer, L., Schl\u00f6gl, S., and Groth, A. (2023). Linking Personality and Trust in Intelligent Virtual Assistants. Multimodal Technol. Interact., 7.","DOI":"10.3390\/mti7060054"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Antonius Alijoyo, F., Sneha Sri, S.S., Alapati, P.R., Yuldashev, D., and M, P.V. (2024, January 11\u201312). Ethical Considerations in Explainable AI: Balancing Transparency and User Privacy in English Language-based Virtual Assistants. Proceedings of the 2024 5th International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV), Tirunelveli, India.","DOI":"10.1109\/ICICV62344.2024.00069"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Elahi, H., Wang, G., Peng, T., and Chen, J. (2019). On Transparency and Accountability of Smart Assistants in Smart Cities. Appl. Sci., 9.","DOI":"10.3390\/app9245344"},{"key":"ref_12","unstructured":"Kubach, M., G\u00f6rwitz, C., and Hornung, G. (2016). Non-Technical Challenges of Building Ecosystems for Trustable Smart Assistants in the Internet of Things: A Socioeconomic and Legal Perspective, Gesellschaft f\u00fcr Informatik."},{"key":"ref_13","unstructured":"Bonilla, K., and Martin-Hammond, A. (2020, January 10\u201311). Older adults\u2019 perceptions of intelligent voice assistant privacy, transparency, and online privacy guidelines. Proceedings of the Sixteenth Symposium on Usable Privacy and Security, Online."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1145\/3441715","article-title":"Why or Why Not? The Effect of Justification Styles on Chatbot Recommendations","volume":"39","author":"Wilkinson","year":"2021","journal-title":"ACM Trans. Inf. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wintersberger, P., Klotz, T., and Riener, A. (2020, January 25\u201329). Tell Me More: Transparency and Time-Fillers to Optimize Chatbots\u2019 Waiting Time Experience. Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society, NordiCHI \u201920, New York, NY, USA.","DOI":"10.1145\/3419249.3420170"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"106763","DOI":"10.1016\/j.chb.2021.106763","article-title":"\u2018Okay google, what about my privacy?\u2019: User\u2019s privacy perceptions and acceptance of voice based digital assistants","volume":"120","author":"Vimalkumar","year":"2021","journal-title":"Comput. Hum. Behav."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Khurana, A., Alamzadeh, P., and Chilana, P.K. (2021, January 10\u201313). ChatrEx: Designing Explainable Chatbot Interfaces for Enhancing Usefulness, Transparency, and Trust. Proceedings of the 2021 IEEE Symposium on Visual Languages and Human-Centric Computing (VL\/HCC), St. Louis, MO, USA.","DOI":"10.1109\/VL\/HCC51201.2021.9576440"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"107711","DOI":"10.1016\/j.chb.2023.107711","article-title":"I will be with you Alexa! The impact of intelligent virtual assistant\u2019s authenticity and personalization on user reusage intentions","volume":"143","author":"Alimamy","year":"2023","journal-title":"Comput. Hum. Behav."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Barricelli, B.R., and Fogli, D. (2021, January 11\u201313). Virtual Assistants for Personalizing IoT Ecosystems: Challenges and Opportunities. Proceedings of the CHItaly 2021: 14th Biannual Conference of the Italian SIGCHI Chapter, CHItaly \u201921, New York, NY, USA.","DOI":"10.1145\/3464385.3464699"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Iannizzotto, G., Bello, L.L., Nucita, A., and Grasso, G.M. (2018, January 4\u20136). A Vision and Speech Enabled, Customizable, Virtual Assistant for Smart Environments. Proceedings of the 2018 11th International Conference on Human System Interaction (HSI), Gdansk, Poland.","DOI":"10.1109\/HSI.2018.8431232"},{"key":"ref_21","unstructured":"Duong, L., Hoang, V.C.D., Pham, T.Q., Hong, Y.H., Dovgalecs, V., Bashkansky, G., Black, J., Bleeker, A., Huitouze, S.L., and Johnson, M. (August, January 28). An adaptable task-oriented dialog system for stand-alone embedded devices. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, Florence, Italy."},{"key":"ref_22","unstructured":"Ng, Y., Miyashita, D., Hoshi, Y., Morioka, Y., Torii, O., Kodama, T., and Deguchi, J. (2023). SimplyRetrieve: A Private and Lightweight Retrieval-Centric Generative AI Tool. arXix."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"85714","DOI":"10.1109\/ACCESS.2020.2991734","article-title":"An Overview on Edge Computing Research","volume":"8","author":"Cao","year":"2020","journal-title":"IEEE Access"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"265","DOI":"10.21105\/joss.00265","article-title":"Mosquitto: Server and client implementation of the MQTT protocol","volume":"2","author":"Light","year":"2017","journal-title":"J. Open Source Softw."},{"key":"ref_25","unstructured":"(2024, July 30). OASIS Advanced Message Queuing Protocol (AMQP) Version 1.0 Part 0: Overview 2012. Available online: https:\/\/docs.oasis-open.org\/amqp\/core\/v1.0\/os\/amqp-core-messaging-v1.0-os.html."},{"key":"ref_26","first-page":"116","article-title":"A Survey of Communication Protocols for Internet of Things and Related Challenges of Fog and Cloud Computing Integration","volume":"51","author":"Carpio","year":"2019","journal-title":"ACM Comput. Surv."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"101931","DOI":"10.1016\/j.pmcj.2024.101931","article-title":"SmAuto: A domain-specific-language for application development in smart environments","volume":"101","author":"Panayiotou","year":"2024","journal-title":"Pervasive Mob. Comput."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"61","DOI":"10.21742\/26531941.1.1.06","article-title":"Research on real-time data transmission between IoT gateway and cloud platform based on two-way communication technology","volume":"1","author":"Taniar","year":"2021","journal-title":"Int. J. Smartcare Home"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Brunete, A., Gambao, E., Hernando, M., and Cedazo, R. (2021). Smart Assistive Architecture for the Integration of IoT Devices, Robotic Systems, and Multimodal Interfaces in Healthcare Environments. Sensors, 21.","DOI":"10.3390\/s21062212"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Savaglio, C., Fortino, G., Zhou, M., and Ma, J. (2024). Evaluating the Performance of a Multimodal Speaker Tracking System at the Edge-to-Cloud Continuum. Device-Edge-Cloud Continuum: Paradigms, Architectures and Applications, Springer Nature.","DOI":"10.1007\/978-3-031-42194-5"},{"key":"ref_31","unstructured":"Soofastaei, A. (2024). Introductory Chapter: Advanced Virtual Assistants\u2014Transforming the Future of Human-Computer Interaction. Advanced Virtual Assistants\u2014A Window to the Virtual Future, IntechOpen. Chapter 1."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Rocha, A.P., Ketsmur, M., Almeida, N., and Teixeira, A. (2021). An Accessible Smart Home Based on Integrated Multimodal Interaction. Sensors, 21.","DOI":"10.3390\/s21165464"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Bakare, S., Akkasaligar, P.T., Kulkarni, S., Kadamba, P., Mutnal, S., and Belagali, S. (2023, January 19\u201321). Multimodal Framework for Multilingual Social Interaction Assistive Application (MSIAA) for Elderly People. Proceedings of the 2023 2nd International Conference on Edge Computing and Applications (ICECAA), Namakkal, India.","DOI":"10.1109\/ICECAA58104.2023.10212159"},{"key":"ref_34","unstructured":"(2024, July 30). Wit.ai. Available online: https:\/\/wit.ai\/."},{"key":"ref_35","unstructured":"(2024, July 30). Botpress. Available online: https:\/\/botpress.com\/."},{"key":"ref_36","unstructured":"Hansen, M. (2024, July 30). Rhasspy Voice Assistant. Available online: https:\/\/rhasspy.readthedocs.io\/en\/latest\/."},{"key":"ref_37","unstructured":"Bocklisch, T., Faulkner, J., Pawlowski, N., and Nichol, A. (2017). Rasa: Open Source Language Understanding and Dialogue Management. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Braun, D., Hernandez Mendez, A., Matthes, F., and Langen, M. (2017, January 15\u201317). Evaluating Natural Language Understanding Services for Conversational Question Answering Systems. Proceedings of the 18th Annual SIGdial Meeting on Discourse and Dialogue, Saarbr\u00fccken, Germany.","DOI":"10.18653\/v1\/W17-5522"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1109\/MIC.2018.2881519","article-title":"Approaches for Dialog Management in Conversational Agents","volume":"23","author":"Harms","year":"2019","journal-title":"IEEE Internet Comput."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Segura, C., Palau, \u00c0., Luque, J., Costa-Juss\u00e0, M.R., and Banchs, R.E. (2019, January 18\u201320). Chatbol, a Chatbot for the Spanish \u201cLa Liga\u201d. Proceedings of the 9th International Workshop on Spoken Dialogue System Technology, Singapore.","DOI":"10.1007\/978-981-13-9443-0_28"},{"key":"ref_41","first-page":"33","article-title":"Enhancing Rasa NLU model for Vietnamese chatbot","volume":"9","author":"Nguyen","year":"2021","journal-title":"Int. J. Open Inf. Technol."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"101180","DOI":"10.1016\/j.softx.2022.101180","article-title":"Commlib: An easy-to-use communication library for Cyber\u2013Physical Systems","volume":"19","author":"Panayiotou","year":"2022","journal-title":"SoftwareX"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/16\/5199\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:34:53Z","timestamp":1760110493000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/16\/5199"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,11]]},"references-count":42,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2024,8]]}},"alternative-id":["s24165199"],"URL":"https:\/\/doi.org\/10.3390\/s24165199","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,11]]}}}