{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T18:12:27Z","timestamp":1776103947743,"version":"3.50.1"},"reference-count":45,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2019,11,1]],"date-time":"2019-11-01T00:00:00Z","timestamp":1572566400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>Conversational agents are reshaping our communication environment and have the potential to inform and persuade in new and effective ways. In this paper, we present the underlying technologies and the theoretical background behind a health-care platform dedicated to supporting medical stuff and individuals with movement disabilities and to providing advanced monitoring functionalities in hospital and home surroundings. The framework implements an intelligent combination of two research areas: (1) sensor- and camera-based monitoring to collect, analyse, and interpret people behaviour and (2) natural machine\u2013human interaction through an apprehensive virtual assistant benefiting ailing patients. In addition, the framework serves as an important assistant to caregivers and clinical experts to obtain information about the patients in an intuitive manner. The proposed approach capitalises on latest breakthroughs in computer vision, sensor management, speech recognition, natural language processing, knowledge representation, dialogue management, semantic reasoning, and speech synthesis, combining medical expertise and patient history.<\/jats:p>","DOI":"10.3390\/fi11110231","type":"journal-article","created":{"date-parts":[[2019,11,1]],"date-time":"2019-11-01T12:30:50Z","timestamp":1572611450000},"page":"231","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["A Context-Aware Conversational Agent in the Rehabilitation Domain"],"prefix":"10.3390","volume":"11","author":[{"given":"Thanassis","family":"Mavropoulos","sequence":"first","affiliation":[{"name":"Centre for Research and Technology Hellas, 57001 Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Georgios","family":"Meditskos","sequence":"additional","affiliation":[{"name":"Centre for Research and Technology Hellas, 57001 Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Spyridon","family":"Symeonidis","sequence":"additional","affiliation":[{"name":"Centre for Research and Technology Hellas, 57001 Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eleni","family":"Kamateri","sequence":"additional","affiliation":[{"name":"Centre for Research and Technology Hellas, 57001 Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maria","family":"Rousi","sequence":"additional","affiliation":[{"name":"Centre for Research and Technology Hellas, 57001 Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dimitris","family":"Tzimikas","sequence":"additional","affiliation":[{"name":"Entranet Ltd., 54249 Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lefteris","family":"Papageorgiou","sequence":"additional","affiliation":[{"name":"Entranet Ltd., 54249 Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christos","family":"Eleftheriadis","sequence":"additional","affiliation":[{"name":"ELBIS P.C., 57001 Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"George","family":"Adamopoulos","sequence":"additional","affiliation":[{"name":"Evexia S.A., 63080 Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stefanos","family":"Vrochidis","sequence":"additional","affiliation":[{"name":"Centre for Research and Technology Hellas, 57001 Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6447-9020","authenticated-orcid":false,"given":"Ioannis","family":"Kompatsiaris","sequence":"additional","affiliation":[{"name":"Centre for Research and Technology Hellas, 57001 Thessaloniki, Greece"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,11,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Bates, D.W. (2002). The quality case for information technology in healthcare. BMC Med. Inform. Decis. Mak., 2.","DOI":"10.1186\/1472-6947-2-7"},{"key":"ref_2","unstructured":"Wickramasinghe, N., Fadlalla, A., Geisler, E., and Schaffer, J. (2004, January 6\u20138). A framework for assessing e-health preparedness. Proceedings of the AMCIS 2004 Proceedings, New York, NY, USA."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/S0969-4765(06)70592-6","article-title":"Biometrics in healthcare","volume":"14","author":"Marohn","year":"2006","journal-title":"Biom. Technol. Today"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1016\/j.csl.2015.07.001","article-title":"State of the art in statistical methods for language and speech processing","volume":"35","author":"Bellegarda","year":"2016","journal-title":"Comput. Speech Lang."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.invent.2017.10.002","article-title":"A fully automated conversational agent for promoting mental well-being: A pilot RCT using mixed methods","volume":"10","author":"Ly","year":"2017","journal-title":"Internet Interv."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Tanaka, H., Negoro, H., Iwasaka, H., and Nakamura, S. (2017). Embodied conversational agents for multimodal automated social skills training in people with autism spectrum disorders. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0182151"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Savino, J.A., and Latifi, R. (2019). Hospital and Healthcare Transformation over Last Few Decades. The Modern Hospital, Springer.","DOI":"10.1007\/978-3-030-01394-3_3"},{"key":"ref_8","first-page":"P955","article-title":"A step forward in integrating healthcare and voice-enabled technology: Concept demonstration with deployment of automatic medical coding model as an amazon \u201calexa\u201d skill","volume":"14","author":"Ravindranath","year":"2018","journal-title":"Alzheimer\u2019s Dement. J. Alzheimer\u2019s Assoc."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Yaghoubzadeh, R., Kramer, M., Pitsch, K., and Kopp, S. (2013). Virtual agents as daily assistants for elderly or cognitively impaired people. International Workshop on Intelligent Virtual Agents, Springer.","DOI":"10.1007\/978-3-642-40415-3_7"},{"key":"ref_10","unstructured":"Fadhil, A. (2018). Beyond patient monitoring: Conversational agents role in telemedicine & healthcare support for home-living elderly individuals. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1248","DOI":"10.1093\/jamia\/ocy072","article-title":"Conversational agents in healthcare: A systematic review","volume":"25","author":"Laranjo","year":"2018","journal-title":"J. Am. Med. Informat. Assoc."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"e11510","DOI":"10.2196\/11510","article-title":"Patient and consumer safety risks when using conversational assistants for medical information: An observational study of Siri, Alexa, and Google Assistant","volume":"20","author":"Bickmore","year":"2018","journal-title":"J. Med. Internet Res."},{"key":"ref_13","first-page":"271","article-title":"Ehud Reiter and Robert Dale. Building Natural Language Generation Systems. Cambridge University Press, 2000. $64.95\/\u00a3 37.50 (Hardback)","volume":"7","author":"Siddharthan","year":"2001","journal-title":"Nat. Lang. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1613\/jair.5477","article-title":"Survey of the state of the art in natural language generation: Core tasks, applications and evaluation","volume":"61","author":"Gatt","year":"2018","journal-title":"J. Artif. Intell. Res."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.4149\/cai_2017_1_1","article-title":"Recent advances in natural language generation: A survey and classification of the empirical literature","volume":"36","author":"Perera","year":"2017","journal-title":"Comput. Inform."},{"key":"ref_16","unstructured":"Ze, H., Senior, A., and Schuster, M. (2013, January 26\u201331). Statistical parametric speech synthesis using deep neural networks. Proceedings of the International Conference on Acoustics, Speech and Signal Processing, Vancouver, Australia."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.1109\/JPROC.2013.2251852","article-title":"Speech synthesis based on hidden Markov models","volume":"101","author":"Tokuda","year":"2013","journal-title":"Proc. IEEE"},{"key":"ref_18","unstructured":"Hough, J. (2011, January 13). Incremental semantics driven natural language generation with self-repairing capability. Proceedings of the Second Student Research Workshop associated with RANLP, Hissar, Bulgaria."},{"key":"ref_19","unstructured":"Oord, A.v.d., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., and Kavukcuoglu, K. (2016). Wavenet: A generative model for raw audio. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Shen, J., Pang, R., Weiss, R.J., Schuster, M., Jaitly, N., Yang, Z., Chen, Z., Zhang, Y., Wang, Y., and Skerrv-Ryan, R. (2018, January 15\u201320). Natural tts synthesis by conditioning wavenet on mel spectrogram predictions. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgart, AL, Canada.","DOI":"10.1109\/ICASSP.2018.8461368"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Zen, H., and Sak, H. (2015, January 19\u201324). Unidirectional long short-term memory recurrent neural network with recurrent output layer for low-latency speech synthesis. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brisbane, Australia.","DOI":"10.1109\/ICASSP.2015.7178816"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Pollet, V., Zovato, E., Irhimeh, S., and Batzu, P.D. (2017, January 20\u201324). Unit Selection with Hierarchical Cascaded Long Short Term Memory Bidirectional Recurrent Neural Nets. Proceedings of the INTERSPEECH, Stockholm, Sweden.","DOI":"10.21437\/Interspeech.2017-428"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2858","DOI":"10.1109\/TBME.2009.2030171","article-title":"A method for automatic fall detection of elderly people using floor vibrations and sound\u2014Proof of concept on human mimicking doll falls","volume":"56","author":"Zigel","year":"2009","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1109\/TBME.2012.2228262","article-title":"Automatic monocular system for human fall detection based on variations in silhouette area","volume":"60","author":"Mirmahboub","year":"2012","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_25","unstructured":"Rougier, C., Meunier, J., St-Arnaud, A., and Rousseau, J. (September, January 30). Monocular 3D head tracking to detect falls of elderly people. Proceedings of the International Conference of the IEEE Engineering in Medicine and Biology Society, New York, NY, USA."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1016\/S0022-3999(97)00004-4","article-title":"Sleep quality versus sleep quantity: Relationships between sleep and measures of health, well-being and sleepiness in college students","volume":"42","author":"Pilcher","year":"1997","journal-title":"J. Psychosom. Res."},{"key":"ref_27","unstructured":"Heit, J., Srinivasan, S., Benitez, D., and Andrews, B.W. (2013). Device and Method to Monitor, Assess and Improve Quality of Sleep. (8,348,840), U.S. Patent."},{"key":"ref_28","unstructured":"Lison, P. (2014). Structured Probabilistic Modelling for Dialogue Management. [Ph.D. Thesis, Department of Informatics Faculty of Mathematics and Natural Sciences]."},{"key":"ref_29","first-page":"309","article-title":"Web Semantics: Science, Services and Agents on the World Wide Web","volume":"6","author":"Graua","year":"2008","journal-title":"Web Semant. Sci. Serv. Agents World Wide Web"},{"key":"ref_30","unstructured":"Baader, F., Calvanese, D., McGuinness, D., Patel-Schneider, P., and Nardi, D. (2003). The Description Logic Handbook: Theory, Implementation and Applications, Cambridge University Press."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.pmcj.2014.12.009","article-title":"Semantic web technologies in pervasive computing: A survey and research roadmap","volume":"23","author":"Ye","year":"2015","journal-title":"Pervasive Mob. Comput."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.websem.2013.02.002","article-title":"Improving habitability of natural language interfaces for querying ontologies with feedback and clarification dialogues","volume":"19","author":"Cunningham","year":"2013","journal-title":"Web Semant. Sci. Serv. Agents World Wide Web"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"586","DOI":"10.1007\/s10489-012-0387-3","article-title":"Multi levels semantic architecture for multimodal interaction","volume":"38","author":"Dourlens","year":"2013","journal-title":"Appl. Intell."},{"key":"ref_34","unstructured":"Altinok, D. (2018). An ontology-based dialogue management system for banking and finance dialogue systems. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Wessel, M., Acharya, G., Carpenter, J., and Yin, M. (2019). OntoVPA\u2014An Ontology-Based Dialogue Management System for Virtual Personal Assistants. Advanced Social Interaction with Agents, Springer.","DOI":"10.1007\/978-3-319-92108-2_23"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Avgerinakis, K., Briassouli, A., and Kompatsiaris, I. (2013, January 18\u201319). Recognition of activities of daily living for smart home environments. Proceedings of the 9th International Conference on Intelligent Environments, Athens, Greece.","DOI":"10.1109\/IE.2013.37"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Toshniwal, S., Kannan, A., Chiu, C.C., Wu, Y., Sainath, T.N., and Livescu, K. (2018, January 18\u201321). A comparison of techniques for language model integration in encoder-decoder speech recognition. Proceedings of the IEEE Spoken Language Technology Workshop (SLT), Athens, Greece.","DOI":"10.1109\/SLT.2018.8639038"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Manning, C., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S., and McClosky, D. (2014, January 23\u201325). The Stanford CoreNLP natural language processing toolkit. Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations, Baltimore, MA, USA.","DOI":"10.3115\/v1\/P14-5010"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Mavropoulos, T., Liparas, D., Symeonidis, S., Vrochidis, S., and Kompatsiaris, I. (2017, January 17\u201323). A Hybrid approach for biomedical relation extraction using finite state automata and random forest-weighted fusion. Proceedings of the International Conference on Computational Linguistics and Intelligent Text Processing, Budapest, Hungary.","DOI":"10.1007\/978-3-319-77113-7_35"},{"key":"ref_40","unstructured":"Jia, Y., Zhang, Y., Weiss, R., Wang, Q., Shen, J., Ren, F., Nguyen, P., Pang, R., Moreno, I.L., and Wu, Y. (2018). Transfer learning from speaker verification to multispeaker text-to-speech synthesis. Advances in Neural Information Processing Systems, MIT PRESS."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Shaw, R., Troncy, R., and Hardman, L. (2009, January 7\u20139). Lode: Linking open descriptions of events. Proceedings of the Asian Semantic Web Conference, Shanghai, China.","DOI":"10.1007\/978-3-642-10871-6_11"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1016\/j.pmcj.2015.01.007","article-title":"MetaQ: A knowledge-driven framework for context-aware activity recognition combining SPARQL and OWL 2 activity patterns","volume":"25","author":"Meditskos","year":"2016","journal-title":"Pervasive Mob. Comput."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Gangemi, A., and Mika, P. (2003, January 3\u20137). Understanding the semantic web through descriptions and situations. Proceedings of the OTM Confederated International Conferences \u201cOn the Move to Meaningful Internet Systems\u201d, Catania, Italy.","DOI":"10.1007\/978-3-540-39964-3_44"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Pragst, L., Miehle, J., Minker, W., and Ultes, S. (2017, January 13\u201317). Challenges for adaptive dialogue management in the KRISTINA project. Proceedings of the 1st ACM SIGCHI International Workshop on Investigating Social Interactions with Artificial Agents, Glasgow, UK.","DOI":"10.1145\/3139491.3139508"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/11\/11\/231\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:31:01Z","timestamp":1760189461000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/11\/11\/231"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,1]]},"references-count":45,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2019,11]]}},"alternative-id":["fi11110231"],"URL":"https:\/\/doi.org\/10.3390\/fi11110231","relation":{},"ISSN":["1999-5903"],"issn-type":[{"value":"1999-5903","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,1]]}}}