{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,18]],"date-time":"2025-12-18T19:55:50Z","timestamp":1766087750769,"version":"build-2065373602"},"reference-count":54,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2021,8,17]],"date-time":"2021-08-17T00:00:00Z","timestamp":1629158400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100008425","name":"Conseller\u00eda de Cultura, Educaci\u00f3n e Ordenaci\u00f3n Universitaria, Xunta de Galicia","doi-asserted-by":"publisher","award":["GRC2018\/053"],"award-info":[{"award-number":["GRC2018\/053"]}],"id":[{"id":"10.13039\/501100008425","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>We recently proposed a novel intelligent newscaster chatbot for digital inclusion. Its controlled dialogue stages (consisting of sequences of questions that are generated with hybrid Natural Language Generation techniques based on the content) support entertaining personalisation, where user interest is estimated by analysing the sentiment of his\/her answers. A differential feature of our approach is its automatic and transparent monitoring of the abstraction skills of the target users. In this work we improve the chatbot by introducing enhanced monitoring metrics based on the distance of the user responses to an accurate characterisation of the news content. We then evaluate abstraction capabilities depending on user sentiment about the news and propose a Machine Learning model to detect users that experience discomfort with precision, recall, F1 and accuracy levels over 80%.<\/jats:p>","DOI":"10.3390\/s21165515","type":"journal-article","created":{"date-parts":[[2021,8,17]],"date-time":"2021-08-17T21:17:06Z","timestamp":1629235026000},"page":"5515","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Evaluation of Abstraction Capabilities and Detection of Discomfort with a Newscaster Chatbot for Entertaining Elderly Users"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1140-679X","authenticated-orcid":false,"given":"Francisco","family":"de Arriba-P\u00e9rez","sequence":"first","affiliation":[{"name":"Information Technologies Group, atlanTTic, Telecommunications Engineering School, Campus as Lagoas-Marcosende, University of Vigo, 36310 Vigo, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0533-1303","authenticated-orcid":false,"given":"Silvia","family":"Garc\u00eda-M\u00e9ndez","sequence":"additional","affiliation":[{"name":"Information Technologies Group, atlanTTic, Telecommunications Engineering School, Campus as Lagoas-Marcosende, University of Vigo, 36310 Vigo, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5225-8378","authenticated-orcid":false,"given":"Francisco J.","family":"Gonz\u00e1lez-Casta\u00f1o","sequence":"additional","affiliation":[{"name":"Information Technologies Group, atlanTTic, Telecommunications Engineering School, Campus as Lagoas-Marcosende, University of Vigo, 36310 Vigo, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4674-1897","authenticated-orcid":false,"given":"Enrique","family":"Costa-Montenegro","sequence":"additional","affiliation":[{"name":"Information Technologies Group, atlanTTic, Telecommunications Engineering School, Campus as Lagoas-Marcosende, University of Vigo, 36310 Vigo, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1177\/1367549417708437","article-title":"The becoming of radio bodies","volume":"21","author":"Blaakilde","year":"2018","journal-title":"Eur. J. Cult. Stud."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1007\/s10639-019-09961-9","article-title":"Overcoming the digital divide with a modern approach to learning digital skills for the elderly adults","volume":"25","year":"2020","journal-title":"Educ. Inf. Technol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"19629","DOI":"10.1007\/s11042-020-08841-6","article-title":"Study on emotion recognition and companion chatbot using deep neural network","volume":"79","author":"Lee","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"75878","DOI":"10.1109\/ACCESS.2021.3080837","article-title":"Entertainment Chatbot for the Digital Inclusion of Elderly People without Abstraction Capabilities","volume":"9","year":"2021","journal-title":"IEEE Access"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1057\/s41599-018-0107-7","article-title":"Discourses of technology, ageing and participation","volume":"4","author":"Fleming","year":"2018","journal-title":"Palgrave Commun."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Hayashi, V., and Ruggiero, W. (2020). Non-Invasive Challenge Response Authentication for Voice Transactions with Smart Home Behavior. Sensors, 20.","DOI":"10.3390\/s20226563"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Leonidis, A., Korozi, M., Kouroumalis, V., Poutouris, E., Stefanidi, E., Arampatzis, D., Sykianaki, E., Anyfantis, N., Kalligiannakis, E., and Nicodemou, V.C. (2019). Ambient intelligence in the living room. Sensors, 19.","DOI":"10.3390\/s19225011"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1111\/j.1471-6712.2009.00711.x","article-title":"Watching television in later life: A deeper understanding of TV viewing in the homes of old people and in geriatric care contexts","volume":"24","year":"2010","journal-title":"Scand. J. Caring Sci."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Xu, A., Liu, Z., Guo, Y., Sinha, V., and Akkiraju, R. (2017, January 6\u201311). A new chatbot for customer service on social media. Proceedings of the Conference on Human Factors in Computing Systems, Denver, CO, USA.","DOI":"10.1145\/3025453.3025496"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"4","DOI":"10.3991\/ijet.v15i20.15657","article-title":"Intelligent Chatbot-LDA Recommender System","volume":"15","author":"Hadioui","year":"2020","journal-title":"Int. J. Emerg. Technol. Learn."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"012014","DOI":"10.1088\/1742-6596\/1487\/1\/012014","article-title":"An Intelligent Chatbot System Based on Entity Extraction Using RASA NLU and Neural Network","volume":"1487","author":"Jiao","year":"2020","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Thomas, N.T. (2016, January 21\u201324). An e-business chatbot using AIML and LSA. Proceedings of the International Conference on Advances in Computing, Communications and Informatics, Jaipur, India.","DOI":"10.1109\/ICACCI.2016.7732476"},{"key":"ref_13","first-page":"68","article-title":"Chatbot Based Solution for Supporting Software Incident Management Process","volume":"15","year":"2020","journal-title":"J. Softw."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ye, B.J., Kim, J.Y., Suh, C., Choi, S.P., Choi, M., Kim, D.H., and Son, B.C. (2021). Development of a Chatbot Program for Follow-Up Management of Workers\u2019 General Health Examinations in Korea: A Pilot Study. Int. J. Environ. Res. Public Health, 18.","DOI":"10.3390\/ijerph18042170"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Clarizia, F., Colace, F., Lombardi, M., Pascale, F., and Santaniello, D. (2018). Chatbot: An Education Support System for Student. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Springer.","DOI":"10.1007\/978-3-030-01689-0_23"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"180672","DOI":"10.1109\/ACCESS.2020.3024795","article-title":"JAICOB: A Data Science Chatbot","volume":"8","author":"Carrera","year":"2020","journal-title":"IEEE Access"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ouatu, B.I., and Gifu, D. (2021). Chatbot, the Future of Learning?. Smart Innovation, Systems and Technologies, Springer.","DOI":"10.1007\/978-981-15-7383-5_23"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1925","DOI":"10.1007\/s10586-018-2334-5","article-title":"Chatbot-based heathcare service with a knowledge base for cloud computing","volume":"22","author":"Chung","year":"2019","journal-title":"Clust. Comput."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"119158","DOI":"10.1109\/ACCESS.2020.3005733","article-title":"Understanding Physician\u2019s Experience With Conversational Interfaces During Occupational Health Consultation","volume":"8","author":"Ren","year":"2020","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Abbas, T., Khan, V.J., Gadiraju, U., Barakova, E., and Markopoulos, P. (2020). Crowd of Oz: A Crowd-Powered Social Robotics System for Stress Management. Sensors, 20.","DOI":"10.3390\/s20020569"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/j.chb.2015.02.026","article-title":"Real conversations with artificial intelligence: A comparison between human-human online conversations and human-chatbot conversations","volume":"49","author":"Hill","year":"2015","journal-title":"Comput. Hum. Behav."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Alqahtani, F., and Ramzan, N. (2019). Comparison and Efficacy of Synergistic Intelligent Tutoring Systems with Human Physiological Response. Sensors, 19.","DOI":"10.3390\/s19030460"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"621","DOI":"10.1016\/j.procs.2019.08.226","article-title":"Designing an Emotionally Realistic Chatbot Framework to Enhance Its Believability with AIML and Information States","volume":"157","author":"Sutoyo","year":"2019","journal-title":"Procedia Comput. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"30","DOI":"10.17011\/ht\/urn.201902201607","article-title":"Help! Is my chatbot falling into the uncanny valley? An empirical study of user experience in human-chatbot interaction","volume":"15","author":"Skjuve","year":"2019","journal-title":"Hum. Technol."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Baby, C.J., Khan, F.A., and Swathi, J.N. (2017, January 21\u201322). Home automation using IoT and a chatbot using natural language processing. Proceedings of the 2017 Innovations in Power and Advanced Computing Technologies (i-PACT), Vellore, India.","DOI":"10.1109\/IPACT.2017.8245185"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Su, M.H., Wu, C.H., Huang, K.Y., Hong, Q.B., and Wang, H.M. (2017, January 8\u201310). A chatbot using LSTM-based multi-layer embedding for elderly care. Proceedings of the International Conference on Orange Technologies, Singapore.","DOI":"10.1109\/ICOT.2017.8336091"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1146\/annurev-control-060117-104911","article-title":"Escaping Oz: Autonomy in Socially Assistive Robotics","volume":"2","author":"Clabaugh","year":"2019","journal-title":"Annu. Rev. Control. Robot. Auton. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1007\/s12369-019-00617-9","article-title":"A Holistic Approach to Behavior Adaptation for Socially Assistive Robots","volume":"12","author":"Umbrico","year":"2020","journal-title":"Int. J. Soc. Robot."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Aaltonen, I., Arvola, A., Heikkil\u00e4, P., and Lammi, H. (2017, January 6\u20139). Hello Pepper, may I tickle you?: Children\u2019s and adults\u2019 responses to an entertainment robot at a shopping mall. Proceedings of the ACM\/IEEE International Conference on Human-Robot Interaction Computer Society, Vienna, Austria.","DOI":"10.1145\/3029798.3038362"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1","DOI":"10.4017\/gt.2020.19.s.69724","article-title":"Implementing mind monitoring service for elderly people at home using LINE Chatbot","volume":"19","author":"Miura","year":"2020","journal-title":"Gerontechnology"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Mundhra, R., Lim, T.J., Duong, H.N., Yeo, K.H., and Niculescu, A.I. (2021). Towards a Humorous Chat-Bot Companion for Senior Citizens. Lecture Notes in Electrical Engineering, Springer.","DOI":"10.1007\/978-981-15-8395-7_3"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"118","DOI":"10.4017\/gt.2014.13.02.239.00","article-title":"An anime agent system for reminiscence therapy","volume":"13","author":"Yasuda","year":"2014","journal-title":"Gerontechnology"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1007\/s12369-015-0319-6","article-title":"Study of Scenarios and Technical Requirements of a Social Assistive Robot for Alzheimer\u2019s Disease Patients and their Caregivers","volume":"8","author":"Salichs","year":"2016","journal-title":"Int. J. Soc. Robot."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Dino, F., Zandie, R., Abdollahi, H., Schoeder, S., and Mahoor, M.H. (2019, January 3\u20138). Delivering Cognitive Behavioral Therapy Using A Conversational Social Robot. Proceedings of the 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Macau, China.","DOI":"10.1109\/IROS40897.2019.8968576"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Tascini, G. (2019). AI-Chatbot Using Deep Learning to Assist the Elderly. Systemics of Incompleteness and Quasi-Systems, Springer.","DOI":"10.1007\/978-3-030-15277-2_24"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1007\/s12369-017-0421-z","article-title":"Assistive Robotic Technology to Combat Social Isolation in Acute Hospital Settings","volume":"10","author":"Sarabia","year":"2018","journal-title":"Int. J. Soc. Robot."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Vyas, V., and Uma, V. (2019). Approaches to Sentiment Analysis on Product Reviews. Sentiment Analysis and Knowledge Discovery in Contemporary Business, IGI Global.","DOI":"10.4018\/978-1-5225-4999-4.ch002"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Chaurasiya, R.K., and Sahu, U. (2019, January 29\u201330). Improving Performance of Product Recommendations Using User Reviews. Proceedings of the 3rd International Conference and Workshops on Recent Advances and Innovations in Engineering, Kota Kinabalu, Malaysia.","DOI":"10.1109\/ICRAIE.2018.8710414"},{"key":"ref_39","unstructured":"Oh, K.J., Lee, D., Ko, B., and Choi, H.J. (June, January 29). A Chatbot for Psychiatric Counseling in Mental Healthcare Service Based on Emotional Dialogue Analysis and Sentence Generation. Proceedings of the 18th IEEE International Conference on Mobile Data Management, Daejeon, Korea."},{"key":"ref_40","unstructured":"Lee, D., Oh, K.J., and Choi, H.J. (2017, January 13\u201316). The chatbot feels you\u2014A counseling service using emotional response generation. Proceedings of the 2017 IEEE International Conference on Big Data and Smart Computing, Jeju, Korea."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Deshpande, S., and Warren, J. (2021). Self-Harm Detection for Mental Health Chatbots. Studies in Health Technology and Informatics, IOS Press.","DOI":"10.3233\/SHTI210118"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Sykora, M., Elayan, S., Angelini, L., R\u00f6cke, C., El Kamali, M., Mugellini, E., and Guye, S. (2021). Understanding Older Adults\u2019 Affect States in Daily Life for Promoting Self-reflection About Mental Wellbeing. Research for Development, Springer.","DOI":"10.1007\/978-3-030-72663-8_11"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"102096","DOI":"10.1016\/j.jretconser.2020.102096","article-title":"Forecasting artificial intelligence on online customer assistance: Evidence from chatbot patents analysis","volume":"55","author":"Pantano","year":"2020","journal-title":"J. Retail. Consum. Serv."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Garc\u00eda-M\u00e9ndez, S., Fern\u00e1ndez-Gavilanes, M., Costa-Montenegro, E., Juncal-Mart\u00ednez, J., and Gonz\u00e1lez-Casta\u00f1o, F.J. (2018, January 23\u201325). Automatic natural language generation applied to alternative and augmentative communication for online video content services using simpleNLG for Spanish. Proceedings of the 15th Web for All Conference: Internet of Accessible Things, Lyon, France.","DOI":"10.1145\/3192714.3192837"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"372","DOI":"10.1016\/j.eswa.2018.11.036","article-title":"A library for automatic natural language generation of Spanish texts","volume":"120","year":"2019","journal-title":"Expert Syst. Appl."},{"key":"ref_46","unstructured":"Padr\u00f3, L., and Stanilovsky, E. (2012, January 21\u201327). FreeLing 3.0: Towards Wider Multilinguality. Proceedings of the Language Resources and Evaluation Conference, European Language Resources Association, Istanbul, Turkey."},{"key":"ref_47","unstructured":"Gonz\u00e1lez-Agirre, A., Laparra, E., and Rigau, G. (2012, January 9\u201313). Multilingual Central Repository version 3.0: Upgrading a very large lexical knowledge base. Proceedings of the Global WordNet Conference, Matsue, Japan."},{"key":"ref_48","unstructured":"Feng, J., Zhou, Y.M., and Martin, T. (2008, January 15\u201319). Sentence similarity based on relevance. Proceedings of the International Conference on Information Processing and Management of Uncertainty in Knowledge-Based Systems, Lisbon, Portugal."},{"key":"ref_49","unstructured":"Yang, D., and Powers, D.M.W. (2005). Measuring Semantic Similarity in the Taxonomy of WordNet, Australian Computer Society."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Liu, W.D., Chuang, K.Y., and Chen, K.Y. (2018, January 28\u201330). The Design and Implementation of a Chatbot\u2019s Character for Elderly Care. Proceedings of the 2018 International Conference on System Science and Engineering, New Taipei City, Taiwan.","DOI":"10.1109\/ICSSE.2018.8520008"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1007\/s10916-019-1237-1","article-title":"Using Health Chatbots for Behavior Change: A Mapping Study","volume":"43","author":"Pereira","year":"2019","journal-title":"J. Med. Syst."},{"key":"ref_52","first-page":"1","article-title":"Comparative Study on Machine Learning Algorithms for Sentiment Classification","volume":"182","author":"Mohaiminul","year":"2018","journal-title":"Int. J. Comput. Appl."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Alabdulkarim, A., Al-Rodhaan, M., Ma, T., and Tian, Y. (2019). PPSDT: A Novel Privacy-Preserving Single Decision Tree Algorithm for Clinical Decision-Support Systems Using IoT Devices. Sensors, 19.","DOI":"10.3390\/s19010142"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"215679","DOI":"10.1109\/ACCESS.2020.3041084","article-title":"Detection of Financial Opportunities in Micro-Blogging Data With a Stacked Classification System","volume":"8","year":"2020","journal-title":"IEEE Access"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/16\/5515\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:45:24Z","timestamp":1760165124000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/16\/5515"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,17]]},"references-count":54,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["s21165515"],"URL":"https:\/\/doi.org\/10.3390\/s21165515","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,8,17]]}}}