{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,12]],"date-time":"2025-12-12T12:56:52Z","timestamp":1765544212082,"version":"3.48.0"},"reference-count":57,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2025,12,12]],"date-time":"2025-12-12T00:00:00Z","timestamp":1765497600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Population aging is increasing dementia care demand. We present an audio-driven monitoring pipeline that operates either on mobile phones, microcontroller nodes, or smart television sets. The system combines audio signal processing with AI tools for structured interpretation. Preprocessing includes voice activity detection, speaker diarization, automatic speech recognition for dialogs, and speech-emotion recognition. An audio classifier detects home-care\u2013relevant events (cough, cane taps, thuds, knocks, and speech). A large language model integrates transcripts, acoustic features, and a consented household knowledge base to produce a daily caregiver report covering orientation\/disorientation (person, place, and time), delusion themes, agitation events, health proxies, and safety flags (e.g., exit seeking and falling). The pipeline targets real-time monitoring in homes and facilities, and it is an adjunct to caregiving, not a diagnostic device. Evaluation focuses on human-in-the-loop review, various audio\/speech modalities, and the ability of AI to integrate information and reason. Intended users are low-income households in remote settings where in-person caregiving cannot be secured, enabling remote monitoring support for older adults with dementia.<\/jats:p>","DOI":"10.3390\/a18120787","type":"journal-article","created":{"date-parts":[[2025,12,12]],"date-time":"2025-12-12T12:52:31Z","timestamp":1765543951000},"page":"787","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Affordable Audio Hardware and Artificial Intelligence Can Transform the Dementia Care Pipeline"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7111-3331","authenticated-orcid":false,"given":"Ilyas","family":"Potamitis","sequence":"first","affiliation":[{"name":"Department of Music Technology and Acoustics, Hellenic Mediterranean University, 71410 Heraklion, Greece"}]}],"member":"1968","published-online":{"date-parts":[[2025,12,12]]},"reference":[{"key":"ref_1","unstructured":"World Health Organization (2025, November 06). Available online: https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/dementia?."},{"key":"ref_2","unstructured":"(2025, November 06). EUROSTAT. Available online: https:\/\/ec.europa.eu\/eurostat\/statistics-explained\/index.php?title=Population_structure_and_ageing."},{"key":"ref_3","unstructured":"United Nations (2025, November 06). Available online: https:\/\/www.un.org\/development\/desa\/pd\/sites\/www.un.org.development.desa.pd\/files\/undesa_pd_2024_wpp_2024_advance_unedited_0.pdf."},{"key":"ref_4","unstructured":"(2025, November 06). Alzheimer\u2019s Association. Available online: https:\/\/www.alz.org\/alzheimers-dementia\/facts-figures?."},{"key":"ref_5","first-page":"112","article-title":"Automatic speech analysis for the assessment of patients with predementia and Alzheimer\u2019s disease","volume":"1","author":"Satt","year":"2015","journal-title":"Alzheimer\u2019s Dement. Diagn. Assess. Dis. Monit."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1109\/JSTSP.2019.2955022","article-title":"An Assessment of Paralinguistic Acoustic Features for Detection of Alzheimer\u2019s Dementia in Spontaneous Speech","volume":"14","author":"Haider","year":"2020","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Qi, X., Zhou, Q., Dong, J., and Bao, W. (2023). Noninvasive automatic detection of Alzheimer\u2019s disease from spontaneous speech: A review. Front. Aging Neurosci., 15.","DOI":"10.3389\/fnagi.2023.1224723"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1789","DOI":"10.14283\/jpad.2024.132","article-title":"Acoustic Speech Analysis in Alzheimer\u2019s Disease: A Systematic Review and Meta-Analysis","volume":"11","author":"Saeedi","year":"2024","journal-title":"J. Prev. Alzheimer\u2019s Dis."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Mart\u00ednez-Nicol\u00e1s, I., Llorente, T.E., Mart\u00ednez-S\u00e1nchez, F., and Meil\u00e1n, J.J.G. (2021). Ten years of research on automatic voice and speech analysis of people with Alzheimer\u2019s disease and mild cognitive impairment: A systematic review article. Front. Psychol., 12.","DOI":"10.3389\/fpsyg.2021.620251"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"176","DOI":"10.1186\/s13195-024-01543-3","article-title":"Digital remote assessment of speech acoustics in cognitively unimpaired adults: Feasibility, reliability and associations with amyloid pathology","volume":"16","author":"Zwan","year":"2024","journal-title":"Alzheimer\u2019s Res. Ther."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Liu, J., Fu, F., Li, L., Yu, J., Zhong, D., Zhu, S., Zhou, Y., Liu, B., and Li, J. (2023). Efficient Pause Extraction and Encode Strategy for Alzheimer\u2019s Disease Detection Using Only Acoustic Features from Spontaneous Speech. Brain Sci., 13.","DOI":"10.3390\/brainsci13030477"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1159\/000356726","article-title":"Speech in Alzheimer\u2019s disease: Can temporal and acoustic parameters discriminate dementia?","volume":"37","author":"Carro","year":"2014","journal-title":"Dement. Geriatr. Cogn. Disord."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1186\/s13195-021-00888-3","article-title":"Detection of dementia on voice recordings using deep learning: A Framingham Heart Study","volume":"13","author":"Xue","year":"2021","journal-title":"Alzheimer\u2019s Res. Ther."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"e57873","DOI":"10.2196\/55126","article-title":"Using acoustic voice features to detect mild cognitive impairment: Machine learning model development study","volume":"7","author":"Ding","year":"2024","journal-title":"JMIR Aging"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"727","DOI":"10.1080\/02699206.2020.1827043","article-title":"Telltale silence: Temporal speech parameters discriminate between prodromal dementia and mild Alzheimer\u2019s disease","volume":"35","author":"Vincze","year":"2021","journal-title":"Clin. Linguist. Phon."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"667","DOI":"10.1017\/S1041610218001205","article-title":"Integrative review: Persistent vocalizations among nursing home residents with dementia","volume":"31","author":"Sefcik","year":"2019","journal-title":"Int. Psychogeriatr."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Kosters, J., Janus, S.I.M., Van Den Bosch, K.A., Zuidema, S., Luijendijk, H.J., and Andringa, T.C. (2022). Soundscape Optimization in Nursing Homes Through Raising Awareness in Nursing Staff With MoSART. Front. Psychol., 13.","DOI":"10.3389\/fpsyg.2022.871647"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"100340","DOI":"10.1016\/j.smhl.2022.100340","article-title":"Fall detection from audios with Audio Transformers","volume":"26","author":"Kaur","year":"2022","journal-title":"Smart Health"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Newaz, N.T., and Hanada, E. (2023). The Methods of Fall Detection: A Literature Review. Sensors, 23.","DOI":"10.3390\/s23115212"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Li, Y., Liu, P., Fang, Y., Wu, X., Xie, Y., Xu, Z., Ren, H., and Jing, F. (2025). A Decade of Progress in Wearable Sensors for Fall Detection (2015\u20132024): A Network-Based Visualization Review. Sensors, 25.","DOI":"10.3390\/s25072205"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Rocha, I.C., Arantes, M., Moreira, A., Vila\u00e7a, J.L., Morais, P., Matos, D., and Carvalho, V. (2024). Monitoring Wearable Devices for Elderly People with Dementia: A Review. Designs, 8.","DOI":"10.3390\/designs8040075"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Saradopoulos, I., Potamitis, I., Ntalampiras, S., Rigakis, I., Manifavas, C., and Konstantaras, A. (2025). Real-Time Acoustic Detection of Critical Incidents in Smart Cities Using Artificial Intelligence and Edge Networks. Sensors, 25.","DOI":"10.3390\/s25082597"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Casu, F., Lagorio, A., Ruiu, P., Trunfio, G.A., and Grosso, E. (2025). Integrating Fine-Tuned LLM with Acoustic Features for Enhanced Detection of Alzheimer\u2019s Disease. IEEE J. Biomed. Health Inform., 1\u201314.","DOI":"10.1109\/JBHI.2025.3566615"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1159\/000362159","article-title":"Vocalizations in dementia: A case report and review of the literature","volume":"6","author":"Yusupov","year":"2014","journal-title":"Case Rep. Neurol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1959","DOI":"10.1002\/gps.5604","article-title":"Impact of agitation in long-term care residents with dementia in the United States","volume":"36","author":"Fillit","year":"2021","journal-title":"Int. J. Geriatr. Psychiatry"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Pedersen, S.K.A., Andersen, P.N., Lugo, R.G., Andreassen, M., and S\u00fctterlin, S. (2017). Effects of Music on Agitation in Dementia: A Meta-Analysis. Front. Psychol., 8.","DOI":"10.3389\/fpsyg.2017.00742"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1067\/mgn.2001.115200","article-title":"Audio presence intervention for decreasing agitation in people with dementia","volume":"22","author":"Miller","year":"2001","journal-title":"Geriatr. Nurs."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Shah, R., Basapur, S., Hendrickson, K., Anderson, J., Plenge, J., Troutman, A., Ranjit, E., and Banker, J. (2025). Does an Audio Wearable Lead to Agitation Reduction in Dementia: The Memesto AWARD Proof-of-Principle Clinical Research Study. Res. Sq., rs.3.rs-6008628.","DOI":"10.21203\/rs.3.rs-6008628\/v1"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Alsina-Pag\u00e8s, R.M., Navarro, J., Al\u00edas, F., and Herv\u00e1s, M. (2017). homeSound: Real-Time Audio Event Detection Based on High Performance Computing for Behaviour and Surveillance Remote Monitoring. Sensors, 17.","DOI":"10.3390\/s17040854"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"949","DOI":"10.1109\/TSMCA.2009.2025137","article-title":"Keeping the Resident in the Loop: Adapting the Smart Home to the User","volume":"39","author":"Rashidi","year":"2009","journal-title":"IEEE Trans. Syst. Man Cybern. \u2014Part A Syst. Hum."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1109\/TITB.2004.834393","article-title":"The installation and support of internationally distributed equipment for people with dementia","volume":"8","author":"Adlam","year":"2004","journal-title":"IEEE Trans. Inf. Technol. Biomed."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1080\/08839510701492579","article-title":"A Keyhole Plan Recognition Model for Alzheimer\u2019s Patients: First Results","volume":"21","author":"Bouchard","year":"2007","journal-title":"Appl. Artif. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"M\u00e9gret, R., Dovgalecs, V., Wannous, H., Karaman, S., Benois-Pineau, J., El Khoury, E., Pinquier, J., Joly, P., Andr\u00e9-Obrecht, R., and Ga\u00ebstel, R. (2010, January 25\u201329). The IMMED Project: Wearable Video Monitoring of People with Age Dementia. Proceedings of the 18th ACM International Conference on Multimedia, Firenze, Italy.","DOI":"10.1145\/1873951.1874206"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1109\/TITB.2008.2010701","article-title":"Detection of movement in bed using unobtrusive load cell sensors","volume":"14","author":"Adami","year":"2010","journal-title":"IEEE Trans. Inf. Technol. Biomed."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Tapia, E., Intille, S., and Larson, K. (2004, January 21\u201323). Activity Recognition in the Home Using Simple and Ubiquitous Sensors. Proceedings of the International Conference on Pervasive Computing, Linz and Vienna, Austria.","DOI":"10.1007\/978-3-540-24646-6_10"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1109\/TITB.2005.856855","article-title":"A model for the measurement of patient activity in a hospital suite","volume":"10","author":"LeBellego","year":"2006","journal-title":"IEEE Trans. Inf. Technol. Biomed."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1049\/cce:19980404","article-title":"Lifestyle monitoring technology for supported independence","volume":"9","author":"Barnes","year":"1998","journal-title":"Comput. Control. Eng."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2174\/1874431100701010001","article-title":"E-healthcare at an experimental welfare techno house in Japan","volume":"1","author":"Tamura","year":"2007","journal-title":"Open Med. Inform. J."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Boumpa, E., Gkogkidis, A., Charalampou, I., Ntaliani, A., Kakarountas, A., and Kokkinos, V. (2019). An Acoustic-Based Smart Home System for People Suffering from Dementia. Technologies, 7.","DOI":"10.20944\/preprints201903.0081.v1"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Peri\u0161a, M., Teskera, P., Cviti\u0107, I., and Grgurevi\u0107, I. (2025). Empowering People with Disabilities in Smart Homes Using Predictive Informing. Sensors, 25.","DOI":"10.3390\/s25010284"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Gong, Y., Chung, Y.-A., and Glass, J. (2021). AST: Audio Spectrogram Transformer. arXiv.","DOI":"10.21437\/Interspeech.2021-698"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Gemmeke, J.F., Ellis, D.P.W., Freedman, D., Jansen, A., Lawrence, W., Moore, R.C., Plakal, M., and Ritter, M. (2017, January 5\u20139). Audio Set: An ontology and human-labeled dataset for audio events. Proceedings of the 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), New Orleans, LA, USA.","DOI":"10.1109\/ICASSP.2017.7952261"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Ilias, L., and Askounis, D. (2022). Multimodal Deep Learning Models for Detecting Dementia From Speech and Transcripts. Front. Aging Neurosci., 14.","DOI":"10.3389\/fnagi.2022.830943"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Llaca-S\u00e1nchez, B.A., Garc\u00eda-Noguez, L.R., Aceves-Fern\u00e1ndez, M.A., Takacs, A., and Tovar-Arriaga, S. (2025). Exploring LLM Embedding Potential for Dementia Detection Using Audio Transcripts. Eng, 6.","DOI":"10.3390\/eng6070163"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"112812","DOI":"10.1016\/j.exger.2025.112812","article-title":"Multimodal LLM for enhanced Alzheimer\u2019s Disease diagnosis: Interpretable feature extraction from Mini-Mental State Examination data","volume":"208","author":"Zhang","year":"2025","journal-title":"Exp. Gerontol."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"96","DOI":"10.4218\/etrij.2023-0356","article-title":"Alzheimer\u2019s disease recognition from spontaneous speech using large language models","volume":"46","author":"Bang","year":"2024","journal-title":"ETRI J."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1038\/s41746-025-01940-4","article-title":"CARE-AD: A multi-agent large language model framework for Alzheimer\u2019s disease prediction using longitudinal clinical notes","volume":"8","author":"Li","year":"2025","journal-title":"npj Digit. Med."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"105401","DOI":"10.1016\/j.ebiom.2024.105401","article-title":"Enhancing early detection of cognitive decline in the elderly: A comparative study utilizing large language models in clinical notes","volume":"109","author":"Du","year":"2024","journal-title":"eBioMedicine"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"5262","DOI":"10.1002\/alz.13886","article-title":"Prediction of Alzheimer\u2019s disease progression within 6 years using speech: A novel approach leveraging language models","volume":"20","author":"Amini","year":"2024","journal-title":"Alzheimer\u2019s Dement."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Agbavor, F., and Liang, H. (2022). Predicting dementia from spontaneous speech using large language models. PLoS Digit. Health, 1.","DOI":"10.1371\/journal.pdig.0000168"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Chen, L., and Asgari, M. (2021, January 6\u201311). Refining Automatic Speech Recognition System for Older Adults. Proceedings of the ICASSP 2021\u20142021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada.","DOI":"10.1109\/ICASSP39728.2021.9414207"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"3561","DOI":"10.1109\/TASLP.2024.3422839","article-title":"Self-Supervised ASR Models and Features for Dysarthric and Elderly Speech Recognition","volume":"32","author":"Hu","year":"2024","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"2597","DOI":"10.1109\/TASLP.2022.3195113","article-title":"Speaker Adaptation Using Spectro-Temporal Deep Features for Dysarthric and Elderly Speech Recognition","volume":"30","author":"Geng","year":"2022","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"ref_54","first-page":"2760","article-title":"Unsupervised Rhythm and Voice Conversion to Improve ASR on Dysarthric Speech","volume":"2025","author":"Hermann","year":"2025","journal-title":"Proc. Interspeech"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1186\/1745-9974-2-8","article-title":"The automatic recognition and counting of cough","volume":"2","author":"Barry","year":"2006","journal-title":"Cough"},{"key":"ref_56","unstructured":"(2025, November 20). Caring for a Person with Dementia A Practical Guide. Available online: https:\/\/www.alzheimers.org.uk\/sites\/default\/files\/2022-07\/Caring-for-a-person-with-dementia-a-practical-guide.pdf."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"1579","DOI":"10.1017\/S1041610215001234","article-title":"The practice and ethics of dementia care","volume":"27","author":"Brodaty","year":"2015","journal-title":"Int. Psychogeriatr."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/18\/12\/787\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,12]],"date-time":"2025-12-12T12:54:01Z","timestamp":1765544041000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/18\/12\/787"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,12]]},"references-count":57,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["a18120787"],"URL":"https:\/\/doi.org\/10.3390\/a18120787","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,12]]}}}