{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:28:24Z","timestamp":1760146104901,"version":"build-2065373602"},"reference-count":47,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2024,10,4]],"date-time":"2024-10-04T00:00:00Z","timestamp":1728000000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea (NRF)","doi-asserted-by":"publisher","award":["NRF-2018R1A6A1A03025109"],"award-info":[{"award-number":["NRF-2018R1A6A1A03025109"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>To create an effective Ambient Assisted Living (AAL) system that supports the daily activities of patients or the elderly, it is crucial to accurately detect and differentiate user actions to determine the necessary assistance. Traditional intrusive methods, such as wearable or object-attached devices, can interfere with the natural behavior of patients and may lead to resistance. Furthermore, non-intrusive systems that rely on video or sound data processed by servers or the cloud can generate excessive data traffic and raise concerns about the security of personal information. In this study, we developed an edge-based real-time system for detecting Activities of Daily Living (ADL) using ambient noise. Additionally, we introduced an online post-processing method to enhance classification performance and extract activity events from noisy sound in resource-constrained environments. The system, tested with data collected in a living space, achieved high accuracy in classifying ADL-related behaviors in continuous events and successfully generated user activity logs from time-series sound data, enabling further analyses such as ADL assessments. Future work will focus on enhancing detection accuracy and expanding the range of detectable behaviors by integrating the activity logs generated in this study with additional data sources beyond sound.<\/jats:p>","DOI":"10.3390\/s24196435","type":"journal-article","created":{"date-parts":[[2024,10,4]],"date-time":"2024-10-04T10:20:52Z","timestamp":1728037252000},"page":"6435","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Real-Time Prediction of Resident ADL Using Edge-Based Time-Series Ambient Sound Recognition"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1382-7926","authenticated-orcid":false,"given":"Cheolhwan","family":"Lee","sequence":"first","affiliation":[{"name":"School of Electronic and Electrical Engineering, College of IT Engineering, Kyungpook National University, 80 Daehakro, Bukgu, Daegu 41566, Republic of Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3241-5628","authenticated-orcid":false,"given":"Ah Hyun","family":"Yuh","sequence":"additional","affiliation":[{"name":"School of Electronic and Electrical Engineering, College of IT Engineering, Kyungpook National University, 80 Daehakro, Bukgu, Daegu 41566, Republic of Korea"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8171-195X","authenticated-orcid":false,"given":"Soon Ju","family":"Kang","sequence":"additional","affiliation":[{"name":"School of Electronic and Electrical Engineering, College of IT Engineering, Kyungpook National University, 80 Daehakro, Bukgu, Daegu 41566, Republic of Korea"}]}],"member":"1968","published-online":{"date-parts":[[2024,10,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Corchado, J.M., Tapia, D.I., and Bravo, J. (2008, January 22\u201324). Ambient Assisted Living. Proceedings of the 3rd Symposium of Ubiquitous Computing and Ambient Intelligence 2008, Salamanca, Spain.","DOI":"10.1007\/978-3-540-85867-6"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Maskeli\u016bnas, R., Dama\u0161evi\u010dius, R., and Segal, S. (2019). A Review of Internet of Things Technologies for Ambient Assisted Living Environments. Future Internet, 11.","DOI":"10.3390\/fi11120259"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Marques, G., Bhoi, A.K., and Hareesha, K. (2021). IoT in Healthcare and Ambient Assisted Living, Springer.","DOI":"10.1007\/978-981-15-9897-5"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Stavropoulos, T.G., Papastergiou, A., Mpaltadoros, L., Nikolopoulos, S., and Kompatsiaris, I. (2020). IoT Wearable Sensors and Devices in Elderly Care: A Literature Review. Sensors, 20.","DOI":"10.3390\/s20102826"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"721","DOI":"10.1111\/j.1532-5415.1983.tb03391.x","article-title":"Assessing self-maintenance: Activities of daily living, mobility, and instrumental activities of daily living","volume":"31","author":"Katz","year":"1983","journal-title":"J. Am. Geriatr. Soc."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1093\/ageing\/25.2.113","article-title":"Assessment of Activities of Daily Living in Dementia: Development of the Bristol Activities of Daily Living Scale","volume":"25","author":"Bucks","year":"1996","journal-title":"Age Ageing"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"13562","DOI":"10.1109\/JSEN.2020.3005642","article-title":"ADL Recognition Through Machine Learning Algorithms on IoT Air Quality Sensor Dataset","volume":"20","author":"Gambi","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3314404","article-title":"Audio-Based Activities of Daily Living (ADL) Recognition with Large-Scale Acoustic Embeddings from Online Videos","volume":"3","author":"Liang","year":"2019","journal-title":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Pires, I.M., Marques, G., Garcia, N.M., Pombo, N., Fl\u00f3rez-Revuelta, F., Spinsante, S., Teixeira, M.C., and Zdravevski, E. (2019). Recognition of Activities of Daily Living and Environments Using Acoustic Sensors Embedded on Mobile Devices. Electronics, 8.","DOI":"10.3390\/electronics8121499"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Park, Y.J., Jung, S.Y., Son, T.Y., and Kang, S.J. (2021). Self-Organizing IoT Device-Based Smart Diagnosing Assistance System for Activities of Daily Living. Sensors, 21.","DOI":"10.3390\/s21030785"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Hoang, M.L., Carrat\u00f9, M., Paciello, V., and Pietrosanto, A. (2021). Body Temperature\u2014Indoor Condition Monitor and Activity Recognition by MEMS Accelerometer Based on IoT-Alert System for People in Quarantine Due to COVID-19. Sensors, 21.","DOI":"10.3390\/s21072313"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Naik, K., Pandit, T., Naik, N., and Shah, P. (2021). Activity Recognition in Residential Spaces with Internet of Things Devices and Thermal Imaging. Sensors, 21.","DOI":"10.37247\/PASen.2.2021.5"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Khan, M.A., Din, I.U., Majali, T., and Kim, B.S. (2022). A Survey of Authentication in Internet of Things-Enabled Healthcare Systems. Sensors, 22.","DOI":"10.3390\/s22239089"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Onthoni, D.D., and Sahoo, P.K. (2022). Artificial-Intelligence-Assisted Activities of Daily Living Recognition for Elderly in Smart Home. Electronics, 11.","DOI":"10.3390\/electronics11244129"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2700316","DOI":"10.1109\/JTEHM.2022.3177710","article-title":"Deep CNN-LSTM with Self-Attention Model for Human Activity Recognition Using Wearable Sensor","volume":"10","author":"Khatun","year":"2022","journal-title":"IEEE J. Transl. Eng. Health Med."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Mekruksavanich, S., and Jitpattanakul, A. (2021). LSTM Networks Using Smartphone Data for Sensor-Based Human Activity Recognition in Smart Homes. Sensors, 21.","DOI":"10.3390\/s21051636"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"133509","DOI":"10.1109\/ACCESS.2019.2941836","article-title":"Design and Implementation of a Convolutional Neural Network on an Edge Computing Smartphone for Human Activity Recognition","volume":"7","author":"Zebin","year":"2019","journal-title":"IEEE Access"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Afzali Arani, M.S., Costa, D.E., and Shihab, E. (2021). Human Activity Recognition: A Comparative Study to Assess the Contribution Level of Accelerometer, ECG, and PPG Signals. Sensors, 21.","DOI":"10.3390\/s21216997"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"14400","DOI":"10.1007\/s10489-022-04250-4","article-title":"A novel deep learning architecture and MINIROCKET feature extraction method for human activity recognition using ECG, PPG and inertial sensor dataset","volume":"53","author":"Bondugula","year":"2023","journal-title":"Appl. Intell."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2364","DOI":"10.1016\/j.procs.2020.03.289","article-title":"A Lightweight Deep Learning Model for Human Activity Recognition on Edge Devices","volume":"167","author":"Agarwal","year":"2020","journal-title":"Procedia Comput. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1072","DOI":"10.1109\/JIOT.2019.2949715","article-title":"A Novel IoT-Perceptive Human Activity Recognition (HAR) Approach Using Multihead Convolutional Attention","volume":"7","author":"Zhang","year":"2020","journal-title":"IEEE Internet Things J."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/j.patrec.2020.01.010","article-title":"A multimodal approach for human activity recognition based on skeleton and RGB data","volume":"131","author":"Franco","year":"2020","journal-title":"Pattern Recognit. Lett."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1016\/j.procs.2020.03.004","article-title":"Activity Recognition in Smart Homes using UWB Radars","volume":"170","author":"Bouchard","year":"2020","journal-title":"Procedia Comput. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"698","DOI":"10.1016\/j.procs.2019.08.100","article-title":"Human Activity Recognition: A Survey","volume":"155","author":"Jobanputra","year":"2019","journal-title":"Procedia Comput. Sci."},{"key":"ref_25","unstructured":"Elliott, D., Otero, C.E., Wyatt, S., and Martino, E. (2021). Tiny Transformers for Environmental Sound Classification at the Edge. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"109025","DOI":"10.1016\/j.patcog.2022.109025","article-title":"Environmental Sound Classification on the Edge: A Pipeline for Deep Acoustic Networks on Extremely Resource-Constrained Devices","volume":"133","author":"Mohaimenuzzaman","year":"2023","journal-title":"Pattern Recognit."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Elliott, D., Martino, E., Otero, C.E., Smith, A., Peter, A.M., Luchterhand, B., Lam, E., and Leung, S. (2020, January 2\u201316). Cyber-Physical Analytics: Environmental Sound Classification at the Edge. Proceedings of the 2020 IEEE 6th World Forum on Internet of Things (WF-IoT), New Orleans, LA, USA.","DOI":"10.1109\/WF-IoT48130.2020.9221148"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Micucci, D., Mobilio, M., and Napoletano, P. (2017). UniMiB SHAR: A Dataset for Human Activity Recognition Using Acceleration Data from Smartphones. Appl. Sci., 7.","DOI":"10.20944\/preprints201706.0033.v1"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/j.inffus.2021.11.006","article-title":"Multi-sensor information fusion based on machine learning for real applications in human activity recognition: State-of-the-art and research challenges","volume":"80","author":"Qiu","year":"2022","journal-title":"Inf. Fusion"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"398","DOI":"10.1016\/j.snb.2014.03.102","article-title":"Human activity monitoring using gas sensor arrays","volume":"199","author":"Fonollosa","year":"2014","journal-title":"Sens. Actuators B Chem."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"30509","DOI":"10.1007\/s11042-020-09004-3","article-title":"Vision-based human activity recognition: A survey","volume":"79","author":"Beddiar","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"103177","DOI":"10.1016\/j.autcon.2020.103177","article-title":"Human activity classification based on sound recognition and residual convolutional neural network","volume":"114","author":"Jung","year":"2020","journal-title":"Autom. Constr."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Al\u00edas, F., Socor\u00f3, J.C., and Sevillano, X. (2016). A Review of Physical and Perceptual Feature Extraction Techniques for Speech, Music and Environmental Sounds. Appl. Sci., 6.","DOI":"10.3390\/app6050143"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Salamon, J., Jacoby, C., and Bello, J.P. (2014, January 3\u20137). A Dataset and Taxonomy for Urban Sound Research. Proceedings of the 22nd ACM International Conference on Multimedia, MM \u201914, New York, NY, USA.","DOI":"10.1145\/2647868.2655045"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Gemmeke, J.F., Ellis, D.P.W., Freedman, D., Jansen, A., Lawrence, W., Moore, R.C., Plakal, M., and Ritter, M. (2017, January 5\u20139). Audio Set: An ontology and human-labeled dataset for audio events. Proceedings of the 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), New Orleans, LA, USA.","DOI":"10.1109\/ICASSP.2017.7952261"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Serizel, R., Turpault, N., Shah, A., and Salamon, J. (2020, January 4\u20138). Sound Event Detection in Synthetic Domestic Environments. Proceedings of the ICASSP 2020\u20142020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.","DOI":"10.1109\/ICASSP40776.2020.9054478"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"107520","DOI":"10.1016\/j.apacoust.2020.107520","article-title":"A new pyramidal concatenated CNN approach for environmental sound classification","volume":"170","author":"Demir","year":"2020","journal-title":"Appl. Acoust."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Turpault, N., Serizel, R., Wisdom, S., Erdogan, H., Hershey, J.R., Fonseca, E., Seetharaman, P., and Salamon, J. (2021, January 6\u201311). Sound Event Detection and Separation: A Benchmark on Desed Synthetic Soundscapes. Proceedings of the ICASSP 2021\u20142021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada.","DOI":"10.1109\/ICASSP39728.2021.9414789"},{"key":"ref_39","first-page":"1595","article-title":"A review on TinyML: State-of-the-art and prospects","volume":"34","author":"Ray","year":"2022","journal-title":"J. King Saud Univ. Comput. Inf. Sci."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Surianarayanan, C., Lawrence, J.J., Chelliah, P.R., Prakash, E., and Hewage, C. (2023). A Survey on Optimization Techniques for Edge Artificial Intelligence (AI). Sensors, 23.","DOI":"10.3390\/s23031279"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"12350","DOI":"10.1109\/JIOT.2021.3063504","article-title":"Lightweight Deep Learning Model in Mobile-Edge Computing for Radar-Based Human Activity Recognition","volume":"8","author":"Zhu","year":"2021","journal-title":"IEEE Internet Things J."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Lee, C., Kang, H.M., Jeon, Y., and Kang, S.J. (2023, January 9\u201312). Ambient Sound Analysis for Non-Invasive Indoor Activity Detection in Edge Computing Environments. Proceedings of the 2023 IEEE Symposium on Computers and Communications (ISCC), Gammarth, Tunisia.","DOI":"10.1109\/ISCC58397.2023.10217851"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"McFee, B., Raffel, C., Liang, D., Ellis, D.P., McVicar, M., Battenberg, E., and Nieto, O. (2015, January 6\u201312). librosa: Audio and music signal analysis in python. Proceedings of the 14th Python in Science Conference, Austin, TX, USA.","DOI":"10.25080\/Majora-7b98e3ed-003"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Stahlbock, R., Weiss, G.M., Abou-Nasr, M., Yang, C.Y., Arabnia, H.R., and Deligiannidis, L. (2021). A Brief Review of Domain Adaptation. Advances in Data Science and Information Engineering, Springer.","DOI":"10.1007\/978-3-030-71704-9"},{"key":"ref_45","first-page":"66","article-title":"Generative Oversampling for Mining Imbalanced Datasets","volume":"7","author":"Liu","year":"2007","journal-title":"DMIN"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1613\/jair.953","article-title":"SMOTE: Synthetic minority over-sampling technique","volume":"16","author":"Chawla","year":"2002","journal-title":"J. Artif. Intell. Res."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Park, D.S., Chan, W., Zhang, Y., Chiu, C.C., Zoph, B., Cubuk, E.D., and Le, Q.V. (2019). Specaugment: A simple data augmentation method for automatic speech recognition. arXiv.","DOI":"10.21437\/Interspeech.2019-2680"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/19\/6435\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:10:42Z","timestamp":1760112642000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/19\/6435"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,4]]},"references-count":47,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2024,10]]}},"alternative-id":["s24196435"],"URL":"https:\/\/doi.org\/10.3390\/s24196435","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2024,10,4]]}}}