{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T10:08:46Z","timestamp":1753438126966,"version":"3.37.3"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2023,12,14]],"date-time":"2023-12-14T00:00:00Z","timestamp":1702512000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,12,14]],"date-time":"2023-12-14T00:00:00Z","timestamp":1702512000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62072468"],"award-info":[{"award-number":["62072468"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004543","name":"China Scholarship Council","doi-asserted-by":"publisher","award":["201906450051"],"award-info":[{"award-number":["201906450051"]}],"id":[{"id":"10.13039\/501100004543","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["18CX06059A"],"award-info":[{"award-number":["18CX06059A"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Research Foundation, Singapore under its AI Singapore Programme","award":["AISG2-RP-2020-019"],"award-info":[{"award-number":["AISG2-RP-2020-019"]}]},{"name":"the SMU-A*STAR Joint Lab in Social and Human-Centered Computing","award":["SAJL-2022-HAS001"],"award-info":[{"award-number":["SAJL-2022-HAS001"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2024,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Activities of daily living (ADLs) relate to people\u2019s daily self-care activities, which reflect their living habits and lifestyle. A prior study presented a neural network model called STADLART for ADL routine learning. In this paper, we propose a cognitive model named Spatial-Temporal Episodic Memory for ADL (STEM-ADL), which extends STADLART to encode event sequences in the form of distributed episodic memory patterns. Specifically, STEM-ADL encodes each ADL and its associated contextual information as an event pattern and encodes all events in a day as an episode pattern. By explicitly encoding the temporal characteristics of events as activity gradient patterns, STEM-ADL can be suitably employed for activity prediction tasks. In addition, STEM-ADL can predict both the ADL type and starting time of the subsequent event in one shot. A series of experiments are carried out on two real-world ADL data sets: Orange4Home and OrdonezB, to estimate the efficacy of STEM-ADL. The experimental results indicate that STEM-ADL is remarkably robust in event retrieval using incomplete or noisy retrieval cues. Moreover, STEM-ADL outperforms STADLART and other state-of-the-art models in ADL retrieval and subsequent event prediction tasks. STEM-ADL thus offers a vast potential to be deployed in real-life healthcare applications for ADL monitoring and lifestyle recommendation.<\/jats:p>","DOI":"10.1007\/s40747-023-01298-8","type":"journal-article","created":{"date-parts":[[2023,12,14]],"date-time":"2023-12-14T09:02:15Z","timestamp":1702544535000},"page":"2733-2750","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Spatial-temporal episodic memory modeling for ADLs: encoding, retrieval, and prediction"],"prefix":"10.1007","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7850-7029","authenticated-orcid":false,"given":"Xinjing","family":"Song","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3171-4001","authenticated-orcid":false,"given":"Di","family":"Wang","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7313-4339","authenticated-orcid":false,"given":"Chai","family":"Quek","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0378-4069","authenticated-orcid":false,"given":"Ah-Hwee","family":"Tan","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9910-7884","authenticated-orcid":false,"given":"Yanjiang","family":"Wang","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,12,14]]},"reference":[{"issue":"5","key":"1298_CR1","doi-asserted-by":"publisher","first-page":"416","DOI":"10.1097\/01.jgp.0000310780.04465.13","volume":"16","author":"VG Wadley","year":"2008","unstructured":"Wadley VG, Okonkwo O, Crowe M, Ross-Meadows LA (2008) Mild cognitive impairment and everyday function: evidence of reduced speed in performing instrumental activities of daily living. Am J Geriatr Psychiatry 16(5):416\u2013424. https:\/\/doi.org\/10.1097\/01.jgp.0000310780.04465.13","journal-title":"Am J Geriatr Psychiatry"},{"issue":"1","key":"1298_CR2","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1109\/tkde.2019.2924623","volume":"33","author":"S Gao","year":"2019","unstructured":"Gao S, Tan A-H, Setchi R (2019) Learning ADL daily routines with spatiotemporal neural networks. IEEE Trans Knowl Data Eng 33(1):143\u2013153. https:\/\/doi.org\/10.1109\/tkde.2019.2924623","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"1298_CR3","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2022.109149","volume":"135","author":"Z Xu","year":"2023","unstructured":"Xu Z, Wang G, Guo X (2023) Event-driven daily activity recognition with enhanced emergent modeling. Pattern Recognit 135:109149. https:\/\/doi.org\/10.1016\/j.patcog.2022.109149","journal-title":"Pattern Recognit"},{"key":"1298_CR4","doi-asserted-by":"publisher","unstructured":"Tan A-H, Carpenter GA, Grossberg S (2007) Intelligence through interaction: Towards a unified theory for learning. In: International Symposium on Neural Networks, pp. 1094\u20131103. https:\/\/doi.org\/10.1007\/978-3-540-72383-7_128","DOI":"10.1007\/978-3-540-72383-7_128"},{"key":"1298_CR5","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1016\/j.neunet.2019.08.020","volume":"120","author":"A-H Tan","year":"2019","unstructured":"Tan A-H, Subagdja B, Wang D, Meng L (2019) Self-organizing neural networks for universal learning and multimodal memory encoding. Neural Netw 120:58\u201373. https:\/\/doi.org\/10.1016\/j.neunet.2019.08.020","journal-title":"Neural Netw"},{"key":"1298_CR6","doi-asserted-by":"publisher","unstructured":"Cumin J, Lefebvre G, Ramparany F, Crowley JL (2017) A dataset of routine daily activities in an instrumented home. In: International Conference on Ubiquitous Computing and Ambient Intelligence, pp. 413\u2013425. https:\/\/doi.org\/10.1007\/978-3-319-67585-5_43","DOI":"10.1007\/978-3-319-67585-5_43"},{"issue":"5","key":"1298_CR7","doi-asserted-by":"publisher","first-page":"5460","DOI":"10.3390\/s130505460","volume":"13","author":"F Ord\u00f3\u00f1ez","year":"2013","unstructured":"Ord\u00f3\u00f1ez F, De Toledo P, Sanchis A (2013) Activity recognition using hybrid generative\/discriminative models on home environments using binary sensors. Sensors 13(5):5460\u20135477. https:\/\/doi.org\/10.3390\/s130505460","journal-title":"Sensors"},{"key":"1298_CR8","unstructured":"Mueller ST, Shiffrin RM (2006) REM II: a model of the developmental co-evolution of episodic memory and semantic knowledge. In: International Conference on Learning and Development (ICDL)"},{"key":"1298_CR9","unstructured":"Nuxoll AM, Laird JE (2007) Extending cognitive architecture with episodic memory. In: Proceedings of the AAAI Conference on Artificial Intelligence, pp. 1560\u20131564"},{"issue":"6","key":"1298_CR10","doi-asserted-by":"publisher","first-page":"759","DOI":"10.1016\/0893-6080(91)90056-b","volume":"4","author":"GA Carpenter","year":"1991","unstructured":"Carpenter GA, Grossberg S, Rosen DB (1991) Fuzzy ART: fast stable learning and categorization of analog patterns by an adaptive resonance system. Neural Netw 4(6):759\u2013771. https:\/\/doi.org\/10.1016\/0893-6080(91)90056-b","journal-title":"Neural Netw"},{"key":"1298_CR11","doi-asserted-by":"publisher","unstructured":"Chang P-H, Tan A-H (2017) Encoding and recall of spatio-temporal episodic memory in real time. In: International Joint Conference on Artificial Intelligence (IJCAI), pp. 1490\u20131496. https:\/\/doi.org\/10.24963\/ijcai.2017\/206","DOI":"10.24963\/ijcai.2017\/206"},{"issue":"2","key":"1298_CR12","doi-asserted-by":"publisher","first-page":"617","DOI":"10.1109\/TCDS.2021.3061659","volume":"14","author":"C-Y Yang","year":"2022","unstructured":"Yang C-Y, Gamborino E, Fu L-C, Chang Y-L (2022) A brain-inspired self-organizing episodic memory model for a memory assistance robot. IEEE Trans Cogn Dev Syst 14(2):617\u2013628. https:\/\/doi.org\/10.1109\/TCDS.2021.3061659","journal-title":"IEEE Trans Cogn Dev Syst"},{"key":"1298_CR13","unstructured":"Wang D, Tan A-H, Miao C (2016) Modeling autobiographical memory in human-like autonomous agents. In: International Conference on Autonomous Agents and Multiagent Systems (AAMAS), pp. 845\u2013853. https:\/\/ink.library.smu.edu.sg\/sis_research\/6277"},{"issue":"01","key":"1298_CR14","doi-asserted-by":"publisher","first-page":"1368","DOI":"10.1609\/aaai.v33i01.33011368","volume":"33","author":"D Wang","year":"2019","unstructured":"Wang D, Tan A-H, Miao C, Moustafa AA (2019) Modelling autobiographical memory loss across life span. Proc AAAI Conf Artif Intell 33(01):1368\u20131375. https:\/\/doi.org\/10.1609\/aaai.v33i01.33011368","journal-title":"Proc AAAI Conf Artif Intell"},{"key":"1298_CR15","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2020.113994","volume":"164","author":"J Maitre","year":"2021","unstructured":"Maitre J, Bouchard K, Bertuglia C, Gaboury S (2021) Recognizing activities of daily living from UWB radars and deep learning. Expert Syst Appl 164:113994. https:\/\/doi.org\/10.1016\/j.eswa.2020.113994","journal-title":"Expert Syst Appl"},{"key":"1298_CR16","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2022.116764","volume":"198","author":"C Han","year":"2022","unstructured":"Han C, Zhang L, Tang Y, Huang W, Min F, He J (2022) Human activity recognition using wearable sensors by heterogeneous convolutional neural networks. Expert Syst Appl 198:116764. https:\/\/doi.org\/10.1016\/j.eswa.2022.116764","journal-title":"Expert Syst Appl"},{"key":"1298_CR17","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2020.107561","volume":"108","author":"LM Dang","year":"2020","unstructured":"Dang LM, Min K, Wang H, Piran MJ, Lee CH, Moon H (2020) Sensor-based and vision-based human activity recognition: a comprehensive survey. Pattern Recogn 108:107561. https:\/\/doi.org\/10.1016\/j.patcog.2020.107561","journal-title":"Pattern Recogn"},{"key":"1298_CR18","doi-asserted-by":"publisher","first-page":"10779","DOI":"10.1007\/s11042-016-3267-8","volume":"76","author":"L Meng","year":"2017","unstructured":"Meng L, Miao C, Leung C (2017) Towards online and personalized daily activity recognition, habit modeling, and anomaly detection for the solitary elderly through unobtrusive sensing. Multimed Tools Appl 76:10779\u201310799. https:\/\/doi.org\/10.1007\/s11042-016-3267-8","journal-title":"Multimed Tools Appl"},{"issue":"3","key":"1298_CR19","doi-asserted-by":"publisher","first-page":"636","DOI":"10.1109\/JIOT.2017.2668061","volume":"4","author":"S Wu","year":"2017","unstructured":"Wu S, Rendall JB, Smith MJ, Zhu S, Xu J, Wang H, Yang Q, Qin P (2017) Survey on prediction algorithms in smart homes. IEEE Internet Things J 4(3):636\u2013644. https:\/\/doi.org\/10.1109\/JIOT.2017.2668061","journal-title":"IEEE Internet Things J"},{"issue":"4","key":"1298_CR20","doi-asserted-by":"publisher","first-page":"985","DOI":"10.1109\/tsmca.2011.2173568","volume":"42","author":"MR Alam","year":"2011","unstructured":"Alam MR, Reaz MBI, Ali MM (2011) SPEED: An inhabitant activity prediction algorithm for smart homes. IEEE Trans Syst Man Cybern A Syst Hum 42(4):985\u2013990. https:\/\/doi.org\/10.1109\/tsmca.2011.2173568","journal-title":"IEEE Trans Syst Man Cybern A Syst Hum"},{"issue":"2","key":"1298_CR21","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1007\/s12652-014-0219-x","volume":"6","author":"E Nazerfard","year":"2015","unstructured":"Nazerfard E, Cook DJ (2015) CRAFFT: an activity prediction model based on Bayesian networks. J Ambient Intell Humaniz Comput 6(2):193\u2013205. https:\/\/doi.org\/10.1007\/s12652-014-0219-x","journal-title":"J Ambient Intell Humaniz Comput"},{"issue":"1","key":"1298_CR22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3424344","volume":"15","author":"J Cumin","year":"2020","unstructured":"Cumin J, Lefebvre G, Ramparany F, Crowley JL (2020) PSINES: activity and availability prediction for adaptive ambient intelligence. ACM Trans Auton Adapt Syst 15(1):1\u201312. https:\/\/doi.org\/10.1145\/3424344","journal-title":"ACM Trans Auton Adapt Syst"},{"key":"1298_CR23","doi-asserted-by":"publisher","unstructured":"Jain A, Singh A, Koppula HS, Soh S, Saxena A (2016) Recurrent neural networks for driver activity anticipation via sensory-fusion architecture. In: 2016 IEEE International Conference on Robotics and Automation (ICRA), pp. 3118\u20133125. https:\/\/doi.org\/10.1109\/icra.2016.7487478","DOI":"10.1109\/icra.2016.7487478"},{"issue":"20","key":"1298_CR24","doi-asserted-by":"publisher","first-page":"4474","DOI":"10.3390\/s19204474","volume":"19","author":"Y Du","year":"2019","unstructured":"Du Y, Lim Y, Tan Y (2019) A novel human activity recognition and prediction in smart home based on interaction. Sensors 19(20):4474. https:\/\/doi.org\/10.3390\/s19204474","journal-title":"Sensors"},{"issue":"2","key":"1298_CR25","doi-asserted-by":"publisher","first-page":"2682","DOI":"10.3390\/s130202682","volume":"13","author":"I Fatima","year":"2013","unstructured":"Fatima I, Fahim M, Lee Y-K, Lee S (2013) A unified framework for activity recognition-based behavior analysis and action prediction in smart homes. Sensors 13(2):2682\u20132699. https:\/\/doi.org\/10.3390\/s130202682","journal-title":"Sensors"},{"issue":"2","key":"1298_CR26","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1109\/tciaig.2014.2336702","volume":"7","author":"D Wang","year":"2014","unstructured":"Wang D, Tan A-H (2014) Creating autonomous adaptive agents in a real-time first-person shooter computer game. IEEE Trans Comput Intell AI Games 7(2):123\u2013138. https:\/\/doi.org\/10.1109\/tciaig.2014.2336702","journal-title":"IEEE Trans Comput Intell AI Games"},{"key":"1298_CR27","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1016\/j.neunet.2019.09.014","volume":"120","author":"L Meng","year":"2019","unstructured":"Meng L, Tan A-H, Miao C (2019) Salience-aware adaptive resonance theory for large-scale sparse data clustering. Neural Netw 120:143\u2013157. https:\/\/doi.org\/10.1016\/j.neunet.2019.09.014","journal-title":"Neural Netw"},{"issue":"12","key":"1298_CR28","doi-asserted-by":"publisher","first-page":"2656","DOI":"10.1109\/tnnls.2015.2498625","volume":"27","author":"L Meng","year":"2015","unstructured":"Meng L, Tan A-H, Wunsch DC (2015) Adaptive scaling of cluster boundaries for large-scale social media data clustering. IEEE Trans Neural Netw Learn Syst 27(12):2656\u20132669. https:\/\/doi.org\/10.1109\/tnnls.2015.2498625","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"1298_CR29","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1109\/mis.2010.112","volume":"27","author":"DJ Cook","year":"2012","unstructured":"Cook DJ (2012) Learning setting-generalized activity models for smart spaces. IEEE Intell Syst 27:32\u201338. https:\/\/doi.org\/10.1109\/mis.2010.112","journal-title":"IEEE Intell Syst"},{"key":"1298_CR30","doi-asserted-by":"publisher","unstructured":"Kasteren TV, Noulas AK, Englebienne G, Kr\u00f6se BJA (2008) Accurate activity recognition in a home setting. In: the 10th International Conference on Ubiquitous Computing (UbiComp), pp. 1\u20139. https:\/\/doi.org\/10.1145\/1409635.1409637","DOI":"10.1145\/1409635.1409637"},{"key":"1298_CR31","doi-asserted-by":"publisher","first-page":"295","DOI":"10.1016\/j.patcog.2017.02.028","volume":"68","author":"L Liu","year":"2017","unstructured":"Liu L, Wang S, Su G, Huang Z-G, Liu M (2017) Towards complex activity recognition using a Bayesian network-based probabilistic generative framework. Pattern Recognit 68:295\u2013309. https:\/\/doi.org\/10.1016\/j.patcog.2017.02.028","journal-title":"Pattern Recognit"},{"issue":"2","key":"1298_CR32","doi-asserted-by":"publisher","first-page":"274","DOI":"10.1109\/titb.2009.2037317","volume":"14","author":"A Fleury","year":"2010","unstructured":"Fleury A, Vacher M, Noury N (2010) Svm-based multimodal classification of activities of daily living in health smart homes: sensors, algorithms, and first experimental results. IEEE Trans Inf Technol Biomed 14(2):274\u2013283. https:\/\/doi.org\/10.1109\/titb.2009.2037317","journal-title":"IEEE Trans Inf Technol Biomed"},{"key":"1298_CR33","doi-asserted-by":"publisher","unstructured":"Logan B, Healey J, Philipose M, Tapia EM, Intille S (2007) A long-term evaluation of sensing modalities for activity recognition. In: International Conference on Ubiquitous Computing, pp. 483\u2013500. https:\/\/doi.org\/10.1007\/978-3-540-74853-3_28. Springer","DOI":"10.1007\/978-3-540-74853-3_28"},{"key":"1298_CR34","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2019.113069","volume":"143","author":"C Wiwatcharakoses","year":"2020","unstructured":"Wiwatcharakoses C, Berrar D (2020) SOINN+, a self-organizing incremental neural network for unsupervised learning from noisy data streams. Expert Syst Appl 143:113069. https:\/\/doi.org\/10.1016\/j.eswa.2019.113069","journal-title":"Expert Syst Appl"},{"issue":"1","key":"1298_CR35","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1016\/j.neunet.2005.04.006","volume":"19","author":"F Shen","year":"2006","unstructured":"Shen F, Osamu H (2006) An incremental network for on-line unsupervised classification and topology learning. Neural Netw 19(1):90\u2013106. https:\/\/doi.org\/10.1016\/j.neunet.2005.04.006","journal-title":"Neural Netw"}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-023-01298-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-023-01298-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-023-01298-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,30]],"date-time":"2024-03-30T15:32:51Z","timestamp":1711812771000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-023-01298-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,14]]},"references-count":35,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,4]]}},"alternative-id":["1298"],"URL":"https:\/\/doi.org\/10.1007\/s40747-023-01298-8","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"type":"print","value":"2199-4536"},{"type":"electronic","value":"2198-6053"}],"subject":[],"published":{"date-parts":[[2023,12,14]]},"assertion":[{"value":"29 March 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 November 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 December 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"On behalf of all authors, the corresponding author states that there is no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}