{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T13:52:27Z","timestamp":1774965147540,"version":"3.50.1"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"27","license":[{"start":{"date-parts":[[2023,4,12]],"date-time":"2023-04-12T00:00:00Z","timestamp":1681257600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,4,12]],"date-time":"2023-04-12T00:00:00Z","timestamp":1681257600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"NBTC"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"published-print":{"date-parts":[[2023,11]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Real time detection of falls and unstable movement by elderly people is vital to their quality of life and safety. We present an edge processing device integrated with a cloud computation framework that can be used for activity profiling as well as trigger alerts for falls and unstable motion by elderly people at home. The proposed system uses fixed cameras to track and analyze each visible person in the scene, classifying their actions into nine ordinary activities, a fall, or unstable movement. An alert notification is sent to caregivers whenever a fall or unstable movement is detected. The major components of the system include an embedded device (NVIDIA JETSON TX2) and cloud-based storage and analysis infrastructure. The system is composed of modules for detecting, tracking and recognizing humans, a cascaded hierarchical classifier for nine ordinary activities and falls, and a long short-term memory (LSTM) module to predict unstable movement in video. The system is designed for accuracy, usability, and cost. A prototype system has been subjected to individual module tests along with a field test within a volunteer\u2019s household. It achieved an accuracy of 91.6% for ordinary actions and falls with a recall of 97.02% for unstable motion. Future phases will expand deployment to multiple homes.<\/jats:p>","DOI":"10.1007\/s11042-023-14993-y","type":"journal-article","created":{"date-parts":[[2023,4,12]],"date-time":"2023-04-12T11:02:52Z","timestamp":1681297372000},"page":"42395-42415","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Video analytic system for activity profiling, fall detection, and unstable motion detection"],"prefix":"10.1007","volume":"82","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8655-8667","authenticated-orcid":false,"given":"Aniqua Nusrat","family":"Zereen","sequence":"first","affiliation":[]},{"given":"Anubinda","family":"Gurung","sequence":"additional","affiliation":[]},{"given":"Amir","family":"Rajak","sequence":"additional","affiliation":[]},{"given":"Jednipat","family":"Moonrinta","sequence":"additional","affiliation":[]},{"given":"Matthew N.","family":"Dailey","sequence":"additional","affiliation":[]},{"given":"Mongkol","family":"Ekpanyapong","sequence":"additional","affiliation":[]},{"given":"Roongtiwa","family":"Vachalathiti","sequence":"additional","affiliation":[]},{"given":"Sunee","family":"Bovonsunthonchai","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,4,12]]},"reference":[{"issue":"7","key":"14993_CR1","first-page":"771","volume":"57","author":"T Al-Aama","year":"2011","unstructured":"Al-Aama T (2011) Falls in the elderly. Canadian Family Phys 57 (7):771\u2013776","journal-title":"Canadian Family Phys"},{"key":"14993_CR2","doi-asserted-by":"publisher","unstructured":"Anderson D, Keller JM, Skubic M, Chen X, He Z (2006) Recognizing falls from silhouettes. In: 2006 International conference of the ieee engineering in medicine and biology society, pp 6388\u20136391. https:\/\/doi.org\/10.1109\/IEMBS.2006.259594","DOI":"10.1109\/IEMBS.2006.259594"},{"key":"14993_CR3","doi-asserted-by":"publisher","first-page":"116287","DOI":"10.1016\/j.eswa.2021.116287","volume":"191","author":"YA Andrade-Ambriz","year":"2022","unstructured":"Andrade-Ambriz YA, Ledesma S, Ibarra-Manzano MA, Oros-Flores MI, Almanza-Ojeda DL (2022) Human activity recognition using temporal convolutional neural network architecture. Expert Syst Appl 191:116287","journal-title":"Expert Syst Appl"},{"issue":"1","key":"14993_CR4","doi-asserted-by":"publisher","first-page":"172","DOI":"10.1109\/TPAMI.2019.2929257","volume":"43","author":"Z Cao","year":"2019","unstructured":"Cao Z, Hidalgo G, Simon T, Wei S E, Sheikh Y (2019) Openpose: realtime multi-person 2D pose estimation using part affinity fields. IEEE Trans Pattern Anal Mach Intell 43(1):172\u2013186. https:\/\/doi.org\/10.1109\/TPAMI.2019.2929257","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"5","key":"14993_CR5","doi-asserted-by":"publisher","first-page":"1572","DOI":"10.1016\/j.patcog.2007.10.022","volume":"41","author":"PC Chung","year":"2008","unstructured":"Chung PC, Liu CD (2008) A daily behavior enabled hidden Markov model for human behavior understanding. Pattern Recognit 41(5):1572\u20131580. https:\/\/doi.org\/10.1016\/j.patcog.2007.10.022","journal-title":"Pattern Recognit"},{"key":"14993_CR6","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1016\/j.jbi.2017.05.010","volume":"71","author":"J Chung","year":"2017","unstructured":"Chung J, Ozkaynak M, Demiris G (2017) Examining daily activity routines of older adults using workflow. J Biomed Inf 71:82\u201390. https:\/\/doi.org\/10.1016\/j.jbi.2017.05.010","journal-title":"J Biomed Inf"},{"key":"14993_CR7","doi-asserted-by":"crossref","unstructured":"Ghorbani S, Mahdaviani K, Thaler A et al (2020) Movi: a large multipurpose motion and video dataset. arXiv:200301888","DOI":"10.1371\/journal.pone.0253157"},{"issue":"4","key":"14993_CR8","doi-asserted-by":"publisher","first-page":"2518","DOI":"10.1007\/s10489-020-01918-7","volume":"51","author":"D Groos","year":"2021","unstructured":"Groos D, Ramampiaro H, Ihlen EA (2021) Efficientpose: scalable single-person pose estimation. Appl Intell 51(4):2518\u20132533","journal-title":"Appl Intell"},{"key":"14993_CR9","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"key":"14993_CR10","doi-asserted-by":"crossref","unstructured":"Ibrahim MJ, Kainat J, AlSalman H, Ullah SS, Al-Hadhrami S, Hussain S (2022) An effective approach for human activity classification using feature fusion and machine learning methods applied bionics and biomechanics","DOI":"10.1155\/2022\/7931729"},{"key":"14993_CR11","doi-asserted-by":"publisher","unstructured":"Karim NT, Jain S, Moonrinta J, Dailey MN, Ekpanyapong M (2018) Customer and target individual face analysis for retail analytics. In: 2018 International workshop on advanced image technology (IWAIT), pp 1\u20134. https:\/\/doi.org\/10.1109\/IWAIT.2018.8369732","DOI":"10.1109\/IWAIT.2018.8369732"},{"key":"14993_CR12","doi-asserted-by":"publisher","unstructured":"Li C, Zhong Q, Xie D, Pu S (2017) Skeleton-based action recognition with convolutional neural networks. In: 2017 IEEE international conference on multimedia & expo workshops (ICMEW), 597\u2013600. https:\/\/doi.org\/10.1109\/ICMEW.2017.8026285","DOI":"10.1109\/ICMEW.2017.8026285"},{"key":"14993_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2017\/8264071","volume":"2017","author":"T Lin","year":"2017","unstructured":"Lin T, Yang C, Shih W (2017) Fall prevention shoes using camera-based line-laser obstacle detection system. J Healthcare Eng 2017:1\u201311. https:\/\/doi.org\/10.1155\/2017\/8264071","journal-title":"J Healthcare Eng"},{"key":"14993_CR14","doi-asserted-by":"publisher","first-page":"144","DOI":"10.1016\/j.neucom.2011.09.037","volume":"100","author":"M Mubashir","year":"2013","unstructured":"Mubashir M, Shao L, Seed LA (2013) Survey on fall detection: principles and approaches. Neurocomputing 100:144\u2013152. https:\/\/doi.org\/10.1016\/j.neucom.2011.09.037","journal-title":"Neurocomputing"},{"key":"14993_CR15","unstructured":"NVIDIA AI IOT (2020) Jetson benchmarks repository. https:\/\/github.com\/NVIDIA-AI-IOT\/jetson_benchmarks. Accessed 15 June 2020"},{"issue":"3","key":"14993_CR16","doi-asserted-by":"publisher","first-page":"14","DOI":"10.33422\/jarss.v3i3.517","volume":"3","author":"S Pumpinyo","year":"2020","unstructured":"Pumpinyo S, Koocharoenprasit S (2020) A survey of leisure activities that the elderly desire. J Adv Res Social Sci 3(3):14\u201319. https:\/\/doi.org\/10.33422\/jarss.v3i3.517","journal-title":"J Adv Res Social Sci"},{"issue":"5","key":"14993_CR17","first-page":"21","volume":"21","author":"B Rim","year":"2020","unstructured":"Rim B, Kim J, Choi YJ, Hong M (2020) Empirical comparison of deep learning networks on backbone method of human pose estimation. J Internet Comput Services 21(5):21\u201329","journal-title":"J Internet Comput Services"},{"key":"14993_CR18","unstructured":"Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556"},{"key":"14993_CR19","doi-asserted-by":"publisher","unstructured":"Stone EE, Skubic M (2011) Evaluation of an inexpensive depth camera for passive in-home fall risk assessment. In: 2011 5th International conference on pervasive computing technologies for healthcare (PervasiveHealth) and workshops, pp 71\u201377. https:\/\/doi.org\/10.4108\/icst.pervasivehealth.2011.246034","DOI":"10.4108\/icst.pervasivehealth.2011.246034"},{"key":"14993_CR20","unstructured":"Tan M, Le Q (2019) Efficientnet: rethinking model scaling for convolutional neural networks. In: International conference on machine learning, pp 6105\u20136114"},{"key":"14993_CR21","doi-asserted-by":"publisher","unstructured":"Wang J, Liu Z, Wu Y, Yuan J (2012) Mining actionlet ensemble for action recognition with depth cameras. In: 2012 IEEE conference on computer vision and pattern recognition, pp 1290\u20131297. https:\/\/doi.org\/10.1109\/CVPR.2012.6247813","DOI":"10.1109\/CVPR.2012.6247813"},{"key":"14993_CR22","doi-asserted-by":"publisher","unstructured":"Wojke N, Bewley A, Paulus D (2017) Simple online and realtime tracking with a deep association metric. In: 2017 IEEE international conference on image processing (ICIP), pp 3645\u20133649. https:\/\/doi.org\/10.1109\/ICIP.2017.8296962","DOI":"10.1109\/ICIP.2017.8296962"},{"key":"14993_CR23","doi-asserted-by":"crossref","unstructured":"Xiao B, Wu H, Wei Y (2018) Simple baselines for human pose estimation and tracking. In: Proceedings of the European conference on computer vision (ECCV), pp 466\u2013481","DOI":"10.1007\/978-3-030-01231-1_29"},{"issue":"2","key":"14993_CR24","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1016\/j.jesf.2018.06.001","volume":"16","author":"HY Yen","year":"2018","unstructured":"Yen HY, Lin LJ (2018) Quality of life in older adults: benefits from the productive engagement in physical activity. J Exercise Sci Fitness 16 (2):49\u201354. https:\/\/doi.org\/10.1016\/j.jesf.2018.06.001","journal-title":"J Exercise Sci Fitness"},{"issue":"5","key":"14993_CR25","first-page":"117","volume":"5","author":"AN Zereen","year":"2021","unstructured":"Zereen AN, Gurung A, Rajak A et al (2021) Automatic elderly fall and unstable movement detection system using framewise and LSTM based video analytics on an embedded device. NBTC J 5(5):117\u2013134","journal-title":"NBTC J"},{"key":"14993_CR26","doi-asserted-by":"publisher","unstructured":"Zhang S, Liu X, Xiao J (2017) On geometric features for skeleton-based action recognition using multilayer lstm networks. In: 2017 IEEE winter conference on applications of computer vision (WACV), pp 148\u2013157. https:\/\/doi.org\/10.1109\/WACV.2017.24","DOI":"10.1109\/WACV.2017.24"},{"issue":"10","key":"14993_CR27","doi-asserted-by":"publisher","first-page":"1499","DOI":"10.1109\/LSP.2016.2603342","volume":"23","author":"K Zhang","year":"2016","unstructured":"Zhang K, Zhang Z, Li Z, Qiao Y (2016) Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process Lett 23(10):1499\u20131503. https:\/\/doi.org\/10.1109\/LSP.2016.2603342","journal-title":"IEEE Signal Process Lett"},{"issue":"11","key":"14993_CR28","doi-asserted-by":"publisher","first-page":"1489","DOI":"10.1109\/TCSVT.2008.2005612","volume":"18","author":"Z Zhou","year":"2008","unstructured":"Zhou Z, Chen X, Chung YC, He Z, Han TX, Keller JM (2008) Activity analysis, summarization, and visualization for indoor human activity monitoring. IEEE Trans Circuits Syst Video Technol 18(11):1489\u20131498","journal-title":"IEEE Trans Circuits Syst Video Technol"},{"key":"14993_CR29","doi-asserted-by":"publisher","unstructured":"Zhou Z, Dai W, Eggert J et al (2009) A real-time system for in-home activity monitoring of elders. In: 2009 Annual international conference of the IEEE engineering in medicine and biology society, pp 6115\u20136118. https:\/\/doi.org\/10.1109\/IEMBS.2009.5334915","DOI":"10.1109\/IEMBS.2009.5334915"},{"key":"14993_CR30","doi-asserted-by":"publisher","unstructured":"Zhou T, Li J, Wang S, Tao R, Shen J (2020) MATNet: motion-attentive transition network for zero-shot video object segmentation. In: IEEE transactions on image processing, pp 8326\u20138338. https:\/\/doi.org\/10.1109\/TIP.2020.3013162","DOI":"10.1109\/TIP.2020.3013162"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-023-14993-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11042-023-14993-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-023-14993-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,26]],"date-time":"2023-10-26T10:13:39Z","timestamp":1698315219000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11042-023-14993-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,12]]},"references-count":30,"journal-issue":{"issue":"27","published-print":{"date-parts":[[2023,11]]}},"alternative-id":["14993"],"URL":"https:\/\/doi.org\/10.1007\/s11042-023-14993-y","relation":{},"ISSN":["1380-7501","1573-7721"],"issn-type":[{"value":"1380-7501","type":"print"},{"value":"1573-7721","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,12]]},"assertion":[{"value":"11 March 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 July 2022","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 February 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 April 2023","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The manuscript describes recent work and is not under consideration for publication elsewhere. Some of the results have been previously publicized in a research report for the funding donor\u2019s annual online compendium, \u201cNBTC Journal.\u201d The new manuscript is substantially extended from the research report, with a more extensive review of the literature, more detailed descriptions of the methodologies, and additional experimental work. Experiments involving human participants were reviewed and approved by the Institutional Review Board at Mahidol University, Thailand. All authors have approved the manuscript and this submission. The authors certify that there is no conflict of interest with any financial\/research\/academic organization with regards to the content\/research work discussed in the manuscript.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}}]}}