{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T15:25:05Z","timestamp":1773156305403,"version":"3.50.1"},"reference-count":43,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2022,11,30]],"date-time":"2022-11-30T00:00:00Z","timestamp":1669766400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["6203000189"],"award-info":[{"award-number":["6203000189"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Shenzhen Science and Technology Program","award":["KQTD2020020113051096"],"award-info":[{"award-number":["KQTD2020020113051096"]}]},{"name":"Innovative Team Program of Education Department of Guangdong Province","award":["2018KCXTD028"],"award-info":[{"award-number":["2018KCXTD028"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Embed. Comput. Syst."],"published-print":{"date-parts":[[2022,11,30]]},"abstract":"<jats:p>\n            Falling is ranked highly among the threats in elderly healthcare, which promotes the development of automatic fall detection systems with extensive concern. With the fast development of the Internet of Things (IoT) and Artificial Intelligence (AI), camera vision-based solutions have drawn much attention for single-frame prediction and video understanding on fall detection in the elderly by using Convolutional Neural Network (CNN) and 3D-CNN, respectively. However, these methods hardly supervise the intermediate features with good accurate and efficient performance on edge devices, which makes the system difficult to be applied in practice. This work introduces a fast and lightweight video fall detection network based on a spatio-temporal joint-point model to overcome these hurdles. Instead of detecting fall motion by the traditional CNNs, we propose a Long Short-Term Memory (LSTM) model based on\n            <jats:italic>time-series joint-point features<\/jats:italic>\n            extracted from a\n            <jats:italic>pose extractor<\/jats:italic>\n            . We also introduce the increasingly mature RGB-D camera and propose 3D pose estimation network to further improve the accuracy of the system. We propose to apply tensor train decomposition on the model to reduce storage and computational consumption so the deployment on edge devices can to realized. Experiments are conducted to verify the proposed framework. For fall detection task, the proposed video fall detection framework achieves a high sensitivity of 98.46% on Multiple Cameras Fall, 100% on UR Fall, and 98.01% on NTU RGB-D 120. For pose estimation task, our 2D model attains 73.3 mAP in the COCO keypoint challenge, which outperforms the OpenPose by 8%. Our 3D model attains 78.6% mAP on NTU RGB-D dataset with 3.6\u00d7 faster speed than OpenPose.\n          <\/jats:p>","DOI":"10.1145\/3531004","type":"journal-article","created":{"date-parts":[[2022,4,30]],"date-time":"2022-04-30T11:12:57Z","timestamp":1651317177000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["A Fall Detection Network by 2D\/3D Spatio-temporal Joint Models with Tensor Compression on Edge"],"prefix":"10.1145","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4044-5886","authenticated-orcid":false,"given":"Shuwei","family":"Li","sequence":"first","affiliation":[{"name":"Southern University of Science and Technology, Shenzhen, Guangdong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0693-3904","authenticated-orcid":false,"given":"Changhai","family":"Man","sequence":"additional","affiliation":[{"name":"Southern University of Science and Technology, Shenzhen, Guangdong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4722-2367","authenticated-orcid":false,"given":"Ao","family":"Shen","sequence":"additional","affiliation":[{"name":"Southern University of Science and Technology, Shenzhen, Guangdong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9866-6588","authenticated-orcid":false,"given":"Ziyi","family":"Guan","sequence":"additional","affiliation":[{"name":"Southern University of Science and Technology, Shenzhen, Guangdong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2527-6778","authenticated-orcid":false,"given":"Wei","family":"Mao","sequence":"additional","affiliation":[{"name":"Southern University of Science and Technology, Shenzhen, Guangdong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8805-1467","authenticated-orcid":false,"given":"Shaobo","family":"Luo","sequence":"additional","affiliation":[{"name":"Southern University of Science and Technology, Shenzhen, Guangdong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2617-2380","authenticated-orcid":false,"given":"Rumin","family":"Zhang","sequence":"additional","affiliation":[{"name":"Southern University of Science and Technology, Shenzhen, Guangdong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2674-4118","authenticated-orcid":false,"given":"Hao","family":"Yu","sequence":"additional","affiliation":[{"name":"Southern University of Science and Technology, Shenzhen, Guangdong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,12,12]]},"reference":[{"key":"e_1_3_1_2_2","first-page":"39","volume-title":"Proceedings of the Machine Learning for Health Workshop","author":"Asif Umar","year":"2020","unstructured":"Umar Asif, Benjamin Mashford, Stefan Von Cavallar, Shivanthan Yohanandan, Subhrajit Roy, Jianbin Tang, and Stefan Harrer. 2020. Privacy preserving human fall detection using video data. In Proceedings of the Machine Learning for Health Workshop. 39\u201351."},{"key":"e_1_3_1_3_2","article-title":"Multiple Cameras Fall Dataset","volume":"1350","author":"Auvinet Edouard","year":"2010","unstructured":"Edouard Auvinet, Caroline Rougier, Jean Meunier, Alain St-Arnaud, and Jacqueline Rousseau. 2010. Multiple Cameras Fall Dataset. Technical report. DIRO-Universit\u00e9 de Montr\u00e9al, Tech. Rep. 1350.","journal-title":"DIRO-Universit\u00e9 de Montr\u00e9al, Tech. Rep."},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/GCCE.2017.8229325"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2014.06.045"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.2978249"},{"key":"e_1_3_1_7_2","article-title":"OpenPose: Realtime multi-person 2D pose estimation using part affinity fields","author":"Cao Zhe","year":"2018","unstructured":"Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2018. OpenPose: Realtime multi-person 2D pose estimation using part affinity fields. arXiv preprint arXiv:1812.08008 (2018).","journal-title":"arXiv preprint arXiv:1812.08008"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2010.5650127"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.23919\/DATE48585.2020.9116533"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3381805"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/3470660"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.368"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2017.2697077"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2018.08.031"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCITECHN.2008.4803020"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.3390\/s21030947"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/MIM.2017.8121952"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.322"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1002\/sapm192761164"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1186\/1475-925X-12-66"},{"key":"e_1_3_1_21_2","first-page":"1","article-title":"Detection and multi-class classification of falling in elderly people by deep belief network algorithms","author":"Jahanjoo Anice","year":"2020","unstructured":"Anice Jahanjoo, Marjan Naderan, and Mohammad Javad Rashti. 2020. Detection and multi-class classification of falling in elderly people by deep belief network algorithms. J. Amb. Intell. Human. Comput. (2020), 1\u201321.","journal-title":"J. Amb. Intell. Human. Comput."},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01252-6_26"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2014.09.005"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1109\/BSN.2009.46"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.00718"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2019.2916873"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2018.2808281"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.288"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2011.09.037"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2017.10.033"},{"key":"e_1_3_1_32_2","doi-asserted-by":"crossref","DOI":"10.1155\/2017\/9474806","article-title":"Vision-based fall detection with convolutional neural networks","author":"N\u00fa\u00f1ez-Marcos Adri\u00e1n","year":"2017","unstructured":"Adri\u00e1n N\u00fa\u00f1ez-Marcos, Gorka Azkune, and Ignacio Arganda-Carreras. 2017. Vision-based fall detection with convolutional neural networks. Wirel. Commun. Mob. Comput. (2017).","journal-title":"Wirel. Commun. Mob. Comput."},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.3390\/s19040866"},{"key":"e_1_3_1_34_2","volume-title":"WHO Global Report on Falls Prevention in Older Age","author":"Organization World Health","year":"2008","unstructured":"World Health Organization, World Health Organization. Ageing, and Life Course Unit. 2008. WHO Global Report on Falls Prevention in Older Age. World Health Organization."},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1137\/090752286."},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01264-9_17"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v31i1.11212"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF02289464."},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICRTIT.2011.5972252"},{"key":"e_1_3_1_40_2","first-page":"1228","volume-title":"Proceedings of the IEEE International Conference on Bioinformatics and Biomedicine (BIBM)","author":"Wang Kun","year":"2016","unstructured":"Kun Wang, Guitao Cao, Dan Meng, Weiting Chen, and Wenming Cao. 2016. Automatic fall detection of human in video using combination of features. In Proceedings of the IEEE International Conference on Bioinformatics and Biomedicine (BIBM). IEEE, 1228\u20131233."},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-015-2698-y"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC46164.2021.9629840"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICMIC.2016.7804195"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1145\/3464941"}],"container-title":["ACM Transactions on Embedded Computing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3531004","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3531004","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T18:09:27Z","timestamp":1750183767000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3531004"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,30]]},"references-count":43,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2022,11,30]]}},"alternative-id":["10.1145\/3531004"],"URL":"https:\/\/doi.org\/10.1145\/3531004","relation":{},"ISSN":["1539-9087","1558-3465"],"issn-type":[{"value":"1539-9087","type":"print"},{"value":"1558-3465","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,30]]},"assertion":[{"value":"2021-07-11","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-03-26","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-12-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}