{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T14:11:43Z","timestamp":1753884703737,"version":"3.41.2"},"reference-count":48,"publisher":"World Scientific Pub Co Pte Ltd","issue":"07","funder":[{"name":"Ministry of Science and Technology (MOST), Taiwan, Republic of China","award":["MOST 109-2410-H-130-044"],"award-info":[{"award-number":["MOST 109-2410-H-130-044"]}]},{"name":"Technical Services of Xi\u2019an Eurasia College","award":["OYGJS-2021005"],"award-info":[{"award-number":["OYGJS-2021005"]}]},{"name":"Level General Project of Xi\u2019an Eurasia College","award":["2020GKYB001"],"award-info":[{"award-number":["2020GKYB001"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Patt. Recogn. Artif. Intell."],"published-print":{"date-parts":[[2023,6,15]]},"abstract":"<jats:p> In response to the aging trend in society and to Human Augmentation beings for home-based activities, this paper proposes an Abnormal Movement Detection system, using the common at-home movements of standing up and hand tremors while picking up items for abnormal movement verification. This can be easily applied in ordinary homes or long-term care institutions; for those living alone with limited resources, there is no longer any need to purchase expensive monitoring equipment to achieve improved quality of life. Therefore, this research collected and built the own dataset as the first important step of the study. The proposed Abnormal Movement Detection system is implemented by designing a deep learning network. Several issues, including the network architecture, the novel method of data augmentation and the scoring method of expanding the intervals between abnormality levels, are studied. For achieving the home-based real-time detection, there are four main contributions of this paper. The first is that a training dataset was collected and established: From this, the pathognomonic movement categories are easy to observe in home activities and geometric data augmentation can be used to improve the related home activity video collection. The second is the abnormal behavior detection architecture: This architecture has several important function blocks including detecting object, detecting action, inspecting abnormal movement and reminding event, using Convolutional Neural Network combined with Long Short-Term Memory ([Formula: see text]) as the core network for abnormal motion detection. With movement abnormality evaluation based on different levels, it can judge abnormal behaviors and conduct model training, performance evaluation and architecture optimization with both public domain datasets and the movement dataset collected in this research project. The third is the proliferation of new attributes in the videos: New attributes are added to the original videos through a Generative Adversarial Network (GAN), producing new training videos; the effectiveness of two different generation methods is evaluated. Finally, the algorithms developed in this paper are deployed on resource-constrained On-device Artificial Intelligence (AI). Activity videos from a total of 20 people were collected; in all, 53 videos of StandUp and 60 videos of PickUpItems were obtained to establish the training dataset. When CNN and LSTM network were added to Batch Normalization (BN), and Global Average Pooling (GAP) replaced Fully Connected (FC) layers, the accuracy rate reached 98.4%. In terms of data augmentation, geometric transformations and GAN were used to estimate the performance. The experimental results showed that the geometric transformation using brightness adjustment had the highest accuracy rate of 98.6%. Finally, the Softmax layer using Phi-Softmax\u2013tan(\u22c5) function was shown to be the best method to expand the intervals between abnormality levels. <\/jats:p>","DOI":"10.1142\/s0218001423590127","type":"journal-article","created":{"date-parts":[[2023,3,24]],"date-time":"2023-03-24T02:44:06Z","timestamp":1679625846000},"source":"Crossref","is-referenced-by-count":4,"title":["Home-Based Real-Time Abnormal Movement Detection System Deployed on On-Device Artificial Intelligence"],"prefix":"10.1142","volume":"37","author":[{"given":"Li-Hong","family":"Yan","sequence":"first","affiliation":[{"name":"School of Information Engineering, Xi\u2019an Eurasia University, Xi\u2019an, Shaanxi 710065, P.\u00a0R.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chiao-Wen","family":"Kao","sequence":"additional","affiliation":[{"name":"Department of Computer and Communication Engineering, Ming Chuan University, 5 De Ming Road, Gui Shan District, Taoyuan City 333, Taiwan, R.\u00a0O.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7302-1019","authenticated-orcid":false,"given":"Bor-Jiunn","family":"Hwang","sequence":"additional","affiliation":[{"name":"Department of Computer and Communication Engineering, Ming Chuan University, 5 De Ming Road, Gui Shan District, Taoyuan City 333, Taiwan, R.\u00a0O.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hui-Hui","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Computer and Communication Engineering, Ming Chuan University, 5 De Ming Road, Gui Shan District, Taoyuan City 333, Taiwan, R.\u00a0O.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hui-Chia","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Computer and Communication Engineering, Ming Chuan University, 5 De Ming Road, Gui Shan District, Taoyuan City 333, Taiwan, R.\u00a0O.\u00a0China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2023,4,29]]},"reference":[{"key":"S0218001423590127BIB002","first-page":"1","volume-title":"Proc. 2017 Int. Conf. Engineering and Technology (ICET)","author":"Albawi S.","year":"2017"},{"key":"S0218001423590127BIB004","first-page":"783","volume-title":"Proc. 2018 IEEE Int. Conf. Computer Vision and Pattern Recognition Workshops","author":"Anoosheh A.","year":"2018"},{"key":"S0218001423590127BIB005","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1016\/j.artmed.2019.01.005","volume":"94","author":"Arifoglu D.","year":"2019","journal-title":"Artificial Intell. Med."},{"volume-title":"Proc. 22th Int. Conf. Annu. Georgia College Student Research","year":"2020","author":"Brewer J. A.","key":"S0218001423590127BIB006"},{"key":"S0218001423590127BIB007","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1109\/TPAMI.2019.2929257","volume":"43","author":"Cao Z.","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"S0218001423590127BIB008","doi-asserted-by":"crossref","first-page":"85714","DOI":"10.1109\/ACCESS.2020.2991734","volume":"8","author":"Cao K.","year":"2020","journal-title":"IEEE Access"},{"key":"S0218001423590127BIB009","first-page":"5933","volume-title":"Proc. 2019 IEEE\/CVF Int. Conf. Computer Vision","author":"Chan C.","year":"2019"},{"key":"S0218001423590127BIB011","first-page":"8789","volume-title":"Proc. 2018 IEEE Int. Conf. Computer Vision and Pattern Recognition","author":"Choi Y.","year":"2018"},{"key":"S0218001423590127BIB013","doi-asserted-by":"crossref","first-page":"1233","DOI":"10.1145\/3123266.3127916","volume-title":"Proc. 25th ACM Int. Conf. Multimedia","author":"Ferracani A.","year":"2017"},{"key":"S0218001423590127BIB014","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/j.neucom.2018.09.013","volume":"321","author":"Frid-Adar M.","year":"2018","journal-title":"Neurocomputing"},{"key":"S0218001423590127BIB018","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1145\/3422622","volume":"63","author":"Goodfellow I.","year":"2020","journal-title":"Commun. ACM"},{"key":"S0218001423590127BIB019","first-page":"4805","volume-title":"Proc. 2019 IEEE Int. Conf. Computer Vision and Pattern Recognition","author":"Guo Y.","year":"2019"},{"key":"S0218001423590127BIB020","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1109\/ACSAT.2013.49","volume-title":"Proc. 2013 Int. Conf. Advanced Computer Science Applications and Technologies","author":"Handayani D. O. D.","year":"2013"},{"issue":"2","key":"S0218001423590127BIB021","doi-asserted-by":"crossref","first-page":"143","DOI":"10.3390\/ai1020008","volume":"1","author":"Hassani H.","year":"2020","journal-title":"AI"},{"issue":"11","key":"S0218001423590127BIB022","doi-asserted-by":"crossref","first-page":"5464","DOI":"10.1109\/TIP.2019.2916751","volume":"28","author":"He Z.","year":"2019","journal-title":"IEEE Trans. Image Process."},{"issue":"1","key":"S0218001423590127BIB023","volume":"52","author":"Hong Y.","year":"2019","journal-title":"ACM Comput. Surv."},{"key":"S0218001423590127BIB025","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1016\/j.future.2019.02.050","volume":"97","author":"Khan W. Z.","year":"2019","journal-title":"Future Gener. Comput. Syst."},{"key":"S0218001423590127BIB026","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.csbj.2018.01.001","volume":"16","author":"Komura D.","year":"2018","journal-title":"Comput. Struct. Biotechnol. J."},{"key":"S0218001423590127BIB027","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/j.jvcir.2019.01.024","volume":"59","author":"Kong Y.","year":"2019","journal-title":"J. Vis. Commun. Image Represent."},{"key":"S0218001423590127BIB028","first-page":"922","volume-title":"Proc. IEEE 19th Int. Conf. Bioinformatics and Bioengineering (BIBE)","author":"Koutli M.","year":"2019"},{"issue":"7553","key":"S0218001423590127BIB029","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"LeCun Y.","year":"2015","journal-title":"Nature"},{"key":"S0218001423590127BIB030","doi-asserted-by":"crossref","first-page":"48049","DOI":"10.1109\/ACCESS.2020.2979239","volume":"8","author":"Lee H.","year":"2020","journal-title":"IEEE Access"},{"key":"S0218001423590127BIB031","doi-asserted-by":"crossref","first-page":"5858","DOI":"10.1109\/ACCESS.2017.2696121","volume":"5","author":"Lemley J.","year":"2017","journal-title":"IEEE Access"},{"key":"S0218001423590127BIB033","first-page":"700","volume-title":"Proc. 31st Int. Conf. Neural Information Processing Systems","volume":"30","author":"Liu M. Y.","year":"2017"},{"key":"S0218001423590127BIB034","first-page":"3673","volume-title":"Proc. 2019 IEEE Int. Conf. Computer Vision and Pattern Recognition","author":"Liu M.","year":"2019"},{"key":"S0218001423590127BIB035","doi-asserted-by":"crossref","first-page":"5114","DOI":"10.1109\/TPAMI.2021.3078270","volume":"44","author":"Liu W.","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"S0218001423590127BIB036","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/j.compeleceng.2019.02.017","volume":"75","author":"Murugan B. S.","year":"2019","journal-title":"Comput. Electr. Eng."},{"key":"S0218001423590127BIB037","first-page":"49","volume-title":"J. Mach. Learn. Res., Workshop Conf. Proc.","volume":"63","author":"Nguyen K.","year":"2016"},{"key":"S0218001423590127BIB041","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/j.ijhcs.2019.05.008","volume":"131","author":"Raisamo R.","year":"2019","journal-title":"Int. J. Hum.-Comput. Stud."},{"issue":"4","key":"S0218001423590127BIB043","doi-asserted-by":"crossref","first-page":"21","DOI":"10.3390\/mti1040021","volume":"1","author":"Rubio-Tamayo J. L.","year":"2017","journal-title":"Multimodal Technol. Interact."},{"key":"S0218001423590127BIB044","first-page":"2234","volume-title":"Advances in Neural Information Processing Systems","volume":"29","author":"Salimans T.","year":"2016"},{"key":"S0218001423590127BIB045","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1007\/978-3-319-59050-9_12","volume-title":"Proc. 11th Int. Conf. Information Processing in Medical Imaging","author":"Schlegl T.","year":"2017"},{"issue":"1","key":"S0218001423590127BIB046","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/MPRV.2017.8","volume":"16","author":"Schmidt A.","year":"2017","journal-title":"IEEE Pervasive Comput."},{"key":"S0218001423590127BIB048","doi-asserted-by":"crossref","first-page":"132306","DOI":"10.1016\/j.physd.2019.132306","volume":"404","author":"Sherstinsky A.","year":"2020","journal-title":"Physica D"},{"issue":"5","key":"S0218001423590127BIB049","doi-asserted-by":"crossref","first-page":"637","DOI":"10.1109\/JIOT.2016.2579198","volume":"3","author":"Shi W.","year":"2016","journal-title":"IEEE Internet Things J."},{"issue":"1","key":"S0218001423590127BIB050","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1186\/s40537-019-0197-0","volume":"6","author":"Shorten C.","year":"2019","journal-title":"J. Big Data"},{"issue":"17","key":"S0218001423590127BIB053","doi-asserted-by":"crossref","first-page":"4755","DOI":"10.3390\/s20174755","volume":"20","author":"Szajna A.","year":"2020","journal-title":"Sensors"},{"key":"S0218001423590127BIB059","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1109\/SmartCloud.2016.18","volume-title":"Proc. IEEE 19th Int. Conf. Smart Cloud (SmartCloud)","author":"Varghese B.","year":"2016"},{"issue":"10","key":"S0218001423590127BIB060","doi-asserted-by":"crossref","first-page":"4941","DOI":"10.1109\/TIP.2019.2917283","volume":"28","author":"Xu B.","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"S0218001423590127BIB061","first-page":"1","volume-title":"Proc. 18th Int. Conf. Mobile and Ubiquitous Multimedia","author":"Yang J.","year":"2019"},{"issue":"10","key":"S0218001423590127BIB062","doi-asserted-by":"crossref","first-page":"4845","DOI":"10.1109\/TIP.2019.2914583","volume":"28","author":"Yang C.","year":"2019","journal-title":"IEEE Trans. Image Process."},{"issue":"2","key":"S0218001423590127BIB065","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1109\/TBDATA.2016.2573280","volume":"6","author":"Zhang W.","year":"2016","journal-title":"IEEE Trans. Big Data"},{"key":"S0218001423590127BIB066","first-page":"102","volume-title":"Proc. 11th Int. Conf. Mobile Ad-hoc and Sensor Networks","author":"Zhang M.","year":"2015"},{"issue":"15","key":"S0218001423590127BIB067","doi-asserted-by":"crossref","first-page":"19415","DOI":"10.1007\/s11042-017-5380-8","volume":"77","author":"Zhao L.","year":"2018","journal-title":"Multimedia Tools Appl."},{"issue":"2","key":"S0218001423590127BIB068","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1631\/FITEE.1700053","volume":"18","author":"Zheng N. N.","year":"2017","journal-title":"Front. Inf. Technol. Electron. Eng."},{"key":"S0218001423590127BIB069","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1007\/978-3-319-93040-4_28","volume-title":"Proc. Pacific-Asia Conf. Knowledge Discovery and Data Mining","author":"Zhu X.","year":"2018"},{"key":"S0218001423590127BIB070","first-page":"2223","volume-title":"Proc. 2017 IEEE Int. Conf. Computer Vision","author":"Zhu J. Y.","year":"2017"},{"key":"S0218001423590127BIB071","first-page":"2682","volume-title":"Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","author":"Li X.","year":"2019"}],"container-title":["International Journal of Pattern Recognition and Artificial Intelligence"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0218001423590127","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,7,6]],"date-time":"2023-07-06T07:25:48Z","timestamp":1688628348000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0218001423590127"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,29]]},"references-count":48,"journal-issue":{"issue":"07","published-print":{"date-parts":[[2023,6,15]]}},"alternative-id":["10.1142\/S0218001423590127"],"URL":"https:\/\/doi.org\/10.1142\/s0218001423590127","relation":{},"ISSN":["0218-0014","1793-6381"],"issn-type":[{"type":"print","value":"0218-0014"},{"type":"electronic","value":"1793-6381"}],"subject":[],"published":{"date-parts":[[2023,4,29]]},"article-number":"2359012"}}