{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T13:49:38Z","timestamp":1779112178638,"version":"3.51.4"},"reference-count":35,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2022,7,29]],"date-time":"2022-07-29T00:00:00Z","timestamp":1659052800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Competitive Research of The University of Aizu, Japan"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Fitness is important in people\u2019s lives. Good fitness habits can improve cardiopulmonary capacity, increase concentration, prevent obesity, and effectively reduce the risk of death. Home fitness does not require large equipment but uses dumbbells, yoga mats, and horizontal bars to complete fitness exercises and can effectively avoid contact with people, so it is deeply loved by people. People who work out at home use social media to obtain fitness knowledge, but learning ability is limited. Incomplete fitness is likely to lead to injury, and a cheap, timely, and accurate fitness detection system can reduce the risk of fitness injuries and can effectively improve people\u2019s fitness awareness. In the past, many studies have engaged in the detection of fitness movements, among which the detection of fitness movements based on wearable devices, body nodes, and image deep learning has achieved better performance. However, a wearable device cannot detect a variety of fitness movements, may hinder the exercise of the fitness user, and has a high cost. Both body-node-based and image-deep-learning-based methods have lower costs, but each has some drawbacks. Therefore, this paper used a method based on deep transfer learning to establish a fitness database. After that, a deep neural network was trained to detect the type and completeness of fitness movements. We used Yolov4 and Mediapipe to instantly detect fitness movements and stored the 1D fitness signal of movement to build a database. Finally, MLP was used to classify the 1D signal waveform of fitness. In the performance of the classification of fitness movement types, the mAP was 99.71%, accuracy was 98.56%, precision was 97.9%, recall was 98.56%, and the F1-score was 98.23%, which is quite a high performance. In the performance of fitness movement completeness classification, accuracy was 92.84%, precision was 92.85, recall was 92.84%, and the F1-score was 92.83%. The average FPS in detection was 17.5. Experimental results show that our method achieves higher accuracy compared to other methods.<\/jats:p>","DOI":"10.3390\/s22155700","type":"journal-article","created":{"date-parts":[[2022,8,1]],"date-time":"2022-08-01T23:49:27Z","timestamp":1659397767000},"page":"5700","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":30,"title":["Fitness Movement Types and Completeness Detection Using a Transfer-Learning-Based Deep Neural Network"],"prefix":"10.3390","volume":"22","author":[{"given":"Kuan-Yu","family":"Chen","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, The University of Aizu Fukushima, Aizuwakamatsu 9658580, Japan"},{"name":"Department of Information and Communication Engineering, Chaoyang University of Technology Taichung, Taichung 41349, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7476-2468","authenticated-orcid":false,"given":"Jungpil","family":"Shin","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, The University of Aizu Fukushima, Aizuwakamatsu 9658580, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Md. Al Mehedi","family":"Hasan","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, The University of Aizu Fukushima, Aizuwakamatsu 9658580, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiun-Jian","family":"Liaw","sequence":"additional","affiliation":[{"name":"Department of Information and Communication Engineering, Chaoyang University of Technology Taichung, Taichung 41349, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Okuyama","family":"Yuichi","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, The University of Aizu Fukushima, Aizuwakamatsu 9658580, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yoichi","family":"Tomioka","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, The University of Aizu Fukushima, Aizuwakamatsu 9658580, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.pcad.2019.01.002","article-title":"Cardiorespiratory fitness and cardiovascular disease-the past, present, and future","volume":"62","author":"Kaminsky","year":"2019","journal-title":"Prog. Cardiovasc. Dis."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Myers, J., Kokkinos, P., and Nyelin, E. (2019). Physical activity, cardiorespiratory fitness, and the metabolic syndrome. Nutrients, 11.","DOI":"10.3390\/nu11071652"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Censin, J.C., Peters, S.A., Bovijn, J., Ferreira, T., Pulit, S.L., M\u00e4gi, R., Mahajan, A., Holmes, M.V., and Lindgren, C.M. (2019). Causal relationships between obesity and the leading causes of death in women and men. PLoS Genet., 15.","DOI":"10.1371\/journal.pgen.1008405"},{"key":"ref_4","first-page":"10","article-title":"Thompson Worldwide survey of fitness trends for 2019","volume":"22","author":"Walter","year":"2019","journal-title":"ACSM\u2019s Health Fit. J."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2152","DOI":"10.1016\/j.jaip.2020.04.039","article-title":"Exercise and fitness in the age of social distancing during the COVID-19 pandemic","volume":"8","author":"Nyenhuis","year":"2020","journal-title":"J. Allergy Clin. Immunol. Pract."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Joo, S.Y., Lee, C.B., Joo, N.Y., and Kim, C.R. (2021). Feasibility and effectiveness of a motion tracking-based online fitness program for office workers. Healthc. Multidiscip. Digit. Publ. Inst., 9.","DOI":"10.3390\/healthcare9050584"},{"key":"ref_7","first-page":"1206","article-title":"Injuries sustained during high intensity interval training: Are modern fitness trends contributing to increased injury rates?","volume":"59","author":"Rynecki","year":"2019","journal-title":"J. Sports Med. Phys. Fit."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Merenda, M., Astrologo, M., Laurendi, D., Romeo, V., and Della Corte, F.G. (2020, January 16\u201318). A Novel Fitness Tracker Using Edge Machine Learning. Proceedings of the 2020 IEEE 20th Mediterranean Electrotechnical Conference (MELECON), Palermo, Italy.","DOI":"10.1109\/MELECON48756.2020.9140602"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"11","DOI":"10.3390\/signals3010002","article-title":"Wearable Device for Observation of Physical Activity with the Purpose of Patient Monitoring Due to COVID-19","volume":"3","author":"Daskalos","year":"2022","journal-title":"Signals"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhao, Z., Lan, S., and Zhang, S. (2020, January 28\u201331). Human Pose Estimation based Speed Detection System for Running on Treadmill. Proceedings of the 2020 International Conference on Culture-oriented Science & Technology (ICCST), Beijing, China.","DOI":"10.1109\/ICCST50977.2020.00108"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Jeon, H., Yoon, Y., and Kim, D. (2021, January 27\u201330). Lightweight 2D human pose estimation for fitness coaching system. Proceedings of the 2021 36th International Technical Conference on Circuits\/Systems, Computers and Communications (ITC-CSCC), Jeju-si, Korea.","DOI":"10.1109\/ITC-CSCC52171.2021.9501458"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhou, J., Feng, W., Lei, Q., Liu, X., Zhong, Q., Wang, Y., Jin, J., Gui, G., and Wang, W. (2021, January 22\u201324). Skeleton-based Human Keypoints Detection and Movement Similarity Assessment for Fitness Assistance. Proceedings of the 2021 IEEE 6th International Conference on Signal and Image Processing (ICSIP), Nanjing, China.","DOI":"10.1109\/ICSIP52628.2021.9689020"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Pauzi, A.S.B., Mohd Nazri, F.B., Sani, S., Bataineh, A.M., Hisyam, M.N., Jaafar, M.H., Ab Wahab, M.N., and Mohamed, A.S.A. (2021, January 23\u201325). Movement Estimation Using Mediapipe BlazePose. Proceedings of the International Visual Informatics Conference, Kajang, Malaysia.","DOI":"10.1007\/978-3-030-90235-3_49"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Bidaran, A., and Sharifian, S. (2021, January 14\u201316). Designing an AI-assisted toolbox for fitness activity recognition based on deep CNN. Proceedings of the 2021 12th International Conference on Information and Knowledge Technology (IKT), Babol, Iran.","DOI":"10.1109\/IKT54664.2021.9685153"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ke, Y., CanNan, Z.E.N.G., XingHua, L.U., and YuHan, C.U.I. (2021, January 9\u201311). Recognition technology of human body movement behavior in fitness exercise based on transfer learning. Proceedings of the 2021 6th International Conference on Intelligent Computing and Signal Processing (ICSP), Xi\u2019an, China.","DOI":"10.1109\/ICSP51882.2021.9409004"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Tan, C., Sun, F., Kong, T., Zhang, W., Yang, C., and Liu, C. (2018, January 4\u20137). A survey on deep transfer learning. Proceedings of the International Conference on Artificial Neural Networks, Rhodes, Greece.","DOI":"10.1007\/978-3-030-01424-7_27"},{"key":"ref_17","first-page":"36","article-title":"Weight training and repetition speed","volume":"1","author":"Palmieri","year":"1987","journal-title":"J. Strength Cond. Res."},{"key":"ref_18","unstructured":"Lugaresi, C., Tang, J., Nash, H., McClanahan, C., Uboweja, E., Hays, M., Zhang, F., Chang, C.L., Yong, M.G., and Lee, J. (2019). Mediapipe: A framework for building perception pipelines. arXiv."},{"key":"ref_19","unstructured":"Bazarevsky, V., Grishchenko, I., Raveendran, K., Zhu, T., Zhang, F., and Grundmann, M. (2020). Blazepose: On-device real-time body pose tracking. arXiv."},{"key":"ref_20","first-page":"9","article-title":"Real-time vernacular sign language recognition using mediapipe and machine learning","volume":"2","author":"Halder","year":"2021","journal-title":"Int. J. Res. Publ. Rev."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Baechle, T.R., and Earle, R.W. (2019). Weight Training: Steps to Success, Human Kinetics.","DOI":"10.5040\/9781718225787"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"637","DOI":"10.1080\/00140139.2011.620177","article-title":"The relationship between general measures of fitness, passive range of motion and whole-body movement quality","volume":"56","author":"Frost","year":"2013","journal-title":"Ergonomics"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You only look once: Unified, real-time object detection. Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"831","DOI":"10.1016\/j.procs.2018.07.112","article-title":"YOLO based human movement recognition and localization","volume":"133","author":"Shinde","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_25","unstructured":"Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv."},{"key":"ref_26","unstructured":"Jiang, Z., Zhao, L., Li, S., and Jia, Y. (2020, January 14\u201319). Real-time object detection method for embedded devices. Proceedings of the Computer Vision and Pattern Recognition, Virtual."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2021, January 20\u201325). Scaled-yolov4: Scaling cross stage partial network. Proceedings of the IEEE\/cvf Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01283"},{"key":"ref_28","first-page":"579","article-title":"Multilayer perceptron and neural networks","volume":"8","author":"Popescu","year":"2009","journal-title":"WSEAS Transmovements Circuits Syst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1046","DOI":"10.1097\/MEG.0b013e3282f198a0","article-title":"Introduction to artificial neural networks","volume":"19","author":"Grossi","year":"2007","journal-title":"Eur. J. Gastroenterol. Hepatol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","article-title":"The pascal visual object classes (voc) challenge","volume":"88","author":"Everingham","year":"2009","journal-title":"Int. J. Comput. Vis."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"7377","DOI":"10.1109\/JIOT.2020.2983124","article-title":"A low-cost smart glove system for real-time fitness coaching","volume":"7","author":"Zou","year":"2022","journal-title":"IEEE Internet Things J."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Crema, C., Depari, A., Flammini, A., Sisinni, E., Haslwanter, T., and Salzmann, S. (2017, January 13\u201315). IMU-based solution for automatic detection and classification of exercises in the fitness scenario. Proceedings of the 2017 IEEE Sensors Applications Symposium (SAS), Glassboro, NJ, USA.","DOI":"10.1109\/SAS.2017.7894068"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Madanayake, P.S., Wickramasinghe, W.A.D.K., Liyanarachchi, H.P., Herath, H.M.D.M., Karunasena, A., and Perera, T.D. (2016, January 16\u201319). Fitness Mate: Intelligent workout assistant using motion detection. Proceedings of the 2016 IEEE International Conference on Information and Automation for Sustainability (ICIAfS), Galle, Sri Lanka.","DOI":"10.1109\/ICIAFS.2016.7946559"},{"key":"ref_34","unstructured":"Chen, C., Liu, K., Jafari, R., and Kehtarnavaz, N. (2014, January 26\u201330). Home-based senior fitness test measurement system using collaborative inertial and depth sensors. Proceedings of the 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Chicago, IL, USA."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1177\/014233129301500305","article-title":"Genetic algorithms and applications in system engineering: A survey","volume":"15","author":"Caponetto","year":"1993","journal-title":"Trans. Inst. Meas. Control"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/15\/5700\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:59:33Z","timestamp":1760140773000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/15\/5700"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,29]]},"references-count":35,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["s22155700"],"URL":"https:\/\/doi.org\/10.3390\/s22155700","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,29]]}}}