{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,13]],"date-time":"2026-07-13T23:26:08Z","timestamp":1783985168888,"version":"3.55.0"},"reference-count":31,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2021,5,29]],"date-time":"2021-05-29T00:00:00Z","timestamp":1622246400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"ITMO University grant","award":["618268"],"award-info":[{"award-number":["618268"]}]},{"DOI":"10.13039\/501100002261","name":"Russian Foundation for Basic Research","doi-asserted-by":"publisher","award":["20-37-90118"],"award-info":[{"award-number":["20-37-90118"]}],"id":[{"id":"10.13039\/501100002261","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Russian State Research","award":["0073-2019-0005"],"award-info":[{"award-number":["0073-2019-0005"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Meditation practice is mental health training. It helps people to reduce stress and suppress negative thoughts. In this paper, we propose a camera-based meditation evaluation system, that helps meditators to improve their performance. We rely on two main criteria to measure the focus: the breathing characteristics (respiratory rate, breathing rhythmicity and stability), and the body movement. We introduce a contactless sensor to measure the respiratory rate based on a smartphone camera by detecting the chest keypoint at each frame, using an optical flow based algorithm to calculate the displacement between frames, filtering and de-noising the chest movement signal, and calculating the number of real peaks in this signal. We also present an approach to detecting the movement of different body parts (head, thorax, shoulders, elbows, wrists, stomach and knees). We have collected a non-annotated dataset for meditation practice videos consists of ninety videos and the annotated dataset consists of eight videos. The non-annotated dataset was categorized into beginner and professional meditators and was used for the development of the algorithm and for tuning the parameters. The annotated dataset was used for evaluation and showed that human activity during meditation practice could be correctly estimated by the presented approach and that the mean absolute error for the respiratory rate is around 1.75 BPM, which can be considered tolerable for the meditation application.<\/jats:p>","DOI":"10.3390\/s21113771","type":"journal-article","created":{"date-parts":[[2021,5,31]],"date-time":"2021-05-31T03:45:29Z","timestamp":1622432729000},"page":"3771","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Estimation of Motion and Respiratory Characteristics during the Meditation Practice Based on Video Analysis"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6503-1447","authenticated-orcid":false,"given":"Alexey","family":"Kashevnik","sequence":"first","affiliation":[{"name":"St. Petersburg Federal Research Center of the Russian Academy of Sciences (SPC RAS), 199178 St. Petersburg, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8581-1333","authenticated-orcid":false,"given":"Walaa","family":"Othman","sequence":"additional","affiliation":[{"name":"Information Technology and Programming Faculty, ITMO University, 197101 St. Petersburg, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Igor","family":"Ryabchikov","sequence":"additional","affiliation":[{"name":"Information Technology and Programming Faculty, ITMO University, 197101 St. Petersburg, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9264-9127","authenticated-orcid":false,"given":"Nikolay","family":"Shilov","sequence":"additional","affiliation":[{"name":"St. Petersburg Federal Research Center of the Russian Academy of Sciences (SPC RAS), 199178 St. Petersburg, Russia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/j.ctim.2019.02.004","article-title":"Prevalence, patterns, and predictors of meditation use among U.S. children: Results from the National Health Interview Survey","volume":"43","author":"Wang","year":"2019","journal-title":"Complement. Ther. Med."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1146\/annurev-clinpsy-021815-093423","article-title":"Mindfulness Meditation and Psychopathology","volume":"15","author":"Wielgosz","year":"2019","journal-title":"Annu. Rev. Clin. Psychol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1016\/j.copsyc.2018.11.009","article-title":"Meditation, stress processes, and telomere biology","volume":"28","author":"Conklin","year":"2019","journal-title":"Curr. Opin. Psychol."},{"key":"ref_4","unstructured":"(2021, May 28). Eight Weeks to a Better Brain, Harvard Gazette. Available online: https:\/\/news.harvard.edu\/gazette\/story\/2011\/01\/eight-weeks-to-a-better-brain."},{"key":"ref_5","unstructured":"Ricard, M., Lutz, A., and Davidson, R. (Scientific American, 2014). Neuroscience Reveals the Secrets of Meditation\u2019s Benefits, Scientific American."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/0163-8343(82)90026-3","article-title":"An outpatient program in behavioral medicine for chronic pain patients based on the practice of mindfulness meditation: Theoretical considerations and preliminary results","volume":"4","year":"1982","journal-title":"Gen. Hosp. Psychiatry"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lei, Q., Du, J.X., Zhang, H.B., Ye, S., and Chen, D.S. (2019). A survey of vision-based human action evaluation methods. Sensors, 19.","DOI":"10.3390\/s19194129"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Kashevnik, A., Kruglov, M., Lashkov, I., Teslya, N., Mikhailova, P., Ripachev, E., Malutin, V., Saveliev, N., and Ryabchikov, I. (2020). Human Psychophysiological Activity Estimation Based on Smartphone Camera and Wearable Electronics. Future Internet, 12.","DOI":"10.3390\/fi12070111"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Kashevnik, A., Kruglov, M., Saveliev, N., Parfenov, V., and Mayatin, A. (2020, January 23\u201325). Motivational and Personalization Strategies for Human Activities in Everyday Life. Proceedings of the Conference of Open Innovation Association, FRUCT, IEEE Computer Society, Yaroslavl, Russia.","DOI":"10.23919\/FRUCT48808.2020.9087356"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"372","DOI":"10.1109\/TMM.2008.917403","article-title":"Video-Based Human Movement Analysis and Its Application to Surveillance Systems","volume":"10","author":"Hsieh","year":"2008","journal-title":"IEEE Trans. Multimed."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Khan, M.H., Z\u00f6ller, M., Farid, M.S., and Grzegorzek, M. (2020). Marker-Based Movement Analysis of Human Body Parts in Therapeutic Procedure. Sensors, 20.","DOI":"10.3390\/s20113312"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhang, Y., An, L., Yu, T., Li, X., Li, K., and Liu, Y. (2020, January 14\u201319). 4D Association Graph for Realtime Multi-Person Motion Capture Using Multiple Video Cameras. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00140"},{"key":"ref_13","unstructured":"S\u00e1r\u00e1ndi, I., Linder, T., Arras, K.O., and Leibe, B. (2018). Synthetic Occlusion Augmentation with Volumetric Heatmaps for the 2018 ECCV PoseTrack Challenge on 3D Human Pose Estimation. arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Sun, X., Xiao, B., Liang, S., and Wei, Y. (2017). Integral Human Pose Regression. arXiv.","DOI":"10.1109\/ICCV.2017.284"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Shi, L., Zhang, Y., Cheng, J., and Lu, H. (2019, January 16\u201320). Skeleton-Based Action Recognition With Directed Graph Neural Networks. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00810"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Liu, P., Lyu, M., King, I., and Xu, J. (2019, January 16\u201320). SelFlow: Self-Supervised Learning of Optical Flow. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00470"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"427","DOI":"10.5194\/isprsannals-II-3-W5-427-2015","article-title":"Joint 3D Estimation of Vehicles and Scene Flow","volume":"II-3\/W5","author":"Menze","year":"2015","journal-title":"ISPRS Ann. Photogramm. Remote. Sens. Spat. Inf. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Butler, D.J., Wulff, J., Stanley, G.B., and Black, M.J. (2012). A Naturalistic Open Source Movie for Optical Flow Evaluation. Computer Vision\u2013ECCV 2012, Springer.","DOI":"10.1007\/978-3-642-33783-3_44"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1124","DOI":"10.1080\/08035250600612280","article-title":"An automated algorithm for determining respiratory rate by photoplethysmogram in children","volume":"95","author":"Leonard","year":"2006","journal-title":"Acta Paediatr."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Gleichauf, J., Herrmann, S., Hennemann, L., Krauss, H., Nitschke, J., Renner, P., Niebler, C., and Koelpin, A. (2021). Automated Non-Contact Respiratory Rate Monitoring of Neonates Based on Synchronous Evaluation of a 3D Time-of-Flight Camera and a Microwave Interferometric Radar Sensor. Sensors, 21.","DOI":"10.3390\/s21092959"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"139274","DOI":"10.1109\/ACCESS.2020.3012676","article-title":"A Region of Interest Selection for Vision-Based Respiratory Rate Measurement in Sleeping Scenario","volume":"8","author":"Wu","year":"2020","journal-title":"IEEE Access"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"130036","DOI":"10.1109\/ACCESS.2020.3008687","article-title":"Fusion-Based Approach for Respiratory Rate Recognition From Facial Video Images","volume":"8","author":"Fiedler","year":"2020","journal-title":"IEEE Access"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Karlen, W., Garde, A., Myers, D., Scheffer, C., Ansermino, M., and Dumont, G. (2015). Estimation of Respiratory Rate From Photoplethysmographic Imaging Videos Compared to Pulse Oximetry. IEEE J. Biomed. Health Inform., 19.","DOI":"10.1109\/JBHI.2015.2429746"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Iozzia, L., L\u00e1zaro, J., Gil, E., Cerina, L., Mainardi, L., and Laguna, P. (2017, January 24\u201327). Respiratory rate detection using a camera as contactless sensor. Proceedings of the 2017 Computing in Cardiology (CinC), Rennes, France.","DOI":"10.22489\/CinC.2017.028-317"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/JTEHM.2018.2818687","article-title":"Algorithms for Monitoring Heart Rate and Respiratory Rate From the Video of a User\u2019s Face","volume":"6","author":"Sanyal","year":"2018","journal-title":"IEEE J. Transl. Eng. Health Med."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1109\/TBME.2020.2993649","article-title":"Multispectral Video Fusion for Non-Contact Monitoring of Respiratory Rate and Apnea","volume":"68","author":"Scebba","year":"2021","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"He, K., Girshick, R., and Dollar, P. (2019, January 16\u201320). Rethinking ImageNet Pre-Training. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), Long Beach, CA, USA.","DOI":"10.1109\/ICCV.2019.00502"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wang, H., and Schmid, C. (2013, January 1\u20138). Action Recognition with Improved Trajectories. Proceedings of the 2013 IEEE International Conference on Computer Vision, Sydney, Australia.","DOI":"10.1109\/ICCV.2013.441"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1007\/s00138-017-0894-7","article-title":"Spatio-temporal elastic cuboid trajectories for efficient fight recognition using Hough forests","volume":"29","author":"Serrano","year":"2017","journal-title":"Mach. Vis. Appl."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Makowski, D., Pham, T., Lau, Z.J., Brammer, J.C., Lespinasse, F., Pham, H., Sch\u00f6lzel, C., and Chen, S.H.A. (2021). NeuroKit2: A Python toolbox for neurophysiological signal processing. Behav. Res. Methods.","DOI":"10.31234\/osf.io\/eyd62"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"094001","DOI":"10.1088\/1361-6579\/aad7e6","article-title":"Optimized breath detection algorithm in electrical impedance tomography","volume":"39","author":"Khodadad","year":"2018","journal-title":"Physiol. Meas."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/11\/3771\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:10:16Z","timestamp":1760163016000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/11\/3771"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,29]]},"references-count":31,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["s21113771"],"URL":"https:\/\/doi.org\/10.3390\/s21113771","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,29]]}}}