{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,25]],"date-time":"2025-10-25T12:36:23Z","timestamp":1761395783638,"version":"build-2065373602"},"reference-count":42,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2020,7,1]],"date-time":"2020-07-01T00:00:00Z","timestamp":1593561600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002261","name":"RFBR","doi-asserted-by":"publisher","award":["19-07-00670"],"award-info":[{"award-number":["19-07-00670"]}],"id":[{"id":"10.13039\/501100002261","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Russian State Research","award":["0073-2019-0005"],"award-info":[{"award-number":["0073-2019-0005"]}]},{"name":"Government of Russian Federation","award":["08-08"],"award-info":[{"award-number":["08-08"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Future Internet"],"abstract":"<jats:p>This paper presents a study related to human psychophysiological activity estimation based on a smartphone camera and sensors. In recent years, awareness of the human body, as well as human mental states, has become more and more popular. Yoga and meditation practices have moved from the east to Europe, the USA, Russia, and other countries, and there are a lot of people who are interested in them. However, recently, people have tried the practice but would prefer an objective assessment. We propose to apply the modern methods of computer vision, pattern recognition, competence management, and dynamic motivation to estimate the quality of the meditation process and provide the users with objective information about their practice. We propose an approach that covers the possibility of recognizing pictures of humans from a smartphone and utilizes wearable electronics to measure the user\u2019s heart rate and motions. We propose a model that allows building meditation estimation scores based on these parameters. Moreover, we propose a meditation expert network through which users can find the coach that is most appropriate for him\/her. Finally, we propose the dynamic motivation model, which encourages people to perform the practice every day.<\/jats:p>","DOI":"10.3390\/fi12070111","type":"journal-article","created":{"date-parts":[[2020,7,2]],"date-time":"2020-07-02T02:44:25Z","timestamp":1593657865000},"page":"111","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Human Psychophysiological Activity Estimation Based on Smartphone Camera and Wearable Electronics"],"prefix":"10.3390","volume":"12","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6503-1447","authenticated-orcid":false,"given":"Alexey","family":"Kashevnik","sequence":"first","affiliation":[{"name":"Computer Aided Integrated Systems Laboratory, SPIIRAS, St. Petersburg 199178, Russia"}]},{"given":"Mikhail","family":"Kruglov","sequence":"additional","affiliation":[{"name":"Information Technology and Programming Faculty, ITMO University, St. Petersburg 197101, Russia"}]},{"given":"Igor","family":"Lashkov","sequence":"additional","affiliation":[{"name":"Computer Aided Integrated Systems Laboratory, SPIIRAS, St. Petersburg 199178, Russia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0619-8620","authenticated-orcid":false,"given":"Nikolay","family":"Teslya","sequence":"additional","affiliation":[{"name":"Computer Aided Integrated Systems Laboratory, SPIIRAS, St. Petersburg 199178, Russia"}]},{"given":"Polina","family":"Mikhailova","sequence":"additional","affiliation":[{"name":"Information Technology and Programming Faculty, ITMO University, St. Petersburg 197101, Russia"}]},{"given":"Evgeny","family":"Ripachev","sequence":"additional","affiliation":[{"name":"Information Technology and Programming Faculty, ITMO University, St. Petersburg 197101, Russia"}]},{"given":"Vladislav","family":"Malutin","sequence":"additional","affiliation":[{"name":"Information Technology and Programming Faculty, ITMO University, St. Petersburg 197101, Russia"}]},{"given":"Nikita","family":"Saveliev","sequence":"additional","affiliation":[{"name":"Information Technology and Programming Faculty, ITMO University, St. Petersburg 197101, Russia"}]},{"given":"Igor","family":"Ryabchikov","sequence":"additional","affiliation":[{"name":"Information Technology and Programming Faculty, ITMO University, St. Petersburg 197101, Russia"}]}],"member":"1968","published-online":{"date-parts":[[2020,7,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/j.ctim.2019.02.004","article-title":"Prevalence, patterns, and predictors of meditation use among U.S. children: Results from the national health interview survey","volume":"43","author":"Wang","year":"2019","journal-title":"Complement. Ther. Med."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1146\/annurev-clinpsy-021815-093423","article-title":"Mindfulness meditation and psychopathology","volume":"15","author":"Wielgosz","year":"2019","journal-title":"Annu. Rev. Clin. Psychol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1016\/j.copsyc.2018.11.009","article-title":"Meditation, stress processes, and telomere biology","volume":"28","author":"Conklin","year":"2019","journal-title":"Curr. Opin. Psychol."},{"key":"ref_4","unstructured":"Ricard, M., Lutz, A., and Davidson, R.J. (2020, June 30). Neuroscience Reveals the Secrets of Meditation\u2019s Benefits. Available online: https:\/\/www.scientificamerican.com\/article\/neuroscience-reveals-the-secrets-of-meditation-s-benefits\/."},{"key":"ref_5","unstructured":"(2020, June 30). Harvard News. Available online: https:\/\/news.harvard.edu\/gazette\/story\/2011\/01\/eight-weeks-to-a-better-brain\/."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Kashevnik, A., Kruglov, M., Saveliev, N., Parfenov, V., and Maiatin, A. (2020, January 23\u201324). Motivational and personalization strategies for human activities in everyday life. Proceedings of the 26th Conference of Open Innovations Association (FRUCT), Yaroslavl, Russia.","DOI":"10.23919\/FRUCT48808.2020.9087356"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/S0167-5273(99)00066-2","article-title":"Exaggerated heart rate oscillations during two meditation techniques","volume":"70","author":"Peng","year":"1999","journal-title":"Int. J. Cardiol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1023\/A:1011343307783","article-title":"The physiological correlates of kundalini yoga meditation: A study of a yoga master","volume":"26","author":"Arambula","year":"2001","journal-title":"Appl. Psychophysiol. Biofeedback"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1038\/scientificamerican0272-84","article-title":"The physiology of meditation","volume":"226","author":"Wallace","year":"1972","journal-title":"Sci. Am."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1177\/1741826711414625","article-title":"Increased heart rate variability during nondirective meditation","volume":"19","author":"Nesvold","year":"2011","journal-title":"Eur. J. Prev. Cardiol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1326","DOI":"10.1001\/archpsyc.1975.01760280124011","article-title":"Psychophysiological correlates of meditation","volume":"32","author":"Woolfolk","year":"1975","journal-title":"Arch. Gen. Psychiatry"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1022","DOI":"10.1016\/j.cptl.2019.06.005","article-title":"Effects of mindfulness meditation on mindfulness, mental well-being, and perceived stress","volume":"11","author":"Zollars","year":"2019","journal-title":"Curr. Pharm. Teach. Learn."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1360","DOI":"10.1161\/HYP.0b013e318293645f","article-title":"Alternative approaches to lowering blood pressure","volume":"61","author":"Brook","year":"2013","journal-title":"Hypertension"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Cao, Z., Hidalgo, G., Simon, T., Wei, S.E., and Sheikh, Y. (2018). OpenPose: Realtime multi-person 2D pose estimation using part affinity fields. arXiv, Available online: https:\/\/arxiv.org\/abs\/1812.08008.","DOI":"10.1109\/CVPR.2017.143"},{"key":"ref_15","unstructured":"(2020, June 30). Medium. Available online: https:\/\/medium.com\/@amarchenkova\/convolutional-neural-network-for-classifying-yoga-poses-bf9c10686f31."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., and Fei-Fei, L. (2014, January 24\u201327). Large-scale video classification with convolutional neural networks. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.223"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1510","DOI":"10.1109\/TPAMI.2017.2712608","article-title":"Long-term temporal convolutions for action recognition","volume":"40","author":"Varol","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1109\/TPAMI.2016.2599174","article-title":"Long-term recurrent convolutional networks for visual recognition and description","volume":"39","author":"Donahue","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","first-page":"568","article-title":"Two-stream convolutional networks for action recognition in videos","volume":"1","author":"Simonyan","year":"2014","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1016\/j.image.2018.06.013","article-title":"Human activity recognition using dynamic representation and matching of skeleton feature sequences from RGB-D images","volume":"68","author":"Li","year":"2018","journal-title":"Signal. Process. Image Commun."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.imavis.2016.11.004","article-title":"Sparse composition of body poses and atomic actions for human activity recognition in RGB-D videos","volume":"59","author":"Lillo","year":"2016","journal-title":"Image Vis. Comput."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Prakash, A., Boochoon, S., Brophy, M., Acuna, D., Cameracci, E., State, G., Shapira, O., and Birchfield, S. (2019). Structured domain randomization: Bridging the reality gap by context-aware synthetic data. Eng. Comput. Sci.","DOI":"10.1109\/ICRA.2019.8794443"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Lei, Q., Du, J.-X., Zhang, H.-B., Ye, S., and Chen, D.-S. (2019). A survey of vision-based human action evaluation methods. Sensors, 19.","DOI":"10.3390\/s19194129"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Guler, R., Neverova, N., and Kokkinos, I. (2018, January 18\u201323). DensePose: Dense human pose estimation in the wild. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00762"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/j.patrec.2020.01.010","article-title":"A multimodal approach for human activity recognition based on skeleton and RGB data","volume":"131","author":"Franco","year":"2020","journal-title":"Pattern Recognit. Lett."},{"key":"ref_26","unstructured":"(2020, June 30). Find a Certified Meditation & Mindfulness Teacher Near You. Available online: https:\/\/mcleanmeditation.com\/find-a-meditation-teacher\/."},{"key":"ref_27","unstructured":"(2020, June 30). Your Partner in Fitness Every Step of the Way. Available online: https:\/\/findyourcoach.com\/."},{"key":"ref_28","unstructured":"(2020, June 30). Find the Right Tutor for You. Available online: https:\/\/www.tutorhunt.com\/."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Heylighen, F. (2013). Self-organization in communicating groups: The emergence of coordination, shared references and collective intelligence. Complexity Perspectives on Language. Communication and Society, Springer.","DOI":"10.1007\/978-3-642-32817-6_10"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1007\/978-3-540-71496-5_38","article-title":"Probabilistic models for coach finding","volume":"Volume 4425","author":"Fang","year":"2007","journal-title":"Lecture Notes in Computer Science"},{"key":"ref_31","unstructured":"Cothern, C. (1996). Value judgments in verifying and validating risk assessment models. Handbook for Environmental Risk Decision Making: Values, Perception and Ethics, London, CRC Lewis Publishers."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1230","DOI":"10.1111\/risa.12360","article-title":"Cognitive and motivational biases in decision and risk analysis","volume":"35","author":"Montibeller","year":"2015","journal-title":"Risk Anal."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Burgman, M., McBride, M., Ashton, R., Speirs-Bridge, A., Flander, L., Wintle, B., Fidler, F., Rumpff, L., and Twardy, C. (2011). Coach status and performance. PLoS ONE, 6.","DOI":"10.1371\/journal.pone.0022998"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1016\/j.chb.2016.12.033","article-title":"How gamification motivates: An experimental study of the effects of specific game design elements on psychological need satisfaction","volume":"69","author":"Sailer","year":"2016","journal-title":"Comput. Hum. Behav."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"He, K., Girshick, R., and Dollar, P. (2019, January 15\u201321). Rethinking imageNet pre-training. Proceedings of the IEEE International Conference on Computer Vision, Long Beach, CA, USA.","DOI":"10.1109\/ICCV.2019.00502"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"386","DOI":"10.1109\/TPAMI.2018.2844175","article-title":"Mask R-CNN","volume":"42","author":"He","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"740","DOI":"10.1007\/978-3-319-10602-1_48","article-title":"Microsoft COCO: Common objects in context","volume":"Volume 8693","author":"Lin","year":"2014","journal-title":"Lecture Notes in Computer Science"},{"key":"ref_38","unstructured":"Sun, X., Li, C., and Lin, S. (2018). An integral pose regression system for the ECCV2018 PoseTrack challenge. arXiv, Available online: https:\/\/arxiv.org\/abs\/1809.06079."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1325","DOI":"10.1109\/TPAMI.2013.248","article-title":"Human3.6M: Large scale datasets and predictive methods for 3D human sensing in natural environments","volume":"36","author":"Ionescu","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Liu, P., Lyu, M., King, I., and Xu, J. (2019, January 15\u201321). Selflow: Self-supervised learning of optical flow. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00470"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1007\/978-3-642-33783-3_44","article-title":"A naturalistic open source movie for optical flow evaluation","volume":"Volume 7577","author":"Butler","year":"2012","journal-title":"Lecture Notes in Computer Science"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1007\/3-540-45103-X_50","article-title":"Two-frame motion estimation based on","volume":"Volume 2749","author":"Farneb","year":"2003","journal-title":"Lecture Notes in Computer Science"}],"container-title":["Future Internet"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-5903\/12\/7\/111\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:46:09Z","timestamp":1760175969000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-5903\/12\/7\/111"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,1]]},"references-count":42,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2020,7]]}},"alternative-id":["fi12070111"],"URL":"https:\/\/doi.org\/10.3390\/fi12070111","relation":{},"ISSN":["1999-5903"],"issn-type":[{"type":"electronic","value":"1999-5903"}],"subject":[],"published":{"date-parts":[[2020,7,1]]}}}