{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,14]],"date-time":"2026-05-14T14:43:43Z","timestamp":1778769823729,"version":"3.51.4"},"reference-count":35,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2023,2,4]],"date-time":"2023-02-04T00:00:00Z","timestamp":1675468800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006769","name":"Russian Science Foundation","doi-asserted-by":"publisher","award":["18-71-10065"],"award-info":[{"award-number":["18-71-10065"]}],"id":[{"id":"10.13039\/501100006769","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006769","name":"Russian Science Foundation","doi-asserted-by":"publisher","award":["FFZF-2022-0005"],"award-info":[{"award-number":["FFZF-2022-0005"]}],"id":[{"id":"10.13039\/501100006769","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Russian State Research","award":["18-71-10065"],"award-info":[{"award-number":["18-71-10065"]}]},{"name":"Russian State Research","award":["FFZF-2022-0005"],"award-info":[{"award-number":["FFZF-2022-0005"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>One of the most effective vital signs of health conditions is blood pressure. It has such an impact that changes your state from completely relaxed to extremely unpleasant, which makes the task of blood pressure monitoring a main procedure that almost everyone undergoes whenever there is something wrong or suspicious with his\/her health condition. The most popular and accurate ways to measure blood pressure are cuff-based, inconvenient, and pricey, but on the bright side, many experimental studies prove that changes in the color intensities of the RGB channels represent variation in the blood that flows beneath the skin, which is strongly related to blood pressure; hence, we present a novel approach to blood pressure estimation based on the analysis of human face video using hybrid deep learning models. We deeply analyzed proposed approaches and methods to develop combinations of state-of-the-art models that were validated by their testing results on the Vision for Vitals (V4V) dataset compared to the performance of other available proposed models. Additionally, we came up with a new metric to evaluate the performance of our models using Pearson\u2019s correlation coefficient between the predicted blood pressure of the subjects and their respiratory rate at each minute, which is provided by our own dataset that includes 60 videos of operators working on personal computers for almost 20 min in each video. Our method provides a cuff-less, fast, and comfortable way to estimate blood pressure with no need for any equipment except the camera of your smartphone.<\/jats:p>","DOI":"10.3390\/s23041753","type":"journal-article","created":{"date-parts":[[2023,2,6]],"date-time":"2023-02-06T02:06:43Z","timestamp":1675649203000},"page":"1753","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Neural Network Model Combination for Video-Based Blood Pressure Estimation: New Approach and Evaluation"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8568-7440","authenticated-orcid":false,"given":"Batol","family":"Hamoud","sequence":"first","affiliation":[{"name":"Information Technology and Programming Faculty, ITMO University, St. Petersburg 197101, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6503-1447","authenticated-orcid":false,"given":"Alexey","family":"Kashevnik","sequence":"additional","affiliation":[{"name":"St. Petersburg Federal Research Center of the Russian Academy of Sciences (SPC RAS), St. Petersburg 199178, Russia"},{"name":"Department of Applied Mathematics and Cybernetics, Institute of Mathematics and Information Technologies, Petrozavodsk State University (PetrSU), Petrozavodsk 185910, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8581-1333","authenticated-orcid":false,"given":"Walaa","family":"Othman","sequence":"additional","affiliation":[{"name":"Information Technology and Programming Faculty, ITMO University, St. Petersburg 197101, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9264-9127","authenticated-orcid":false,"given":"Nikolay","family":"Shilov","sequence":"additional","affiliation":[{"name":"St. Petersburg Federal Research Center of the Russian Academy of Sciences (SPC RAS), St. Petersburg 199178, Russia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"e2160","DOI":"10.1097\/MD.0000000000002160","article-title":"High Blood Pressure and All-Cause and Cardiovascular DiseaseMortalities in Community-Dwelling Older Adults","volume":"94","author":"Wu","year":"2015","journal-title":"Medicine"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Jain, M., Deb, S., and Subramanyam, A.V. (2016, January 21\u201323). Face video based touchless blood pressure and heart rate estimation. Proceedings of the 2016 IEEE 18th International Workshop on Multimedia Signal Processing (MMSP), Montreal, QC, Canada.","DOI":"10.1109\/MMSP.2016.7813389"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Secerbegovic, A., Bergsland, J., Halvorsen, P.S., Suljanovic, N., Mujcic, A., and Balasingham, I. (2016, January 13\u201316). Blood pressure estimation using video plethysmography. Proceedings of the 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI), Prague, Czech Republic.","DOI":"10.1109\/ISBI.2016.7493307"},{"key":"ref_4","first-page":"195","article-title":"A review on wearable photoplethysmography sensors and their potential future applications in health care","volume":"4","author":"Castaneda","year":"2018","journal-title":"Int. J. Biosens. Bioelectron."},{"key":"ref_5","unstructured":"O\u2019Shea, K., and Nash, R. (2015). An Introduction to Convolutional Neural Networks. arXiv, Available online: https:\/\/arxiv.org\/abs\/1511.08458."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long short-term memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"21434","DOI":"10.1364\/OE.16.021434","article-title":"Remote plethysmographic imaging using ambient light","volume":"16","author":"Verkruysse","year":"2008","journal-title":"Opt. Express"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"e008857","DOI":"10.1161\/CIRCIMAGING.119.008857","article-title":"Smartphone-Based Blood Pressure Measurement Using Transdermal Optical Imaging Technology","volume":"12","author":"Luo","year":"2019","journal-title":"Circ. Cardiovasc. Imaging"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Hyv\u00e4rinen, A., Hurri, J., and Hoyer, P.O. (2009). Natural Image Statistics: A Probabilistic Approach to Early Computational Vision, Springer.","DOI":"10.1007\/978-1-84882-491-1"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1007\/s10015-018-0450-1","article-title":"Contactless blood pressure sensing using facial visible and thermal images","volume":"23","author":"Oiwa","year":"2018","journal-title":"Artif. Life Robot."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Iuchi, K., Miyazaki, R., Cardoso, G.C., Ogawa-Ochiai, K., and Tsumura, N. (2022, January 19\u201324). Remote Estimation of Continuous Blood Pressure by a Convolutional Neural Network Trained on Spatial Patterns of Facial Pulse Waves. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, New Orleans, LA, USA.","DOI":"10.1109\/CVPRW56347.2022.00232"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wu, B.F., Chiu, L.W., Wu, Y.C., Lai, C.C., and Chu, P.H. (2022, January 18\u201324). Contactless Blood Pressure Measurement via Remote Photoplethysmography With Synthetic Data Generation Using Generative Adversarial Network. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, New Orleans, LA, USA.","DOI":"10.1109\/CVPRW56347.2022.00231"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2878","DOI":"10.1109\/TBME.2013.2266196","article-title":"Robust pulse rate from chrominance-based rPPG","volume":"60","author":"Jeanne","year":"2013","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1145\/3422622","article-title":"Generative Adversarial Networks","volume":"63","author":"Goodfellow","year":"2020","journal-title":"Commun. ACM"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Schrumpf, F., Frenzel, P., Aust, C., Osterhoff, G., and Fuchs, M. (2021). Assessment of Non-Invasive Blood Pressure Prediction from PPG and rPPG Signals Using Deep Learning. Sensors, 21.","DOI":"10.3390\/s21186022"},{"key":"ref_16","first-page":"84","article-title":"ImageNet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Adv. Neural Inf.Process. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Slapni\u010dar, G., Mlakar, N., and Lu\u0161trek, M. (2019). Blood pressure estimation from photoplethysmogram using a spectro-temporal deep neural network. Sensors, 19.","DOI":"10.3390\/s19153420"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1479","DOI":"10.1109\/TBME.2016.2609282","article-title":"Algorithmic principles of remote PPG","volume":"64","author":"Wang","year":"2017","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1007\/s10916-016-0439-z","article-title":"Introducing contactless blood pressure assessment using a high speed video camera","volume":"40","author":"Jeong","year":"2016","journal-title":"J. Med. Syst."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Finkelstein, J., and Jeong, I.C. (2020, January 28\u201331). Towards Contactless Monitoring of Blood Pressure at Rest and During Exercise Using Infrared Imaging. Proceedings of the 2020 11th IEEE Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON), New York, NY, USA.","DOI":"10.1109\/UEMCON51285.2020.9298152"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Gaurav, A., Maheedhar, M., Tiwari, V.N., and Narayanan, R. (2016, January 16\u201320). Cuff-less PPG based continuous blood pressure monitoring\u2014A smartphone based approach. Proceedings of the 2016 38th annual international conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA.","DOI":"10.1109\/EMBC.2016.7590775"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Visvanathan, A., Sinha, A., and Pal, A. (2013, January 10\u201313). Estimation of blood pressure levels from reflective photoplethysmograph using smart phones. Proceedings of the 13th IEEE International Conference on BioInformatics and BioEngineering, Chania, Greece.","DOI":"10.1109\/BIBE.2013.6701568"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Revanur, A., Li, Z., Ciftci, U.A., Yin, L., and Jeni, L.A. (2021, January 11\u201317). The First Vision for Vitals (V4V) Challenge for Non-Contact Video-Based Physiological Estimation. In Proceeding of the 2021 IEEE\/CVF International Conference on Computer Vision Workshops (ICCVW), Montreal, BC, Canada.","DOI":"10.1109\/ICCVW54120.2021.00310"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Girard, J.M., Wu, Y., Zhang, X., Liu, P., Ciftci, U., Canavan, S., Reale, M., Horowitz, A., and Yang, H. (2016, January 27\u201330). Multimodal spontaneous emotion corpus for human behavior analysis. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.374"},{"key":"ref_26","unstructured":"InformedHealth.org (2022, November 29). What Is Blood Pressure and How Is It Measured?, Available online: https:\/\/www.ncbi.nlm.nih.gov\/books\/NBK279251\/."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"233","DOI":"10.7326\/0003-4819-132-3-200002010-00010","article-title":"The diastolic blood pressure in systolic hypertension","volume":"132","author":"Smulyan","year":"2000","journal-title":"Ann. Intern. Med."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1186\/s40885-017-0071-3","article-title":"Effect of respiratory pattern on automated clinical blood pressure measurement: An observational study with normotensive subjects","volume":"23","author":"Herakova","year":"2017","journal-title":"Clin. Hypertens."},{"key":"ref_29","unstructured":"Saha, R. (2018). Transfer Learning\u2014A Comparative Analysis. [Bachelor\u2019s Thesis, Kalinga Institute of Industrial Technology]. Available online: https:\/\/www.researchgate.net\/publication\/329786975_Transfer_Learning_-_A_Comparative_Analysis."},{"key":"ref_30","unstructured":"(2022, August 12). Keras Applications. Available online: https:\/\/keras.io\/api\/applications\/."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Guo, J., Zhu, X., Yang, Y., Yang, F., Lei, Z., and Li, S.Z. (2020, January 23\u201328). Towards fast, accurate and stable 3d dense face alignment. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58529-7_10"},{"key":"ref_32","unstructured":"(2022, December 03). Pearson Product-Moment Correlation. Available online: https:\/\/statistics.laerd.com\/statistical-guides\/pearson-correlation-coefficient-statistical-guide.php."},{"key":"ref_33","unstructured":"Schrumpf, F. (2022, October 24). Fabian-Sc85\/Non-Invasive-bp-Estimation-Using-Deep-Learning. Available online: https:\/\/github.com\/Fabian-Sc85\/Non-Invasive-bp-Estimation-Using-Deep-Learning."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Dietterich, T.G. (2000, January 21\u201323). Ensemble methods in machine learning. Proceedings of the International Workshop on Multiple Classifier Systems, Cagliari, Italy.","DOI":"10.1007\/3-540-45014-9_1"},{"key":"ref_35","unstructured":"Nguyen, J.D., and Duong, H. (2022, December 07). Anatomy, Head and Neck, Cheeks, Available online: https:\/\/www.ncbi.nlm.nih.gov\/books\/NBK546659\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/4\/1753\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:24:04Z","timestamp":1760120644000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/4\/1753"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,4]]},"references-count":35,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["s23041753"],"URL":"https:\/\/doi.org\/10.3390\/s23041753","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,4]]}}}