{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T04:23:05Z","timestamp":1773116585186,"version":"3.50.1"},"reference-count":29,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2023,8,21]],"date-time":"2023-08-21T00:00:00Z","timestamp":1692576000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100007751","name":"AGH University of Krakow","doi-asserted-by":"publisher","award":["16.16.120.773"],"award-info":[{"award-number":["16.16.120.773"]}],"id":[{"id":"10.13039\/501100007751","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Motivation: The advancement of preventive medicine and, subsequently, telemedicine drives the need for noninvasive and remote measurements in patients\u2019 natural environments. Heart rate (HR) measurements are particularly promising and extensively researched due to their quick assessment and comprehensive representation of patients\u2019 conditions. However, in scenarios such as endurance training or emergencies, where HR measurement was not anticipated and direct access to victims is limited, no method enables obtaining HR results that are suitable even for triage. Methods: This paper presents the possibility of remotely measuring of human HR from a series of in-flight videos using videoplethysmography (VPG) along with skin detection, human pose estimation and image stabilization methods. An unmanned aerial vehicle (UAV) equipped with a camera captured ten segments of video footage featuring volunteers engaged in free walking and running activities in natural sunlight. The human pose was determined using the OpenPose algorithm, and subsequently, skin areas on the face and forearms were identified and tracked in consecutive frames. Ultimately, HR was estimated using several VPG methods: the green channel (G), green-red difference (GR), excess green (ExG), independent component analysis (ICA), and a plane orthogonal to the skin (POS). Results: When compared to simultaneous readings from a reference ECG-based wearable recorder, the root-mean-squared error ranged from 17.7 (G) to 27.7 (POS), with errors of less than 3.5 bpm achieved for the G and GR methods. Conclusions: These results demonstrate the acceptable accuracy of touchless human pulse measurement with the accompanying UAV-mounted camera. The method bridges the gap between HR-transmitting wearables and emergency HR recorders, and it has the potential to be advantageous in training or rescue scenarios in mountain, water, disaster, or battlefield settings.<\/jats:p>","DOI":"10.3390\/s23167297","type":"journal-article","created":{"date-parts":[[2023,8,21]],"date-time":"2023-08-21T09:07:16Z","timestamp":1692608836000},"page":"7297","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Touchless Heart Rate Monitoring from an Unmanned Aerial Vehicle Using Videoplethysmography"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4705-5335","authenticated-orcid":false,"given":"Anna","family":"Paj\u0105k","sequence":"first","affiliation":[{"name":"Department of Biocybernetics and Biomedical Engineering, AGH University of Krakow, 30 Mickiewicz Ave., 30-059 Krakow, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6607-0624","authenticated-orcid":false,"given":"Jaromir","family":"Przyby\u0142o","sequence":"additional","affiliation":[{"name":"Department of Biocybernetics and Biomedical Engineering, AGH University of Krakow, 30 Mickiewicz Ave., 30-059 Krakow, Poland"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5986-3247","authenticated-orcid":false,"given":"Piotr","family":"Augustyniak","sequence":"additional","affiliation":[{"name":"Department of Biocybernetics and Biomedical Engineering, AGH University of Krakow, 30 Mickiewicz Ave., 30-059 Krakow, Poland"}]}],"member":"1968","published-online":{"date-parts":[[2023,8,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"7831","DOI":"10.3390\/s140507831","article-title":"Seamless Tracing of Human Behavior Using Complementary Wearable and House-Embedded Sensors","volume":"14","author":"Augustyniak","year":"2014","journal-title":"Sensors"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1662","DOI":"10.1166\/jmihi.2015.1627","article-title":"Turning Domestic Appliances Into a Sensor Network for Monitoring of Activities of Daily Living","volume":"5","author":"Augustyniak","year":"2015","journal-title":"J. Med. Imaging Health Inform."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"10762","DOI":"10.1364\/OE.18.010762","article-title":"Non-contact, automated cardiac pulse measurements using video imaging and blind source separation","volume":"18","author":"Poh","year":"2010","journal-title":"Opt. Express"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1515\/mms-2016-0052","article-title":"Distant measurements of plethysmographic signal in various lighting conditions using configurable frame-rate camera","volume":"23","author":"Augustyniak","year":"2016","journal-title":"Metrol. Meas. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Przyby\u0142o, J. (2019). Continuous Distant Measurement of the User\u2019s Heart Rate in Human-Computer Interaction Applications. Sensors, 19.","DOI":"10.3390\/s19194205"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Cao, Z., Hidalgo, G., Simon, T., Wei, S., and Sheikh, Y. (2018). OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. arXiv.","DOI":"10.1109\/CVPR.2017.143"},{"key":"ref_7","unstructured":"(2023, April 29). Available online: https:\/\/www.mathworks.com\/help\/vision\/ug\/multiple-objecttracking.html."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1023","DOI":"10.1088\/1361-6579\/aa6d02","article-title":"Robust heart rate from fitness videos","volume":"38","author":"Wang","year":"2017","journal-title":"Physiol. Meas."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"M\u00f6sch, L., Barz, I., M\u00fcller, A., Pereira, C.B., Moormann, D., Czaplik, M., and Follmann, A. (2023). For Heart Rate Assessments from Drone Footage in Disaster Scenarios. Bioengineering, 10.","DOI":"10.3390\/bioengineering10030336"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2878","DOI":"10.1109\/TBME.2013.2266196","article-title":"Robust Pulse Rate From Chrominance-Based rPPG","volume":"60","author":"Jeanne","year":"2013","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1479","DOI":"10.1109\/TBME.2016.2609282","article-title":"Algorithmic Principles of Remote PPG","volume":"64","author":"Wang","year":"2017","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_12","first-page":"1","article-title":"Remote monitoring of cardiorespiratory signals from a hovering unmanned aerial vehicle","volume":"16","author":"Perera","year":"2017","journal-title":"Biomed. Eng. Online"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Yu, Z., Shen, Y., Shi, J., Zhao, H., Torr, P.H., and Zhao, G. (2022, January 19\u201320). PhysFormer: Facial video-based physiological measurement with temporal difference transformer. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Washington, DC, USA.","DOI":"10.1109\/CVPR52688.2022.00415"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1016\/j.aiopen.2022.10.001","article-title":"A Survey of Transformers","volume":"3","author":"Lin","year":"2021","journal-title":"AI Open"},{"key":"ref_15","unstructured":"Kolesnikov, A., Dosovitskiy, A., Weissenborn, D., Heigold, G., Uszkoreit, J., Beyer, L., Minderer, M., Dehghani, M., Houlsby, N., and Gelly, S. (2021). An Image is Worth 16 \u00d7 16 Words: Transformers for Image Recognition at Scale. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2409","DOI":"10.1109\/TIP.2019.2947204","article-title":"RhythmNet: End-to-End Heart Rate Estimation From Face via Spatial-Temporal Representation","volume":"29","author":"Niu","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1109\/T-AFFC.2011.25","article-title":"A Multimodal Database for Affect Recognition and Implicit Tagging","volume":"3","author":"Soleymani","year":"2012","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Girard, J., Wu, Y., Zhang, X., Liu, P., Ciftci, U., Canavan, S., Reale, M., Horowitz, A., and Yang, H. (2016, January 17\u201319). Multimodal Spontaneous Emotion Corpus for Human Behavior Analysis. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Juan, PR, USA.","DOI":"10.1109\/CVPR.2016.374"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Li, X., Alikhani, I., Shi, J., Seppanen, T., Junttila, J., Majamaa-Voltti, K., Tulppo, M., and Zhao, G. (2018, January 15\u201319). The OBF Database: A Large Face Video Database for Remote Physiological Signal Measurement and Atrial Fibrillation Detection. Proceedings of the 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), Xi\u2019an, China.","DOI":"10.1109\/FG.2018.00043"},{"key":"ref_20","unstructured":"\u0160petl\u00edk, R., Franc, V., and Matas, J. (2018, January 3\u20136). Visual heart rate estimation with convolutional neural network. Proceedings of the British Machine Vision Conference, Newcastle, UK."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Stricker, R., M\u00fcller, S., and Gross, H.M. (2014, January 25\u201329). Non-contact video-based pulse rate measurement on a mobile service robot. Proceedings of the 23rd IEEE International Symposium on Robot and Human Interactive Communication, Edinburgh, UK.","DOI":"10.1109\/ROMAN.2014.6926392"},{"key":"ref_22","unstructured":"Heusch, G., Anjos, A., and Marcel, S. (2017). A Reproducible Study on Remote Heart Rate Measurement. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Chen, W., and McDuff, D. (2018, January 8\u201314). Deepphys: Video-based physiological measurement using convolutional attention networks. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01216-8_22"},{"key":"ref_24","first-page":"19400","article-title":"Multi-task temporal shift attention networks for on-device contactless vitals measurement","volume":"33","author":"Liu","year":"2020","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Estepp, J.R., Blackford, E.B., and Meier, C.M. (2014, January 5\u20138). Recovering pulse rate during motion artifact with a multi-imager array for non-contact imaging photoplethysmography. Proceedings of the 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC), San Diego, CA, USA.","DOI":"10.1109\/SMC.2014.6974121"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kr\u00f3lak, A. (2017, January 20\u201322). Influence of skin tone on efficiency of vision-based heart rate estimation. Proceedings of the Recent Developments and Achievements in Biocybernetics and Biomedical Engineering: Proceedings of the 20th Polish Conference on Biocybernetics and Biomedical Engineering, Krak\u00f3w, Poland.","DOI":"10.1007\/978-3-319-66905-2_4"},{"key":"ref_27","unstructured":"(2023, July 24). Available online: https:\/\/www.polar.com\/en\/img\/static\/whitepapers\/pdf\/polar-h10-heart-rate-sensor-whitepaper.pdf\/."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Schaffarczyk, M., Rogers, B., Reer, R., and Gronwald, T. (2022). Validity of the polar H10 sensor for heart rate variability analysis during resting state and incremental exercise in recreational men and women. Sensors, 22.","DOI":"10.3390\/s22176536"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Topiwala, A., Al-Zogbi, L., Fleiter, T., and Krieger, A. (2019, January 28\u201330). Adaptation and Evaluation of Deep Leaning Techniques for Skin Segmentation on Novel Abdominal Dataset. Proceedings of the 2019 IEEE 19th International Conference on Bioinformatics and Bioengineering (BIBE), IEEE, Athens, Greece.","DOI":"10.1109\/BIBE.2019.00141"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/16\/7297\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:38:31Z","timestamp":1760128711000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/16\/7297"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,21]]},"references-count":29,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2023,8]]}},"alternative-id":["s23167297"],"URL":"https:\/\/doi.org\/10.3390\/s23167297","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,21]]}}}