{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T04:22:39Z","timestamp":1773116559850,"version":"3.50.1"},"reference-count":37,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2019,9,27]],"date-time":"2019-09-27T00:00:00Z","timestamp":1569542400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In real world scenarios, the task of estimating heart rate (HR) using video plethysmography (VPG) methods is difficult because many factors could contaminate the pulse signal (i.e., a subjects\u2019 movement, illumination changes). This article presents the evaluation of a VPG system designed for continuous monitoring of the user\u2019s heart rate during typical human-computer interaction scenarios. The impact of human activities while working at the computer (i.e., reading and writing text, playing a game) on the accuracy of HR VPG measurements was examined. Three commonly used signal extraction methods were evaluated: green (G), green-red difference (GRD), blind source separation (ICA). A new method based on an excess green (ExG) image representation was proposed. Three algorithms for estimating pulse rate were used: power spectral density (PSD), autoregressive modeling (AR) and time domain analysis (TIME). In summary, depending on the scenario being studied, different combinations of signal extraction methods and the pulse estimation algorithm ensure optimal heart rate detection results. The best results were obtained for the ICA method: average RMSE = 6.1 bpm (beats per minute). The proposed ExG signal representation outperforms other methods except ICA (RMSE = 11.2 bpm compared to 14.4 bpm for G and 13.0 bmp for GRD). ExG also is the best method in terms of proposed success rate metric (sRate).<\/jats:p>","DOI":"10.3390\/s19194205","type":"journal-article","created":{"date-parts":[[2019,9,27]],"date-time":"2019-09-27T11:14:35Z","timestamp":1569582875000},"page":"4205","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Continuous Distant Measurement of the User\u2019s Heart Rate in Human-Computer Interaction Applications"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6607-0624","authenticated-orcid":false,"given":"Jaromir","family":"Przyby\u0142o","sequence":"first","affiliation":[{"name":"AGH University of Science and Technology, 30 Mickiewicza Ave., 30-059 Krakow, Poland"}]}],"member":"1968","published-online":{"date-parts":[[2019,9,27]]},"reference":[{"key":"ref_1","first-page":"S1","article-title":"Pulse oximetry: Its invention, contribution to medicine, and future tasks","volume":"94","author":"Aoyagi","year":"2002","journal-title":"Anesth. Analg."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1157","DOI":"10.1111\/j.1399-6576.2005.00721.x","article-title":"Respiration can be monitored by photoplethysmography with high sensitivity and specificity regardless of anaesthesia and ventilatory mode","volume":"49","author":"Nilsson","year":"2005","journal-title":"Acta Anaesthesiol. Scand."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1016\/S0950-821X(89)80005-2","article-title":"Response of skin photoplethysmography, laser Doppler flowmetry and transcutaneous oxygen tensiometry to stenosis-induced reductions in limb blood flow","volume":"3","author":"Kvernebo","year":"1989","journal-title":"Eur. J. Vasc. Surg."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1088\/0967-3334\/23\/3\/309","article-title":"Validation of a device to measure arterial pulse wave velocity by a photoplethysmographic method","volume":"23","author":"Loukogeorgakis","year":"2002","journal-title":"Physiol. Meas."},{"key":"ref_5","first-page":"35","article-title":"The use of light reflection rheography in diagnosing venous disease and arterial microcirculation","volume":"41","author":"Incze","year":"2003","journal-title":"Rom. J. Intern. Med."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1054\/bjps.2000.3359","article-title":"The use of the photoplethysmograph to monitor the training of a cross-leg free flap prior to division","volume":"53","author":"Jones","year":"2000","journal-title":"Br. J. Plast. Surg."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1016\/S0008-6363(98)00067-4","article-title":"Fifteen years experience with finger arterial pressure monitoring: Assessment of the technology","volume":"38","author":"Imholz","year":"1998","journal-title":"Cardiovasc. Res."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1660","DOI":"10.1093\/brain\/awg158","article-title":"Different patterns of parasympathetic activation in uni- and bilateral migraineurs","volume":"126","author":"Avnon","year":"2003","journal-title":"Brain"},{"key":"ref_9","first-page":"696324","article-title":"Development and validation of a smartphone heart rate acquisition application for health promotion and wellness telehealth applications","volume":"2012","author":"Gregoski","year":"2012","journal-title":"Int. J. Telemed. Appl."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"R1","DOI":"10.1088\/0967-3334\/28\/3\/R01","article-title":"Photoplethysmography and its application in clinical physiological measurement","volume":"28","author":"Allen","year":"2007","journal-title":"Physiol. Meas."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1016\/j.bspc.2014.03.004","article-title":"Review","volume":"13","author":"Kranjec","year":"2014","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"21434","DOI":"10.1364\/OE.16.021434","article-title":"Remote plethysmographic imaging using ambient light","volume":"16","author":"Verkruysse","year":"2008","journal-title":"Opt. Express"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1016\/j.measurement.2017.01.007","article-title":"Webcam-based, non-contact, real-time measurement for the physiological parameters of drivers","volume":"100","author":"Zhang","year":"2017","journal-title":"Measurement"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1023","DOI":"10.1088\/1361-6579\/aa6d02","article-title":"Robust heart rate from fitness videos","volume":"38","author":"Wang","year":"2017","journal-title":"Physiol. Meas."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"McDuff, D.J., Hernandez, J., Gontarek, S., and Picard, R.W. (2016, January 7\u201312). COGCAM: Contact-free Measurement of Cognitive Stress During Computer Tasks with a Digital Camera. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, San Jose, CA, USA.","DOI":"10.1145\/2858036.2858247"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1109\/TBME.2015.2476337","article-title":"Photoplethysmography Revisited: From Contact to Noncontact, From Point to Imaging","volume":"63","author":"Sun","year":"2016","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"10762","DOI":"10.1364\/OE.18.010762","article-title":"Non-contact, automated cardiac pulse measurements using video imaging and blind source separation","volume":"18","author":"Poh","year":"2010","journal-title":"Opt. Express"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1109\/TBME.2010.2086456","article-title":"Advancements in noncontact, multiparameter physiological measurements using a webcam","volume":"58","author":"Poh","year":"2011","journal-title":"IEEE Trans Biomed. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Li, X., Chen, J., Zhao, G., and Pietikainen, M. (2014, January 24\u201327). Remote heart rate measurement from face videos under realistic situations. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.543"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Balakrishnan, G., Durand, F., and Guttag, J. (2013, January 23\u201328). Detecting Pulse from Head Motions in Video. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.440"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"045001","DOI":"10.1088\/2057-1976\/aabd09","article-title":"Pulse rate estimation using imaging photoplethysmography: Generic framework and comparison of methods on a publicly available dataset","volume":"4","author":"Unakafov","year":"2018","journal-title":"Biomed. Phys. Eng. Express"},{"key":"ref_22","unstructured":"H\u00fclsbusch, M. (2008). An image-based functional method for opto-electronic detection of skin-perfusion. [Ph.D. Thesis, RWTH Aachen University]."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1515\/mms-2016-0052","article-title":"Distant Measurement of Plethysmographic Signal in Various Lighting Conditions Using Configurable Frame-Rate Camera","volume":"23","author":"Augustyniak","year":"2016","journal-title":"Metrol. Meas. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Gong, S., McKenna, S.J., and Psarrou, A. (2000). Dynamic Vision: From Images to Face Recognition, Imperial College Press. [1st ed.].","DOI":"10.1142\/p155"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cviu.2015.03.015","article-title":"A Survey on Face Detection in the Wild","volume":"138","author":"Zafeiriou","year":"2015","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_26","unstructured":"Zhang, C., and Zhang, Z. (2019, September 27). A Survey of Recent Advances in Face Detection. Available online: https:\/\/www.microsoft.com\/en-us\/research\/publication\/a-survey-of-recent-advances-in-face-detection\/."},{"key":"ref_27","unstructured":"King, D. (2018, January 22). Dlib c++ library. Available online: http:\/\/dlib. net."},{"key":"ref_28","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of Oriented Gradients for Human Detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905), San Diego, CA, USA."},{"key":"ref_29","unstructured":"King, D.E. (2015). Max-Margin Object Detection. arXiv."},{"key":"ref_30","unstructured":"Tomasi, C., and Kanade, T. (2019, September 27). Detection and Tracking of Point Features. Available online: https:\/\/www2.cs.duke.edu\/courses\/fall17\/compsci527\/notes\/interest-points.pdf."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/B:VISI.0000013087.49260.fb","article-title":"Robust Real-Time Face Detection","volume":"57","author":"Viola","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_32","unstructured":"Shi, J., and Tomasi, C. (1993). Good Features to Track, Cornell University."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Kazemi, V., and Sullivan, J. (2014, January 24\u201327). One Millisecond Face Alignment with an Ensemble of Regression Trees. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.241"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2466","DOI":"10.1364\/BOE.6.002466","article-title":"Dynamic heart rate measurements from video sequences","volume":"6","author":"Yu","year":"2015","journal-title":"Biomed. Opt. Express"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1016\/S0893-6080(00)00026-5","article-title":"Independent Component Analysis: Algorithms and Applications","volume":"13","author":"Oja","year":"2000","journal-title":"Neural Netw."},{"key":"ref_36","first-page":"149","article-title":"Greenness identification based on HSV decision tree","volume":"2","author":"Yang","year":"2015","journal-title":"Inf. Process. Agric."},{"key":"ref_37","unstructured":"(2019, September 26). Jaromir Przyby\u0142o. Available online: http:\/\/home.agh.edu.pl\/~przybylo\/download_en.html."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/19\/4205\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:25:18Z","timestamp":1760189118000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/19\/4205"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,9,27]]},"references-count":37,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2019,10]]}},"alternative-id":["s19194205"],"URL":"https:\/\/doi.org\/10.3390\/s19194205","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,9,27]]}}}