{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,28]],"date-time":"2025-10-28T15:05:47Z","timestamp":1761663947431,"version":"build-2065373602"},"reference-count":26,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2019,7,24]],"date-time":"2019-07-24T00:00:00Z","timestamp":1563926400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["NRF-2018R1A2B6008901"],"award-info":[{"award-number":["NRF-2018R1A2B6008901"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Heart rate has been measured comfortably using a camera without the skin-contact by the development of vision-based measurement. Despite the potential of the vision-based measurement, it has still presented limited ability due to the noise of illumination variance and motion artifacts. Remote ballistocardiography (BCG) was used to estimate heart rate from the ballistocardiographic head movements generated by the flow of blood through the carotid arteries. It was robust to illumination variance but still limited in the motion artifacts such as facial expressions and voluntary head motions. Recent studies on remote BCG focus on the improvement of signal extraction by minimizing the motion artifacts. They simply estimated the heart rate from the cardiac signal using peak detection and fast fourier transform (FFT). However, the heart rate estimation based on peak detection and FFT depend on the robust signal estimation. Thus, if the cardiac signal is contaminated with some noise, the heart rate cannot be estimated accurately. This study aimed to develop a novel method to improve heart rate estimation from ballistocardiographic head movements using the unsupervised clustering. First, the ballistocardiographic head movements were measured from facial video by detecting facial points using the good-feature-to-track (GFTT) algorithm and by tracking using the Kanade\u2013Lucas\u2013Tomasi (KLT) tracker. Second, the cardiac signal was extracted from the ballistocardiographic head movements by bandpass filter and principal component analysis (PCA). The relative power density (RPD) was extracted from its power spectrum between 0.75 Hz and 2.5 Hz. Third, the unsupervised clustering was performed to construct a model to estimate the heart rate from the RPD using the dataset consisting of the RPD and the heart rate measured from electrocardiogram (ECG). Finally, the heart rate was estimated from the RPD using the model. The proposed method was verified by comparing it with previous methods using the peak detection and the FFT. As a result, the proposed method estimated a more accurate heart rate than previous methods in three experiments by levels of the motion artifacts consisting of facial expressions and voluntary head motions. The four main contributions are as follows: (1) the unsupervised clustering improved the heart rate estimation by overcoming the motion artifacts (i.e., facial expressions and voluntary head motions); (2) the proposed method was verified by comparing with the previous methods using the peak detection and the FFT; (3) the proposed method can be combined with existing vision-based measurement and can improve their performance; (4) the proposed method was tested by three experiments considering the realistic environment including the motion artifacts, thus, it increases the possibility of the non-contact measurement in daily life.<\/jats:p>","DOI":"10.3390\/s19153263","type":"journal-article","created":{"date-parts":[[2019,7,24]],"date-time":"2019-07-24T10:48:19Z","timestamp":1563965299000},"page":"3263","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["Vision-Based Measurement of Heart Rate from Ballistocardiographic Head Movements Using Unsupervised Clustering"],"prefix":"10.3390","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5173-726X","authenticated-orcid":false,"given":"Hyunwoo","family":"Lee","sequence":"first","affiliation":[{"name":"Department of Emotion Engineering, University of Sangmyung, Seoul 03016, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0035-3853","authenticated-orcid":false,"given":"Ayoung","family":"Cho","sequence":"additional","affiliation":[{"name":"Department of Emotion Engineering, University of Sangmyung, Seoul 03016, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Seongwon","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Emotion Engineering, University of Sangmyung, Seoul 03016, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mincheol","family":"Whang","sequence":"additional","affiliation":[{"name":"Department of Intelligence Informatics Engineering, University of Sangmyung, Seoul 03016, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,7,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"750","DOI":"10.1016\/S0002-8703(40)90534-8","article-title":"Applications of photoelectric plethysmography in peripheral vascular disease","volume":"20","author":"Hertzman","year":"1940","journal-title":"Am. Heart J."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.bspc.2017.07.004","article-title":"Heart rate estimation using facial video: A review","volume":"38","author":"Hassan","year":"2017","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"10762","DOI":"10.1364\/OE.18.010762","article-title":"Non-contact, automated cardiac pulse measurements using video imaging and blind source separation","volume":"18","author":"Poh","year":"2010","journal-title":"Opt. Express"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2878","DOI":"10.1109\/TBME.2013.2266196","article-title":"Robust Pulse Rate from Chrominance-Based rPPG","volume":"60","author":"Jeanne","year":"2013","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1913","DOI":"10.1088\/0967-3334\/35\/9\/1913","article-title":"Improved motion robustness of remote-PPG by using the blood volume pulse signature","volume":"35","year":"2014","journal-title":"Physiol. Meas."},{"key":"ref_6","first-page":"S903","article-title":"Noncontact measurement of heart rate using facial video illuminated under natural light and signal weighted analysis","volume":"26","author":"Yan","year":"2015","journal-title":"Biol. Med. Mater. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1152\/ajplegacy.1939.127.1.1","article-title":"Studies on the Estimation of Cardiac Output in Man, and of Abnormalities in Cardiac Function, from the heart\u2019s Recoil and the blood\u2019s Impacts; the Ballistocardiogram","volume":"127","author":"Starr","year":"1939","journal-title":"Am. J. Physiol. Leg. Content"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"858","DOI":"10.1007\/s11704-016-6243-6","article-title":"Remote heart rate measurement using low-cost RGB face video: A technical literature review","volume":"12","author":"Rouast","year":"2018","journal-title":"Front. Comput. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Balakrishnan, G., Durand, F., and Guttag, J. (2013, January 23\u201328). Detecting pulse from head motions in video. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.440"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Shan, L., and Yu, M. (2013, January 16\u201318). Video-based heart rate measurement using head motion tracking and ICA. Proceedings of the 2013 6th International Congress on Image and Signal Processing (CISP), Hangzhou, China.","DOI":"10.1109\/CISP.2013.6743978"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1049\/iet-cvi.2015.0215","article-title":"Facial video-based detection of physical fatigue for maximal muscle activity","volume":"10","author":"Haque","year":"2016","journal-title":"IET Comput. Vis."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"4544","DOI":"10.1109\/JSEN.2017.2708133","article-title":"Video-Based Heartbeat Rate Measuring Method Using Ballistocardiography","volume":"17","author":"Hassan","year":"2017","journal-title":"IEEE Sens. J."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zeiler, M.D., and Fergus, R. (2014, January 6\u201312). Visualizing and Understanding Convolutional Networks. Proceedings of the European Conference on Computer Vision (ECCV), Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10590-1_53"},{"key":"ref_14","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVRP), Las Vegas, NV, USA."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Kim, Y. (2014, January 25\u201329). Convolutional Neural Networks for Sentence Classification. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.","DOI":"10.3115\/v1\/D14-1181"},{"key":"ref_16","unstructured":"Schl\u00fcter, J., and Grill, T. (2015, January 26\u201330). Exploring Data Augmentation for Improved Singing Voice Detection with Neural Networks. Proceedings of the International Society for Music Information Retrieval Conference (ISMIR), Malaga, Spain."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Um, T.T., Babakeshizadeh, V., and Kulic, D. (2017, January 24\u201328). Exercise Motion Classification from Large-Scale Wearable Sensor Data Using Convolutional Networks. Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8206051"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lee, H., and Whang, M. (2018). Heart Rate Estimated from Body Movements at Six Degrees of Freedom by Convolutional Neural Networks. Sensors, 18.","DOI":"10.3390\/s18051392"},{"key":"ref_19","first-page":"9","article-title":"Unsupervised and semi-supervised clustering: A brief survey","volume":"1","author":"Grira","year":"2004","journal-title":"Rev. Mach. Learn. Tech. Process. Multimed. Content"},{"key":"ref_20","unstructured":"Viola, P., and Jones, M. (2001, January 8\u201314). Rapid object detection using a boosted cascade of simple features. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Kauai, HI, USA."},{"key":"ref_21","unstructured":"Tommasini, T., Fusiello, A., Trucco, E., and Roberto, V. (1998, January 23\u201325). Making good features track better. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Santa Barbara, CA, USA."},{"key":"ref_22","first-page":"4","article-title":"Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm","volume":"5","author":"Bouguet","year":"2001","journal-title":"Intel Corp."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1109\/TBME.1985.325532","article-title":"A Real-Time QRS Detection Algorithm","volume":"32","author":"Pan","year":"1985","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_24","first-page":"100","article-title":"Algorithm AS 136: A K-Means Clustering Algorithm","volume":"28","author":"Wong","year":"1979","journal-title":"J. R. Stat. Soc. Ser. C Appl. Stat."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"42","DOI":"10.1109\/T-AFFC.2011.25","article-title":"A Multimodal Database for Affect Recognition and Implicit Tagging","volume":"3","author":"Soleymani","year":"2012","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_26","unstructured":"Jones, E., Oliphant, T., and Peterson, P. (2019, March 11). SciPy: Open Source Scientific Tools for Python. Available online: http:\/\/www.scipy.org."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/15\/3263\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:09:14Z","timestamp":1760188154000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/15\/3263"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,24]]},"references-count":26,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2019,8]]}},"alternative-id":["s19153263"],"URL":"https:\/\/doi.org\/10.3390\/s19153263","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2019,7,24]]}}}