{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T06:43:54Z","timestamp":1776840234267,"version":"3.51.2"},"reference-count":34,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2020,10,27]],"date-time":"2020-10-27T00:00:00Z","timestamp":1603756800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010667","name":"H2020 Industrial Leadership","doi-asserted-by":"publisher","award":["732242"],"award-info":[{"award-number":["732242"]}],"id":[{"id":"10.13039\/100010667","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The problem of performing remote biomedical measurements using just a video stream of a subject face is called remote photoplethysmography (rPPG). The aim of this work is to propose a novel method able to perform rPPG using single-photon avalanche diode (SPAD) cameras. These are extremely accurate cameras able to detect even a single photon and are already used in many other applications. Moreover, a novel method that mixes deep learning and traditional signal analysis is proposed in order to extract and study the pulse signal. Experimental results show that this system achieves accurate results in the estimation of biomedical information such as heart rate, respiration rate, and tachogram. Lastly, thanks to the adoption of the deep learning segmentation method and dependability checks, this method could be adopted in non-ideal working conditions\u2014for example, in the presence of partial facial occlusions.<\/jats:p>","DOI":"10.3390\/s20216102","type":"journal-article","created":{"date-parts":[[2020,10,27]],"date-time":"2020-10-27T09:22:45Z","timestamp":1603790565000},"page":"6102","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Biometric Signals Estimation Using Single Photon Camera and Deep Learning"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4040-5742","authenticated-orcid":false,"given":"Marco","family":"Paracchini","sequence":"first","affiliation":[{"name":"Dipartimento di Informazione, Elettronica e Bioingegneria, Politecnico di Milano, 20133 Milano, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6557-2120","authenticated-orcid":false,"given":"Marco","family":"Marcon","sequence":"additional","affiliation":[{"name":"Dipartimento di Informazione, Elettronica e Bioingegneria, Politecnico di Milano, 20133 Milano, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9840-0269","authenticated-orcid":false,"given":"Federica","family":"Villa","sequence":"additional","affiliation":[{"name":"Dipartimento di Informazione, Elettronica e Bioingegneria, Politecnico di Milano, 20133 Milano, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1715-501X","authenticated-orcid":false,"given":"Franco","family":"Zappa","sequence":"additional","affiliation":[{"name":"Dipartimento di Informazione, Elettronica e Bioingegneria, Politecnico di Milano, 20133 Milano, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stefano","family":"Tubaro","sequence":"additional","affiliation":[{"name":"Dipartimento di Informazione, Elettronica e Bioingegneria, Politecnico di Milano, 20133 Milano, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,10,27]]},"reference":[{"key":"ref_1","unstructured":"Gupta, M., Konar, D., Bhattacharyya, S., and Biswas, S. (2020). An Overview of Remote Photoplethysmography Methods for Vital Sign Monitoring. Computer Vision and Machine Intelligence in Medical Image Analysis, Springer."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Paracchini, M., Marchesi, L., Pasquinelli, K., Marcon, M., Fontana, G., Gabrielli, A., and Villa, F. (2019, January 2\u20134). Remote PhotoPlethysmoGraphy Using SPAD Camera for Automotive Health Monitoring Application. Proceedings of the 2019 AEIT International Conference of Electrical and Electronic Technologies for Automotive (AEIT AUTOMOTIVE), Turin, Italy.","DOI":"10.23919\/EETA.2019.8804516"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Zhang, G., Liu, C., Ji, L., Yang, J., and Liu, C. (2016). Effect of a Percutaneous Coronary Intervention Procedure on Heart Rate Variability and Pulse Transit Time Variability: A Comparison Study Based on Fuzzy Measure Entropy. Entropy, 18.","DOI":"10.3390\/e18070246"},{"key":"ref_4","first-page":"482","article-title":"Research Advances Series Cardiovascular Neural Regulation Explored in the Frequency Domain","volume":"84","author":"Malliani","year":"1991","journal-title":"CV Neural Regul. Freq. Domain"},{"key":"ref_5","unstructured":"Rouast, P., Adam, M., Chiong, R., Cornforth, D., and Lux, E. (2017). Remote heart rate measurement using low-cost RGB face video: A technical literature review. Front. Comput. Sci., 1\u201315."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/JSEN.2015.2483565","article-title":"SPAD Figures of Merit for Photon-Counting, Photon-Timing, and Imaging Applications: A Review","volume":"16","author":"Bronzi","year":"2016","journal-title":"IEEE Sens. J."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1109\/JSTQE.2014.2341562","article-title":"100,000 Frames\/s 64 \u00d7 32 Single-Photon Detector Array for 2-D Imaging and 3-D Ranging","volume":"20","author":"Bronzi","year":"2014","journal-title":"IEEE J. Sel. Top. Quantum Electron."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"782","DOI":"10.1109\/TITS.2015.2482601","article-title":"Automotive Three-Dimensional Vision through a Single-Photon Counting SPAD Camera","volume":"17","author":"Bronzi","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"7671","DOI":"10.1364\/AO.41.007671","article-title":"Three-dimensional imaging laser radar with a photon-counting avalanche photodiode array and microchip laser","volume":"41","author":"Albota","year":"2002","journal-title":"Appl. Opt."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"529","DOI":"10.3181\/00379727-37-9630","article-title":"Photoelectric Plethysmography of the Fingers and Toes in Man","volume":"37","author":"Hertzman","year":"1937","journal-title":"Proc. Soc. Exp. Biol. Med."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"037005","DOI":"10.1117\/1.JBO.17.3.037005","article-title":"Use of ambient light in remote photoplethysmographic systems: Comparison between a high-performance camera and a low-cost webcam","volume":"17","author":"Sun","year":"2012","journal-title":"J. Biomed. Opt."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1364\/OE.16.021434","article-title":"Remote plethysmographic imaging using ambient light","volume":"16","author":"Verkruysse","year":"2008","journal-title":"Opt. Express"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"474","DOI":"10.1055\/s-0034-1398530","article-title":"Facial video-based photoplethysmography to detect HRV at rest","volume":"36","author":"Moreno","year":"2015","journal-title":"Int. J. Sport. Med."},{"key":"ref_14","unstructured":"Rouast, P.V., Adam, M.P., Dorner, V., and Lux, E. (2016, January 22\u201324). Remote photoplethysmography: Evaluation of contactless heart rate measurement in an information systems setting. Proceedings of the Applied Informatics and Technology Innovation Conference, Newcastle, Australia."},{"key":"ref_15","unstructured":"Vieira Moco, A. (2019). Towards Photoplethysmographic Imaging: Modeling, Experiments and Applications. [Ph.D. Thesis, Department of Electrical Engineering]."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1934","DOI":"10.1088\/0967-3334\/37\/11\/1934","article-title":"Relationships between heart-rate variability and pulse-rate variability obtained from video-PPG signal using ZCA","volume":"37","author":"Iozzia","year":"2016","journal-title":"Physiol. Meas."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2878","DOI":"10.1109\/TBME.2013.2266196","article-title":"Robust pulse rate from chrominance-based rPPG","volume":"60","author":"Jeanne","year":"2013","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"McDuff, D., Estepp, J.R., Piasecki, A.M., and Blackford, E.B. (2015, January 25\u201329). A survey of remote optical photoplethysmographic imaging methods. Proceedings of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Milan, Italy.","DOI":"10.1109\/EMBC.2015.7319857"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1515\/bmt-2017-0119","article-title":"Cardiovascular assessment by imaging photoplethysmography\u2014A review","volume":"63","author":"Zaunseder","year":"2018","journal-title":"Biomed. Eng. Biomed. Tech."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.bspc.2017.07.004","article-title":"Heart rate estimation using facial video: A review","volume":"38","author":"Hassan","year":"2017","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"101870","DOI":"10.1016\/j.bspc.2020.101870","article-title":"A review of machine learning techniques in photoplethysmography for the non-invasive cuff-less measurement of blood pressure","volume":"58","author":"Kyriacou","year":"2020","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Bousefsaf, F., Pruski, A., and Maaoui, C. (2019). 3D Convolutional Neural Networks for Remote Pulse Rate Measurement and Mapping from Facial Video. Appl. Sci., 9.","DOI":"10.3390\/app9204364"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Sabokrou, M., Pourreza, M., Li, X., Fathy, M., and Zhao, G. (2020). Deep-HR: Fast Heart Rate Estimation from Face Video Under Realistic Conditions. arXiv.","DOI":"10.1016\/j.eswa.2021.115596"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Kopeliovich, M., Mironenko, Y., and Petrushan, M. (2019, January 27\u201328). Architectural Tricks for Deep Learning in Remote Photoplethysmography. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision Workshop (ICCVW), Seoul, Korea.","DOI":"10.1109\/ICCVW.2019.00209"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-Net: Convolutional Networks for Biomedical Image Segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_26","unstructured":"Baldassarre, F., Gonzalez-Morin, D., and Rodes-Guirao, L. (2017). Deep-Koalarization: Image Colorization using CNNs and Inception-ResNet-v2. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1016\/j.patrec.2019.12.021","article-title":"Deep skin detection on low resolution grayscale images","volume":"131","author":"Paracchini","year":"2020","journal-title":"Pattern Recognit. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"630","DOI":"10.1109\/TBME.2005.844028","article-title":"Quantifying Errors in Spectral Estimates of HRV Due to Beat Replacement and Resampling","volume":"52","author":"Clifford","year":"2005","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/B:VISI.0000013087.49260.fb","article-title":"Robust Real-Time Face Detection","volume":"57","author":"Viola","year":"2004","journal-title":"Int. J. Comput. Vision"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1109\/TBME.1985.325532","article-title":"A Real-Time QRS Detection Algorithm","volume":"BME-32","author":"Pan","year":"1985","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1088\/0967-3334\/37\/4\/610","article-title":"An assessment of algorithms to estimate respiratory rate from the electrocardiogram and photoplethysmogram","volume":"37","author":"Charlton","year":"2016","journal-title":"Physiol. Meas."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Gudi, A., Bittner, M., Lochmans, R., and Gemert, J.V. (2019, January 27\u201328). Efficient Real-Time Camera Based Estimation of Heart Rate and Its Variability. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision Workshop (ICCVW), Seoul, Korea.","DOI":"10.1109\/ICCVW.2019.00196"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1909","DOI":"10.1007\/s10103-017-2317-4","article-title":"Effect of wavelength and beam width on penetration in light-tissue interaction using computational methods","volume":"32","author":"Ash","year":"2017","journal-title":"Lasers Med. Sci."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"743","DOI":"10.1016\/S0305-0491(97)00230-7","article-title":"Spectrophotometry of hemoglobin: Absorption spectra of bovine oxyhemoglobin, deoxyhemoglobin, carboxyhemoglobin, and methemoglobin","volume":"118","author":"Zijlstra","year":"1997","journal-title":"Comp. Biochem. Physiol.-B Biochem. Mol. Biol."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/21\/6102\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:29:00Z","timestamp":1760178540000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/21\/6102"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,27]]},"references-count":34,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2020,11]]}},"alternative-id":["s20216102"],"URL":"https:\/\/doi.org\/10.3390\/s20216102","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,27]]}}}