{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T03:35:58Z","timestamp":1780976158101,"version":"3.54.1"},"reference-count":40,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2020,11,12]],"date-time":"2020-11-12T00:00:00Z","timestamp":1605139200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002347","name":"Bundesministerium f\u00fcr Bildung und Forschung","doi-asserted-by":"publisher","award":["03ZZ0482C"],"award-info":[{"award-number":["03ZZ0482C"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>The contactless estimation of vital signs using conventional color cameras and ambient light can be affected by motion artifacts and changes in ambient light. On both these problems, a multimodal 3D imaging system with an irritation-free controlled illumination was developed in this work. In this system, real-time 3D imaging was combined with multispectral and thermal imaging. Based on 3D image data, an efficient method was developed for the compensation of head motions, and novel approaches based on the use of 3D regions of interest were proposed for the estimation of various vital signs from multispectral and thermal video data. The developed imaging system and algorithms were demonstrated with test subjects, delivering a proof-of-concept.<\/jats:p>","DOI":"10.3390\/jimaging6110123","type":"journal-article","created":{"date-parts":[[2020,11,12]],"date-time":"2020-11-12T10:00:32Z","timestamp":1605175232000},"page":"123","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":29,"title":["Enhanced Contactless Vital Sign Estimation from Real-Time Multimodal 3D Image Data"],"prefix":"10.3390","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8942-4624","authenticated-orcid":false,"given":"Chen","family":"Zhang","sequence":"first","affiliation":[{"name":"Group for Quality Assurance and Industrial Image Processing, Department of Mechanical Engineering, Technische Universit\u00e4t Ilmenau, D-98693 Ilmenau, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ingo","family":"Gebhart","sequence":"additional","affiliation":[{"name":"Fraunhofer Institute for Applied Optics and Precision Engineering, D-07745 Jena, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"K\u00fchmstedt","sequence":"additional","affiliation":[{"name":"Fraunhofer Institute for Applied Optics and Precision Engineering, D-07745 Jena, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maik","family":"Rosenberger","sequence":"additional","affiliation":[{"name":"Group for Quality Assurance and Industrial Image Processing, Department of Mechanical Engineering, Technische Universit\u00e4t Ilmenau, D-98693 Ilmenau, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gunther","family":"Notni","sequence":"additional","affiliation":[{"name":"Group for Quality Assurance and Industrial Image Processing, Department of Mechanical Engineering, Technische Universit\u00e4t Ilmenau, D-98693 Ilmenau, Germany"},{"name":"Fraunhofer Institute for Applied Optics and Precision Engineering, D-07745 Jena, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,11,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"21434","DOI":"10.1364\/OE.16.021434","article-title":"Remote plethysmographic imaging using ambient light","volume":"16","author":"Verkruysse","year":"2008","journal-title":"Opt. Express"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2878","DOI":"10.1109\/TBME.2013.2266196","article-title":"Robust pulse rate from chrominance-based rPPG","volume":"60","author":"Jeanne","year":"2013","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1124","DOI":"10.1364\/BOE.5.001124","article-title":"Robust efficient estimation of heart rate pulse from video","volume":"5","author":"Xu","year":"2014","journal-title":"Biomed. Opt. Express"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Rapczynski, M., Werner, P., Saxen, F., and Al-Hamadi, A. (2018, January 7\u201310). How the Region of Interest Impacts Contact Free Heart Rate Estimation Algorithms. Proceedings of the 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451846"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"831","DOI":"10.1088\/0967-3334\/35\/5\/807","article-title":"Non-contact video-based vital sign monitoring using ambient light and auto-regressive models","volume":"35","author":"Tarassenko","year":"2014","journal-title":"Physiol. Meas."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1565","DOI":"10.1364\/BOE.6.001565","article-title":"DistancePPG: Robust non-contact vital signs monitoring using a camera","volume":"6","author":"Kumar","year":"2015","journal-title":"Biomed. Opt. Express"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3320","DOI":"10.1364\/BOE.6.003320","article-title":"Non-contact measurement of oxygen saturation with an RGB camera","volume":"6","author":"Guazzi","year":"2015","journal-title":"Biomed. Opt. Express"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1109\/TBME.2011.2163157","article-title":"Physiological Parameter Monitoring from Optical Recordings with a Mobile Phone","volume":"59","author":"Scully","year":"2012","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1364\/BOE.6.000086","article-title":"Non-contact estimation of heart rate and oxygen saturation using ambient light","volume":"6","author":"Bal","year":"2015","journal-title":"Biomed. Opt. Express"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2120","DOI":"10.1109\/TIM.2019.2920183","article-title":"Noncontact SpO2 Measurement Using Eulerian Video Magnification","volume":"69","author":"Rosa","year":"2020","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"4941","DOI":"10.1364\/BOE.7.004941","article-title":"Robust respiration detection from remote photoplethysmography","volume":"7","author":"Stuijk","year":"2016","journal-title":"Biomed. Opt. Express"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"130036","DOI":"10.1109\/ACCESS.2020.3008687","article-title":"Fusion-Based Approach for Respiratory Rate Recognition from Facial Video Images","volume":"8","author":"Fiedler","year":"2020","journal-title":"IEEE Access"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"4378","DOI":"10.1364\/BOE.6.004378","article-title":"Remote monitoring of breathing dynamics using infrared thermography","volume":"6","author":"Pereira","year":"2015","journal-title":"Biomed. Opt. Express"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"4480","DOI":"10.1364\/BOE.8.004480","article-title":"Robust tracking of respiratory rate in high-dynamic range scenes using mobile thermal imaging","volume":"8","author":"Cho","year":"2017","journal-title":"Biomed. Opt. Express"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Rapczynski, M., Zhang, C., Al-Hamadi, A., and Notni, G. (2018, January 7\u201310). A Multi-Spectral Database for NIR Heart Rate Estimation. Proceedings of the 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece.","DOI":"10.1109\/ICIP.2018.8451104"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"12804","DOI":"10.3390\/s131012804","article-title":"3D Multi-Spectrum Sensor System with Face Recognition","volume":"13","author":"Kim","year":"2013","journal-title":"Sensors"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1016\/j.imavis.2012.10.006","article-title":"Integration of 3D and multispectral data for cultural heritage applications: Survey and perspectives","volume":"31","author":"Chane","year":"2013","journal-title":"Image Vis. Comput."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"5134021","DOI":"10.1155\/2017\/5134021","article-title":"A 3D Scan Model and Thermal Image Data Fusion Algorithms for 3D Thermography in Medicine","volume":"2017","author":"Chromy","year":"2017","journal-title":"J. Healthc. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"23366","DOI":"10.1364\/OE.26.023366","article-title":"5D hyperspectral imaging: Fast and accurate measurement of surface shape and spectral characteristics using structured light","volume":"26","author":"Heist","year":"2018","journal-title":"Opt. Express"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"448","DOI":"10.1016\/j.optlaseng.2019.05.009","article-title":"High-speed 3D thermography","volume":"121","author":"Landmann","year":"2019","journal-title":"Opt. Lasers Eng."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1016\/j.optlaseng.2016.02.017","article-title":"High-speed three-dimensional shape measurement using GOBO projection","volume":"87","author":"Heist","year":"2016","journal-title":"Opt. Lasers Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1038\/s41377-018-0072-3","article-title":"GOBO projection for 3D measurements at highest frame rates: A performance analysis","volume":"7","author":"Heist","year":"2018","journal-title":"Light"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"10541","DOI":"10.1364\/AO.54.010541","article-title":"Theoretical considerations on aperiodic sinusoidal fringes in comparison to phase-shifted sinusoidal fringes for high-speed three-dimensional shape measurement","volume":"54","author":"Heist","year":"2015","journal-title":"Appl. Opt."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Dietrich, P., Heist, S., Landmann, M., K\u00fchmstedt, P., and Notni, G. (2019). BICOS\u2014An Algorithm for Fast Real-Time Correspondence Search for Statistical Pattern Projection-Based Active Stereo Sensors. Appl. Sci., 9.","DOI":"10.3390\/app9163330"},{"key":"ref_25","unstructured":"International Commission on Non-Ionizing Radiation Protection (1997). Guidelines of limits of exposure to broad-band incoherent optical radiation (0.38 to 3 \u00b5m). Health Phys., 73, 539\u2013554."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Rosenberger, M., Zhang, C., Zhang, Y., and Notni, G. (2020, January 4\u20138). 3D high-resolution multimodal imaging system for real-time applications. Proceedings of the SPIE 11397, Dimensional Optical Metrology and Inspection for Practical Applications IX, 27, Anaheim, CA, USA.","DOI":"10.1117\/12.2558413"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/B:VISI.0000013087.49260.fb","article-title":"Robust Real-Time Face Detection","volume":"57","author":"Viola","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Baltru\u0161aitis, T., Robinson, P., and Morency, L.-P. (2016, January 7\u201310). OpenFace: An open source facial behavior analysis toolkit. Proceedings of the 2016 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Placid, NY, USA.","DOI":"10.1109\/WACV.2016.7477553"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Ren, S., Cao, X., Wei, Y., and Sun, J. (2014, January 23\u201328). Face Alignment at 3000 FPS via Regressing Local Binary Features. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.218"},{"key":"ref_30","unstructured":"Shi, J., and Tomasi, C. (1994, January 21\u201323). Good Features to Track. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA."},{"key":"ref_31","unstructured":"Lucas, B.D., and Kanade, T. (1981, January 23). An Iterative Image Registration Technique with an Application to Stereo Vision. Proceedings of the 1981 DARPA Image Understanding Workshop, Washington, DC, USA."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1115\/1.3662552","article-title":"A New Approach to Linear Filtering and Prediction Problems","volume":"82","author":"Kalman","year":"1960","journal-title":"Trans. ASME J. Basic Eng."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1145\/2185520.2185561","article-title":"Eulerian Video Magnification for Revealing Subtle Changes in the World","volume":"31","author":"Wu","year":"2012","journal-title":"ACM Trans. Graph."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Bennett, S.L., Goubran, R., and Knoefel, F. (2016, January 15\u201318). Adaptive eulerian video magnification methods to extract heart rate from thermal video. Proceedings of the 2016 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Benevento, Italy.","DOI":"10.1109\/MeMeA.2016.7533818"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Dosso, Y.S., Bekele, A., and Green, J.R. (2018, January 11\u201313). Eulerian Magnification of Multi-Modal RGB-D Video for Heart Rate Estimation. Proceedings of the 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA), Rome, Italy.","DOI":"10.1109\/MeMeA.2018.8438741"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Ord\u00f3\u00f1ez, C., Cabo, C., Men\u00e9ndez, A., and Bello, A. (2018). Detection of human vital signs in hazardous environments by means of video magnification. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0195290"},{"key":"ref_37","first-page":"33","article-title":"Pyramid methods in image processing","volume":"29","author":"Andelson","year":"1984","journal-title":"RCA Eng."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1016\/S0140-6736(86)90837-8","article-title":"Statistical methods for assessing agreement between two methods of clinical measurement","volume":"1","author":"Bland","year":"1986","journal-title":"Lancet"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Munkholm, S., Kr\u00f8gholt, T., Ebbesen, F., Szecsi, P.B., and Kristensen, S.R. (2018). The smartphone camera as a potential method for transcutaneous bilirubin measurement. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0197938"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zhang, G., Shan, C., Kirenko, I., Long, X., and Aarts, R.M. (2017). Hybrid Optical Unobtrusive Blood Pressure Measurements. Sensors, 17.","DOI":"10.3390\/s17071541"}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/6\/11\/123\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:32:36Z","timestamp":1760178756000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/6\/11\/123"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,12]]},"references-count":40,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2020,11]]}},"alternative-id":["jimaging6110123"],"URL":"https:\/\/doi.org\/10.3390\/jimaging6110123","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,12]]}}}