{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,8]],"date-time":"2026-07-08T16:29:48Z","timestamp":1783528188835,"version":"3.55.0"},"reference-count":35,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,1,26]],"date-time":"2022-01-26T00:00:00Z","timestamp":1643155200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["LE 817\/32-1"],"award-info":[{"award-number":["LE 817\/32-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002347","name":"Federal Ministry of Education and Research","doi-asserted-by":"publisher","award":["13GW0441C"],"award-info":[{"award-number":["13GW0441C"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Premature infants are among the most vulnerable patients in a hospital. Due to numerous complications associated with immaturity, a continuous monitoring of vital signs with a high sensitivity and accuracy is required. Today, wired sensors are attached to the patient\u2019s skin. However, adhesive electrodes can be potentially harmful as they can damage the very thin immature skin. Although unobtrusive monitoring systems using cameras show the potential to replace cable-based techniques, advanced image processing algorithms are data-driven and, therefore, need much data to be trained. Due to the low availability of public neonatal image data, a patient phantom could help to implement algorithms for the robust extraction of vital signs from video recordings. In this work, a camera-based system is presented and validated using a neonatal phantom, which enabled a simulation of common neonatal pathologies such as hypo-\/hyperthermia and brady-\/tachycardia. The implemented algorithm was able to continuously measure and analyze the heart rate via photoplethysmography imaging with a mean absolute error of 0.91 bpm, as well as the distribution of a neonate\u2019s skin temperature with a mean absolute error of less than 0.55 \u00b0C. For accurate measurements, a temperature gain offset correction on the registered image from two infrared thermography cameras was performed. A deep learning-based keypoint detector was applied for temperature mapping and guidance for the feature extraction. The presented setup successfully detected several levels of hypo- and hyperthermia, an increased central-peripheral temperature difference, tachycardia and bradycardia.<\/jats:p>","DOI":"10.3390\/s22030957","type":"journal-article","created":{"date-parts":[[2022,1,27]],"date-time":"2022-01-27T04:49:51Z","timestamp":1643258991000},"page":"957","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["A Setup for Camera-Based Detection of Simulated Pathological States Using a Neonatal Phantom"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0063-8090","authenticated-orcid":false,"given":"Florian","family":"Voss","sequence":"first","affiliation":[{"name":"Chair for Medical Information Technology, Helmholtz Institute for Biomedical Engineering, RWTH Aachen University, 52074 Aachen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3842-6897","authenticated-orcid":false,"given":"Simon","family":"Lyra","sequence":"additional","affiliation":[{"name":"Chair for Medical Information Technology, Helmholtz Institute for Biomedical Engineering, RWTH Aachen University, 52074 Aachen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Daniel","family":"Blase","sequence":"additional","affiliation":[{"name":"Chair for Medical Information Technology, Helmholtz Institute for Biomedical Engineering, RWTH Aachen University, 52074 Aachen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6898-6887","authenticated-orcid":false,"given":"Steffen","family":"Leonhardt","sequence":"additional","affiliation":[{"name":"Chair for Medical Information Technology, Helmholtz Institute for Biomedical Engineering, RWTH Aachen University, 52074 Aachen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2487-0962","authenticated-orcid":false,"given":"Markus","family":"L\u00fcken","sequence":"additional","affiliation":[{"name":"Chair for Medical Information Technology, Helmholtz Institute for Biomedical Engineering, RWTH Aachen University, 52074 Aachen, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,26]]},"reference":[{"key":"ref_1","unstructured":"UNICEF Data: United Nations Inter-Agency Group for Child Mortality Estimation (UN IGME) (2021, November 23). Levels and Trends in Child Mortality 2020, Available online: https:\/\/data.unicef.org\/resources\/levels-and-trends-in-child-mortality\/."},{"key":"ref_2","unstructured":"Bont, L., Bernl\u00f6hr, A., Abbott, J., Mader, S., and Thiele, N. (2021, November 23). Caring for Tomorrow: EFCNI White Paper on Maternal and Newborn Health and Aftercare Services. Available online: https:\/\/www.researchgate.net\/publication\/344632275_Caring_for_Tomorrow_EFCNI_White_Paper_on_Maternal_and_Newborn_Health_and_Aftercare_Services."},{"key":"ref_3","unstructured":"World Health Organization (2021, November 23). Newborns: Improving Survival and Well-Being, Available online: https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/newborns-reducing-mortality."},{"key":"ref_4","unstructured":"World Health Organization (2021, November 23). Preterm Birth, Available online: https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/preterm-birth."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/1741-7015-11-24","article-title":"The global burden of neonatal hypothermia: Systematic review of a major challenge for newborn survival","volume":"11","author":"Lunze","year":"2013","journal-title":"BMC Med."},{"key":"ref_6","unstructured":"Lyon, A., and P\u00fcschner, P. (1995). Thermomonitoring: A Step Forward in Neonatal Intensive Care, Dragerwerk."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"274","DOI":"10.1177\/1099800411403467","article-title":"Thermoregulation and thermography in neonatal physiology and disease","volume":"13","author":"Knobel","year":"2011","journal-title":"Biol. Res. Nurs."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"814","DOI":"10.1038\/jp.2009.99","article-title":"Extremely low birth weight preterm infants lack vasomotor response in relationship to cold body temperatures at birth","volume":"29","author":"Knobel","year":"2009","journal-title":"J. Perinatol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1089\/wound.2015.0642","article-title":"Skin physiology of the neonate and infant: Clinical implications","volume":"4","author":"Oranges","year":"2015","journal-title":"Adv. Wound Care"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"035104","DOI":"10.1088\/0957-0233\/23\/3\/035104","article-title":"A high-resolution non-contact fluorescence-based temperature sensor for neonatal care","volume":"23","author":"Lam","year":"2012","journal-title":"Meas. Sci. Technol."},{"key":"ref_11","unstructured":"Morris, A. (2021, November 23). No Wires, More Cuddles. Available online: https:\/\/news.northwestern.edu\/stories\/2019\/02\/wireless-body-sensors-premature-babies-nicu\/."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1055\/s-0039-1677914","article-title":"A broader look: Camera-based vital sign estimation across the spectrum","volume":"28","author":"Antink","year":"2019","journal-title":"Yearb. Med. Inform."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lyra, S., Mayer, L., Ou, L., Chen, D., Timms, P., Tay, A., Chan, P.Y., Ganse, B., Leonhardt, S., and Hoog Antink, C. (2021). A Deep Learning-Based Camera Approach for Vital Sign Monitoring Using Thermography Images for ICU Patients. Sensors, 21.","DOI":"10.3390\/s21041495"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"104447","DOI":"10.1016\/j.engappai.2021.104447","article-title":"A neonatal dataset and benchmark for non-contact neonatal heart rate monitoring based on spatio-temporal neural networks","volume":"106","author":"Huang","year":"2021","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Cao, Z., Simon, T., Wei, S.E., and Sheikh, Y. (2017, January 21\u201326). Realtime multi-person 2d pose estimation using part affinity fields. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.143"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1850011","DOI":"10.1142\/S0129065718500119","article-title":"Neonatal Seizure Detection Using Deep Convolutional Neural Networks","volume":"29","author":"Ansari","year":"2019","journal-title":"Int. J. Neural Syst."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ihlen, E.A.F., St\u00f8en, R., Boswell, L., de Regnier, R.A., Fj\u00f8rtoft, T., Gaebler-Spira, D., Labori, C., Loennecken, M.C., Msall, M.E., and M\u00f6inichen, U.I. (2020). Machine Learning of Infant Spontaneous Movements for the Early Prediction of Cerebral Palsy: A Multi-Site Cohort Study. J. Clin. Med., 9.","DOI":"10.3390\/jcm9010005"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Turova, V., Sidorenko, I., Eckardt, L., Rieger-Fackeldey, E., Felderhoff-M\u00fcser, U., Alves-Pinto, A., and Lampe, R. (2020). Machine learning models for identifying preterm infants at risk of cerebral hemorrhage. PLoS ONE, 15.","DOI":"10.1371\/journal.pone.0227419"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Nagy, \u00c1., F\u00f6ldesy, P., J\u00e1noki, I., Terbe, D., Siket, M., Szab\u00f3, M., Varga, J., and Zar\u00e1ndy, \u00c1. (2021). Continuous Camera-Based Premature-Infant Monitoring Algorithms for NICU. Appl. Sci., 11.","DOI":"10.3390\/app11167215"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41746-019-0199-5","article-title":"Non-contact physiological monitoring of preterm infants in the neonatal intensive care unit","volume":"2","author":"Villarroel","year":"2019","journal-title":"NPJ Digit. Med."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Khanam, F.T.Z., Perera, A.G., Al-Naji, A., Gibson, K., and Chahl, J. (2021). Non-contact automatic vital signs monitoring of infants in a neonatal intensive care unit based on neural networks. J. Imaging, 7.","DOI":"10.3390\/jimaging7080122"},{"key":"ref_22","first-page":"1","article-title":"Classification of neonatal diseases with limited thermal Image data","volume":"151","author":"Ervural","year":"2021","journal-title":"Multimed. Tools Appl."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"949","DOI":"10.1109\/TBCAS.2021.3108066","article-title":"A Neonatal Phantom for Vital Signs Simulation","volume":"15","author":"Lyra","year":"2021","journal-title":"IEEE Trans. Biomed. Circuits Syst."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Lubkowska, A., Szyma\u0144ski, S., and Chudecka, M. (2019). Surface body temperature of full-term healthy newborns immediately after Birth\u2014Pilot study. Int. J. Environ. Res. Public Health, 16.","DOI":"10.3390\/ijerph16081312"},{"key":"ref_25","unstructured":"Zemlin, M., Berger, A., Franz, A., Gille, C., H\u00e4rtel, C., Helmut, K., M\u00fcller, A., Pohlandt, F., Simon, A., and Merz, W. (2019). Leitlinie der Gesellschaft f\u00fcr Neonatologie und P\u00e4diatrische Intensivmedizin, der Deutschen Gesellschaft f\u00fcr Kinder- und Jugendmedizin, der Gesellschaft f\u00fcr P\u00e4diatrische Gastroenterologie und Ern\u00e4hrung und der Deutschen Gesellschaft f\u00fcr Kinderchirurgie. AWMF Online, AWMF-Leitlinien-Register Nr. 024\/008."},{"key":"ref_26","unstructured":"McCormick, M., and Cooper, P. (2003). Managing Newborn Problems: A Guide for Doctors, Nurses, and Midwives."},{"key":"ref_27","unstructured":"World Health Organization (1997). Maternal and Newborn Health. Thermal Protection of the Newborn: A Practical Guide."},{"key":"ref_28","unstructured":"American Academy of Pediatrics and the American College of Obstetricians and Gynecologists (2017). Guidelines for Perinatal Care, ACOG."},{"key":"ref_29","unstructured":"Gausepohl, H.J., and P\u00f6schl, J. (2020). Heidelberger Leidfaden Neonatalogie 2020, Universit\u00e4tsklinikum Heidelberg. Zentrum f\u00fc Kinder- und Jugendmedizin, Klinik f\u00fcr Neonatalogie."},{"key":"ref_30","unstructured":"(2021, November 23). Arducam MINI High Quality Camera with M12 Mount Lens, 12.3MP 1\/2.3 Inch IMX477 HQ Camera Module for Jetson Nano, Xavier NX. Available online: https:\/\/www.arducam.com\/product\/arducam-high-quality-camera-for-jetson-nano-and-xavier-nx-12mp-m12-mount\/."},{"key":"ref_31","unstructured":"Teledyne FLIR LLC (2021, November 23). LWIR Micro Thermal Camera Module 3 & 3.5. Available online: https:\/\/flir.netx.net\/file\/asset\/15529\/original\/attachment."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Jost, K., Pramana, I., Delgado-Eckert, E., Kumar, N., Datta, A.N., Frey, U., and Schulzke, S.M. (2017). Dynamics and complexity of body temperature in preterm infants nursed in incubators. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0176670"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_34","unstructured":"(2021, November 23). Real-Time Pose Estimation Accelerated with Nvidia Tensorrt. GitHub Repository. Available online: https:\/\/github.com\/NVIDIA-AI-IOT\/trt_pose."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Xiao, B., Wu, H., and Wei, Y. (2018, January 8\u201314). Simple baselines for human pose estimation and tracking. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01231-1_29"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/3\/957\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:08:12Z","timestamp":1760134092000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/3\/957"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,26]]},"references-count":35,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["s22030957"],"URL":"https:\/\/doi.org\/10.3390\/s22030957","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,26]]}}}