{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,19]],"date-time":"2026-08-19T16:16:04Z","timestamp":1787156164008,"version":"build-2736575974"},"reference-count":54,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,2,1]],"date-time":"2023-02-01T00:00:00Z","timestamp":1675209600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002322","name":"CAPES (Coordena\u00e7\u00e3o de Aperfei\u00e7oamento de Pessoal de N\u00edvel Superior)","doi-asserted-by":"publisher","award":["23038.002643\/2018-01"],"award-info":[{"award-number":["23038.002643\/2018-01"]}],"id":[{"id":"10.13039\/501100002322","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002322","name":"CAPES (Coordena\u00e7\u00e3o de Aperfei\u00e7oamento de Pessoal de N\u00edvel Superior)","doi-asserted-by":"publisher","award":["432038\/2016-7"],"award-info":[{"award-number":["432038\/2016-7"]}],"id":[{"id":"10.13039\/501100002322","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003593","name":"CNPq (Conselho Nacional de Desenvolvimento Cient\u00edfico e Tecnol\u00f3gico)\u2014UNIVERSAL","doi-asserted-by":"publisher","award":["23038.002643\/2018-01"],"award-info":[{"award-number":["23038.002643\/2018-01"]}],"id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003593","name":"CNPq (Conselho Nacional de Desenvolvimento Cient\u00edfico e Tecnol\u00f3gico)\u2014UNIVERSAL","doi-asserted-by":"publisher","award":["432038\/2016-7"],"award-info":[{"award-number":["432038\/2016-7"]}],"id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Medical thermography provides an overview of the human body with two-dimensional (2D) information that assists the identification of temperature changes, based on the analysis of surface distribution. However, this approach lacks spatial depth information, which can be enhanced by adding multiple images or three-dimensional (3D) systems. Therefore, the methodology applied for this paper generates a 3D point cloud (from thermal infrared images), a 3D geometry model (from CT images), and the segmented inner anatomical structures. Thus, the following computational processing was employed: Structure from Motion (SfM), image registration, and alignment (affine transformation) between the 3D models obtained to combine and unify them. This paper presents the 3D reconstruction and visualization of the respective geometry of the neck\/bust and inner anatomical structures (thyroid, trachea, veins, and arteries). Additionally, it shows the whole 3D thermal geometry in different anatomical sections (i.e., coronal, sagittal, and axial), allowing it to be further examined by a medical team, improving pathological assessments. The generation of 3D thermal anatomy models allows for a combined visualization, i.e., functional and anatomical images of the neck region, achieving encouraging results. These 3D models bring correlation of the inner and outer regions, which could improve biomedical applications and future diagnosis with such a methodology.<\/jats:p>","DOI":"10.3390\/s23031610","type":"journal-article","created":{"date-parts":[[2023,2,2]],"date-time":"2023-02-02T01:53:54Z","timestamp":1675302834000},"page":"1610","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":52,"title":["3D Multi-Modality Medical Imaging: Combining Anatomical and Infrared Thermal Images for 3D Reconstruction"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6137-918X","authenticated-orcid":false,"given":"Mauren","family":"Abreu de Souza","sequence":"first","affiliation":[{"name":"Programa de P\u00f3s-Gradua\u00e7\u00e3o em Tecnologia em Sa\u00fade (PPGTS), Pontif\u00edcia Universidade Cat\u00f3lica do Paran\u00e1, Curitiba 80215-901, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7130-7697","authenticated-orcid":false,"given":"Daoana Carolaine","family":"Alka Cordeiro","sequence":"additional","affiliation":[{"name":"Programa de P\u00f3s-Gradua\u00e7\u00e3o em Tecnologia em Sa\u00fade (PPGTS), Pontif\u00edcia Universidade Cat\u00f3lica do Paran\u00e1, Curitiba 80215-901, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonathan de","family":"Oliveira","sequence":"additional","affiliation":[{"name":"Programa de P\u00f3s-Gradua\u00e7\u00e3o em Tecnologia em Sa\u00fade (PPGTS), Pontif\u00edcia Universidade Cat\u00f3lica do Paran\u00e1, Curitiba 80215-901, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5998-900X","authenticated-orcid":false,"given":"Mateus Ferro Antunes de","family":"Oliveira","sequence":"additional","affiliation":[{"name":"Programa de P\u00f3s-Gradua\u00e7\u00e3o em Tecnologia em Sa\u00fade (PPGTS), Pontif\u00edcia Universidade Cat\u00f3lica do Paran\u00e1, Curitiba 80215-901, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Beatriz Leandro","family":"Bonafini","sequence":"additional","affiliation":[{"name":"Programa de P\u00f3s-Gradua\u00e7\u00e3o em Tecnologia em Sa\u00fade (PPGTS), Pontif\u00edcia Universidade Cat\u00f3lica do Paran\u00e1, Curitiba 80215-901, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1016\/j.apenergy.2014.08.005","article-title":"Infrared thermography (IRT) applications for building diagnostics: A review","volume":"134","author":"Kylili","year":"2014","journal-title":"Appl. Energy"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Frodella, W., Lazzeri, G., Moretti, S., Keizer, J., and Verheijen, F.G.A. (2020). Applying Infrared Thermography to Soil Surface Temperature Monitoring: Case Study of a High-Resolution 48 h Survey in a Vineyard (Anadia, Portugal). Sensors, 20.","DOI":"10.3390\/s20092444"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"98","DOI":"10.2460\/ajvr.77.1.98","article-title":"Veterinary applications of infrared thermography","volume":"77","author":"Rekant","year":"2016","journal-title":"Am. J. Vet. Res."},{"key":"ref_4","first-page":"35","article-title":"Medical Applications of Infrared Thermography: A Narrative Review","volume":"14","author":"Jasti","year":"2019","journal-title":"J. Stem Cells Hauppauge"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1016\/j.compmedimag.2007.02.002","article-title":"Computer-Aided Diagnosis in Medical Imaging: Historical Review, Current Status and Future potential","volume":"31","author":"Doi","year":"2007","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Luhmann, T., Robson, S., Kyle, S., and Boehm, J. (2020). Close-Range Photogrammetry and 3D Imaging, Walter de Gruyter.","DOI":"10.1515\/9783110607253"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Foster, S., and Halbstein, D. (2014). Integrating 3D Modeling, Photogrammetry and Design, Springer.","DOI":"10.1007\/978-1-4471-6329-9"},{"key":"ref_8","unstructured":"Cabrelles, M., Galcer\u00e1, S., Navarro, S., Lerma, J.L., Akasheh, T., and Haddad, N. (2009, January 11\u201315). Integration of 3D Laser Scanning, Photogrammetry and Thermography to Record Architectural Monuments. Proceedings of the 22nd CIPA Symposium, Kyoto, Japan."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Yang, M.-D., Su, T.-C., and Lin, H.-Y. (2018). Fusion of Infrared Thermal Image and Visible Image for 3D Thermal Model Reconstruction Using Smartphone Sensors. Sensors, 18.","DOI":"10.20944\/preprints201805.0225.v1"},{"key":"ref_10","first-page":"1","article-title":"Thermal Pattern Variations Analysed using 2D\/3D Mapping Techniques among Females","volume":"7","author":"Domina","year":"2011","journal-title":"J. Text. Appar. Technol. Manag."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Campione, I., Lucchi, F., Santopuoli, N., and Seccia, L. (2020). 3D Thermal Imaging System with Decoupled Acquisition for Industrial and Cultural Heritage Applications. Appl. Sci., 10.","DOI":"10.3390\/app10030828"},{"key":"ref_12","unstructured":"Aksenov, P., Clark, I., Grant, D., Inman, A., Vartikovski, L., and Nebel, J.-C. (2003, January 3\u20137). 3D thermography for quantification of heat generation resulting from inflammation. 8th 3D Modelling Symposium, Paris, France."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ju, X., Nebel, J.-C., and Siebert, J.P. (2004, January 8\u201312). 3D Thermography Imaging Standardization Technique for Inflammation Diagnosis. Proceedings of the Photonics Asia 2004, Beijing, China.","DOI":"10.1117\/12.577055"},{"key":"ref_14","unstructured":"Barone, S., Paoli, A., and Razionale, A.V. (June, January 31). A biomedical application combining visible and thermal 3D imaging. Proceedings of the XVIII Congreso internactional de Ingenieria Grafica, Barcelona, Spain."},{"key":"ref_15","unstructured":"Parker, M.D., Taberner, A.J., and Nielsen, P.M. (September, January 30). A Thermal Stereoscope for Surface Reconstruction of The Diabetic Foot. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Boston, MA, USA."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ng, E.Y., and Etehadtavakol, M. (2017). Application of Infrared to Biomedical Sciences, Springer.","DOI":"10.1007\/978-981-10-3147-2"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"8179","DOI":"10.1364\/OE.26.008179","article-title":"Depth and Thermal Sensor Fusion to Enhance 3D Thermographic Reconstruction","volume":"26","author":"Cao","year":"2018","journal-title":"Opt. Express"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.cmpb.2017.08.009","article-title":"A method for generating 3D thermal models with decoupled acquisition","volume":"151","author":"Krefer","year":"2017","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_19","unstructured":"Bader, C. (2019). 3D Thermal Imaging: Acquisition and Surface Reconstruction. [Master Thesis, ICP Institute of Computational Physics, ZHAW Zurich University of Applied Sciences School of Engineering]."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1177\/1932296819854062","article-title":"Infrared 3D Thermography for Inflammation Detection in Diabetic Foot Disease: A Proof of Concept","volume":"14","year":"2020","journal-title":"J. Diabetes Sci. Technol."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Mancilla, R.B., and PHAN, B. (2021). Anatomical 3D Modeling Using IR Sensors and Radiometric Processing Based on Structure from Motion: Towards a Tool for the Diabetic Foot Diagnosis. Sensors, 21.","DOI":"10.3390\/s21113918"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1080\/17686733.2021.1991746","article-title":"Combining modern 3D reconstruction and thermal imaging: Generation of large-scale 3D thermograms in real-time","volume":"19","author":"Schramm","year":"2022","journal-title":"Quant. InfraRed Thermogr. J."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"41","DOI":"10.5194\/jsss-11-41-2022","article-title":"Method and Experimental Investigation of Surface Heat Dissipation Measurement Using 3D Thermography","volume":"11","author":"Schmoll","year":"2022","journal-title":"J. Sens. Sens. Syst"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2347","DOI":"10.1038\/s41598-022-06076-z","article-title":"Tomographic reconstruction from planar thermal imaging using convolutional neural network","volume":"12","author":"Ledwon","year":"2022","journal-title":"Sci. Rep."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"107234","DOI":"10.1016\/j.cmpb.2022.107234","article-title":"Finite element analysis to predict temperature distribution in the human neck with abnormal thyroid: A proof of concept","volume":"227","author":"Paz","year":"2022","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1109\/MCI.2011.942756","article-title":"A Neural Network for Thyroid Segmentation and Volume Estimation in CT Images","volume":"6","author":"Chang","year":"2011","journal-title":"IEEE Comput. Intell. Mag."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"372","DOI":"10.5603\/FM.2015.0056","article-title":"Segmentation and surface reconstruction of a cadaver heart on Mimics software","volume":"74","author":"Shin","year":"2014","journal-title":"Folia Morphol."},{"key":"ref_28","first-page":"24","article-title":"Comparison of Thyroid Segmentation Algorithms in Ultrasound and Scintigraphy Images","volume":"50","author":"Kaur","year":"2012","journal-title":"Int. J. Comput. Appl."},{"key":"ref_29","unstructured":"Souza, M.A., de Borba, G.B., Krefer, A.G., and Gamba, H.R. (2016, January 13\u201315). 3D THERMO-SCAN\u2014Multi-modality image registration. Proceedings of the 2016 SAI Computing Conference (SAI), London, UK."},{"key":"ref_30","unstructured":"Souza, M.A., de Krefer, A.G., Borba, G.B., E Silva, G.J.V., Franco, A.P.G.O., and Gamba, H.R. (2016, January 16\u201320). Generation of 3D thermal models for dentistry applications. Proceedings of the 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Scholleman, F., Barbosa Pereira, C., Rosenhain, S., Follmann, A., Gremse, F., Kiessling, F., Czaplik, M., and Abreu de Souza, M. (2021). An Anatomical Thermal 3D Model in Preclinical Research: Combining CT and Thermal Images. Sensors, 21.","DOI":"10.3390\/s21041200"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Sch\u00f6nberger, L., and Frahm, J.-M. (2016, January 27\u201330). Structure-from-Motion Revisited. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.445"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1017\/S096249291700006X","article-title":"A survey of structure from motion","volume":"26","author":"Voroninski","year":"2017","journal-title":"Acta Numer."},{"key":"ref_34","unstructured":"Wu, C. (July, January 29). Towards linear-time incremental structure from motion, In Proceedings of the International Conference on 3D Vision. Seattle, WA, USA."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"239","DOI":"10.5194\/isprs-archives-XLII-4-W14-239-2019","article-title":"Overview Begin of Open Source Software for Close Range Photogrammetry","volume":"XLII-4\/W14","author":"Vacca","year":"2019","journal-title":"Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/S1361-8415(01)80026-8","article-title":"A Survey of Medical Image Registration","volume":"2","author":"Maintz","year":"1998","journal-title":"Med. Image Anal."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1016\/j.media.2016.06.030","article-title":"A survey of medical image registration\u2014under review","volume":"33","author":"Viergever","year":"2016","journal-title":"Med. Image Anal."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/51.195938","article-title":"Medical image matching\u2013A review with classification","volume":"12","author":"Pol","year":"1993","journal-title":"IEEE Eng. Med. Biol. Mag."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Niessen, W.J., and Viergever, M.A. (2001). Medical Image Computing and Computer-Assisted Intervention\u2014MICCAI 2001. MICCAI 2001, Springer. Lecture Notes in Computer Science.","DOI":"10.1007\/3-540-45468-3"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"284","DOI":"10.1016\/j.jvoice.2017.11.017","article-title":"How Age and Frequency Impact the Thyroid Cartilages of Professional Singers","volume":"33","author":"Unteregger","year":"2019","journal-title":"J Voice"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1016\/j.medengphy.2013.08.003","article-title":"MRI-based three-dimensional thermal physiological characterization of thyroid gland of human body","volume":"36","author":"Jin","year":"2014","journal-title":"Med. Eng. Phys."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Szeliski, R. (2010). Computer Vision: Algorithms and Applications, Springer.","DOI":"10.1007\/978-1-84882-935-0"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1362","DOI":"10.1109\/TPAMI.2009.161","article-title":"Accurate, Dense and Robust Multi-View Stereopsis","volume":"32","author":"Furukawa","year":"2010","journal-title":"Trans. Pattern Anal. Mach. Intell."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Wallner, J., Hochegger, K., Chen, X., Mischak, I., Reinbacher, K., Pau, M., Zrnc, T., Schwenzer-Zimmerer, K., Zemann, W., and Schmalstieg, D. (2018). Clinical evaluation of semi-automatic open-source algorithmic software segmentation of the mandibular bone: Practical feasibility and assessment of a new course of action. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0196378"},{"key":"ref_46","unstructured":"Heckel, F., Schwier, M., and Peitgen, H.-O. (October, January 28). Object-oriented application development with MeVisLab and Python. Proceedings of the Informatik 2009\u2013Im Focus das Leben, L\u00fcbeck, Germany."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1016\/j.jbiomech.2007.07.007","article-title":"Head and neck anthropometry, vertebral geometry and neck strength in height-matched men and women","volume":"41","author":"Vasavada","year":"2008","journal-title":"J. Biomech."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1768","DOI":"10.1109\/TPAMI.2006.233","article-title":"Random Walks for Image Segmentation","volume":"28","author":"Grady","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"2065","DOI":"10.1007\/s11548-022-02678-0","article-title":"MeVisLab-OpenVR prototyping platform for virtual reality medical applications","volume":"17","author":"Budts","year":"2022","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_50","unstructured":"Hern\u00e1ndez, A.C., Shilo, A., P\u00e9ry, P., and Raidou, R. (2022, January 22\u201323). Calvariam: Visual Educational Resources for Maxillofacial Surgery. Eurographics Workshop on Visual Computing for Biology and Medicine, Vienna, Austria."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"715","DOI":"10.1007\/s00784-022-04819-w","article-title":"An application framework of 3D assessment image registration accuracy and untouched surface area in canal instrumentation laboratory research with micro-computed tomography","volume":"27","author":"Lui","year":"2023","journal-title":"Clin. Oral Investig."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"901","DOI":"10.1007\/s00784-021-04071-8","article-title":"Micro-computed tomography analysis of root canal morphology and thickness of crown and root of mandibular incisors in Chinese population","volume":"26","author":"Chen","year":"2022","journal-title":"Clin. Oral Investig."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"750","DOI":"10.1002\/cre2.561","article-title":"Three-dimensional quantification of the relationship between the upper first molar and maxillary sinus","volume":"8","author":"Regnstrand","year":"2022","journal-title":"Clin. Exp. Dent. Res."},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Egger, J., Gall, M., Tax, A., \u00dccal, M., Zefferer, U., Li, X., von Campe, G., Sch\u00e4fer, U., Schmalstieg, D., and Chen, X. (2017). Interactive reconstructions of cranial 3D implants under MeVisLab as an alternative to commercial planning software. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0172694"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/3\/1610\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:21:33Z","timestamp":1760120493000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/3\/1610"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,1]]},"references-count":54,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["s23031610"],"URL":"https:\/\/doi.org\/10.3390\/s23031610","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,1]]}}}