{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,3]],"date-time":"2026-05-03T03:20:40Z","timestamp":1777778440430,"version":"3.51.4"},"reference-count":47,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2022,8,20]],"date-time":"2022-08-20T00:00:00Z","timestamp":1660953600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000780","name":"European Union","doi-asserted-by":"publisher","award":["835846"],"award-info":[{"award-number":["835846"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Increasing the efficiency of the quality control phase in industrial production lines through automation is a rapidly growing trend. In non-destructive testing, active thermography techniques are known for their suitability to allow rapid non-contact and full-field inspections. The robotic manipulation of the thermographic instrumentation enables the possibility of performing inspections of large components with complex geometries by collecting multiple thermographic images from optimal positions. The robotisation of the thermographic inspection is highly desirable to improve assessment speed and repeatability without compromising inspection accuracy. Although integrating a robotic setup for thermographic data capture is not challenging, the application of robotic thermography has not grown significantly to date due to the absence of a suitable approach for merging multiple thermographic images into a single presentation. Indeed, such an approach must guarantee accurate alignment and consistent pixel blending, which is crucial to facilitate defect detection and sizing. In this work, an innovative inspection platform was conceptualised and implemented, consisting of a pulsed thermography setup, a six-axis robotic manipulator and an algorithm for image alignment, correction and blending. The performance of the inspection platform is tested on a convex-shaped specimen with artificial defects, which highlights the potential of the new combined approach. This work bridges a technology gap, making thermographic inspections more deployable in industrial environments. The proposed fine image alignment approach can find applicability beyond thermographic non-destructive testing.<\/jats:p>","DOI":"10.3390\/s22166267","type":"journal-article","created":{"date-parts":[[2022,8,22]],"date-time":"2022-08-22T01:56:40Z","timestamp":1661133400000},"page":"6267","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Fine Alignment of Thermographic Images for Robotic Inspection of Parts with Complex Geometries"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5086-366X","authenticated-orcid":false,"given":"Carmelo","family":"Mineo","sequence":"first","affiliation":[{"name":"Institute for High-Performance Computing and Networking, National Research Council of Italy, 90146 Palermo, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9607-3324","authenticated-orcid":false,"given":"Nicola","family":"Montinaro","sequence":"additional","affiliation":[{"name":"Department of Engineering, University of Palermo, 90128 Palermo, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mario","family":"Fustaino","sequence":"additional","affiliation":[{"name":"Department of Engineering, University of Palermo, 90128 Palermo, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1983-3320","authenticated-orcid":false,"given":"Antonio","family":"Pantano","sequence":"additional","affiliation":[{"name":"Department of Engineering, University of Palermo, 90128 Palermo, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1981-4402","authenticated-orcid":false,"given":"Donatella","family":"Cerniglia","sequence":"additional","affiliation":[{"name":"Department of Engineering, University of Palermo, 90128 Palermo, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,20]]},"reference":[{"key":"ref_1","unstructured":"Hull, J.B., and John, V. (2015). Non-Destructive Testing, Macmillan International Higher Education."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Sattar, T.P. (2010). Robotic Non-Destructive Testing. Ind. Robot. Int. J., 37.","DOI":"10.1108\/ir.2010.04937eaa.002"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Gibson, I., and Rosen, D. (2021). Brent Stucker, and Mahyar Khorasani. Additive Manufacturing Technologies, Springer.","DOI":"10.1007\/978-3-030-56127-7"},{"key":"ref_4","unstructured":"Appleton, E., and Williams, D.J. (2012). Industrial Robot Applications, Springer Science & Business Media."},{"key":"ref_5","first-page":"161","article-title":"PAUT inspection of complex-shaped composite materials through six DOFs robotic manipulators","volume":"57","author":"Mineo","year":"2015","journal-title":"Insight Non-Destr. Test. Cond. Monit."},{"key":"ref_6","unstructured":"Cuevas, E., Lopez, M., Garc\u00eda, M., and Ib\u00e9rica, K.R. (2012, January 13\u201315). Ultrasonic Techniques and Industrial Robots: Natural Evolution of Inspection Systems. Proceedings of the 4th International Symposium on NDT in Aerospace, Berlin, Germany."},{"key":"ref_7","unstructured":"Bosse, J., Thaler, B., Ilse, D., and B\u00fchling, L. (2022, July 11). Automated Air-Coupled Ultrasonic Technique for the Inspection of the Ec145 Tail Boom. Available online: http:\/\/2012.ndt-aerospace.com\/Portals\/aerospace2012\/BB\/tu2b3.pdf."},{"key":"ref_8","first-page":"183","article-title":"Index-based triangulation method for efficient generation of large three-dimensional ultrasonic C-scans","volume":"60","author":"Mineo","year":"2018","journal-title":"Insight Non-Destr. Test. Cond. Monit."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1729881416663664","DOI":"10.1177\/1729881416663664","article-title":"A survey on inspecting structures using robotic systems","volume":"13","author":"Almadhoun","year":"2016","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Meola, C. (2012). Infrared Thermography Recent Advances and Future Trends, Bentham Science Publishers.","DOI":"10.2174\/97816080514341120101"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Holst, G.C. (2000). Common Sense Approach to Thermal Imaging, SPIE Optical Engineering Press.","DOI":"10.1117\/3.2588945"},{"key":"ref_12","unstructured":"Maldague, X. (2001). Theory and Practice of Infrared Technology for Nondestructive Testing, John Wiley & Son."},{"key":"ref_13","unstructured":"Schmidt, T., and Dutta, S. (2012). Automation in Production Integrated Ndt Using Thermography, NDT Aerospace."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Massaro, A., and Galiano, A. (2020). Infrared Thermography for Intelligent Robotic Systems in Research Industry Inspections: Thermography in Industry Processes. Handbook of Research on Advanced Mechatronic Systems and Intelligent Robotics, IGI Global.","DOI":"10.4018\/978-1-7998-0137-5.ch005"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Holland, S.D., and Krishnamurthy, A. (2022). Registration of Nde Data to Cad. Handbook of Nondestructive Evaluation 4.0, Springer.","DOI":"10.1007\/978-3-030-73206-6_5"},{"key":"ref_16","unstructured":"Maldague, X., and Moore, P.O. (2001). Non-Destructive Handbook, Infrared and Thermal Testing, ASNT Press."},{"key":"ref_17","first-page":"611","article-title":"Interpreting the Results of Pulsed Thermography Data","volume":"61","author":"Martin","year":"2003","journal-title":"Mater. Eval."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"314906","DOI":"10.1155\/2013\/314906","article-title":"In Search of Early Time: An Original Approach in the Thermographic Identification of Thermophysical Properties and Defects","volume":"2013","author":"Balageas","year":"2013","journal-title":"Adv. Opt. Technol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1080\/10589750701448548","article-title":"Qualitative and quantitative assessment of aerospace structures by pulsed thermography","volume":"22","author":"Genest","year":"2007","journal-title":"Nondestruct. Test. Eval."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2694","DOI":"10.1063\/1.362662","article-title":"Pulse phase infrared thermography","volume":"79","author":"Maldague","year":"1996","journal-title":"J. Appl. Phys."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1016\/S1350-4495(02)00138-X","article-title":"Advances in pulsed phase thermography","volume":"43","author":"Maldague","year":"2002","journal-title":"Infrared Phys. Technol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"47","DOI":"10.3166\/qirt.1.47-70","article-title":"Pulsed Phase Thermography Reviewed","volume":"1","author":"Maldague","year":"2004","journal-title":"Quant. Infrared Thermogr. J."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"3962","DOI":"10.1063\/1.351366","article-title":"Thermal Wave Imaging with Phase Sensitive Modulated Thermography","volume":"71","author":"BuSSe","year":"1992","journal-title":"J. Appl. Phys."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1007\/s10846-022-01673-6","article-title":"Autonomous Robotic Sensing for Simultaneous Geometric and Volumetric Inspection of Free-Form Parts","volume":"105","author":"Mineo","year":"2022","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhang, Q., Tian, W., Hu, J., Li, P., and Wu, C. (2021, January 22\u201325). Robot Hand-Eye Calibration Method Based on Intermediate Measurement System. Proceedings of the International Conference on Intelligent Robotics and Applications 2021, Yantai, China.","DOI":"10.1007\/978-3-030-89134-3_4"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Schramm, S., Osterhold, P., Schmoll, R., and Kroll, A. (2021). Combining modern 3D reconstruction and thermal imaging: Generation of large-scale 3D thermograms in real-time. Quant. Infrared Thermogr. J., 1\u201317.","DOI":"10.1080\/17686733.2021.1991746"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Paragios, N., Chen, Y., and Faugeras, O.D. (2006). Handbook of Mathematical Models in Computer Vision, Springer Science & Business Media.","DOI":"10.1007\/0-387-28831-7"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/0600000009","article-title":"Image alignment and stitching: A tutorial","volume":"2","author":"Szeliski","year":"2007","journal-title":"Found. Trends Comput. Graph. Vis."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Keysers, D., Deselaers, T., and Ney, H. (2004). Pixel-to-Pixel Matching for Image Recognition Using Hungarian Graph Matching. Joint Pattern Recognition Symposium, Springer.","DOI":"10.1007\/978-3-540-28649-3_19"},{"key":"ref_30","unstructured":"Zoghlami, I., Faugeras, O., and Deriche, R. (1997, January 17\u201319). Using Geometric Corners to Build a 2d Mosaic from a Set of Images. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 1997, San Juan, PR, USA."},{"key":"ref_31","unstructured":"Cham, T.-J., and Cipolla, R. (1998, January 25\u201325). A statistical framework for long-range feature matching in uncalibrated image mosaicing. Proceedings of the 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No. 98CB36231), Santa Barbara, CA, USA."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Brown, M., and Lowe, D.G. (2003, January 14\u201317). Recognising Panoramas. Proceedings of the 9th IEEE International Conference on Computer Vision (ICCV 2003), Nice, France.","DOI":"10.1109\/ICCV.2003.1238630"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"424","DOI":"10.1016\/j.infrared.2019.01.026","article-title":"Non-destructive Inspection of Curved Clad Composites with Subsurface Defects by Combination Active Thermography and Three-Dimensional (3d) Structural Optical Imaging","volume":"97","author":"Meng","year":"2019","journal-title":"Infrared Phys. Technol."},{"key":"ref_34","unstructured":"Albert, A.A. (2016). Solid Analytic Geometry, Courier Dover Publications."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"10807","DOI":"10.1007\/s11042-017-5077-z","article-title":"A novel patch matching algorithm for exemplar-based image inpainting","volume":"77","author":"Fan","year":"2017","journal-title":"Multimedia Tools Appl."},{"key":"ref_36","first-page":"70","article-title":"Image Interpolation Techniques in Digital Image Processing: An Overview","volume":"4","author":"Fadnavis","year":"2014","journal-title":"Int. J. Eng. Res. Appl."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1145\/245.247","article-title":"A multiresolution spline with application to image mosaics","volume":"2","author":"Burt","year":"1983","journal-title":"ACM Trans. Graph."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Levin, A., Zomet, A., Peleg, S., and Weiss, Y. (2004, January 11\u201314). Seamless Image Stitching in the Gradient Domain. Proceedings of the European Conference on Computer Vision 2004, Prague, Czech Republic.","DOI":"10.1007\/978-3-540-24673-2_31"},{"key":"ref_39","unstructured":"KUKA (2022, June 16). Kr 10 R1100-2. Available online: https:\/\/www.kuka.com\/-\/media\/kuka-downloads\/imported\/6b77eecacfe542d3b736af377562ecaa\/0000290003_en.pdf?rev=3e82b095d46c4a86b7e195cabdb980cb&hash=A4F0F7D35D9485B612F8BC455B5805E4."},{"key":"ref_40","unstructured":"Elinchrom (2022, June 16). Digital Rx. Available online: https:\/\/www.elinchrom.com\/wp-content\/uploads\/download-center\/73256_digital_rx_manuel--en-de-fr.pdf."},{"key":"ref_41","unstructured":"FLIR (2022, June 16). Flir X6540sc. Available online: http:\/\/www.flir.at\/fileadmin\/user_upload\/Vertretungen\/FLIR\/X6900sc\/Datasheets\/X6540sc_66701-0101-en-US_A4-1706-nbn.pdf."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1108\/01439910910924611","article-title":"Finishing robots: A review of technologies and applications","volume":"36","author":"Bogue","year":"2009","journal-title":"Ind. Robot. Int. J. Robot. Res. Appl."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.rcim.2011.08.004","article-title":"Recent progress on programming methods for industrial robots","volume":"28","author":"Pan","year":"2012","journal-title":"Robot. Comput. Manuf."},{"key":"ref_44","unstructured":"Haase, W., Ungerer, D., and Mohr, F. (2013, January 18\u201322). Automated Non-Destructive Examination of Complex Shapes. Proceedings of the 14th Asia-Pacific Conference on NDT (APCNDT), Mumbai, India."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.rcim.2015.05.003","article-title":"Robotic path planning for non-destructive testing\u2014A custom MATLAB toolbox approach","volume":"37","author":"Mineo","year":"2016","journal-title":"Robot. Comput. Manuf."},{"key":"ref_46","first-page":"338","article-title":"Enabling Robotic Adaptive Behaviour Capabilities for New Industry 4.0 Automated Quality Inspection Paradigms","volume":"62","author":"Mineo","year":"2020","journal-title":"Insight-Non-Destr. Test. Cond. Monit."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/17686733.2017.1328642","article-title":"Aspect ratio considerations for flat bottom hole defects in active thermography","volume":"15","author":"Beemer","year":"2017","journal-title":"Quant. Infrared Thermogr. J."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/16\/6267\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:12:49Z","timestamp":1760141569000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/16\/6267"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,20]]},"references-count":47,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["s22166267"],"URL":"https:\/\/doi.org\/10.3390\/s22166267","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,20]]}}}