{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T16:21:33Z","timestamp":1770222093279,"version":"3.49.0"},"reference-count":39,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2020,7,21]],"date-time":"2020-07-21T00:00:00Z","timestamp":1595289600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"This research was funded by TBE and EDP under supervision of ANEEL","award":["PD-02651-0013\/2017"],"award-info":[{"award-number":["PD-02651-0013\/2017"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Thermal inspection is a powerful tool that enables the diagnosis of several components at its early stages. One critical aspect that influences thermal inspection outputs is the infrared reflection from external sources. This situation may change the readings, demanding that an expert correctly define the camera position, which is a time consuming and expensive operation. To mitigate this problem, this work proposes an autonomous system capable of identifying infrared reflections by filtering and fusing data obtained from both stereo and thermal cameras. The process starts by acquiring readings from multiples Observation Points (OPs) where, at each OP, the system processes the 3D point cloud and thermal image by fusing them together. The result is a dense point cloud where each point has its spatial position and temperature. Considering that each point\u2019s information is acquired from multiple poses, it is possible to generate a temperature profile of each spatial point and filter undesirable readings caused by interference and other phenomena. To deploy and test this approach, a Directional Robotic System (DRS) is mounted over a traditional human-operated service vehicle. In that way, the DRS autonomously tracks and inspects any desirable equipment as the service vehicle passes them by. To demonstrate the results, this work presents the algorithm workflow, a proof of concept, and a real application result, showing improved performance in real-life conditions.<\/jats:p>","DOI":"10.3390\/s20144042","type":"journal-article","created":{"date-parts":[[2020,7,21]],"date-time":"2020-07-21T06:38:55Z","timestamp":1595313535000},"page":"4042","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Sensors Fusion and Multidimensional Point Cloud Analysis for Electrical Power System Inspection"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2576-2760","authenticated-orcid":false,"given":"Vinicius F.","family":"Vidal","sequence":"first","affiliation":[{"name":"Electrical Engineering Department, Federal University of Juiz de Fora, Juiz de Fora 36036, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2735-4792","authenticated-orcid":false,"given":"Leonardo M.","family":"Hon\u00f3rio","sequence":"additional","affiliation":[{"name":"Electrical Engineering Department, Federal University of Juiz de Fora, Juiz de Fora 36036, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7778-4606","authenticated-orcid":false,"given":"Felipe M.","family":"Dias","sequence":"additional","affiliation":[{"name":"Electrical Engineering Department, Federal University of Juiz de Fora, Juiz de Fora 36036, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6916-700X","authenticated-orcid":false,"given":"Milena F.","family":"Pinto","sequence":"additional","affiliation":[{"name":"Electronics Department, Federal Center for Technological Education of Rio de Janeiro, Rio de Janeiro 20271, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alexandre L.","family":"Carvalho","sequence":"additional","affiliation":[{"name":"MRS Logistica, Juiz de Fora 36060, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9171-3089","authenticated-orcid":false,"given":"Andre L. M.","family":"Marcato","sequence":"additional","affiliation":[{"name":"Electrical Engineering Department, Federal University of Juiz de Fora, Juiz de Fora 36036, Brazil"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,7,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1108\/IR-10-2019-0207","article-title":"Robots in the offshore oil and gas industries: A review of recent developments","volume":"47","author":"Bogue","year":"2019","journal-title":"Ind. Robot. Int. J."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"6536","DOI":"10.1109\/TIE.2015.2422112","article-title":"A survey on wind turbine condition monitoring and fault diagnosis\u2014Part I: Components and subsystems","volume":"62","author":"Qiao","year":"2015","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Nikolic, J., Burri, M., Rehder, J., Leutenegger, S., Huerzeler, C., and Siegwart, R. (2013, January 2\u20139). A UAV system for inspection of industrial facilities. Proceedings of the 2013 IEEE Aerospace Conference, Big Sky, MT, USA.","DOI":"10.1109\/AERO.2013.6496959"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Varadharajan, S., Jose, S., Sharma, K., Wander, L., and Mertz, C. (2014, January 24\u201326). Vision for road inspection. Proceedings of the IEEE Winter Conference on Applications of Computer Vision, Steamboat Springs, CO, USA.","DOI":"10.1109\/WACV.2014.6836111"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"22","DOI":"10.18178\/ijmerr.6.1.22-27","article-title":"A new computer vision based method for rail track detection and fault diagnosis in railways","volume":"6","author":"Karakose","year":"2017","journal-title":"Int. J. Mech. Eng. Robot. Res."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Dragomir, A., Adam, M., Andru\u00e7c\u00e2, M., Munteanu, A., and Boghiu, E. (2017, January 11\u201313). Considerations regarding infrared thermal stresses monitoring of electrical equipment. Proceedings of the 2017 International Conference on Electromechanical and Power Systems (SIELMEN), Iasi, Romania.","DOI":"10.1109\/SIELMEN.2017.8123307"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Wang, C., and Cho, Y.K. (2014, January 19\u201321). Automatic 3D thermal zones creation for building energy simulation of existing residential buildings. Proceedings of the Construction Research Congress 2014: Construction in a Global Network, Atlanta, GA, USA.","DOI":"10.1061\/9780784413517.104"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1016\/j.aei.2015.03.004","article-title":"3D as-is building energy modeling and diagnostics: A review of the state-of-the-art","volume":"29","author":"Cho","year":"2015","journal-title":"Adv. Eng. Inform."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Borrmann, D., Leutert, F., Schilling, K., and N\u00fcchter, A. (2016, January 13\u201315). Spatial projection of thermal data for visual inspection. Proceedings of the 14th International Conference on Control, Automation, Robotics and Vision (ICARCV), Phuket, Thailand.","DOI":"10.1109\/ICARCV.2016.7838617"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1216","DOI":"10.1016\/j.enbuild.2010.12.031","article-title":"Energy efficiency studies through 3D laser scanning and thermographic technologies","volume":"43","author":"Armesto","year":"2011","journal-title":"Energy Build."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1969","DOI":"10.1109\/TPWRD.2013.2261692","article-title":"A model to extract wind influence from outdoor IR thermal inspections","volume":"28","author":"Bortoni","year":"2013","journal-title":"IEEE Trans. Power Deliv."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"450101","DOI":"10.1155\/2015\/450101","article-title":"Multimodal registration and fusion for 3d thermal imaging","volume":"2015","author":"Akhloufi","year":"2015","journal-title":"Math. Probl. Eng."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.infrared.2018.01.019","article-title":"On-rail solution for autonomous inspections in electrical substations","volume":"90","author":"Silva","year":"2018","journal-title":"Infrared Phys. Technol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1109\/TITS.2016.2568758","article-title":"Deep multitask learning for railway track inspection","volume":"18","author":"Gibert","year":"2016","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1016\/j.isprsjprs.2018.07.010","article-title":"Tunnel inspection using photogrammetric techniques and image processing: A review","volume":"144","author":"Attard","year":"2018","journal-title":"ISPRS J. Photogramm. Remote. Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.measurement.2015.07.022","article-title":"A new approach based on firefly algorithm for vision-based railway overhead inspection system","volume":"74","author":"Aydin","year":"2015","journal-title":"Measurement"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1309","DOI":"10.1109\/TRO.2016.2624754","article-title":"Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age","volume":"32","author":"Cadena","year":"2016","journal-title":"IEEE Trans. Robot."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Engel, J., Sch\u00f6ps, T., and Cremers, D. (2014, January 6\u201312). LSD-SLAM: Large-scale direct monocular SLAM. Proceedings of the 13th European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10605-2_54"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Usenko, V., Engel, J., St\u00fcckler, J., and Cremers, D. (2016, January 16\u201320). Direct visual-inertial odometry with stereo cameras. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487335"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1109\/TRO.2017.2705103","article-title":"Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras","volume":"33","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1002\/rob.20184","article-title":"Two years of visual odometry on the mars exploration rovers","volume":"24","author":"Maimone","year":"2007","journal-title":"J. Field Robot."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Howard, A. (2008, January 22\u201326). Real-time stereo visual odometry for autonomous ground vehicles. In Proceeding of the 2008 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Nice, France.","DOI":"10.1109\/IROS.2008.4651147"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Fischer, T., Pire, T., \u010c\u00ed\u017eek, P., De Crist\u00f3foris, P., and Faigl, J. (2016, January 9\u201314). Stereo vision-based localization for hexapod walking robots operating in rough terrains. In Proceeding of the 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea.","DOI":"10.1109\/IROS.2016.7759388"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1016\/j.engappai.2015.11.004","article-title":"Robot navigation via spatial and temporal coherent semantic maps","volume":"48","author":"Kostavelis","year":"2016","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1002\/rob.21812","article-title":"Distributed stereo vision-based 6D localization and mapping for multi-robot teams","volume":"36","author":"Schuster","year":"2019","journal-title":"J. Field Robot."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ad\u00e1n, A., Prado, T., Prieto, S., and Quintana, B. (November, January 29). Fusion of thermal imagery and LiDAR data for generating TBIM models. In Proceeding of the 2017 IEEE SENSORS, Glasgow, UK.","DOI":"10.1109\/ICSENS.2017.8234261"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1016\/j.infrared.2012.03.002","article-title":"Recent progress in diagnosing the reliability of electrical equipment by using infrared thermography","volume":"55","author":"Jadin","year":"2012","journal-title":"Infrared Phys. Technol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1016\/j.engappai.2014.11.010","article-title":"Recursive construction of output-context fuzzy systems for the condition monitoring of electrical hotspots based on infrared thermography","volume":"39","author":"Ahmed","year":"2015","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1016\/j.infrared.2016.12.003","article-title":"Diagnosis of the three-phase induction motor using thermal imaging","volume":"81","author":"Glowacz","year":"2017","journal-title":"Infrared Phys. Technol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"965","DOI":"10.1049\/oap-cired.2017.0290","article-title":"Autonomous inspection in transmission and distribution power lines\u2013methodology for image acquisition by means of unmanned aircraft system and its treatment and storage","volume":"2017","author":"Homma","year":"2017","journal-title":"Cired-Open Access Proc. J."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.infrared.2017.09.013","article-title":"Infrared and visible images registration with adaptable local-global feature integration for rail inspection","volume":"87","author":"Tang","year":"2017","journal-title":"Infrared Phys. Technol."},{"key":"ref_32","unstructured":"Vidas, S.G. (2014). Handheld 3D Thermography Using Range Sensing and Computer Vision. [Ph.D. Thesis, Queensland University of Technology]."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Schramm, S., Rangel, J., and Kroll, A. (2018, January 12\u201314). Data fusion for 3D thermal imaging using depth and stereo camera for robust self-localization. Proceedings of the 2018 IEEE Sensors Applications Symposium (SAS), Seoul, Korea.","DOI":"10.1109\/SAS.2018.8336740"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"62050J","DOI":"10.1117\/12.668459","article-title":"Robust thermal camera calibration and 3D mapping of object surface temperatures","volume":"6205","author":"Prakash","year":"2006","journal-title":"SPIE Proc. Thermosense Xxviii"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Ellmauthaler, A., da Silva, E.A., Pagliari, C.L., Gois, J.N., and Neves, S.R. (2013, January 15\u201318). A novel iterative calibration approach for thermal infrared cameras. Proceedings of the 2013 IEEE International Conference on Image Processing, Melbourne, Australia.","DOI":"10.1109\/ICIP.2013.6738450"},{"key":"ref_36","first-page":"322","article-title":"Unmanned aerial vehicle for transmission line inspection using an extended Kalman filter with colored electromagnetic interference","volume":"100","author":"Marcato","year":"2019","journal-title":"ISA Trans."},{"key":"ref_37","unstructured":"Solem, J.E. (2012). Programming Computer Vision with Python: Tools and Algorithms for Analyzing Images, O\u2019Reilly Media."},{"key":"ref_38","unstructured":"Bradski, G., and Kaehler, A. (2008). Learning OpenCV: Computer Vision with the OpenCV Library, O\u2019Reilly Media."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Christensen, H.I., and Hager, G.D. (2016). Sensing and estimation. Springer Handbook of Robotics, Springer.","DOI":"10.1007\/978-3-319-32552-1_5"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/14\/4042\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:50:12Z","timestamp":1760176212000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/14\/4042"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,21]]},"references-count":39,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2020,7]]}},"alternative-id":["s20144042"],"URL":"https:\/\/doi.org\/10.3390\/s20144042","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,7,21]]}}}