{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,20]],"date-time":"2025-12-20T22:16:38Z","timestamp":1766268998672,"version":"3.41.2"},"reference-count":60,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,6,27]],"date-time":"2024-06-27T00:00:00Z","timestamp":1719446400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p><jats:bold>Introduction:<\/jats:bold> Robotics uptake in the aerospace industry is low, mainly due to the low-volume\/high-accuracy production that aerospace manufacturers require. Furthermore, aerospace manufacturing and assembly sites are often unstructured environments not specifically suitable for robots to operate in.<\/jats:p><jats:p><jats:bold>Methods:<\/jats:bold> This paper introduces a robotic visual inspection system using off-the-shelf components able to inspect the mounting holes for wing slat actuators without the need for fixed-coordinate programming; the part just needs to be left within reach of the robot. Our system sets one of the opposed pairs of mounting holes as a reference (the \u201cdatum\u201d) and then compares the tilt of all other pairs of mounting holes with respect to it. Under the assumption that any deviation in the mounting hole tilt is not systematic but due to normal manufacturing tolerances, our system will either guarantee the correct alignment of all mounting holes or highlight the existence of misaligned holes.<\/jats:p><jats:p><jats:bold>Results and Discussion:<\/jats:bold> Computer-vision tilt measurements are performed with an error of below 0.03\u00b0 using custom optimization for the sub-pixel determination of the center and radius of the mounting holes. The error introduced by the robot\u2019s motion from the datum to each of the remaining hole pairs is compensated by moving back to the datum and fixing the orientation again before moving to inspect the next hole pair. This error is estimated to be approximately 0.05\u00b0, taking the total tilt error estimation for any mounting hole pair to be 0.08\u00b0 with respect to the datum. This is confirmed by manually measuring the tilt of the hole pairs using a clock gauge on a calibrated table (not used during normal operation).<\/jats:p>","DOI":"10.3389\/frobt.2024.1423319","type":"journal-article","created":{"date-parts":[[2024,6,27]],"date-time":"2024-06-27T06:54:16Z","timestamp":1719471256000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Adaptive robotic system for the inspection of aerospace slat actuator mount"],"prefix":"10.3389","volume":"11","author":[{"given":"Nour M.","family":"Morsi","sequence":"first","affiliation":[]},{"given":"Mario","family":"Mata","sequence":"additional","affiliation":[]},{"given":"Colin S.","family":"Harrison","sequence":"additional","affiliation":[]},{"given":"David","family":"Semple","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2024,6,27]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"12484","DOI":"10.1016\/j.jmrt.2020.09.003","article-title":"A review: drilling performance and hole quality of aluminium alloys for aerospace applications","volume":"9","author":"Aamir","year":"2020","journal-title":"J. Mater. Res. Technol."},{"key":"B2","first-page":"61","article-title":"Detection of road potholes using computer vision and machine learning approaches to assist the visually challenged","volume-title":"EAI\/Springer innovations in communication and computing","author":"Akshaya Devi","year":"2023"},{"key":"B3","first-page":"26","article-title":"Angle of view","volume-title":"The visual dictionary of photography","author":"Allgaier","year":"2011"},{"key":"B4","doi-asserted-by":"publisher","first-page":"172988141666366","DOI":"10.1177\/1729881416663664","article-title":"A survey on inspecting structures using robotic systems","volume":"13","author":"Almadhoun","year":"2016","journal-title":"Int. J. Adv. Robotic Syst."},{"key":"B5","doi-asserted-by":"publisher","first-page":"937","DOI":"10.3390\/APP12020937","article-title":"Smart industrial robot control trends, challenges and opportunities within manufacturing","volume":"12","author":"Arents","year":"2022","journal-title":"Appl. Sci."},{"key":"B6","first-page":"404","article-title":"SURF: speeded up robust features","volume-title":"Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics) 3951 LNCS","author":"Bay","year":"2006"},{"key":"B7","doi-asserted-by":"publisher","first-page":"767","DOI":"10.1007\/s00170-010-2962-2","article-title":"Robotic drilling system for titanium structures","volume":"54","author":"Bi","year":"2011","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"B8","doi-asserted-by":"crossref","DOI":"10.1002\/9780470744055","volume-title":"Template matching techniques in computer vision: theory and practice","author":"Brunelli","year":"2009"},{"key":"B9","doi-asserted-by":"publisher","first-page":"208","DOI":"10.1177\/14759217211048149","article-title":"Modeling of an aircraft structural health monitoring sensor network for operational impact assessment","volume":"21","author":"B\u00fcchter","year":"2022","journal-title":"Struct. Health Monit."},{"key":"B10","first-page":"1","article-title":"Comparisions of Robert, Prewitt, Sobel operator based edge detection methods for real time uses on FPGA","author":"Chaple","year":"2015"},{"key":"B11","first-page":"1","article-title":"ONCE (ONe-sided cell end effector) robotic drilling system","author":"Devlieg","year":"2001"},{"key":"B12","doi-asserted-by":"publisher","first-page":"180","DOI":"10.4271\/2010-01-1836","article-title":"Applied accurate robotic drilling for aircraft fuselage","volume":"3","author":"Devlieg","year":"2010","journal-title":"SAE Int. J. Aerosp."},{"key":"B13","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/978-3-319-18305-3_1","article-title":"What is machine learning?","author":"El Naqa","year":"2015","journal-title":"Mach. Learn. Radiat. Oncol."},{"key":"B14","doi-asserted-by":"crossref","DOI":"10.1109\/CVPR.2003.1211479","article-title":"Object class recognition by unsupervised scale-invariant learning","author":"Fergus","year":"2003"},{"key":"B15","first-page":"628","article-title":"A perpendicularity measurement system for industrial robots","volume":"4","author":"Fernando","year":"2010","journal-title":"Int. Congr. Mech. Eng."},{"key":"B16","doi-asserted-by":"crossref","DOI":"10.1109\/ICAI50593.2020.9311332","article-title":"Comparative analysis of RoboDK and robot operating system for solving diagnostics tasks in off-line programming","author":"Garbev","year":"2020"},{"key":"B17","first-page":"3757","article-title":"K-nearest neighbor search: fast GPU-based implementations and application to high-dimensional feature matching","author":"Garcia","year":"2010"},{"key":"B18","doi-asserted-by":"crossref","DOI":"10.22541\/au.164502808.88072147\/v1","volume-title":"Impact behaviours and non-destructive testing (NDT) methods in carbon fiber composites in aerospace industry: a review","author":"Gholizadeh","year":"2022"},{"key":"B19","doi-asserted-by":"publisher","first-page":"745","DOI":"10.1016\/J.COMPSTRUCT.2016.10.015","article-title":"An Investigation of burrs, chip formation, hole size, circularity and delamination during drilling operation of GLARE using ANOVA","volume":"159","author":"Giasin","year":"2017","journal-title":"Compos. Struct."},{"key":"B20","first-page":"450","article-title":"A novel method of surface-normal measurement in robotic drilling for aircraft fuselage using three laser range sensors","author":"Gong","year":"2012"},{"key":"B21","doi-asserted-by":"publisher","first-page":"2286","DOI":"10.1080\/2374068X.2021.1909332","article-title":"Advances in applications of non-destructive testing (NDT): a review","volume":"8","author":"Gupta","year":"2022","journal-title":"Adv. Mater. Process. Technol."},{"key":"B22","first-page":"1","article-title":"A combined corner and edge detector","author":"Harris","year":"1988"},{"key":"B23","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1016\/J.COGR.2021.06.001","article-title":"Substantial capabilities of robotics in enhancing industry 4.0 implementation","volume":"1","author":"Javaid","year":"2021","journal-title":"Cogn. Robot."},{"key":"B24","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1080\/09511920903529255","article-title":"Metrology-assisted robotic processing of aerospace applications","volume":"23","author":"Jayaweera","year":"2010","journal-title":"Int. J. Comput. Integr. Manuf."},{"key":"B25","doi-asserted-by":"crossref","DOI":"10.1115\/DETC2021-68098","article-title":"Mechanical design of a new anthropomorphic robot for fastening in wing-box","author":"Jiang","year":"2021"},{"key":"B26","first-page":"21011","article-title":"Research on wide range measurement system of free-form surfaces using laser displacement detector and grating displacement sensor","author":"Jiang","year":"2009"},{"article-title":"PCA-SIFT: a more distinctive representation for local image descriptors","year":"2004","author":"Ke","key":"B27"},{"volume-title":"Chapter 25 \u2013 lean management","year":"2017","author":"Kiran","key":"B28"},{"key":"B29","doi-asserted-by":"publisher","first-page":"21","DOI":"10.5772\/62099","article-title":"Stereo-based visual odometry for autonomous robot navigation","volume":"13","author":"Kostavelis","year":"2016","journal-title":"Int. J. Adv. Robotic Syst."},{"key":"B30","first-page":"496","article-title":"Affine adaptation of local image features using the Hessian matrix","author":"Lakemond","year":"2009"},{"key":"B31","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1023\/A:1008045108935","article-title":"Feature detection with automatic scale selection","volume":"30","author":"Lindeberg","year":"1996","journal-title":"Int. J. Comput. Vis."},{"key":"B32","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1023\/b:visi.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"article-title":"A probabilistic approach to image orientation detection via confidence-based integration of low-level and semantic cues","year":"2004","author":"Luo","key":"B33"},{"key":"B34","doi-asserted-by":"publisher","first-page":"715","DOI":"10.1109\/TPAMI.2005.96","article-title":"Automatic image orientation detection via confidence-based integration of low-level and semantic cues","volume":"27","author":"Luo","year":"2005","journal-title":"IEEE Trans. Pattern Analysis Mach. Intell."},{"key":"B35","doi-asserted-by":"publisher","first-page":"761","DOI":"10.1016\/J.IMAVIS.2004.02.006","article-title":"Robust wide-baseline stereo from maximally stable extremal regions","volume":"22","author":"Matas","year":"2004","journal-title":"Image Vis. Comput."},{"key":"B36","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1007\/3-540-47969-4_9","article-title":"An affine invariant interest point detector","volume":"2350","author":"Mikolajczyk","year":"2002","journal-title":"Lect. Notes Comput. Sci."},{"key":"B37","doi-asserted-by":"publisher","first-page":"20026","DOI":"10.1063\/1.4974567\/976868","article-title":"Flexible integration of robotics, ultrasonics and metrology for the inspection of aerospace components","volume":"1806","author":"Mineo","year":"2017","journal-title":"AIP Conf. Proc."},{"key":"B38","doi-asserted-by":"crossref","DOI":"10.1109\/ICAC57885.2023.10275276","article-title":"Autonomous robotic inspection system for drill holes tilt: feasibility and development by advanced simulation and real testing","author":"Morsi","year":"2023"},{"key":"B39","doi-asserted-by":"publisher","first-page":"2227","DOI":"10.1109\/TPAMI.2014.2321376","article-title":"Scalable nearest neighbor algorithms for high dimensional data","volume":"36","author":"Muja","year":"2014","journal-title":"IEEE Trans. Pattern Analysis Mach. Intell."},{"key":"B40","doi-asserted-by":"publisher","first-page":"102231","DOI":"10.1016\/j.rcim.2021.102231","article-title":"A survey of robot learning strategies for human-robot collaboration in industrial settings","volume":"73","author":"Mukherjee","year":"2021","journal-title":"Robotics Computer-Integrated Manuf."},{"volume-title":"Measurement of large objects","year":"2024","key":"B41"},{"key":"B42","doi-asserted-by":"publisher","first-page":"100132","DOI":"10.1016\/j.sftr.2023.100132","article-title":"K-nearest neighbour and K-fold cross-validation used in wind turbines for false alarm detection","volume":"6","author":"Peco Chac\u00f3n","year":"2023","journal-title":"Sustain. Futur."},{"year":"2023","key":"B43","article-title":"RoboDK driver for ABB - RoboDK documentation"},{"key":"B44","doi-asserted-by":"crossref","DOI":"10.1109\/ICETST49965.2020.9080724","article-title":"Collaborative robots and industrial revolution 4.0 (IR 4.0)","author":"Sherwani","year":"2020"},{"key":"B45","doi-asserted-by":"publisher","first-page":"1132","DOI":"10.1016\/j.cja.2015.11.001","article-title":"New design of a compact aero-robotic drilling end effector: an experimental analysis","volume":"29","author":"Shi","year":"2016","journal-title":"Chin. J. Aeronautics"},{"key":"B46","first-page":"127","article-title":"Detecting orientation of in-plain rotated face images based on category classification by deep learning","author":"Shima","year":"2017"},{"key":"B47","doi-asserted-by":"publisher","first-page":"1719","DOI":"10.1007\/s00170-016-9850-3","article-title":"Hole-making processes and their impacts on the microstructure and fatigue response of aircraft alloys","volume":"94","author":"Sun","year":"2018","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"B48","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1109\/MAES.2008.4694832","article-title":"SLAM for robot navigation","volume":"23","author":"Temeltas","year":"2008","journal-title":"IEEE Aerosp. Electron. Syst. Mag."},{"volume-title":"DFK 42BUC03 technical reference manual","year":"2023","key":"B49"},{"key":"B50","doi-asserted-by":"publisher","first-page":"771","DOI":"10.1016\/J.CJA.2019.09.017","article-title":"Successes and challenges in non-destructive testing of aircraft composite structures","volume":"33","author":"Towsyfyan","year":"2020","journal-title":"Chin. J. Aeronautics"},{"key":"B51","doi-asserted-by":"publisher","first-page":"6","DOI":"10.3390\/robotics5010006","article-title":"Application of the naive bayes classifier for representation and use of heterogeneous and incomplete knowledge in social robotics","volume":"5","author":"Trovato","year":"2016","journal-title":"Robotics"},{"key":"B52","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1016\/J.IJMACHTOOLS.2014.06.004","article-title":"Experimental investigation of drilling damage and stitching effects on the mechanical behavior of carbon\/epoxy composites","volume":"87","author":"Turki","year":"2014","journal-title":"Int. J. Mach. Tools Manuf."},{"key":"B53","first-page":"1","article-title":"Wide baseline stereo matching based on local, affinely invariant regions","volume-title":"The British machine vision association and society for pattern recognition","author":"Tuytelaars","year":"2013"},{"key":"B54","doi-asserted-by":"publisher","first-page":"746","DOI":"10.1109\/TIP.2002.801590","article-title":"Automatic image orientation detection","volume":"11","author":"Vailaya","year":"2002","journal-title":"IEEE Trans. Image Process."},{"key":"B55","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1007\/S00170-013-5262-9","article-title":"Dimensional management for aerospace assemblies: framework implementation with case-based scenarios for simulation and measurement of in-process assembly variations","volume":"70","author":"Vichare","year":"2014","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"B56","doi-asserted-by":"publisher","first-page":"17969","DOI":"10.1109\/ACCESS.2019.2895516","article-title":"Ieee access special section editorial: key technologies for smart factory of industry 4.0","volume":"7","author":"Wan","year":"2019","journal-title":"IEEE Access"},{"key":"B57","first-page":"4481","article-title":"Surface normal measurement in the end effector of a drilling robot for aviation","author":"Yuan","year":"2014"},{"key":"B58","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1016\/0004-3702(95)00022-4","article-title":"A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry","volume":"78","author":"Zhang","year":"1995","journal-title":"Artif. Intell."},{"key":"B59","doi-asserted-by":"publisher","first-page":"2535","DOI":"10.1007\/s00170-013-4873-5","article-title":"An off-line programming system for robotic drilling in aerospace manufacturing","volume":"68","author":"Zhu","year":"2013","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"B60","doi-asserted-by":"publisher","first-page":"879","DOI":"10.1016\/J.MATCOM.2008.02.017","article-title":"Simulation in robotics","volume":"79","author":"\u017dlajpah","year":"2008","journal-title":"Math. Comput. Simul."}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2024.1423319\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,27]],"date-time":"2024-06-27T06:54:27Z","timestamp":1719471267000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2024.1423319\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,27]]},"references-count":60,"alternative-id":["10.3389\/frobt.2024.1423319"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2024.1423319","relation":{},"ISSN":["2296-9144"],"issn-type":[{"type":"electronic","value":"2296-9144"}],"subject":[],"published":{"date-parts":[[2024,6,27]]},"article-number":"1423319"}}