{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T04:14:15Z","timestamp":1776744855081,"version":"3.51.2"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2023,8,18]],"date-time":"2023-08-18T00:00:00Z","timestamp":1692316800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,8,18]],"date-time":"2023-08-18T00:00:00Z","timestamp":1692316800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"STRATA Manufacturing PJSC"},{"DOI":"10.13039\/501100004070","name":"Khalifa University of Science, Technology and Research","doi-asserted-by":"publisher","award":["RC1-2018-KUCARS"],"award-info":[{"award-number":["RC1-2018-KUCARS"]}],"id":[{"id":"10.13039\/501100004070","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Sandooq Al Watan","award":["SWARD-S22-015"],"award-info":[{"award-number":["SWARD-S22-015"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Intell Manuf"],"published-print":{"date-parts":[[2024,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Countersink inspection is crucial in various automated assembly lines, especially in the aerospace and automotive sectors. Advancements in machine vision introduced automated robotic inspection of countersinks using laser scanners and monocular cameras. Nevertheless, the aforementioned sensing pipelines require the robot to pause on each hole for inspection due to high latency and measurement uncertainties with motion, leading to prolonged execution times of the inspection task. The neuromorphic vision sensor, on the other hand, has the potential to expedite the countersink inspection process, but the unorthodox output of the neuromorphic technology prohibits utilizing traditional image processing techniques. Therefore, novel event-based perception algorithms need to be introduced. We propose a countersink detection approach on the basis of event-based motion compensation and the mean-shift clustering principle. In addition, our framework presents a robust event-based circle detection algorithm to precisely estimate the depth of the countersink specimens. The proposed approach expedites the inspection process by a factor of 10<jats:inline-formula><jats:alternatives><jats:tex-math>$$\\times $$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                  <mml:mo>\u00d7<\/mml:mo>\n                <\/mml:math><\/jats:alternatives><\/jats:inline-formula> compared to conventional countersink inspection methods. The work in this paper was validated for over 50 trials on three countersink workpiece variants. The experimental results show that our method provides a standard deviation of 0.025 mm and an accuracy of 0.026 mm for countersink depth inspection despite the low resolution of commercially available neuromorphic cameras. Video Link: <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"https:\/\/www.dropbox.com\/s\/pateqqwh4d605t3\/final_video_new.mp4?dl=0\">https:\/\/www.dropbox.com\/s\/pateqqwh4d605t3\/final_video_new.mp4?dl=0<\/jats:ext-link>.<\/jats:p>","DOI":"10.1007\/s10845-023-02187-0","type":"journal-article","created":{"date-parts":[[2023,8,18]],"date-time":"2023-08-18T07:02:49Z","timestamp":1692342169000},"page":"3067-3081","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["High speed neuromorphic vision-based inspection of countersinks in automated manufacturing processes"],"prefix":"10.1007","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1646-7919","authenticated-orcid":false,"given":"Mohammed","family":"Salah","sequence":"first","affiliation":[]},{"given":"Abdulla","family":"Ayyad","sequence":"additional","affiliation":[]},{"given":"Mohammed","family":"Ramadan","sequence":"additional","affiliation":[]},{"given":"Yusra","family":"Abdulrahman","sequence":"additional","affiliation":[]},{"given":"Dewald","family":"Swart","sequence":"additional","affiliation":[]},{"given":"Abdelqader","family":"Abusafieh","sequence":"additional","affiliation":[]},{"given":"Lakmal","family":"Seneviratne","sequence":"additional","affiliation":[]},{"given":"Yahya","family":"Zweiri","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,8,18]]},"reference":[{"key":"2187_CR1","unstructured":"Abdul Hay, O., Chehadeh, M., Ayyad, A., Wahbah, M., Humais, M., & Zweiri, Y. (2021). Unified identification and tuning approach using deep neural networks for visual servoing applications. arXiv:2107.01581."},{"key":"2187_CR2","doi-asserted-by":"crossref","unstructured":"Akinlar, C., & Tonal, C. (2012). Edcircles: Real-time circle detection by edge drawing. In 2012 IEEE international conference on acoustics, speech and signal processing (ICASSP) (pp. 1309\u20131312).","DOI":"10.1109\/ICASSP.2012.6288130"},{"key":"2187_CR3","doi-asserted-by":"publisher","DOI":"10.1016\/j.rcim.2022.102419","volume":"79","author":"A Ayyad","year":"2023","unstructured":"Ayyad, A., Halwani, M., Swart, D., Muthusamy, R., Almaskari, F., & Zweiri, Y. (2023). Neuromorphic vision based control for the precise positioning of robotic drilling systems. Robotics and Computer-Integrated Manufacturing, 79, 102419.","journal-title":"Robotics and Computer-Integrated Manufacturing"},{"key":"2187_CR4","doi-asserted-by":"crossref","unstructured":"Bertrand, J., Yi\u01e7it, A., & Durand, S. (2020). Embedded event-based visual odometry. In 2020 6th international conference on event-based control, communication, and signal processing (EBCCSP) (pp. 1\u20138).","DOI":"10.1109\/EBCCSP51266.2020.9291346"},{"issue":"2","key":"2187_CR5","first-page":"345","volume":"24","author":"A Burghardt","year":"2017","unstructured":"Burghardt, A., Kurc, K., Szybicki, D., Muszy\u0144ska, M., & Szcz\u0119ch, T. (2017). Robot-operated inspection of aircraft engine turbine rotor guide vane segment geometry. Technical Gazette, 24(2), 345\u2013348.","journal-title":"Technical Gazette"},{"key":"2187_CR6","doi-asserted-by":"publisher","first-page":"14575","DOI":"10.1109\/ACCESS.2022.3147951","volume":"10","author":"C Cariou","year":"2022","unstructured":"Cariou, C., Le Moan, S., & Chehdi, K. (2022). A novel mean-shift algorithm for data clustering. IEEE Access, 10, 14575\u201314585.","journal-title":"IEEE Access"},{"key":"2187_CR7","first-page":"06","volume":"27","author":"S-H Chen","year":"2014","unstructured":"Chen, S.-H., & Perng, D.-B. (2014). Automatic optical inspection system for IC molding surface. Journal of Intelligent Manufacturing, 27, 06.","journal-title":"Journal of Intelligent Manufacturing"},{"key":"2187_CR8","doi-asserted-by":"publisher","DOI":"10.1016\/j.compind.2022.103850","volume":"147","author":"KR da Silva Santos","year":"2023","unstructured":"da Silva Santos, K. R., de Oliveira, W. R., Villani, E., & Dttmann, A. (2023). 3D scanning method for robotized inspection of industrial sealed parts. Computers in Industry, 147, 103850.","journal-title":"Computers in Industry"},{"key":"2187_CR9","doi-asserted-by":"publisher","DOI":"10.1016\/j.addma.2022.102900","volume":"56","author":"T Feldhausen","year":"2022","unstructured":"Feldhausen, T., Heinrich, L., Saleeby, K., Burl, A., Post, B., MacDonald, E., Saldana, C., & Love, L. (2022). Review of computer-aided manufacturing (CAM) strategies for hybrid directed energy deposition. Additive Manufacturing, 56, 102900.","journal-title":"Additive Manufacturing"},{"key":"2187_CR10","unstructured":"Gavin, H. P. (2013). The Levenberg-Marquardt method for nonlinear least squares curve-fitting problems c$$\\copyright $$. Department of Civil and Environmental Engineering, Duke University"},{"key":"2187_CR11","unstructured":"Gokcesu, K., & Gokcesu, H. (2021). Generalized Huber loss for robust learning and its efficient minimization for a robust statistics. arXiv:2108.12627"},{"key":"2187_CR12","doi-asserted-by":"crossref","unstructured":"Haldiman, R. (2015) 3d countersink measurement. SAE Technical Paper","DOI":"10.4271\/2015-01-2510"},{"key":"2187_CR13","doi-asserted-by":"crossref","unstructured":"Halwani, M., Ayyad, A., AbuAssi, L., Abdulrahman, Y., Almaskari, F., Hassanin, H., Abusafieh, A., & Zweiri, Y. (2023). A novel vision-based multi-functional sensor for normality and position measurements in precise robotic manufacturing. SSRN Electronic Journal, 01 .","DOI":"10.2139\/ssrn.4360666"},{"key":"2187_CR14","doi-asserted-by":"publisher","first-page":"02","DOI":"10.1007\/s10845-021-01887-9","volume":"33","author":"X Huang","year":"2022","unstructured":"Huang, X., Halwani, M., Muthusamy, R., Ayyad, A., Swart, D., Seneviratne, L., Gan, D., & Zweiri, Y. (2022). Real-time grasping strategies using event camera. Journal of Intelligent Manufacturing, 33, 02.","journal-title":"Journal of Intelligent Manufacturing"},{"key":"2187_CR15","doi-asserted-by":"publisher","DOI":"10.1016\/j.rcim.2022.102452","volume":"80","author":"HZ Imam","year":"2023","unstructured":"Imam, H. Z., Al-Musaibeli, H., Zheng, Y., Martinez, P., & Ahmad, R. (2023). Vision-based spatial damage localization method for autonomous robotic laser cladding repair processes. Robotics and Computer-Integrated Manufacturing, 80, 102452.","journal-title":"Robotics and Computer-Integrated Manufacturing"},{"key":"2187_CR16","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1016\/j.jmsy.2021.10.015","volume":"62","author":"D Jayasekara","year":"2022","unstructured":"Jayasekara, D., Lai, N. Y. G., Wong, K.-H., Pawar, K., & Zhu, Y. (2022). Level of automation (loa) in aerospace composite manufacturing: Present status and future directions towards industry 4.0. Journal of Manufacturing Systems, 62, 44\u201361.","journal-title":"Journal of Manufacturing Systems"},{"key":"2187_CR17","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1016\/j.proeng.2015.12.041","volume":"129","author":"T Kruglova","year":"2015","unstructured":"Kruglova, T., Sayfeddine, D., & Vitaliy, K. (2015). Robotic laser inspection of airplane wings using quadrotor. Procedia Engineering, 129, 245\u2013251.","journal-title":"Procedia Engineering"},{"key":"2187_CR18","doi-asserted-by":"publisher","first-page":"51","DOI":"10.3389\/fnbot.2020.00051","volume":"14","author":"B Li","year":"2020","unstructured":"Li, B., Cao, H., Qu, Z., Hu, Y., Wang, Z., & Liang, Z. (2020). Event-based robotic grasping detection with neuromorphic vision sensor and event-grasping dataset. Frontiers in Neurorobotics, 14, 51.","journal-title":"Frontiers in Neurorobotics"},{"key":"2187_CR19","doi-asserted-by":"crossref","unstructured":"Liu, D., Parra, A., & Chin, T.-J. (2021). Spatiotemporal registration for event-based visual odometry. In Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (pp. 4937\u20134946)","DOI":"10.1109\/CVPR46437.2021.00490"},{"key":"2187_CR20","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1016\/j.precisioneng.2019.05.002","volume":"58","author":"Yu Long","year":"2019","unstructured":"Long, Yu., Bi, Q., Ji, Y., Fan, Y., Huang, N., & Wang, Y. (2019). Vision based in-process inspection for countersink in automated drilling and riveting. Precision Engineering, 58, 35\u201346.","journal-title":"Precision Engineering"},{"key":"2187_CR21","doi-asserted-by":"crossref","unstructured":"Luker, Z., & Stansbury, E. (2020). In-process hole and fastener inspection using a high-accuracy laser sensor. SAE Technical Paper, 2(2020-01-0015).","DOI":"10.4271\/2020-01-0015"},{"issue":"4","key":"2187_CR22","doi-asserted-by":"publisher","first-page":"8651","DOI":"10.1109\/LRA.2022.3187826","volume":"7","author":"F Mahlknecht","year":"2022","unstructured":"Mahlknecht, F., Gehrig, D., Nash, J. R., Friedrich, M., Morrell, B., Delaune, J., & Scaramuzza, D. (2022). Exploring event camera-based odometry for planetary robots. IEEE Robotics and Automation Letters, 7(4), 8651\u20138658.","journal-title":"IEEE Robotics and Automation Letters"},{"issue":"25","key":"2187_CR23","doi-asserted-by":"publisher","first-page":"G144","DOI":"10.1364\/AO.425623","volume":"60","author":"PN McMahon-Crabtree","year":"2021","unstructured":"McMahon-Crabtree, P. N., & Monet, D. G. (2021). Commercial-off-the-shelf event-based cameras for space surveillance applications. Applied Optics, 60(25), G144\u2013G153.","journal-title":"Applied Optics"},{"issue":"5","key":"2187_CR24","doi-asserted-by":"publisher","first-page":"1881","DOI":"10.1109\/TIM.2019.2919354","volume":"69","author":"FB Naeini","year":"2020","unstructured":"Naeini, F. B., AlAli, A. M., Al-Husari, R., Rigi, A., Al-Sharman, M. K., Makris, D., & Zweiri, Y. (2020). A novel dynamic-vision-based approach for tactile sensing applications. IEEE Transactions on Instrumentation and Measurement, 69(5), 1881\u20131893.","journal-title":"IEEE Transactions on Instrumentation and Measurement"},{"key":"2187_CR25","doi-asserted-by":"publisher","DOI":"10.1016\/j.compstruct.2020.112951","volume":"256","author":"W Nsengiyumva","year":"2021","unstructured":"Nsengiyumva, W., Zhong, S., Lin, J., Zhang, Q., Zhong, J., & Huang, Y. (2021). Advances, limitations and prospects of nondestructive testing and evaluation of thick composites and sandwich structures: A state-of-the-art review. Composite Structures, 256, 112951.","journal-title":"Composite Structures"},{"key":"2187_CR26","doi-asserted-by":"publisher","first-page":"392","DOI":"10.1016\/j.procir.2017.12.231","volume":"67","author":"NDM Phan","year":"2018","unstructured":"Phan, N. D. M., Quinsat, Y., Lavernhe, S., & Lartigue, C. (2018). Path planning of a laser-scanner with the control of overlap for 3d part inspection. Procedia Cirp, 67, 392\u2013397.","journal-title":"Procedia Cirp"},{"issue":"6","key":"2187_CR27","doi-asserted-by":"publisher","first-page":"1964","DOI":"10.1109\/TPAMI.2019.2963386","volume":"43","author":"H Rebecq","year":"2019","unstructured":"Rebecq, H., Ranftl, R., Koltun, V., & Scaramuzza, D. (2019). High speed and high dynamic range video with an event camera. IEEE Transactions on Pattern Analysis and Machine Intelligence, 43(6), 1964\u20131980.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"2187_CR28","doi-asserted-by":"crossref","unstructured":"Rigi, A., Naeini, F. B., Makris, D., & Zweiri, Y. (2018). A novel event-based incipient slip detection using dynamic active-pixel vision sensor (Davis). Sensors, 18(2).","DOI":"10.3390\/s18020333"},{"key":"2187_CR29","doi-asserted-by":"crossref","unstructured":"Sa, J., Ye, F., Shao, Y., An, Y., & Wan, S. (2018). Design and realization of counterbore inspection system based on machine vision. In 2018 5th international conference on systems and informatics (ICSAI) (pp. 87\u201392). IEEE.","DOI":"10.1109\/ICSAI.2018.8599335"},{"key":"2187_CR30","doi-asserted-by":"crossref","unstructured":"Salah, M., Chehadah, M., Humais, M., Wahbah, M., Ayyad, A., Azzam, R., Seneviratne, L., & Zweiri, Y. (2022). A neuromorphic vision-based measurement for robust relative localization in future space exploration missions. IEEE Transactions on Instrumentation and Measurement, 1\u20131.","DOI":"10.1109\/TIM.2022.3217513"},{"key":"2187_CR31","doi-asserted-by":"publisher","first-page":"138","DOI":"10.1016\/j.rcim.2018.11.009","volume":"57","author":"L Shahid","year":"2019","unstructured":"Shahid, L., Janabi-Sharifi, F., & Keenan, P. (2019). A hybrid vision-based surface coverage measurement method for robotic inspection. Robotics and Computer-Integrated Manufacturing, 57, 138\u2013145.","journal-title":"Robotics and Computer-Integrated Manufacturing"},{"key":"2187_CR32","unstructured":"Siqi, J. (2022). Event camera survey and extension application to semantic segmentation. In Proceedings of the 4th international conference on image processing and machine vision, IPMV \u201922, New York, NY (pp. 115\u2013121). Association for Computing Machinery."},{"key":"2187_CR33","doi-asserted-by":"crossref","unstructured":"Smith, J., & Kochhar-Lindgren, D. (2013). Integrated hole and countersink inspection of aircraft components. SAE Technical Paper","DOI":"10.4271\/2013-01-2147"},{"issue":"1","key":"2187_CR34","doi-asserted-by":"publisher","first-page":"33","DOI":"10.5121\/ijcsit.2012.4103","volume":"4","author":"K Sreedhar","year":"2012","unstructured":"Sreedhar, K. (2012). Enhancement of images using morphological transformations. International Journal of Computer Science and Information Technology, 4(1), 33\u201350.","journal-title":"International Journal of Computer Science and Information Technology"},{"key":"2187_CR35","doi-asserted-by":"publisher","first-page":"08","DOI":"10.1088\/2631-8695\/ac1fc7","volume":"3","author":"T Tocci","year":"2021","unstructured":"Tocci, T., Capponi, L., & Rossi, G. (2021). Aruco marker-based displacement measurement technique: Uncertainty analysis. Engineering Research Express, 3, 08.","journal-title":"Engineering Research Express"},{"key":"2187_CR36","unstructured":"Topal, C., Ozsen, O., & Akinlar, C. (2011). Real-time edge segment detection with edge drawing algorithm. In 2011 7th international symposium on image and signal processing and analysis (ISPA) (pp. 313\u2013318)."},{"key":"2187_CR37","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2023.106268","volume":"123","author":"VD Truong","year":"2023","unstructured":"Truong, V. D., Xia, J., Jeong, Y. H., & Yoon, J. (2023). An automatic machine vision-based algorithm for inspection of hardwood flooring defects during manufacturing. Engineering Applications of Artificial Intelligence, 123, 106268.","journal-title":"Engineering Applications of Artificial Intelligence"},{"key":"2187_CR38","doi-asserted-by":"publisher","first-page":"206","DOI":"10.1016\/j.optcom.2016.03.069","volume":"371","author":"JH Wang","year":"2016","unstructured":"Wang, J. H., & Wang, M. R. (2016). Handheld non-contact evaluation of fastener flushness and countersink surface profiles using optical coherence tomography. Optics Communications, 371, 206\u2013212.","journal-title":"Optics Communications"},{"issue":"15","key":"2187_CR39","doi-asserted-by":"publisher","first-page":"5687","DOI":"10.3390\/s22155687","volume":"22","author":"Y Wang","year":"2022","unstructured":"Wang, Y., Yang, J., Peng, X., Wu, P., Gao, L., Huang, K., Chen, J., & Kneip, L. (2022). Visual odometry with an event camera using continuous ray warping and volumetric contrast maximization. Sensors, 22(15), 5687.","journal-title":"Sensors"},{"key":"2187_CR40","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1016\/j.jmsy.2023.01.006","volume":"67","author":"X Yan","year":"2023","unstructured":"Yan, X., & Melkote, S. (2023). Automated manufacturability analysis and machining process selection using deep generative model and Siamese neural networks. Journal of Manufacturing Systems, 67, 57\u201367.","journal-title":"Journal of Manufacturing Systems"},{"key":"2187_CR41","doi-asserted-by":"publisher","DOI":"10.1016\/j.compind.2022.103695","volume":"141","author":"YDV Yasuda","year":"2022","unstructured":"Yasuda, Y. D. V., Cappabianco, F. A. M., Martins, L. E., & Gripp, J. A. B. (2022). Aircraft visual inspection: A systematic literature review. Computers in Industry, 141, 103695.","journal-title":"Computers in Industry"}],"container-title":["Journal of Intelligent Manufacturing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10845-023-02187-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10845-023-02187-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10845-023-02187-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,5]],"date-time":"2024-09-05T12:28:35Z","timestamp":1725539315000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10845-023-02187-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,18]]},"references-count":41,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2024,10]]}},"alternative-id":["2187"],"URL":"https:\/\/doi.org\/10.1007\/s10845-023-02187-0","relation":{},"ISSN":["0956-5515","1572-8145"],"issn-type":[{"value":"0956-5515","type":"print"},{"value":"1572-8145","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,18]]},"assertion":[{"value":"7 March 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 July 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 August 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}