{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,28]],"date-time":"2026-03-28T11:57:17Z","timestamp":1774699037628,"version":"3.50.1"},"reference-count":34,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2023,4,27]],"date-time":"2023-04-27T00:00:00Z","timestamp":1682553600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"ERDF\u2014European Regional Development Fund","award":["NORTE-01-0247-FEDER-072550"],"award-info":[{"award-number":["NORTE-01-0247-FEDER-072550"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Machine vision systems are widely used in assembly lines for providing sensing abilities to robots to allow them to handle dynamic environments. This paper presents a comparison of 3D sensors for evaluating which one is best suited for usage in a machine vision system for robotic fastening operations within an automotive assembly line. The perception system is necessary for taking into account the position uncertainty that arises from the vehicles being transported in an aerial conveyor. Three sensors with different working principles were compared, namely laser triangulation (SICK TriSpector1030), structured light with sequential stripe patterns (Photoneo PhoXi S) and structured light with infrared speckle pattern (Asus Xtion Pro Live). The accuracy of the sensors was measured by computing the root mean square error (RMSE) of the point cloud registrations between their scans and two types of reference point clouds, namely, CAD files and 3D sensor scans. Overall, the RMSE was lower when using sensor scans, with the SICK TriSpector1030 achieving the best results (0.25 mm \u00b1 0.03 mm), the Photoneo PhoXi S having the intermediate performance (0.49 mm \u00b1 0.14 mm) and the Asus Xtion Pro Live obtaining the higher RMSE (1.01 mm \u00b1 0.11 mm). Considering the use case requirements, the final machine vision system relied on the SICK TriSpector1030 sensor and was integrated with a collaborative robot, which was successfully deployed in an vehicle assembly line, achieving 94% success in 53,400 screwing operations.<\/jats:p>","DOI":"10.3390\/s23094310","type":"journal-article","created":{"date-parts":[[2023,4,27]],"date-time":"2023-04-27T02:18:34Z","timestamp":1682561914000},"page":"4310","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Comparison of 3D Sensors for Automating Bolt-Tightening Operations in the Automotive Industry"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8091-1650","authenticated-orcid":false,"given":"Joana","family":"Dias","sequence":"first","affiliation":[{"name":"INESC TEC\u2014INESC Technology and Science, 4200-465 Porto, Portugal"}]},{"given":"Pedro","family":"Sim\u00f5es","sequence":"additional","affiliation":[{"name":"Europneumaq\u2014Solu\u00e7\u00f5es Industriais, 4410-052 Serzedo, Portugal"}]},{"given":"Nuno","family":"Soares","sequence":"additional","affiliation":[{"name":"Europneumaq\u2014Solu\u00e7\u00f5es Industriais, 4410-052 Serzedo, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8453-4031","authenticated-orcid":false,"given":"Carlos M.","family":"Costa","sequence":"additional","affiliation":[{"name":"INESC TEC\u2014INESC Technology and Science, 4200-465 Porto, Portugal"},{"name":"Faculty of Engineering, University of Porto (FEUP), 4200-465 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7023-8562","authenticated-orcid":false,"given":"Marcelo R.","family":"Petry","sequence":"additional","affiliation":[{"name":"INESC TEC\u2014INESC Technology and Science, 4200-465 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3044-6938","authenticated-orcid":false,"given":"Germano","family":"Veiga","sequence":"additional","affiliation":[{"name":"INESC TEC\u2014INESC Technology and Science, 4200-465 Porto, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8680-4290","authenticated-orcid":false,"given":"Lu\u00eds F.","family":"Rocha","sequence":"additional","affiliation":[{"name":"INESC TEC\u2014INESC Technology and Science, 4200-465 Porto, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2023,4,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Tellaeche, A., Maurtua, I., and Ibarguren, A. (2016, January 6\u20139). Use of machine vision in collaborative robotics: An industrial case. Proceedings of the IEEE International Conference on Emerging Technologies and Factory Automation, ETFA, Berlin, Germany.","DOI":"10.1109\/ETFA.2016.7733689"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/S0262-8856(02)00152-X","article-title":"A survey on industrial vision systems, applications and tools","volume":"21","author":"Malamas","year":"2003","journal-title":"Image Vis. Comput."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"103472","DOI":"10.1016\/j.compind.2021.103472","article-title":"The quiet revolution in machine vision\u2014A state-of-the-art survey paper, including historical review, perspectives, and future directions","volume":"130","author":"Smith","year":"2021","journal-title":"Comput. Ind."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"P\u00e9rez, L., Rodr\u00edguez, \u00cd., Rodr\u00edguez, N., Usamentiaga, R., and Garc\u00eda, D.F. (2016). Robot Guidance Using Machine Vision Techniques in Industrial Environments: A Comparative Review. Sensors, 16.","DOI":"10.3390\/s16030335"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Cuesta, E., Meana, V., \u00c1lvarez, B.J., Giganto, S., and Mart\u00ednez-Pellitero, S. (2022). Metrology Benchmarking of 3D Scanning Sensors Using a Ceramic GD and T-Based Artefact. Sensors, 22.","DOI":"10.3390\/s22228596"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1016\/j.procir.2018.03.043","article-title":"Review of vision-based safety systems for human-robot collaboration","volume":"72","author":"Halme","year":"2018","journal-title":"Procedia CIRP"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1729881418760623","DOI":"10.1177\/1729881418760623","article-title":"Advances in sensing and processing methods for three-dimensional robot vision","volume":"15","author":"He","year":"2018","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.rcim.2014.12.008","article-title":"An adaptive and automated bolt tensioning system for the pitch bearing assembly of wind turbines","volume":"36","author":"Vette","year":"2015","journal-title":"Robot. Comput.-Integr. Manuf."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TCST.2014.2309854","article-title":"Accurate Bolt Tightening Using Model-Free Fuzzy Control for Wind Turbine Hub Bearing Assembly","volume":"23","author":"Deters","year":"2015","journal-title":"IEEE Trans. Control Syst. Technol."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Fang, Y., Wang, H., Wang, X., and Luo, Y. (2020, January 4\u20136). Automated Assembly System for Miniature Bolted Joints During the Gimbal Assembly. Proceedings of the 2020 3rd World Conference on Mechanical Engineering and Intelligent Manufacturing (WCMEIM), Shanghai, China.","DOI":"10.1109\/WCMEIM52463.2020.00086"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Pinto, A.M., Costa, P., Moreira, A.P., Rocha, L.F., Veiga, G., and Moreira, E. (2015, January 8\u201310). Evaluation of Depth Sensors for Robotic Applications. Proceedings of the 2015 IEEE International Conference on Autonomous Robot Systems and Competitions, Vila Real, Portugal.","DOI":"10.1109\/ICARSC.2015.24"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1109\/MRA.2018.2852795","article-title":"An Empirical Evaluation of Ten Depth Cameras: Bias, Precision, Lateral Noise, Different Lighting Conditions and Materials, and Multiple Sensor Setups in Indoor Environments","volume":"26","author":"Suchi","year":"2019","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Heide, N.F., Albrecht, A., and Heizmann, M. (2019, January 28\u201330). SET: Stereo Evaluation Toolbox for Combined Performance Assessment of Camera Systems, 3D Reconstruction and Visual SLAM. Proceedings of the 2019 IEEE 2nd International Conference on Information Communication and Signal Processing (ICICSP), Weihai, China.","DOI":"10.1109\/ICICSP48821.2019.8958548"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"da Silva Neto, J.G., da Lima Silva, P.J., Figueredo, F., Teixeira, J.M.X.N., and Teichrieb, V. (2020, January 7\u201310). Comparison of RGB-D sensors for 3D reconstruction. Proceedings of the 2020 22nd Symposium on Virtual and Augmented Reality (SVR), Porto de Galinhas, Brazil.","DOI":"10.1109\/SVR51698.2020.00046"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"131699","DOI":"10.1109\/ACCESS.2020.3009680","article-title":"Performance Analysis of 10 Models of 3D LiDARs for Automated Driving","volume":"8","author":"Lambert","year":"2020","journal-title":"IEEE Access"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Cop, K.P., Peters, A., \u017dagar, B.L., Hettegger, D., and Knoll, A.C. (2021\u20131, January 27). New Metrics for Industrial Depth Sensors Evaluation for Precise Robotic Applications. Proceedings of the 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Prague, Czech Republic.","DOI":"10.1109\/IROS51168.2021.9636322"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"106763","DOI":"10.1016\/j.optlaseng.2021.106763","article-title":"Comparative study on 3D optical sensors for short range applications","volume":"149","author":"Chen","year":"2022","journal-title":"Opt. Lasers Eng."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wee Sit, E., Walber, C., Walter, P., and Seidlitz, S. (2017). Proceedings of the Sensors and Instrumentation, Volume 5, Springer International Publishing.","DOI":"10.1007\/978-3-319-54987-3"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"136752","DOI":"10.1109\/ACCESS.2019.2941918","article-title":"A Review on Significant Technologies Related to the Robot-Guided Intelligent Bolt Assembly Under Complex or Uncertain Working Conditions","volume":"7","author":"Xu","year":"2019","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Han, Q., Wang, S., Fang, Y., Wang, L., Du, X., Li, H., He, Q., and Feng, Q. (2020). A Rail Fastener Tightness Detection Approach Using Multi-source Visual Sensor. Sensors, 20.","DOI":"10.3390\/s20051367"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1207","DOI":"10.1111\/mice.12797","article-title":"Image-based monitoring of bolt loosening through deep-learning-based integrated detection and tracking","volume":"37","author":"Pan","year":"2022","journal-title":"Comput.-Aided Civ. Infrastruct. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Yang, Q., Tan, K.H., Culbertson, W.B., and Apostolopoulos, J.G. (2010, January 4\u20136). Fusion of active and passive sensors for fast 3D capture. Proceedings of the 2010 IEEE International Workshop on Multimedia Signal Processing, Saint Malo, France.","DOI":"10.1109\/MMSP.2010.5661996"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Franca, J., Gazziro, M., Ide, A., and Saito, J. (2005, January 11\u201314). A 3D scanning system based on laser triangulation and variable field of view. Proceedings of the IEEE International Conference on Image Processing 2005, Genoa, Italy.","DOI":"10.1109\/ICIP.2005.1529778"},{"key":"ref_24","unstructured":"Shahnewaz, A., and Pandey, A.K. (2020). Machine Vision and Navigation, Springer International Publishing."},{"key":"ref_25","unstructured":"Zanuttigh, P., Marin, G., Dal Mutto, C., Dominio, F., Minto, L., and Cortelazzo, G.M. (2016). Technology and Applications, Springer International Publishing."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Orriordan, A., Newe, T., Dooly, G., and Toal, D. (2018, January 4\u20136). Stereo vision sensing: Review of existing systems. Proceedings of the International Conference on Sensing Technology, ICST, Limerick, Ireland.","DOI":"10.1109\/ICSensT.2018.8603605"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Rusu, R.B., and Cousins, S. (2011, January 9\u201313). 3d is here: Point cloud library (pcl). Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980567"},{"key":"ref_28","first-page":"248","article-title":"Segmentation of point clouds using smoothness constraint","volume":"36","author":"Rabbani","year":"2006","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1109\/34.121791","article-title":"A method for registration of 3-D shapes","volume":"14","author":"Besl","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Damodaran, S., Sudheer, A.P., and Kumar, T.K. (2015, January 19\u201321). An evaluation of spatial mapping of indoor environment based on point cloud registration using Kinect sensor. Proceedings of the 2015 International Conference on Control, Communication and Computing India, Trivandrum, India.","DOI":"10.1109\/ICCC.2015.7432958"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Costa, C.M., Sobreira, H.M., Sousa, A.J., and Veiga, G. (2015). 3 DoF\/6 DoF Localization System for Low Computing Power Mobile Robot Platforms. Cut. Edge Res. Technol., 27\u201363.","DOI":"10.5772\/61258"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Costa, C.M., Sobreira, H.M., Sousa, A.J., and Veiga, G.M. (2015, January 17\u201319). Robust and accurate localization system for mobile manipulators in cluttered environments. Proceedings of the 2015 IEEE International Conference on Industrial Technology (ICIT), Seville, Spain.","DOI":"10.1109\/ICIT.2015.7125588"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1016\/j.robot.2015.09.030","article-title":"Robust 3\/6 DoF self-localization system with selective map update for mobile robot platforms","volume":"76","author":"Costa","year":"2016","journal-title":"Robot. Auton. Syst."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Wheeler, R., and Ng, A.Y. (2009, January 12\u201317). ROS: An open-source Robot Operating System. Proceedings of the ICRA Workshop on Open Source Software, Kobe, Japan.","DOI":"10.1109\/MRA.2010.936956"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/9\/4310\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:24:09Z","timestamp":1760124249000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/9\/4310"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,27]]},"references-count":34,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2023,5]]}},"alternative-id":["s23094310"],"URL":"https:\/\/doi.org\/10.3390\/s23094310","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,27]]}}}