{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T01:30:21Z","timestamp":1781055021167,"version":"3.54.1"},"reference-count":19,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2017,6,27]],"date-time":"2017-06-27T00:00:00Z","timestamp":1498521600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>2D and 3D computer vision systems are frequently being used in automated production to detect and determine the position of objects. Accuracy is important in the production industry, and computer vision systems require structured environments to function optimally. For 2D vision systems, a change in surfaces, lighting and viewpoint angles can reduce the accuracy of a method, maybe even to a degree that it will be erroneous, while for 3D vision systems, the accuracy mainly depends on the 3D laser sensors. Commercially available 3D cameras lack the precision found in high-grade 3D laser scanners, and are therefore not suited for accurate measurements in industrial use. In this paper, we show that it is possible to identify and locate objects using a combination of 2D and 3D cameras. A rough estimate of the object pose is first found using a commercially available 3D camera. Then, a robotic arm with an eye-in-hand 2D camera is used to determine the pose accurately. We show that this increases the accuracy to     &lt; 1     and     &lt; 1    . This was demonstrated in a real industrial assembly task where high accuracy is required.<\/jats:p>","DOI":"10.3390\/robotics6030014","type":"journal-article","created":{"date-parts":[[2017,6,28]],"date-time":"2017-06-28T10:25:56Z","timestamp":1498645556000},"page":"14","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Automated Assembly Using 3D and 2D Cameras"],"prefix":"10.3390","volume":"6","author":[{"given":"Adam","family":"Kleppe","sequence":"first","affiliation":[{"name":"Department of Mechanical and Industrial Engineering, Norwegian University of Science and Technology, N-7491 Trondheim, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Asgeir","family":"Bj\u00f8rkedal","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kristoffer","family":"Larsen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Olav","family":"Egeland","sequence":"additional","affiliation":[{"name":"Department of Mechanical and Industrial Engineering, Norwegian University of Science and Technology, N-7491 Trondheim, Norway"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2017,6,27]]},"reference":[{"key":"ref_1","unstructured":"Dietz, T., and Schneider, U. (2012, January 21\u201322). Programming System for Efficient Use of Industrial Robots for Deburring in SME Environments. Proceedings of the 7th German Conference on Robotics ROBOTIK 2012, Munich, Germany."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Freeman, W.T. (2011, January 23\u201325). Where computer vision needs help from computer science. Proceedings of the ACM-SIAM Symposium on Discrete Algorithms (SODA), San Francisco, CA, USA.","DOI":"10.1137\/1.9781611973082.64"},{"key":"ref_3","unstructured":"Blake, A., and Brelstaff, G. (1988, January 5\u20138). Geometry from Specularities. Proceedings of the Second International Conference on Computer Vision, Tampa, FL, USA."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1109\/MRA.2007.339609","article-title":"Visual Servo Control, Part II: Advanced Approaches","volume":"14","author":"Chaumette","year":"2007","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1006\/cviu.2000.0889","article-title":"A Survey of Free-Form Object Representation and Recognition Techniques","volume":"210","author":"Campbell","year":"2001","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"133","DOI":"10.5194\/isprsarchives-XXXVIII-5-W12-133-2011","article-title":"Accuracy Analysis of Kinect Depth Data","volume":"XXXVIII-5","author":"Khoshelham","year":"2012","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Nguyen, D.D., Ko, J.P., and Jeon, J.W. (2015, January 28\u201330). Determination of 3D object pose in point cloud with CAD model. Proceedings of the 2015 21st Korea-Japan Joint Workshop on Frontiers of Computer Vision, Mokpo, Korea.","DOI":"10.1109\/FCV.2015.7103725"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Luo, R.C., Kuo, C.W., and Chung, Y.T. (2015, January 26\u201330). Model-based 3D Object Recognition and Fetching by a 7-DoF Robot with Online Obstacle Avoidance for Factory Automation. Proceedings of the IEEE International Conference on Robotics and Automation, Seattle, WA, USA.","DOI":"10.1109\/ICRA.2015.7139556"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Lutz, M., Stampfer, D., and Schlegel, C. (2013, January 6\u201310). Probabilistic object recognition and pose estimation by fusing multiple algorithms. Proceedings of the IEEE International Conference on Robotics and Automation, Karlsruhe, Germany.","DOI":"10.1109\/ICRA.2013.6631177"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1179","DOI":"10.1109\/LRA.2016.2532924","article-title":"A Dataset for Improved RGBD-Based Object Detection and Pose Estimation for Warehouse Pick-and-Place","volume":"1","author":"Rennie","year":"2016","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Aldoma, A., Vincze, M., Blodow, N., Gossow, D., Gedikli, S., Rusu, R.B., and Bradski, G. (2011, January 6\u201313). CAD-model recognition and 6DOF pose estimation using 3D cues. Proceedings of the IEEE International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCVW.2011.6130296"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1111\/j.1467-8659.2007.01016.x","article-title":"Efficient RANSAC for point-cloud shape detection","volume":"26","author":"Schnabel","year":"2007","journal-title":"Comput. Graph. Forum"},{"key":"ref_13","unstructured":"Chen, Y., and Medioni, G. (1991, January 9\u201311). Object modeling by registration of multiple range images. Proceedings of the 1991 IEEE International Conference on Robotics and Automation, Sacramento, CA, USA."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Besl, P., and McKay, N. (1992). A Method for Registration of 3-D Shapes. Int. Soc. Opt. Photonics, 586\u2013606.","DOI":"10.1109\/34.121791"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"698","DOI":"10.1109\/TPAMI.1987.4767965","article-title":"Least-squares fitting of two 3-D point sets","volume":"5","author":"Arun","year":"1987","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Rusu, R.B., Blodow, N., and Beetz, M. (2009, January 12\u201317). Fast Point Feature Histograms (FPFH) for 3D registration. Proceedings of the IEEE International Conference on Robotics and Automation, Kobe, Japan.","DOI":"10.1109\/ROBOT.2009.5152473"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Gool, L.V. (2006, January 7\u201313). Surf: Speeded up robust features. Proceedings of the European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kleppe, A.L., Bj\u00f8rkedal, A., Larsen, K., and Egeland, O. (2017, March 31). Website of NTNU MTP Production Group. Available online: https:\/\/github.com\/ps-mtp-ntnu\/Automated-Assembly-using-3D-and-2D-Cameras\/.","DOI":"10.3390\/robotics6030014"}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/6\/3\/14\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:40:30Z","timestamp":1760208030000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/6\/3\/14"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,6,27]]},"references-count":19,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2017,9]]}},"alternative-id":["robotics6030014"],"URL":"https:\/\/doi.org\/10.3390\/robotics6030014","relation":{},"ISSN":["2218-6581"],"issn-type":[{"value":"2218-6581","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,6,27]]}}}