{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,25]],"date-time":"2026-02-25T18:08:55Z","timestamp":1772042935606,"version":"3.50.1"},"reference-count":36,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2023,5,29]],"date-time":"2023-05-29T00:00:00Z","timestamp":1685318400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000780","name":"European Union\u2019s Horizon 2020 research and innovation program","doi-asserted-by":"publisher","award":["101006732"],"award-info":[{"award-number":["101006732"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>Multi-camera systems are an effective solution for perceiving large areas or complex scenarios with many occlusions. In such a setup, an accurate camera network calibration is crucial in order to localize scene elements with respect to a single reference frame shared by all the viewpoints of the network. This is particularly important in applications such as object detection and people tracking. Multi-camera calibration is a critical requirement also in several robotics scenarios, particularly those involving a robotic workcell equipped with a manipulator surrounded by multiple sensors. Within this scenario, the robot-world hand-eye calibration is an additional crucial element for determining the exact position of each camera with respect to the robot, in order to provide information about the surrounding workspace directly to the manipulator. Despite the importance of the calibration process in the two scenarios outlined above, namely (i) a camera network, and (ii) a camera network with a robot, there is a lack of standard datasets available in the literature to evaluate and compare calibration methods. Moreover they are usually treated separately and tested on dedicated setups. In this paper, we propose a general standard dataset acquired in a robotic workcell where calibration methods can be evaluated in two use cases: camera network calibration and robot-world hand-eye calibration. The Multi-Eye To Robot Indoor Calibration (METRIC) dataset consists of over 10,000 synthetic and real images of ChAruCo and checkerboard patterns, each one rigidly attached to the robot end-effector, which was moved in front of four cameras surrounding the manipulator from different viewpoints during the image acquisition. The real images in the dataset includes several multi-view image sets captured by three different types of sensor networks: Microsoft Kinect V2, Intel RealSense Depth D455 and Intel RealSense Lidar L515, to evaluate their advantages and disadvantages for calibration. Furthermore, in order to accurately analyze the effect of camera-robot distance on calibration, we acquired a comprehensive synthetic dataset, with related ground truth, with three different camera network setups corresponding to three levels of calibration difficulty depending on the cell size. An additional contribution of this work is to provide a comprehensive evaluation of state-of-the-art calibration methods using our dataset, highlighting their strengths and weaknesses, in order to outline two benchmarks for the two aforementioned use cases.<\/jats:p>","DOI":"10.3390\/info14060314","type":"journal-article","created":{"date-parts":[[2023,5,30]],"date-time":"2023-05-30T02:04:21Z","timestamp":1685412261000},"page":"314","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["METRIC\u2014Multi-Eye to Robot Indoor Calibration Dataset"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-1180-9290","authenticated-orcid":false,"given":"Davide","family":"Allegro","sequence":"first","affiliation":[{"name":"Departement of Information Engineering, University of Padova, Via Giovanni Gradenigo 6b, 35131 Padova, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9862-8469","authenticated-orcid":false,"given":"Matteo","family":"Terreran","sequence":"additional","affiliation":[{"name":"Departement of Information Engineering, University of Padova, Via Giovanni Gradenigo 6b, 35131 Padova, Italy"}]},{"given":"Stefano","family":"Ghidoni","sequence":"additional","affiliation":[{"name":"Departement of Information Engineering, University of Padova, Via Giovanni Gradenigo 6b, 35131 Padova, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2023,5,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Dong, Z., Song, J., Chen, X., Guo, C., and Hilliges, O. (2021, January 11\u201317). Shape-aware multi-person pose estimation from multi-view images. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.01097"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Golda, T., Kalb, T., Schumann, A., and Beyerer, J. (2019, January 18\u201321). Human pose estimation for real-world crowded scenarios. Proceedings of the 2019 16th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Taipei, Taiwan.","DOI":"10.1109\/AVSS.2019.8909823"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Cort\u00e9s, I., Beltr\u00e1n, J., de la Escalera, A., and Garc\u00eda, F. (November, January 19). Sianms: Non-maximum suppression with siamese networks for multi-camera 3d object detection. Proceedings of the 2020 IEEE Intelligent Vehicles Symposium (IV), Las Vegas, NV, USA.","DOI":"10.1109\/IV47402.2020.9304685"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Quintana, M., Karaoglu, S., Alvarez, F., Menendez, J.M., and Gevers, T. (2019). Three-D Wide Faces (3DWF): Facial Landmark Detection and 3D Reconstruction over a New RGB\u2013D Multi-Camera Dataset. Sensors, 19.","DOI":"10.3390\/s19051103"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/j.promfg.2020.10.018","article-title":"Low-cost scalable people tracking system for human-robot collaboration in industrial environment","volume":"51","author":"Terreran","year":"2020","journal-title":"Procedia Manuf."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Zhu, L., Menon, M., Santillo, M., and Linkowski, G. (January, January 24). Occlusion Handling for Industrial Robots. Proceedings of the 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA.","DOI":"10.1109\/IROS45743.2020.9341329"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","unstructured":"Sturm, P.F., and Maybank, S.J. (1999, January 23\u201325). On plane-based camera calibration: A general algorithm, singularities, applications. Proceedings of the Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149), Fort Collins, CO, USA."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1109\/JRA.1987.1087109","article-title":"A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses","volume":"3","author":"Tsai","year":"1987","journal-title":"IEEE J. Robot. Autom."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2280","DOI":"10.1016\/j.patcog.2014.01.005","article-title":"Automatic generation and detection of highly reliable fiducial markers under occlusion","volume":"47","year":"2014","journal-title":"Pattern Recognit."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Shen, J., Xu, W., Luo, Y., Su, P.C., and Cheung, S.C.S. (2014, January 22\u201324). Extrinsic calibration for wide-baseline RGB-D camera network. Proceedings of the 2014 IEEE 16th International Workshop on Multimedia Signal Processing (MMSP), Jakarta, Indonesia.","DOI":"10.1109\/MMSP.2014.6958798"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Kim, E.S., and Park, S.Y. (2019, January 2\u20135). Extrinsic calibration of a camera-LIDAR multi sensor system using a planar chessboard. Proceedings of the 2019 Eleventh International Conference on Ubiquitous and Future Networks (ICUFN), Zagreb, Croatia.","DOI":"10.1109\/ICUFN.2019.8806057"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"525","DOI":"10.1016\/j.robot.2015.10.004","article-title":"OpenPTrack: Open source multi-camera calibration and people tracking for RGB-D camera networks","volume":"75","author":"Munaro","year":"2016","journal-title":"Robot. Auton. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"H\u00f6dlmoser, M., and Kampel, M. (December, January 29). Multiple camera self-calibration and 3D reconstruction using pedestrians. Proceedings of the Advances in Visual Computing: 6th International Symposium, ISVC 2010, Las Vegas, NV, USA. Proceedings, Part II 6.","DOI":"10.1007\/978-3-642-17274-8_1"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Le, Q.V., and Ng, A.Y. (2009, January 10\u201315). Joint calibration of multiple sensors. Proceedings of the 2009 IEEE\/RSJ International Conference on Intelligent Robots and Systems, St. Louis, MO, USA.","DOI":"10.1109\/IROS.2009.5354272"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zhu, Y., Wu, Y., Zhang, Y., and Qu, F. (2021, January 3\u20135). Multi-camera System Calibration of Indoor Mobile Robot Based on SLAM. Proceedings of the 2021 3rd International Conference on Machine Learning, Big Data and Business Intelligence (MLBDBI), Taiyuan, China.","DOI":"10.1109\/MLBDBI54094.2021.00052"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Kroeger, O., Huegle, J., and Niebuhr, C.A. (2019, January 10\u201313). An automatic calibration approach for a multi-camera-robot system. Proceedings of the 2019 24th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), Zaragoza, Spain.","DOI":"10.1109\/ETFA.2019.8869522"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Mi\u0161eikis, J., Glette, K., Elle, O.J., and Torresen, J. (2016, January 13\u201315). Automatic Calibration of a Robot Manipulator and Multi 3D Camera System. Proceedings of the 2016 IEEE\/SICE International Symposium on System Integration (SII), Sapporo, Japan.","DOI":"10.1109\/SII.2016.7844087"},{"key":"ref_19","unstructured":"Sung, H., Lee, S., and Kim, D. (2013, January 24\u201326). A robot-camera hand\/eye self-calibration system using a planar target. Proceedings of the IEEE ISR 2013, Seoul, Republic of Korea."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"\u0160uligoj, F., Jerbi\u0107, B., \u0160vaco, M., \u0160ekoranja, B., Mihalinec, D., and Vidakovi\u0107, J. (October, January 28). Medical applicability of a low-cost industrial robot arm guided with an optical tracking system. Proceedings of the 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany.","DOI":"10.1109\/IROS.2015.7353908"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Su, P.C., Shen, J., Xu, W., Cheung, S.C.S., and Luo, Y. (2018). A fast and robust extrinsic calibration for RGB-D camera networks. Sensors, 18.","DOI":"10.3390\/s18010235"},{"key":"ref_22","unstructured":"Tabb, A., Medeiros, H., Feldmann, M.J., and Santos, T.T. (2019). Calibration of Asynchronous Camera Networks: CALICO. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Wang, Y., Jiang, W., Huang, K., Schwertfeger, S., and Kneip, L. (2022, January 23\u201327). Accurate Calibration of Multi-Perspective Cameras from a Generalization of the Hand-Eye Constraint. Proceedings of the 2022 International Conference on Robotics and Automation (ICRA), Philadelphia, PA, USA.","DOI":"10.1109\/ICRA46639.2022.9811577"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1007\/s00138-017-0841-7","article-title":"Solving the robot-world hand-eye (s) calibration problem with iterative methods","volume":"28","author":"Tabb","year":"2017","journal-title":"Mach. Vis. Appl."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Furgale, P., Rehder, J., and Siegwart, R. (2013, January 3\u20137). Unified temporal and spatial calibration for multi-sensor systems. Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan.","DOI":"10.1109\/IROS.2013.6696514"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Caron, G., and Eynard, D. (2011, January 9\u201313). Multiple camera types simultaneous stereo calibration. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5979975"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Evangelista, D., Allegro, D., Terreran, M., Pretto, A., and Ghidoni, S. (2022, January 6\u20139). An Unified Iterative Hand-Eye Calibration Method for Eye-on-Base and Eye-in-Hand Setups. Proceedings of the 2022 IEEE 27th International Conference on Emerging Technologies and Factory Automation (ETFA), Stuttgart, Germany.","DOI":"10.1109\/ETFA52439.2022.9921738"},{"key":"ref_28","unstructured":"Schweighofer, G., and Pinz, A. (2008). BMVC, BMVA Press."},{"key":"ref_29","first-page":"1530","article-title":"Simultaneous robot-world and hand-eye calibration using dual-quaternions and Kronecker product","volume":"5","author":"Li","year":"2010","journal-title":"Int. J. Phys. Sci."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"031007","DOI":"10.1115\/1.4024473","article-title":"Solving the robot-world\/hand-eye calibration problem using the Kronecker product","volume":"5","author":"Shah","year":"2013","journal-title":"J. Mech. Robot."},{"key":"ref_31","unstructured":"H\u00fcser, T., Sheshadri, S., D\u00f6rge, M., Scherberger, H., and Dann, B. (2023, March 03). JARVIS-MoCap Monkey Grasping Recordings and Annotations. Available online: https:\/\/doi.org\/10.5281\/zenodo.6982805."},{"key":"ref_32","unstructured":"Skaloud, J., Cucci, D.A., and Joseph Paul, K. (2023, March 03). Coaxial Octocopter Open Data with Digicam\u2014IGN Calibration 2. Available online: https:\/\/doi.org\/10.5281\/zenodo.4705424."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1021","DOI":"10.1109\/LRA.2019.2893612","article-title":"General hand\u2014Eye calibration based on reprojection error minimization","volume":"4","author":"Koide","year":"2019","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Wheeler, R., Ng, A.Y., and Berger, E. (2009, January 12\u201317). ROS: An open-source Robot Operating System. Proceedings of the ICRA Workshop on Open Source Software, Kobe, Japan.","DOI":"10.1109\/MRA.2010.936956"},{"key":"ref_35","first-page":"120","article-title":"The openCV library","volume":"25","author":"Bradski","year":"2000","journal-title":"Dr. Dobb\u2019s J. Softw. Tools Prof. Program."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Wang, J., and Olson, E. (2016, January 9\u201314). AprilTag 2: Efficient and robust fiducial detection. Proceedings of the 2016 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Republic of Korea.","DOI":"10.1109\/IROS.2016.7759617"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/6\/314\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:44:43Z","timestamp":1760125483000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/14\/6\/314"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,29]]},"references-count":36,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["info14060314"],"URL":"https:\/\/doi.org\/10.3390\/info14060314","relation":{},"ISSN":["2078-2489"],"issn-type":[{"value":"2078-2489","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,29]]}}}