{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:45:49Z","timestamp":1760147149389,"version":"build-2065373602"},"reference-count":35,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2023,1,13]],"date-time":"2023-01-13T00:00:00Z","timestamp":1673568000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001871","name":"Funda\u00e7\u00e3o para a Ci\u00eancia e Tecnologia","doi-asserted-by":"publisher","award":["UIDB\/00127\/2020","POCI-01-0247-FEDER-046103"],"award-info":[{"award-number":["UIDB\/00127\/2020","POCI-01-0247-FEDER-046103"]}],"id":[{"id":"10.13039\/501100001871","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Competitiveness and Internationalization 562 Operational Program, the Lisbon Regional Operational Program, and the European Regional 563 Development Fund","award":["UIDB\/00127\/2020","POCI-01-0247-FEDER-046103"],"award-info":[{"award-number":["UIDB\/00127\/2020","POCI-01-0247-FEDER-046103"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Robotic systems are evolving to include a large number of sensors and diverse sensor modalities. In order to operate a system with multiple sensors, the geometric transformations between those sensors must be accurately estimated. The process by which these transformations are estimated is known as sensor calibration. Behind every sensor calibration approach is a formulation and a framework. The formulation is the method by which the transformations are estimated. The framework is the set of operations required to carry out the calibration procedure. This paper proposes a novel calibration framework that gives more flexibility, control and information to the user, enhancing the user interface and the user experience of calibrating a robotic system. The framework consists of several visualization and interaction functionalities useful for a calibration procedure, such as the estimation of the initial pose of the sensors, the data collection and labeling, the data review and correction and the visualization of the estimation of the extrinsic and intrinsic parameters. This framework is supported by the Atomic Transformations Optimization Method formulation, referred to as ATOM. Results show that this framework is applicable to various robotic systems with different configurations, number of sensors and sensor modalities. In addition to this, a survey comparing the frameworks of different calibration approaches shows that ATOM provides a very good user experience.<\/jats:p>","DOI":"10.3390\/s23020936","type":"journal-article","created":{"date-parts":[[2023,1,13]],"date-time":"2023-01-13T05:09:32Z","timestamp":1673586572000},"page":"936","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["ATOM Calibration Framework: Interaction and Visualization Functionalities"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2455-1849","authenticated-orcid":false,"given":"Manuel","family":"Gomes","sequence":"first","affiliation":[{"name":"Intelligent System Associate Laboratory (LASI), Institute of Electronics and Informatics Engineering of Aveiro (IEETA), University of Aveiro, 3810-193 Aveiro, Portugal"},{"name":"Department of Mechanical Engineering, University of Aveiro, 3810-193 Aveiro, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9288-5058","authenticated-orcid":false,"given":"Miguel","family":"Oliveira","sequence":"additional","affiliation":[{"name":"Intelligent System Associate Laboratory (LASI), Institute of Electronics and Informatics Engineering of Aveiro (IEETA), University of Aveiro, 3810-193 Aveiro, Portugal"},{"name":"Department of Mechanical Engineering, University of Aveiro, 3810-193 Aveiro, Portugal"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1283-7388","authenticated-orcid":false,"given":"V\u00edtor","family":"Santos","sequence":"additional","affiliation":[{"name":"Intelligent System Associate Laboratory (LASI), Institute of Electronics and Informatics Engineering of Aveiro (IEETA), University of Aveiro, 3810-193 Aveiro, Portugal"},{"name":"Department of Mechanical Engineering, University of Aveiro, 3810-193 Aveiro, Portugal"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"118000","DOI":"10.1016\/j.eswa.2022.118000","article-title":"ATOM: A general calibration framework for multi-modal, multi-sensor systems","volume":"207","author":"Oliveira","year":"2022","journal-title":"Expert Syst. Appl."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"965","DOI":"10.1109\/34.159901","article-title":"Camera Calibration with Distortion Models and Accuracy Evaluation","volume":"14","author":"Weng","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Carrera, G., Angeli, A., and Davison, A.J. (2011, January 9\u201313). SLAM-based automatic extrinsic calibration of a multi-camera rig. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980294"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1401","DOI":"10.1177\/0278364915580683","article-title":"Extrinsic calibration of 2D laser rangefinders from perpendicular plane observations","volume":"34","year":"2015","journal-title":"Int. J. Robot. Res."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Almeida, M., Dias, P., Oliveira, M., and Santos, V. (2012). 3D-2D Laser Range Finder Calibration Using a Conic Based Geometry Shape. International Conference Image Analysis and Recognition, Springer.","DOI":"10.1007\/978-3-642-31295-3_37"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Trejos, K., Rinc\u00f3n, L., Bola\u00f1os, M., Fallas, J., and Mar\u00edn, L. (2022). 2D SLAM Algorithms Characterization, Calibration, and Comparison Considering Pose Error, Map Accuracy as Well as CPU and Memory Usage. Sensors, 22.","DOI":"10.3390\/s22186903"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Martinec, D., and Pajdla, T. (2007, January 17\u201322). Robust rotation and translation estimation in multiview reconstruction. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383115"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1109\/70.313105","article-title":"Simultaneous robot\/world and tool\/flange calibration by solving homogeneous transformation equations of the form AX=YB","volume":"10","author":"Zhuang","year":"1994","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Tan, J., An, X., Xu, X., and He, H. (2013, January 7\u20138). Automatic extrinsic calibration for an onboard camera. Proceedings of the 2013 Chinese Automation Congress, Changsha, China.","DOI":"10.1109\/CAC.2013.6775755"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"326","DOI":"10.1016\/j.robot.2016.05.010","article-title":"Self calibration of multiple LIDARs and cameras on autonomous vehicles","volume":"83","author":"Pereira","year":"2016","journal-title":"Robot. Auton. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1016\/j.inffus.2017.04.007","article-title":"Distributed data association in smart camera network via dual decomposition","volume":"39","author":"Jiuqing","year":"2018","journal-title":"Inf. Fusion"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2058","DOI":"10.1109\/TPAMI.2012.125","article-title":"Joint depth and color camera calibration with distortion correction","volume":"34","author":"Kannala","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_13","unstructured":"Zhang, Q., and Pless, R. (October, January 28). Extrinsic calibration of a camera and laser range finder (improves camera calibration). Proceedings of the 2004 IEEE\/RSJ Int. Conf. on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566), Sendai, Japan."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1619","DOI":"10.1109\/TRO.2021.3062306","article-title":"A General Approach to Hand\u2013Eye Calibration Through the Optimization of Atomic Transformations","volume":"37","author":"Pedrosa","year":"2021","journal-title":"IEEE Trans. Robot."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"114894","DOI":"10.1016\/j.eswa.2021.114894","article-title":"A Camera to LiDAR calibration approach through the Optimization of Atomic Transformations","volume":"176","author":"Aguiar","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"103558","DOI":"10.1016\/j.robot.2020.103558","article-title":"A ROS framework for the extrinsic calibration of intelligent vehicles: A multi-sensor, multi-modal approach","volume":"131","author":"Oliveira","year":"2020","journal-title":"Robot. Auton. Syst."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"497","DOI":"10.1016\/j.jmsy.2022.07.006","article-title":"A sensor-to-pattern calibration framework for multi-modal industrial collaborative cells","volume":"64","author":"Rato","year":"2022","journal-title":"J. Manuf. Syst."},{"key":"ref_18","first-page":"119","article-title":"Learning-based computer vision with intel\u2019s open source computer vision library","volume":"9","author":"Bradski","year":"2005","journal-title":"Intel Technol. J."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/MRA.2011.2181749","article-title":"MoveIt!","volume":"19","author":"Chitta","year":"2012","journal-title":"IEEE Robot. Autom. Mag."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1513","DOI":"10.1177\/0278364919842925","article-title":"Communicating and controlling robot arm motion intent through mixed-reality head-mounted displays","volume":"38","author":"Rosen","year":"2019","journal-title":"Int. J. Robot. Res."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1109\/TRO.2016.2529645","article-title":"A General Approach to Spatiotemporal Calibration in Multisensor Systems","volume":"32","author":"Rehder","year":"2016","journal-title":"IEEE Trans. Robot."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Maye, J., Furgale, P., and Siegwart, R. (2013, January 23\u201326). Self-supervised calibration for robotic systems. Proceedings of the 2013 IEEE Intelligent Vehicles Symposium (IV), Gold Coast, QLD, Australia.","DOI":"10.1109\/IVS.2013.6629513"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Grundmann, M., Kwatra, V., Castro, D., and Essa, I. (2012, January 28\u201329). Calibration-free rolling shutter removal. Proceedings of the 2012 IEEE International Conference on Computational Photography (ICCP), Seattle, WA, USA.","DOI":"10.1109\/ICCPhot.2012.6215213"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Furgale, P., Barfoot, T.D., and Sibley, G. (2012, January 14\u201318). Continuous-time batch estimation using temporal basis functions. Proceedings of the 2012 IEEE International Conference on Robotics and Automation, Saint Paul, MN, USA.","DOI":"10.1109\/ICRA.2012.6225005"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Furgale, P., Rehder, J., and Siegwart, R. (2013, January 3\u20137). Unified temporal and spatial calibration for multi-sensor systems. Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan.","DOI":"10.1109\/IROS.2013.6696514"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Yan, G., Liu, Z., Wang, C., Shi, C., Wei, P., Cai, X., Ma, T., Liu, Z., Zhong, Z., and Liu, Y. (2022). OpenCalib: A Multi-sensor Calibration Toolbox for Autonomous Driving. arXiv.","DOI":"10.1016\/j.simpa.2022.100393"},{"key":"ref_27","unstructured":"Leung, K. (2022, October 26). Hand-Eye Calibration Tutorial. Available online: https:\/\/ros-planning.github.io\/moveit_tutorials\/doc\/hand_eye_calibration\/hand_eye_calibration_tutorial.html."},{"key":"ref_28","unstructured":"Schneider, T. (2022, October 26). Kalibr Wiki. Available online: https:\/\/github.com\/ethz-asl\/kalibr\/wiki\/."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Li, G., Xie, X., and Wang, Z. (2017, January 28\u201331). A new algorithm for accurate and automatic chessboard corner detection. Proceedings of the 2017 IEEE International Symposium on Circuits and Systems (ISCAS), Baltimore, MD, USA.","DOI":"10.1109\/ISCAS.2017.8050637"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1016\/j.patcog.2015.09.023","article-title":"Generation of fiducial marker dictionaries using Mixed Integer Linear Programming","volume":"51","author":"Jurado","year":"2016","journal-title":"Pattern Recognit."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1016\/j.imavis.2018.05.004","article-title":"Speeded up detection of squared fiducial markers","volume":"76","author":"Ramirez","year":"2018","journal-title":"Image Vis. Comput."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Hu, D., DeTone, D., and Malisiewicz, T. (2019, January 15\u201320). Deep ChArUco: Dark ChArUco Marker Pose Estimation. Proceedings of the 2019 IEEE\/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00863"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Santos, V., Almeida, J., \u00c1vila, E., Gameiro, D., Oliveira, M., Pascoal, R., Sabino, R., and Stein, P. (2010, January 19\u201322). ATLASCAR-technologies for a computer assisted driving system, on board a common automobile. Proceedings of the 13th International IEEE Conference on Intelligent Transportation Systems, Funchal, Portugal.","DOI":"10.1109\/ITSC.2010.5625031"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Usikhin, O., and Madani, K. (2020). ATLASCAR: A Sample of the Quests and Concerns for Autonomous Cars. International Conference on Informatics in Control, Automation and Robotics, Springer.","DOI":"10.1007\/978-3-030-31993-9"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"625","DOI":"10.1007\/s10459-010-9222-y","article-title":"Likert scales, levels of measurement and the \u201claws\u201d of statistics","volume":"15","author":"Norman","year":"2010","journal-title":"Adv. Health Sci. Educ."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/2\/936\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:05:18Z","timestamp":1760119518000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/2\/936"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,13]]},"references-count":35,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["s23020936"],"URL":"https:\/\/doi.org\/10.3390\/s23020936","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,1,13]]}}}