{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T08:48:06Z","timestamp":1775810886784,"version":"3.50.1"},"reference-count":37,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2017,6,24]],"date-time":"2017-06-24T00:00:00Z","timestamp":1498262400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Camera calibration is a crucial problem in many applications, such as 3D reconstruction, structure from motion, object tracking and face alignment. Numerous methods have been proposed to solve the above problem with good performance in the last few decades. However, few methods are targeted at joint calibration of multi-sensors (more than four devices), which normally is a practical issue in the real-time systems. In this paper, we propose a novel method and a corresponding workflow framework to simultaneously calibrate relative poses of a Kinect and three external cameras. By optimizing the final cost function and adding corresponding weights to the external cameras in different locations, an effective joint calibration of multiple devices is constructed. Furthermore, the method is tested in a practical platform, and experiment results show that the proposed joint calibration method can achieve a satisfactory performance in a project real-time system and its accuracy is higher than the manufacturer\u2019s calibration.<\/jats:p>","DOI":"10.3390\/s17071491","type":"journal-article","created":{"date-parts":[[2017,6,27]],"date-time":"2017-06-27T02:58:05Z","timestamp":1498532285000},"page":"1491","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":45,"title":["Simultaneous Calibration: A Joint Optimization Approach for Multiple Kinect and External Cameras"],"prefix":"10.3390","volume":"17","author":[{"given":"Yajie","family":"Liao","sequence":"first","affiliation":[{"name":"Key Laboratory of Metallurgical Equipment and Control Technology, Wuhan University of Science and Technology, Ministry of Education, Wuhan 430081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ying","family":"Sun","sequence":"additional","affiliation":[{"name":"Key Laboratory of Metallurgical Equipment and Control Technology, Wuhan University of Science and Technology, Ministry of Education, Wuhan 430081, China"},{"name":"Hubei Key Laboratory of Mechanical Transmission and Manufacturing Engineering, Wuhan University of Science and Technology, Wuhan 430081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gongfa","family":"Li","sequence":"additional","affiliation":[{"name":"Key Laboratory of Metallurgical Equipment and Control Technology, Wuhan University of Science and Technology, Ministry of Education, Wuhan 430081, China"},{"name":"Hubei Key Laboratory of Mechanical Transmission and Manufacturing Engineering, Wuhan University of Science and Technology, Wuhan 430081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianyi","family":"Kong","sequence":"additional","affiliation":[{"name":"Key Laboratory of Metallurgical Equipment and Control Technology, Wuhan University of Science and Technology, Ministry of Education, Wuhan 430081, China"},{"name":"Hubei Key Laboratory of Mechanical Transmission and Manufacturing Engineering, Wuhan University of Science and Technology, Wuhan 430081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guozhang","family":"Jiang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Metallurgical Equipment and Control Technology, Wuhan University of Science and Technology, Ministry of Education, Wuhan 430081, China"},{"name":"Hubei Key Laboratory of Mechanical Transmission and Manufacturing Engineering, Wuhan University of Science and Technology, Wuhan 430081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Du","family":"Jiang","sequence":"additional","affiliation":[{"name":"Hubei Key Laboratory of Mechanical Transmission and Manufacturing Engineering, Wuhan University of Science and Technology, Wuhan 430081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haibin","family":"Cai","sequence":"additional","affiliation":[{"name":"School of Computing, University of Portsmouth, Portsmouth PO1 3HE, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhaojie","family":"Ju","sequence":"additional","affiliation":[{"name":"School of Computing, University of Portsmouth, Portsmouth PO1 3HE, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7655-9228","authenticated-orcid":false,"given":"Hui","family":"Yu","sequence":"additional","affiliation":[{"name":"School of Computing, University of Portsmouth, Portsmouth PO1 3HE, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Honghai","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Computing, University of Portsmouth, Portsmouth PO1 3HE, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2017,6,24]]},"reference":[{"key":"ref_1","unstructured":"Zhang, Z. (1999, January 20\u201327). Flexible Camera Calibration by Viewing a Plane from Unknown Orientations. Proceedings of the IEEE 1999 Seventh International Conference on Computer Vision, Kerkyra, Greece."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1617","DOI":"10.1016\/S0031-3203(01)00126-1","article-title":"A comparative review of camera calibrating methods with accuracy evaluation","volume":"35","author":"Salvi","year":"2002","journal-title":"Pattern Recognit."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1902","DOI":"10.3390\/s130201902","article-title":"3D LIDAR-camera extrinsic calibration using an arbitrary trihedron","volume":"13","author":"Gong","year":"2013","journal-title":"Sensors"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.jvcir.2013.02.011","article-title":"Calibrated depth and color cameras for accurate 3D interaction in a stereoscopic augmented reality environment","volume":"25","author":"Canessa","year":"2014","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"242","DOI":"10.3390\/s17020242","article-title":"Structure-From-Motion in 3D Space Using 2D Lidars","volume":"17","author":"Choi","year":"2017","journal-title":"Sensors"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"013032","DOI":"10.1117\/1.JEI.25.1.013032","article-title":"Object tracking based on bit-planes","volume":"25","author":"Li","year":"2016","journal-title":"J. Electron. Imaging"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1513","DOI":"10.1109\/TPAMI.2006.178","article-title":"Camera calibration from video of a walking human","volume":"28","author":"Lv","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","first-page":"481","article-title":"Depth camera in computer vision and computer graphics: An overview","volume":"5","author":"Xiang","year":"2011","journal-title":"J. Front. Comput. Sci. Technol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"253","DOI":"10.3390\/s17020253","article-title":"An Interactive Image Segmentation Method in Hand Gesture Recognition","volume":"17","author":"Chen","year":"2017","journal-title":"Sensors"},{"key":"ref_10","first-page":"238","article-title":"Optimal grasp planning of multi-fingered robotic hands: A review","volume":"14","author":"Miao","year":"2015","journal-title":"Appl. Comput. Math."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/MMUL.2012.24","article-title":"Microsoft kinect sensor and its effect","volume":"19","author":"Zhang","year":"2012","journal-title":"IEEE Multimed."},{"key":"ref_12","unstructured":"Henry, P., Krainin, M., Herbst, E., Ren, X., and Fox, D. (2010). RGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments. The 12th International Symposium on Experimental Robotics (ISER), Springer."},{"key":"ref_13","unstructured":"Burrus, N. (2011, November 10). Kinect Calibration. Available online: http:\/\/nicolas.burrus.name\/index.php\/Research\/KinectCalibration."},{"key":"ref_14","unstructured":"Yamazoe, H., Habe, H., Mitsugami, I., and Yagi, Y. (2012, January 11\u201315). Easy Depth Sensor Calibration. Proceedings of the 2012 21st International Conference on Pattern Recognition (ICPR), Tsukuba, Japan."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Herrera, D., Kannala, J., and Heikkil\u00e4, J. (2011). Accurate and Practical Calibration of a Depth and Color Camera Pair. International Conference on Computer Analysis of Images and Patterns, Springer.","DOI":"10.1007\/978-3-642-23678-5_52"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zhang, C., and Zhang, Z. (2014). Calibration between depth and color sensors for commodity depth cameras. Computer Vision and Machine Learning with RGB-D Sensors, Springer.","DOI":"10.1007\/978-3-319-08651-4_3"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Smisek, J., Jancosek, M., and Pajdla, T. (2013). 3D with Kinect. Consumer Depth Cameras for Computer Vision, Springer.","DOI":"10.1007\/978-1-4471-4640-7_1"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2058","DOI":"10.1109\/TPAMI.2012.125","article-title":"Joint depth and color camera calibration with distortion correction","volume":"34","author":"Herrera","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Raposo, C., Barreto, J.P., and Nunes, U. (July, January 29). Fast and Accurate Calibration of a Kinect Sensor. Proceedings of the 2013 International Conference on 3DTV-Conference, Washington, DC, USA.","DOI":"10.1109\/3DV.2013.52"},{"key":"ref_20","first-page":"1584","article-title":"Calibration of Kinect sensor with depth and color camera","volume":"19","author":"Guo","year":"2014","journal-title":"J. Image Graph."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"074211","DOI":"10.7498\/aps.63.074211","article-title":"Calibration of D-RGB camera networks by skeleton-based viewpoint invariance transformation","volume":"63","author":"Han","year":"2014","journal-title":"Acta Phys. Sin."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1066","DOI":"10.1109\/34.879788","article-title":"Geometric camera calibration using circular control points","volume":"22","author":"Heikkila","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"965","DOI":"10.1109\/34.159901","article-title":"Camera calibration with distortion models and accuracy evaluation","volume":"14","author":"Weng","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1016\/j.patcog.2007.06.012","article-title":"A new calibration model of camera lens distortion","volume":"41","author":"Wang","year":"2008","journal-title":"Pattern Recognit."},{"key":"ref_25","first-page":"1415","article-title":"Research on the method of step feature extraction for EOD robot based on 2D laser radar","volume":"8","author":"Yin","year":"2015","journal-title":"Discrete Cont Dyn-S"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1550011","DOI":"10.1142\/S0219843615500115","article-title":"A multichannel surface emg system for hand motion recognition","volume":"12","author":"Fang","year":"2015","journal-title":"Int. J. Hum. Robot."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_28","unstructured":"Unnikrishnan, R., and Hebert, M. (2005). Fast Extrinsic Calibration of a Laser Rangefinder to a Camera, Carnegie Mellon University."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"359","DOI":"10.3390\/s16030359","article-title":"Measurement of 3-D Vibrational Motion by Dynamic Photogrammetry Using Least-Square Image Matching for Sub-Pixel Targeting to Improve Accuracy","volume":"16","author":"Lee","year":"2016","journal-title":"Sensors"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1007\/s11390-016-1641-7","article-title":"A Linear Approach for Depth and Colour Camera Calibration Using Hybrid Parameters","volume":"31","author":"Cheng","year":"2016","journal-title":"J. Comput. Sci. Technol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1051","DOI":"10.12785\/amis\/070324","article-title":"Intelligent control of air compressor production process","volume":"7","author":"Li","year":"2013","journal-title":"Appl. Math. Inform. Sci."},{"key":"ref_32","first-page":"1223","article-title":"Intelligent control model and its simulation of flue temperature in coke oven","volume":"8","author":"Li","year":"2015","journal-title":"Discrete Cont Dyn-S"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1109\/TIP.2014.2371234","article-title":"Weighted guided image filtering","volume":"24","author":"Li","year":"2015","journal-title":"IEEE Trans. Image Proc."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"745","DOI":"10.1016\/j.image.2013.03.005","article-title":"Depth image enlargement using an evolutionary approach","volume":"28","author":"Chen","year":"2013","journal-title":"Signal Proc. Soc. Image Commun."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s11263-015-0866-1","article-title":"Caliber: Camera Localization and Calibration Using Rigidity Constraints","volume":"118","author":"Liu","year":"2016","journal-title":"Int. J. Comput. Vis."},{"key":"ref_36","first-page":"4487","article-title":"Air-fuel ratio intelligent control in coke oven combustion process","volume":"15","author":"Li","year":"2012","journal-title":"INF Int. J."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1043","DOI":"10.12785\/amis\/070323","article-title":"Coke oven intelligent integrated control system","volume":"7","author":"Li","year":"2013","journal-title":"Appl. Math. Inform. Sci."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/7\/1491\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:40:19Z","timestamp":1760208019000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/7\/1491"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,6,24]]},"references-count":37,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2017,7]]}},"alternative-id":["s17071491"],"URL":"https:\/\/doi.org\/10.3390\/s17071491","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,6,24]]}}}