{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T02:09:28Z","timestamp":1760234968583,"version":"build-2065373602"},"reference-count":33,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2021,7,6]],"date-time":"2021-07-06T00:00:00Z","timestamp":1625529600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["2021R1G1A1009792"],"award-info":[{"award-number":["2021R1G1A1009792"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In intelligent vehicles, extrinsic camera calibration is preferable to be conducted on a regular basis to deal with unpredictable mechanical changes or variations on weight load distribution. Specifically, high-precision extrinsic parameters between the camera coordinate and the world coordinate are essential to implement high-level functions in intelligent vehicles such as distance estimation and lane departure warning. However, conventional calibration methods, which solve a Perspective-n-Point problem, require laborious work to measure the positions of 3D points in the world coordinate. To reduce this inconvenience, this paper proposes an automatic camera calibration method based on 3D reconstruction. The main contribution of this paper is a novel reconstruction method to recover 3D points on planes perpendicular to the ground. The proposed method jointly optimizes reprojection errors of image features projected from multiple planar surfaces, and finally, it significantly reduces errors in camera extrinsic parameters. Experiments were conducted in synthetic simulation and real calibration environments to demonstrate the effectiveness of the proposed method.<\/jats:p>","DOI":"10.3390\/s21144643","type":"journal-article","created":{"date-parts":[[2021,7,6]],"date-time":"2021-07-06T11:36:44Z","timestamp":1625571404000},"page":"4643","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Constrained Multiple Planar Reconstruction for Automatic Camera Calibration of Intelligent Vehicles"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9312-6299","authenticated-orcid":false,"given":"Sang Jun","family":"Lee","sequence":"first","affiliation":[{"name":"Division of Electronic Engineering, Jeonbuk National University, 567 Baekje-daero, Deokjin-gu, Jeonju-si 54896, Jeollabuk-do, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5914-6889","authenticated-orcid":false,"given":"Jae-Woo","family":"Lee","sequence":"additional","affiliation":[{"name":"Samsung Advanced Institute of Technology (SAIT), 130 Samsung-ro, Yeongtong-gu, Suwon-si 16678, Gyeonggi-do, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wonju","family":"Lee","sequence":"additional","affiliation":[{"name":"Samsung Advanced Institute of Technology (SAIT), 130 Samsung-ro, Yeongtong-gu, Suwon-si 16678, Gyeonggi-do, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cheolhun","family":"Jang","sequence":"additional","affiliation":[{"name":"Samsung Advanced Institute of Technology (SAIT), 130 Samsung-ro, Yeongtong-gu, Suwon-si 16678, Gyeonggi-do, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Song, S., and Chandraker, M. (2014, January 23\u201328). Robust scale estimation in real-time monocular SFM for autonomous driving. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.203"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Schonberger, J.L., and Frahm, J.M. (2016, January 27\u201330). Structure-from-motion revisited. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.445"},{"key":"ref_3","unstructured":"Zhou, Z., Jin, H., and Ma, Y. (2012, January 16\u201321). Robust plane-based structure from motion. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1052","DOI":"10.1109\/TPAMI.2007.1049","article-title":"MonoSLAM: Real-time single camera SLAM","volume":"29","author":"Davison","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1147","DOI":"10.1109\/TRO.2015.2463671","article-title":"ORB-SLAM: A versatile and accurate monocular SLAM system","volume":"31","author":"Montiel","year":"2015","journal-title":"IEEE Trans. Robot."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Bustos, A.P., Chin, T.J., Eriksson, A., and Reid, I. (2019, January 20\u201324). Visual SLAM: Why Bundle Adjust?. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8793749"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Mouragnon, E., Lhuillier, M., Dhome, M., Dekeyser, F., and Sayd, P. (2006, January 17\u201322). Real time localization and 3d reconstruction. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, New York, NY, USA.","DOI":"10.1109\/CVPR.2006.236"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Li, Y., Ushiku, Y., and Harada, T. (2019, January 20\u201324). Pose Graph Optimization for Unsupervised Monocular Visual Odometry. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8793706"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1006\/cviu.1997.0547","article-title":"Triangulation","volume":"68","author":"Hartley","year":"1997","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Kanatani, K., Sugaya, Y., and Niitsuma, H. (2008, January 1\u20134). Triangulation from two views revisited: Hartley-Sturm vs.optimal correction. Proceedings of the British Machine Vision Conference, Leeds, UK.","DOI":"10.5244\/C.22.18"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Lindstrom, P. (2010, January 13\u201318). Triangulation made easy. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5539785"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Kanatani, K., Sugaya, Y., and Kanazawa, Y. (2016). Guide to 3D Vision Computation, Springer.","DOI":"10.1007\/978-3-319-48493-8"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.cviu.2004.03.004","article-title":"The geometric error for homographies","volume":"97","author":"Chum","year":"2005","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"67","DOI":"10.2197\/ipsjtcva.3.67","article-title":"Optimal two-view planar scene triangulation","volume":"3","author":"Kanatani","year":"2011","journal-title":"IPSJ Trans. Comput. Vis. Appl."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Miksch, M., Yang, B., and Zimmermann, K. (2010, January 21\u201324). Automatic extrinsic camera self-calibration based on homography and epipolar geometry. Proceedings of the 2010 IEEE Intelligent Vehicles Symposium, La Jolla, CA, USA.","DOI":"10.1109\/IVS.2010.5548048"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1109\/MIM.2015.7335834","article-title":"Camera calibration and pose estimation from planes","volume":"18","author":"Bazargani","year":"2015","journal-title":"IEEE Instrum. Meas. Mag."},{"key":"ref_17","unstructured":"Haralick, R.M., Lee, C.N., Ottenburg, K., and N\u00f6lle, M. (1991, January 3\u20136). Analysis and solutions of the three point perspective pose estimation problem. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Maui, HI, USA."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1016\/0734-189X(89)90052-2","article-title":"An analytic solution for the perspective 4-point problem","volume":"47","author":"Horaud","year":"1989","journal-title":"Comput. Vis. Graph. Image Process."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"774","DOI":"10.1109\/34.784291","article-title":"Linear n-point camera pose determination","volume":"21","author":"Quan","year":"1999","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"930","DOI":"10.1109\/TPAMI.2003.1217599","article-title":"Complete solution classification for the perspective-three-point problem","volume":"25","author":"Gao","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1007\/s11263-008-0152-6","article-title":"Epnp: An accurate o(n) solution to the pnp problem","volume":"81","author":"Lepetit","year":"2009","journal-title":"Int. J. Comput. Vis."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Lee, J., Sung, M., Lee, H., and Kim, J. (2020, January 23\u201328). Neural Geometric Parser for Single Image Camera Calibration. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58610-2_32"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Itu, R., Borza, D., and Danescu, R. (2017, January 7\u20139). Automatic extrinsic camera parameters calibration using Convolutional Neural Networks. Proceedings of the 2017 13th IEEE International Conference on Intelligent Computer Communication and Processing (ICCP), Cluj-Napoca, Romania.","DOI":"10.1109\/ICCP.2017.8117016"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Antunes, M., Barreto, J.P., Aouada, D., and Ottersten, B. (2017, January 21\u201326). Unsupervised vanishing point detection and camera calibration from a single manhattan image with radial distortion. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.708"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wang, X., Ban, K., and Ishii, K. (2009, January 11\u201314). Estimation of mobile robot ego-motion and obstacle depth detection by using optical flow. Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, San Antonio, TX, USA.","DOI":"10.1109\/ICSMC.2009.5346611"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Yamaguchi, K., Kato, T., and Ninomiya, Y. (2006, January 20\u201324). Vehicle ego-motion estimation and moving object detection using a monocular camera. Proceedings of the 18th International Conference on Pattern Recognition (ICPR), Hong Kong, China.","DOI":"10.1109\/ICPR.2006.1165"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Zhao, J. (2020). An efficient solution to non-minimal case essential matrix estimation. IEEE Trans. Pattern Anal. Mach. Intell.","DOI":"10.1109\/TPAMI.2020.3030161"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge Univertity Press.","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Kolupaev, A.V., Metelyov, A.P., Prozorov, D.E., Kurbatova, E.E., and Kharina, N.L. (2018, January 14\u201317). Speed increasing of FOE calculation in autonomous vehicle control systems. Proceedings of the 2018 IEEE East-West Design & Test Symposium (EWDTS), Kazan, Russia.","DOI":"10.1109\/EWDTS.2018.8524815"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","unstructured":"Lucas, B.D., and Kanade, T. (1981, January 24\u201328). An iterative image registration technique with an application to stereo vision. Proceedings of the 7th International Joint Conference on Artificial Intelligence, Vancouver, BC, Canada. Available online: https:\/\/www.researchgate.net\/publication\/215458777."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"756","DOI":"10.1109\/TPAMI.2004.17","article-title":"An efficient solution to the five-point relative pose problem","volume":"26","year":"2004","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/14\/4643\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:26:51Z","timestamp":1760164011000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/14\/4643"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,6]]},"references-count":33,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["s21144643"],"URL":"https:\/\/doi.org\/10.3390\/s21144643","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,7,6]]}}}