{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T18:41:30Z","timestamp":1773081690432,"version":"3.50.1"},"reference-count":29,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T00:00:00Z","timestamp":1773014400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>LiDAR\u2013camera fusion systems are widely used in robotic localization and perception, where accurate extrinsic calibration is crucial for multi-sensor fusion. During long-term operation, extrinsic parameters can drift due to vibration and other disturbances, while target-based recalibration is inconvenient in the field and targetless approaches often suffer from highly non-convex objectives and limited robustness in challenging outdoor scenes.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We propose a targetless LiDAR\u2013camera extrinsic calibration method by minimizing a semantic distribution consistency risk on SE(3). We align semantic probability distributions from the two sensing modalities in the image domain and freeze the pixel sampling measure at an anchor pose, so that pixel weighting no longer depends on the current extrinsic estimate and the objective landscape remains stable during optimization. On top of this anchor-fixed measure, we introduce a direction-aware weighting strategy that emphasizes pixels sensitive to yaw perturbations, improving the conditioning of rotation estimation. We further use a globally balanced Jensen\u2013Shannon divergence to mitigate semantic class imbalance and enhance robustness.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Experiments on the KITTI Odometry dataset show that the proposed method reliably converges from substantial initial perturbations and yields stable extrinsic estimates.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>The results indicate that the method is promising for maintaining long-term LiDAR\u2013camera calibration in real-world robotic systems.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/frobt.2026.1760867","type":"journal-article","created":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T11:06:31Z","timestamp":1773054391000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Targetless LiDAR\u2013camera extrinsic calibration via semantic distribution alignment"],"prefix":"10.3389","volume":"13","author":[{"given":"Xi","family":"Chen","sequence":"first","affiliation":[{"name":"Hefei Institutes of Physical Science, Chinese Academy of Sciences","place":["Hefei, China"]},{"name":"University of Science and Technology of China","place":["Hefei, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bingyu","family":"Sun","sequence":"additional","affiliation":[{"name":"Hefei Institutes of Physical Science, Chinese Academy of Sciences","place":["Hefei, China"]}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2026,3,9]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"2122","DOI":"10.1364\/oe.381176","article-title":"Geometric calibration for lidar-camera system fusing 3d-2d and 3d-3d point correspondences","volume":"28","author":"An","year":"2020","journal-title":"Opt. Express"},{"key":"B2","doi-asserted-by":"publisher","first-page":"15342","DOI":"10.1109\/tits.2024.3419758","article-title":"Survey of extrinsic calibration on lidar-camera system for intelligent vehicle: challenges, approaches, and trends","volume":"25","author":"An","year":"2024","journal-title":"IEEE Trans. Intelligent Transp. Syst."},{"key":"B3","first-page":"9297","article-title":"Semantickitti: a dataset for semantic scene understanding of lidar sequences","volume-title":"Proceedings of the IEEE\/CVF international conference on computer vision (IEEE)","author":"Behley","year":"2019"},{"key":"B4","doi-asserted-by":"publisher","first-page":"1130","DOI":"10.3390\/s20041130","article-title":"A novel calibration board and experiments for 3d lidar and camera calibration","volume":"20","author":"Cai","year":"2020","journal-title":"Sensors"},{"key":"B5","doi-asserted-by":"publisher","first-page":"2862","DOI":"10.1109\/icassp.2016.7472200","article-title":"Autocalibration of lidar and optical cameras via edge alignment","author":"Castorena","year":"2016","journal-title":"IEEE, TR2016-009"},{"key":"B6","doi-asserted-by":"publisher","first-page":"4348","DOI":"10.1016\/j.proeng.2012.01.669","article-title":"Extrinsic calibration of a camera and a laser range finder using point to line constraint","volume":"29","author":"Chen","year":"2012","journal-title":"Procedia Eng."},{"key":"B7","volume-title":"4d spatio-temporal convnets: minkowski convolutional neural networks","author":"Choy","year":"2019"},{"key":"B8","first-page":"3936","article-title":"Automatic camera and range sensor calibration using a single shot","volume-title":"2012 IEEE international conference on robotics and automation (ICRA)","author":"Geiger","year":"2012"},{"key":"B9","doi-asserted-by":"crossref","first-page":"7342","DOI":"10.1109\/IROS.2018.8593360","article-title":"Lidar and camera calibration using motions estimated by sensor fusion odometry","volume-title":"2018 IEEE\/RSJ international conference on intelligent robots and systems (IROS)","author":"Ishikawa","year":"2018"},{"key":"B10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/MFI52462.2021.9591203","article-title":"Semcal: semantic lidar-camera calibration using neural mutual information estimator","volume-title":"2021 IEEE international conference on multisensor fusion and integration for intelligent systems (MFI)","author":"Jiang","year":"2021"},{"key":"B11","doi-asserted-by":"publisher","first-page":"158","DOI":"10.1002\/rob.21893","article-title":"Automatic targetless camera\u2013lidar calibration by aligning edge with gaussian mixture model","volume":"37","author":"Kang","year":"2020","journal-title":"J. Field Robotics"},{"key":"B12","doi-asserted-by":"crossref","DOI":"10.1109\/ICRA48891.2023.10160691","article-title":"General, single-shot, target-less, and automatic lidar-camera extrinsic calibration toolbox","volume-title":"2023 IEEE international conference on robotics and automation (ICRA) (IEEE)","author":"Koide","year":"2023"},{"key":"B13","first-page":"6042","article-title":"Analytic plane covariances construction for precise planarity-based extrinsic calibration of camera and lidar","volume-title":"Proc. IEEE international conference on robotics and automation (ICRA)","author":"Koo","year":"2020"},{"key":"B14","doi-asserted-by":"publisher","first-page":"9949","DOI":"10.1007\/s10462-022-10317-y","article-title":"Automatic targetless lidar-camera calibration: a survey","volume":"56","author":"Li","year":"2023","journal-title":"Artif. Intell. Rev."},{"key":"B15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/tgrs.2023.3278024","article-title":"Se-calib: semantic edge-based lidar\u2013camera boresight online calibration in urban scenes","volume":"61","author":"Liao","year":"2023","journal-title":"IEEE Trans. Geoscience Remote Sens."},{"key":"B16","doi-asserted-by":"crossref","first-page":"14527","DOI":"10.1109\/ICRA57147.2024.10610560","article-title":"Sgcalib: a two-stage camera-lidar calibration method using semantic information and geometric features","volume-title":"2024 IEEE international conference on robotics and automation (ICRA)","author":"Lin","year":"2024"},{"key":"B17","doi-asserted-by":"publisher","first-page":"14472","DOI":"10.1109\/icra57147.2024.10610983","article-title":"Zero-training lidar-camera extrinsic calibration method using segment anything model","author":"Luo","year":"2024","journal-title":"IEEE"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2103.04558","article-title":"Crlf: automatic calibration and refinement based on line feature for lidar and camera in road scenes","author":"Ma","year":"2021","journal-title":"arXiv Preprint arXiv:2103.04558"},{"key":"B19","first-page":"3685","volume-title":"Line-based extrinsic calibration of range and image sensors. In 2013 IEEE international conference on robotics and automation (ICRA)","author":"Moghadam","year":"2013"},{"key":"B20","doi-asserted-by":"publisher","first-page":"2053","DOI":"10.1609\/aaai.v26i1.8379","article-title":"Automatic targetless extrinsic calibration of a 3d lidar and camera by maximizing mutual information","volume":"26","author":"Pandey","year":"2012","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"B21","first-page":"4647","article-title":"Optimal hand-eye calibration","volume-title":"2006 IEEE\/RSJ international conference on intelligent robots and systems (IROS)","author":"Strobl","year":"2006"},{"key":"B22","first-page":"1293","article-title":"Automatic calibration of multi-modal sensor systems using a gradient orientation measure","volume-title":"2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS)","author":"Taylor","year":"2013"},{"key":"B23","first-page":"3781","article-title":"Extrinsic camera calibration with semantic segmentation","volume-title":"Proc. IEEE international conference on intelligent transportation systems (ITSC)","author":"Tsaregorodtsev","year":"2022"},{"key":"B24","doi-asserted-by":"crossref","DOI":"10.1109\/CVPR52729.2023.01385","article-title":"Internimage: exploring large-scale vision foundation models with deformable convolutions","volume-title":"Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (CVPR)","author":"Wang","year":"2023"},{"key":"B25","doi-asserted-by":"publisher","first-page":"6487","DOI":"10.1109\/lra.2022.3173033","article-title":"A4lidartag: depth-based fiducial marker for extrinsic calibration of solid-state lidar and camera","volume":"7","author":"Xie","year":"2022","journal-title":"IEEE Robotics Automation Lett."},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2312.01085","article-title":"Robustcalib: robust lidar-camera extrinsic calibration with consistency learning","author":"Xu","year":"2023","journal-title":"arXiv Preprint arXiv:2312.01085"},{"key":"B27","doi-asserted-by":"publisher","first-page":"19871","DOI":"10.1109\/jsen.2023.3297522","article-title":"Automatic and targetless lidar\u2013camera extrinsic calibration using edge alignment","volume":"23","author":"Yin","year":"2023","journal-title":"IEEE Sensors J."},{"key":"B28","first-page":"2301","article-title":"Extrinsic calibration of a camera and laser range finder (improves camera calibration)","volume-title":"Proceedings of the IEEE\/RSJ international conference on intelligent robots and systems (IROS)","author":"Zhang","year":"2004"},{"key":"B29","first-page":"4970","article-title":"Online camera-lidar calibration with sensor semantic information","volume-title":"Proc. IEEE international conference on robotics and automation (ICRA)","author":"Zhu","year":"2020"}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2026.1760867\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T11:06:36Z","timestamp":1773054396000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2026.1760867\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,9]]},"references-count":29,"alternative-id":["10.3389\/frobt.2026.1760867"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2026.1760867","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,9]]},"article-number":"1760867"}}