{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,5]],"date-time":"2026-11-05T15:55:52Z","timestamp":1793894152777,"version":"4.8.0"},"reference-count":34,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T00:00:00Z","timestamp":1781136000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Autonomous driving systems face critical perception failures in dense fog, where conventional RGB cameras suffer from severe degradation due to atmospheric scattering and reduced visibility. This paper presents an adaptive multi-modal fusion framework that synergistically integrates gated imaging with 3D LiDAR point clouds to achieve robust obstacle detection under visibility conditions as low as 50 m. Unlike standard cameras that passively capture scattered ambient light, gated cameras employ time-synchronized active illumination to physically filter backscattered photons, preserving structural features even in low-visibility scenarios. We propose a novel Adaptive Feature-Weighting Network (AFW-Net) that dynamically adjusts sensor modality contributions based on real-time environmental degradation assessment. The framework incorporates three key innovations: (1) a cross-modal feature extraction module that exploits the complementary physical properties of gated imaging and LiDAR, (2) an attention-based adaptive fusion mechanism that quantifies per-modality reliability through uncertainty estimation, and (3) a degradation-aware training strategy using weather-specific augmentation. Extensive experiments on the Princeton Automated Driving Dataset demonstrate that our approach maintains detection average precision (AP) above 82% under dense fog conditions (50 m visibility), representing a 23.7% improvement over state-of-the-art RGB-LiDAR fusion methods that exhibit substantial performance degradation to 58.4% AP. Ablation studies validate the necessity of each component, and cross-dataset evaluation confirms the generalization capability of the proposed framework. The adaptive weighting mechanism proves particularly effective, dynamically rebalancing modality contributions across the gated imaging and LiDAR branches while maintaining LiDAR geometric constraints. This work establishes a robust perception paradigm for safety-critical autonomous systems operating in low-visibility environmental conditions.<\/jats:p>","DOI":"10.3390\/s26123728","type":"journal-article","created":{"date-parts":[[2026,6,12]],"date-time":"2026-06-12T01:52:08Z","timestamp":1781229128000},"page":"3728","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Adaptive Sensor Fusion for Robust Perception in Dense Fog: A Gated Vision and LiDAR Integration Framework"],"prefix":"10.3390","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-4649-0905","authenticated-orcid":false,"given":"Fengyuan","family":"Zhang","sequence":"first","affiliation":[{"name":"Tandon School of Engineering, New York University, New York, NY 10010, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-2463-5330","authenticated-orcid":false,"given":"Zixuan","family":"Guo","sequence":"additional","affiliation":[{"name":"Steinhardt School, New York University, New York, NY 10010, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-1883-2238","authenticated-orcid":false,"given":"Jianbo","family":"Ding","sequence":"additional","affiliation":[{"name":"SonicWall, Milpitas, CA 95035, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-2200-546X","authenticated-orcid":false,"given":"Jingyun","family":"Yang","sequence":"additional","affiliation":[{"name":"David A. Tepper School of Business, Carnegie Mellon University, Pittsburgh, PA 15213, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenhe","family":"Liu","sequence":"additional","affiliation":[{"name":"David A. Tepper School of Business, Carnegie Mellon University, Pittsburgh, PA 15213, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,6,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1341","DOI":"10.1109\/TITS.2020.2972974","article-title":"Deep multi-modal object detection and semantic segmentation for autonomous driving: Datasets, methods, and challenges","volume":"22","author":"Feng","year":"2020","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Bijelic, M., Gruber, T., Mannan, F., Kraus, F., Ritter, W., Dietmayer, K., and Heide, F. (2020). Seeing through fog without seeing fog: Deep multimodal sensor fusion in unseen adverse weather. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR42600.2020.01170"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"973","DOI":"10.1007\/s11263-018-1072-8","article-title":"Semantic foggy scene understanding with synthetic data","volume":"126","author":"Sakaridis","year":"2018","journal-title":"Int. J. Comput. Vis."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kutila, M., Pyyk\u00f6nen, P., Holzh\u00fcter, H., Colomb, M., and Duthon, P. (2018). Automotive LiDAR performance verification in fog and rain. Proceedings of the 2018 21st International Conference on Intelligent Transportation Systems (ITSC), IEEE.","DOI":"10.1109\/ITSC.2018.8569624"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Hahner, M., Sakaridis, C., Bijelic, M., Heide, F., Yu, F., Dai, D., and Van Gool, L. (2022). Lidar snowfall simulation for robust 3d object detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR52688.2022.01588"},{"key":"ref_6","unstructured":"U.S. Department of Transportation, Federal Highway Administration (2026, April 22). How Do Weather Events Impact Roads? 2010, Available online: https:\/\/ops.fhwa.dot.gov\/weather\/q1_roadimpact.htm."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Vora, S., Lang, A.H., Helou, B., and Beijbom, O. (2020). Pointpainting: Sequential fusion for 3d object detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR42600.2020.00466"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Liang, M., Yang, B., Chen, Y., Hu, R., and Urtasun, R. (2019). Multi-task multi-sensor fusion for 3d object detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR.2019.00752"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Wang, Y., Chen, X., You, Y., Li, L.E., Hariharan, B., Campbell, M., Weinberger, K.Q., and Chao, W.L. (2020). Train in germany, test in the usa: Making 3d object detectors generalize. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR42600.2020.01173"},{"key":"ref_10","unstructured":"Kurup, A., and Bos, J. (2021). Dsor: A scalable statistical filter for removing falling snow from lidar point clouds in severe winter weather. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Walia, A., Walz, S., Bijelic, M., Mannan, F., Julca-Aguilar, F., Langer, M., Ritter, W., and Heide, F. (2022). Gated2gated: Self-supervised depth estimation from gated images. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR52688.2022.00283"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Dreissig, M., Scheuble, D., Piewak, F., and Boedecker, J. (2023). Survey on lidar perception in adverse weather conditions. Proceedings of the 2023 IEEE Intelligent Vehicles Symposium (IV), IEEE.","DOI":"10.1109\/IV55152.2023.10186539"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"49","DOI":"10.5194\/ars-9-49-2011","article-title":"Influences of weather phenomena on automotive laser radar systems","volume":"9","author":"Rasshofer","year":"2011","journal-title":"Adv. Radio Sci."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Bai, X., Hu, Z., Zhu, X., Huang, Q., Chen, Y., Fu, H., and Tai, C.L. (2022). Transfusion: Robust lidar-camera fusion for 3d object detection with transformers. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR52688.2022.00116"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Li, Z., Wang, W., Li, H., Xie, E., Sima, C., Lu, T., Yu, Q., and Dai, J. (2022). Bevformer: Learning bird\u2019s-eye-view representation from multi-camera images via spatiotemporal transformers. arXiv.","DOI":"10.1007\/978-3-031-20077-9_1"},{"key":"ref_16","unstructured":"Qi, C.R., Yi, L., Su, H., and Guibas, L.J. (2017). Pointnet++: Deep hierarchical feature learning on point sets in a metric space. Proceedings of the 31st International Conference on Neural Information Processing Systems, Curran Associates Inc."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Chen, X., Ma, H., Wan, J., Li, B., and Xia, T. (2017). Multi-view 3d object detection network for autonomous driving. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR.2017.691"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Ku, J., Mozifian, M., Lee, J., Harakeh, A., and Waslander, S.L. (2018). Joint 3d proposal generation and object detection from view aggregation. Proceedings of the 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE.","DOI":"10.1109\/IROS.2018.8594049"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Sindagi, V.A., Zhou, Y., and Tuzel, O. (2019). Mvx-net: Multimodal voxelnet for 3d object detection. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), IEEE.","DOI":"10.1109\/ICRA.2019.8794195"},{"key":"ref_20","unstructured":"Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017). Pointnet: Deep learning on point sets for 3d classification and segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yan, Y., Mao, Y., and Li, B. (2018). Second: Sparsely embedded convolutional detection. Sensors, 18.","DOI":"10.3390\/s18103337"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Lang, A.H., Vora, S., Caesar, H., Zhou, L., Yang, J., and Beijbom, O. (2019). Pointpillars: Fast encoders for object detection from point clouds. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR.2019.01298"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Pang, S., Morris, D., and Radha, H. (2020). CLOCs: Camera-LiDAR object candidates fusion for 3D object detection. Proceedings of the 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE.","DOI":"10.1109\/IROS45743.2020.9341791"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Yoo, J.H., Kim, Y., Kim, J., and Choi, J.W. (2020). 3d-cvf: Generating joint camera and lidar features using cross-view spatial feature fusion for 3d object detection. Proceedings of the European Conference on Computer Vision, Springer International Publishing.","DOI":"10.1007\/978-3-030-58583-9_43"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wang, C., Ma, C., Zhu, M., and Yang, X. (2021). Pointaugmenting: Cross-modal augmentation for 3d object detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR46437.2021.01162"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Sakaridis, C., Dai, D., and Van Gool, L. (2021). ACDC: The adverse conditions dataset with correspondences for semantic driving scene understanding. Proceedings of the IEEE\/CVF International Conference on Computer Vision, IEEE.","DOI":"10.1109\/ICCV48922.2021.01059"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Marathe, A., Ramanan, D., Walambe, R., and Kotecha, K. (2023). Wedge: A multi-weather autonomous driving dataset built from generative vision-language models. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPRW59228.2023.00334"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Rothmeier, T., and Huber, W. (2020). Performance evaluation of object detection algorithms under adverse weather conditions. Proceedings of the International Conference on Intelligent Transport Systems, Springer International Publishing.","DOI":"10.1007\/978-3-030-71454-3_13"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Hasirlioglu, S., Kamann, A., Doric, I., and Brandmeier, T. (2016). Test methodology for rain influence on automotive surround sensors. Proceedings of the 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC), IEEE.","DOI":"10.1109\/ITSC.2016.7795918"},{"key":"ref_30","first-page":"968","article-title":"Rare-event prediction in imbalanced data: A unified evaluation and optimization framework for high-risk systems","volume":"9","author":"Abdulrazaq","year":"2023","journal-title":"Commun. Phys. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Gruber, T., Julca-Aguilar, F., Bijelic, M., and Heide, F. (2019). Gated2depth: Real-time dense lidar from gated images. Proceedings of the IEEE\/CVF International Conference on Computer Vision, IEEE.","DOI":"10.1109\/ICCV.2019.00159"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"061303","DOI":"10.1117\/1.OE.51.6.061303","article-title":"Investigation of range-gated imaging in scattering environments","volume":"51","author":"Laurenzis","year":"2012","journal-title":"Opt. Eng."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., and Urtasun, R. (2012). Are we ready for autonomous driving? the kitti vision benchmark suite. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"7517","DOI":"10.1109\/LRA.2021.3098923","article-title":"Pixel-level extrinsic self calibration of high resolution lidar and camera in targetless environments","volume":"6","author":"Yuan","year":"2021","journal-title":"IEEE Robot. Autom. Lett."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/12\/3728\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,12]],"date-time":"2026-06-12T01:53:36Z","timestamp":1781229216000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/12\/3728"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,6,11]]},"references-count":34,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2026,6]]}},"alternative-id":["s26123728"],"URL":"https:\/\/doi.org\/10.3390\/s26123728","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,11]]}}}