{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T10:07:19Z","timestamp":1779271639976,"version":"3.51.4"},"reference-count":49,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T00:00:00Z","timestamp":1779235200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T00:00:00Z","timestamp":1779235200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Hochschule f\u00fcr angewandte Wissenschaften M\u00fcnchen"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["SN COMPUT. SCI."],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    Adverse weather conditions, such as fog and rain, pose major challenges for autonomous vehicle perception by degrading sensor data quality. However, existing datasets rarely offer reproducible conditions or quantitative evaluations of sensor performance. To address this, we present MuFoRa, a multimodal dataset acquired in a controlled indoor facility using a stereo camera and two solid-state LiDAR sensors. Data were collected under clear and night conditions, as well as under simulated fog (5\u00a0m to 160\u00a0m visibility) and rain (\n                    <jats:inline-formula>\n                      <jats:tex-math>$${20}\\,\\text {mm}\\,\\text {h}^{-1}$$<\/jats:tex-math>\n                    <\/jats:inline-formula>\n                    to\n                    <jats:inline-formula>\n                      <jats:tex-math>$${100}\\,\\text {mm}\\,\\text {h}^{-1}$$<\/jats:tex-math>\n                    <\/jats:inline-formula>\n                    ), with target distances from 5\u00a0m to 50\u00a0m. Sensor degradation is assessed using normalised image entropy for camera data and the inlier ratio of points relative to their distance from the surface of a spherical target for LiDAR data. Results show that camera performance is moderately affected by rain and strongly affected by fog, with normalised entropy dropping by 35% and 57%, respectively. LiDAR performance remains stable under moderate rain, but degrades under dense fog and heavy rain, with inlier ratios reduced by up to 41% and 44%, respectively. Additionally, we propose a semi-automated approach for evaluating calibration accuracy using a spherical target, which includes a circle detection benchmark with 24 deep learning models. The MuFoRa dataset enables reproducible quantitative benchmarking of perception and calibration under controlled weather conditions, supporting the development of robust multimodal perception systems for autonomous driving.\n                  <\/jats:p>","DOI":"10.1007\/s42979-026-04976-9","type":"journal-article","created":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T09:20:14Z","timestamp":1779268814000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["MuFoRa: A Multimodal Dataset and the Impact of Adverse Weather on Camera and LiDAR"],"prefix":"10.1007","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-2479-6677","authenticated-orcid":false,"given":"Valentino","family":"Behret","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Regina","family":"Kushtanova","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Simon","family":"Weber","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Julian","family":"Wiesner","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Thomas","family":"Helmer","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Frank","family":"Palme","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2026,5,20]]},"reference":[{"key":"4976_CR1","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1016\/j.isprsjprs.2022.12.021","volume":"196","author":"Y Zhang","year":"2023","unstructured":"Zhang Y, Carballo A, Yang H, Takeda K. Perception and Sensing for Autonomous Vehicles Under Adverse Weather Conditions: A Survey. ISPRS J Photogramm Remote Sens. 2023;196:146\u201377.","journal-title":"ISPRS J Photogramm Remote Sens"},{"key":"4976_CR2","first-page":"8887","volume":"975","author":"D Feng","year":"2020","unstructured":"Feng D, Haase-Sch\u00fctz C, Rosenbaum L, Hertlein H, Glaeser C, Timm F, et al. Deep Multi-Modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges. IEEE Trans Intell Transp Syst. 2020;975:8887.","journal-title":"IEEE Trans Intell Transp Syst"},{"key":"4976_CR3","first-page":"6","volume":"64","author":"K Bengler","year":"2014","unstructured":"Bengler K, Dietmayer K, Farber B, Maurer M, Stiller C, Winner H. Three Decades of Driver Assistance Systems: Review and Future Perspectives. IEEE Intell Transp Syst Mag. 2014;64:6\u201322.","journal-title":"IEEE Intell Transp Syst Mag"},{"key":"4976_CR4","doi-asserted-by":"publisher","DOI":"10.1115\/1.4052991","volume":"13","author":"R Ayala","year":"2021","unstructured":"Ayala R, Mohd TK. Sensors in Autonomous Vehicles: A Survey. Journal of Autonomous Vehicles and Systems. 2021;13:031003.","journal-title":"Journal of Autonomous Vehicles and Systems"},{"key":"4976_CR5","doi-asserted-by":"crossref","unstructured":"Corral-Soto ER, Bingbing L. Understanding Strengths and Weaknesses of Complementary Sensor Modalities in Early Fusion for Object Detection. 2020 IEEE Intelligent Vehicles Symposium (IV) (2020)","DOI":"10.1109\/IV47402.2020.9304558"},{"key":"4976_CR6","doi-asserted-by":"crossref","unstructured":"Br\u00f6dermann T, Sakaridis C, Fu Y, Van\u00a0Gool L. CAFuser: Condition-Aware Multimodal Fusion for Robust Semantic Perception of Driving Scenes. IEEE Robotics and Automation Letters (2025)","DOI":"10.1109\/LRA.2025.3536218"},{"key":"4976_CR7","doi-asserted-by":"crossref","unstructured":"Diaz-Ruiz CA, Xia Y, You Y, Nino J, Chen J, Monica J, Chen X, Luo K, Wang Y, Emond M, et al. Ithaca365: Dataset and Driving Perception under Repeated and Challenging Weather Conditions. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (2022)","DOI":"10.1109\/CVPR52688.2022.02069"},{"key":"4976_CR8","unstructured":"Matuszka T, Barton I, Butykai \u00c1, Hajas P, Kiss D, Kov\u00e1cs D, Kuns\u00e1gi-M\u00e1t\u00e9 S, Lengyel P, N\u00e9meth G, Pet\u0151 L, et al. aiMotive Dataset: A Multimodal Dataset for Robust Autonomous Driving with Long-Range Perception. arXiv preprint arXiv:2211.09445 (2022)"},{"key":"4976_CR9","first-page":"3","volume":"361","author":"W Maddern","year":"2016","unstructured":"Maddern W, Pascoe G, Linegar C, Newman P. 1 Year, 1000 km: The Oxford RobotCar Dataset. The International Journal of Robotics Research. 2016;361:3\u201315.","journal-title":"The International Journal of Robotics Research"},{"key":"4976_CR10","doi-asserted-by":"publisher","first-page":"2247","DOI":"10.3390\/rs16122247","volume":"1612","author":"Y Zhang","year":"2024","unstructured":"Zhang Y, Ding M, Yang H, Niu Y, Ge M, Ohtani K, et al. LiDAR Point Cloud Augmentation for Adverse Conditions Using Conditional Generative Model. Remote Sensing. 2024;1612:2247.","journal-title":"Remote Sensing"},{"key":"4976_CR11","doi-asserted-by":"crossref","unstructured":"Bijelic M, Gruber T, Mannan F, Kraus F, Ritter W, Dietmayer K, Heide F. Seeing Through Fog Without Seeing Fog: Deep Multimodal Sensor Fusion in Unseen Adverse Weather. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (2020)","DOI":"10.1109\/CVPR42600.2020.01170"},{"key":"4976_CR12","doi-asserted-by":"crossref","unstructured":"Bijelic M, Gruber T, Ritter W. A Benchmark for Lidar Sensors in Fog: Is Detection Breaking Down? In: 2018 IEEE Intelligent Vehicles Symposium (IV) (2018)","DOI":"10.1109\/IVS.2018.8500543"},{"key":"4976_CR13","doi-asserted-by":"crossref","unstructured":"Fadl I, Sch\u00f6n T, Behret V, Brandmeier T, Palme F, Helmer T. Environment Setup and Model Benchmark of the MuFoRa Dataset. In: Proceedings of the 20th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, Volume 2: VISAPP (2025). SciTePress","DOI":"10.5220\/0013307900003912"},{"key":"4976_CR14","doi-asserted-by":"crossref","unstructured":"Behret V, Kushtanova R, Fadl I, Weber S, Helmer T, Palme F. Sensor Calibration and Data Analysis of the MuFoRa Dataset. In: Proceedings of the 20th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, Volume 2: VISAPP (2025). SciTePress","DOI":"10.5220\/0013310400003912"},{"key":"4976_CR15","unstructured":"Kassir A, Peynot T. Reliable Automatic Camera-Laser Calibration. In: Proceedings of the 2010 Australasian Conference on Robotics & Automation (2010). Australian Robotics and Automation Association (ARAA)"},{"key":"4976_CR16","doi-asserted-by":"crossref","unstructured":"Sheeny M, De\u00a0Pellegrin E, Mukherjee S, Ahrabian A, Wang S, Wallace A. RADIATE: A Radar Dataset for Automotive Perception in Bad Weather. 2021 IEEE International Conference on Robotics and Automation (ICRA) (2021)","DOI":"10.1109\/ICRA48506.2021.9562089"},{"key":"4976_CR17","doi-asserted-by":"crossref","unstructured":"Burnett K, Yoon DJ, Wu Y, Li AZ, Zhang H, Lu S, Qian J, Tseng W-K, Lambert A, Leung KY, et al. Boreas: A Multi-Season Autonomous Driving Dataset. The International Journal of Robotics Research (2023)","DOI":"10.1177\/02783649231160195"},{"key":"4976_CR18","doi-asserted-by":"crossref","unstructured":"Gruber T, Bijelic M, Heide F, Ritter W, Dietmayer K. Pixel-Accurate Depth Evaluation in Realistic Driving Scenarios. 2019 International Conference on 3D Vision (3DV) (2019). IEEE","DOI":"10.1109\/3DV.2019.00020"},{"key":"4976_CR19","unstructured":"Zhang Q, Pless R. Extrinsic Calibration of a Camera and Laser Range Finder (Improves Camera Calibration). 2004 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS)(IEEE Cat. No. 04CH37566) (2004)"},{"key":"4976_CR20","doi-asserted-by":"crossref","unstructured":"Moghadam P, Bosse M, Zlot R. Line-Based Extrinsic Calibration of Range and Image Sensors. 2013 IEEE International Conference on Robotics and Automation (2013)","DOI":"10.1109\/ICRA.2013.6631095"},{"key":"4976_CR21","doi-asserted-by":"crossref","unstructured":"Zhu Y, Li C, Zhang Y. Online Camera-LiDAR Calibration with Sensor Semantic Information. 2020 IEEE International Conference on Robotics and Automation (ICRA) (2020)","DOI":"10.1109\/ICRA40945.2020.9196627"},{"key":"4976_CR22","doi-asserted-by":"crossref","unstructured":"Taylor Z, Nieto J, Johnson D. Multi-Modal Sensor Calibration Using a Gradient Orientation Measure. Journal of Field Robotics (2015)","DOI":"10.1002\/rob.21523"},{"key":"4976_CR23","doi-asserted-by":"crossref","unstructured":"Yan G, Liu Z, Wang C, Shi C, Wei P, Cai X, Ma T, Liu Z, Zhong Z, Liu Y, Zhao M, Ma Z, Li Y. OpenCalib: A Multi-Sensor Calibration Toolbox for Autonomous Driving. Software Impacts (2022)","DOI":"10.1016\/j.simpa.2022.100393"},{"key":"4976_CR24","doi-asserted-by":"crossref","unstructured":"Luo Z, Yan G, Cai X, Shi B. Zero-training LiDAR-Camera Extrinsic Calibration Method Using Segment Anything Model. In: 2024 IEEE International Conference on Robotics and Automation (ICRA) (2024)","DOI":"10.1109\/ICRA57147.2024.10610983"},{"key":"4976_CR25","doi-asserted-by":"crossref","unstructured":"T\u00f3th T, Pusztai Z, Hajder L. Automatic LiDAR-Camera Calibration of Extrinsic Parameters Using a Spherical Target. In: 2020 IEEE International Conference on Robotics and Automation (ICRA) (2020)","DOI":"10.1109\/ICRA40945.2020.9197316"},{"key":"4976_CR26","unstructured":"IEC: Degrees of Protection Provided by Enclosures (IP Code). Standard IEC 60529, International Electrotechnical Commission (2015)"},{"key":"4976_CR27","doi-asserted-by":"crossref","unstructured":"Macenski S, Foote T, Gerkey B, Lalancette C, Woodall W. Robot Operating System 2: Design, Architecture, and Uses in the Wild. Science Robotics (2022)","DOI":"10.1126\/scirobotics.abm6074"},{"key":"4976_CR28","unstructured":"Merkel D. Docker: Lightweight Linux Containers for Consistent Development and Deployment. Linux Journal (2014)"},{"key":"4976_CR29","unstructured":"Blickfeld GmbH: Qb2 Series Documentation (2024). https:\/\/docs.blickfeld.com\/qb2\/Qb2\/index.html Accessed 2025-08-10"},{"key":"4976_CR30","unstructured":"Stereolabs Inc.: ZED 2i Stereo Camera (2024). https:\/\/www.stereolabs.com\/docs Accessed 2025-08-10"},{"key":"4976_CR31","unstructured":"Sick AG: VISIC620 Visual Range Measuring Devices (2013). https:\/\/www.mysick.com\/en\/VISIC620 Accessed 2025-08-10"},{"key":"4976_CR32","unstructured":"Bradski G. The OpenCV Library. Dr. Dobb\u2019s Journal of Software Tools (2000)"},{"key":"4976_CR33","doi-asserted-by":"crossref","unstructured":"Akiba T, Sano S, Yanase T, Ohta T, Koyama M. Optuna: A Next-generation Hyperparameter Optimization Framework. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (2019)","DOI":"10.1145\/3292500.3330701"},{"key":"4976_CR34","doi-asserted-by":"crossref","unstructured":"Carion N, Massa F, Synnaeve G, Usunier N, Kirillov A, Zagoruyko S. End-to-End Object Detection with Transformers. In: Computer Vision \u2013 ECCV 2020 (2020)","DOI":"10.1007\/978-3-030-58452-8_13"},{"key":"4976_CR35","doi-asserted-by":"crossref","unstructured":"Zhao Y, Lv W, Xu S, Wei J, Wang G, Dang Q, Liu Y, Chen J. Detrs beat yolos on real-time object detection. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (2024)","DOI":"10.1109\/CVPR52733.2024.01605"},{"key":"4976_CR36","unstructured":"Ren S, He K, Girshick R, Sun J. Faster r-cnn: Towards real-time object detection with region proposal networks. In: Cortes, C., Lawrence, N., Lee, D., Sugiyama, M., Garnett, R. (eds.) Advances in Neural Information Processing Systems (2015)"},{"key":"4976_CR37","doi-asserted-by":"crossref","unstructured":"Tian Z, Shen C, Chen H, He T. Fcos: Fully convolutional one-stage object detection. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV) (2019)","DOI":"10.1109\/ICCV.2019.00972"},{"key":"4976_CR38","doi-asserted-by":"crossref","unstructured":"Lin T-Y, Goyal P, Girshick R, He K, Doll\u00e1r P. Focal loss for dense object detection. IEEE Transactions on Pattern Analysis and Machine Intelligence (2020)","DOI":"10.1109\/TPAMI.2018.2858826"},{"key":"4976_CR39","doi-asserted-by":"crossref","unstructured":"Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu C-Y, Berg AC. Ssd: Single shot multibox detector. In: Computer Vision \u2013 ECCV 2016 (2016)","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"4976_CR40","doi-asserted-by":"crossref","unstructured":"Howard A, Sandler M, Chen B, Wang W, Chen L-C, Tan M, Chu G, Vasudevan V, Zhu Y, Pang R, Adam H, Le Q. Searching for mobilenetv3. In: 2019 IEEE\/CVF International Conference on Computer Vision (ICCV) (2019)","DOI":"10.1109\/ICCV.2019.00140"},{"key":"4976_CR41","unstructured":"Glenn J. YOLOv5 (2020). https:\/\/github.com\/ultralytics\/yolov5"},{"key":"4976_CR42","unstructured":"Glenn J, Jing Q. YOLO11 (2024). https:\/\/github.com\/ultralytics\/ultralytics"},{"key":"4976_CR43","unstructured":"Jocher G, Qiu J. YOLO26 104, 255(2026). https:\/\/github.com\/ultralytics\/ultralytics"},{"key":"4976_CR44","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.18988561","author":"V Behret","year":"2025","unstructured":"Behret V, Weber S. Accurate Balls Detection Zenodo. 2025. https:\/\/doi.org\/10.5281\/zenodo.18988561.","journal-title":"Accurate Balls Detection Zenodo"},{"key":"4976_CR45","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1145\/361002.361007","volume":"189","author":"JL Bentley","year":"1975","unstructured":"Bentley JL. Multidimensional Binary Search Trees Used for Associative Searching. Commun ACM. 1975;189:509\u201317.","journal-title":"Commun ACM"},{"key":"4976_CR46","unstructured":"Bergstra J, Bardenet R, Bengio Y, K\u00e9gl B. Algorithms for Hyper-Parameter Optimization. In: Proceedings of the 25th International Conference on Neural Information Processing Systems (2011)"},{"key":"4976_CR47","doi-asserted-by":"crossref","unstructured":"Lin T-Y, Maire M, Belongie S, Hays J, Perona P, Ramanan D, Doll\u00e1r P, Zitnick CL. Microsoft coco: Common objects in context. In: Computer Vision \u2013 ECCV 2014 (2014)","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"4976_CR48","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","volume":"273","author":"CE Shannon","year":"1948","unstructured":"Shannon CE. A Mathematical Theory of Communication. The Bell System Technical Journal. 1948;273:379\u2013423.","journal-title":"The Bell System Technical Journal"},{"key":"4976_CR49","doi-asserted-by":"crossref","unstructured":"Baraldi A, Parmiggiani F. An investigation of the textural characteristics associated with gray level cooccurrence matrix statistical parameters. IEEE Transactions on Geoscience and Remote Sensing (1995)","DOI":"10.1109\/36.377929"}],"container-title":["SN Computer Science"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s42979-026-04976-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s42979-026-04976-9","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s42979-026-04976-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T09:20:46Z","timestamp":1779268846000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s42979-026-04976-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,20]]},"references-count":49,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2026,6]]}},"alternative-id":["4976"],"URL":"https:\/\/doi.org\/10.1007\/s42979-026-04976-9","relation":{},"ISSN":["2661-8907"],"issn-type":[{"value":"2661-8907","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,20]]},"assertion":[{"value":"23 December 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 April 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 May 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"On behalf of all authors, the corresponding author states that there is no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Research Involving Humans and\/or Animals"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed Consent"}}],"article-number":"442"}}