{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,16]],"date-time":"2026-05-16T15:57:11Z","timestamp":1778947031321,"version":"3.51.4"},"reference-count":34,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2026,3,8]],"date-time":"2026-03-08T00:00:00Z","timestamp":1772928000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In rainy and foggy conditions, the scattering of light and the occlusion effects of atmospheric particles distort the reflected light from object surfaces, leading to inconsistent depth information. As a result, depth estimation models trained under clear weather conditions fail to generalize effectively to adverse weather conditions. To address this challenge, we propose a novel CNN-Transformer architecture, WeatherMono, for self-supervised monocular depth estimation under rainy and foggy weather. Rainy and foggy images often contain large regions of low contrast and blurry features. By combining Convolutional Neural Networks (CNNs) with Transformers, WeatherMono effectively captures both local and global contextual information, thus improving depth estimation accuracy. Specifically, we introduce a Multi-Scale Deformable Convolution (MDC) module and a Global-Local Feature Interaction (GLFI) module. The MDC module extracts detailed local features in rainy and foggy environments, while the GLFI module incorporates an efficient multi-head attention mechanism into the Transformer encoder, enabling more effective capture of both local and global information. This enhances the model\u2019s ability to comprehend image features, strengthens its capability to handle low-contrast and blurry images, and ultimately improves the accuracy of depth estimation in adverse weather conditions. Experiments on WeatherKITTI show WeatherMono achieves AbsRel of 0.097, outperforming WeatherDepth (0.104) and RoboDepth (0.107). On DrivingStereo, it achieves AbsRel of 0.149 (rain) and 0.101 (fog). Extensive qualitative and quantitative experiments demonstrate that WeatherMono significantly outperforms existing methods in terms of both accuracy and robustness under rainy and foggy conditions.<\/jats:p>","DOI":"10.3390\/s26051705","type":"journal-article","created":{"date-parts":[[2026,3,9]],"date-time":"2026-03-09T08:58:45Z","timestamp":1773046725000},"page":"1705","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["WeatherMono: A CNN-Transformer Architecture for Self-Supervised Monocular Depth Estimation in Rainy and Foggy Conditions"],"prefix":"10.3390","volume":"26","author":[{"given":"Yongsheng","family":"Qiu","sequence":"first","affiliation":[{"name":"School of Computer Science and Technology, Kashi University, Kashi 844000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2026,3,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zhang, N., Nex, F., Vosselman, G., and Kerle, N. (2023). Lite-Mono: A Lightweight CNN and Transformer Architecture for Self-Supervised Monocular Depth Estimation. Proceedings of the 2023 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada, 17\u201324 June 2023, IEEE.","DOI":"10.1109\/CVPR52729.2023.01778"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"305","DOI":"10.3390\/vehicles6010013","article-title":"Deep learning-based stereopsis and monocular depth estimation techniques: A review","volume":"6","author":"Lahiri","year":"2024","journal-title":"Vehicles"},{"key":"ref_3","unstructured":"Li, Z., Wang, X., Liu, X., and Jiang, J. (2022). Binsformer: Revisiting adaptive bins for monocular depth estimation. arXiv."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Hu, J., and Cao, Z. (2024). Monocular Depth Estimation Algorithm for Rainy Scenes. Proceedings of the 2024 5th International Conference on Electronic Communication and Artificial Intelligence (ICECAI), Guangzhou, China, 31 May\u20132 June 2024, IEEE.","DOI":"10.1109\/ICECAI62591.2024.10675134"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Lee, J., Lai-Dang, Q.V., Sengar, N., and Har, D. (2024). Robust Monocular Depth Estimation in Adverse Weather Conditions by Unsupervised Domain Adaptation. Proceedings of the ECAI 2024, Santiago de Compostela, Spain, 19\u201324 October 2024, IOS Press.","DOI":"10.3233\/FAIA240539"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Gasperini, S., Morbitzer, N., Jung, H., Navab, N., and Tombari, F. (2023). Robust monocular depth estimation under challenging conditions. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Paris, France, 2\u20136 October 2023, IEEE.","DOI":"10.1109\/ICCV51070.2023.00751"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Liu, J., Guo, Z., Ping, P., Zhang, H., and Shi, Q. (2024). Channel Interaction and Transformer Depth Estimation Network: Robust Self-Supervised Depth Estimation Under Varied Weather Conditions. Sustainability, 16.","DOI":"10.3390\/su16209131"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Saunders, K., Vogiatzis, G., and Manso, L.J. (2023). Self-supervised monocular depth estimation: Let\u2019s talk about the weather. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Paris, France, 2\u20136 October 2023, IEEE.","DOI":"10.1109\/ICCV51070.2023.00818"},{"key":"ref_9","unstructured":"Eigen, D., Puhrsch, C., and Fergus, R. (2014). Depth map prediction from a single image using a multi-scale deep network. arXiv."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Laina, I., Rupprecht, C., Belagiannis, V., Tombari, F., and Navab, N. (2016). Deeper depth prediction with fully convolutional residual networks. Proceedings of the 2016 Fourth International Conference on 3D Vision (3DV), Stanford, CA, USA, 25\u201328 October 2016, IEEE.","DOI":"10.1109\/3DV.2016.32"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Fu, H., Gong, M., Wang, C., Batmanghelich, K., and Tao, D. (2018). Deep ordinal regression network for monocular depth estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18\u201323 June 2018, IEEE.","DOI":"10.1109\/CVPR.2018.00214"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhou, T., Brown, M., Snavely, N., and Lowe, D.G. (2017). Unsupervised learning of depth and ego-motion from video. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21\u201326 July 2017, IEEE.","DOI":"10.1109\/CVPR.2017.700"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Yin, Z., and Shi, J. (2018). Geonet: Unsupervised learning of dense depth, optical flow and camera pose. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 18\u201323 June 2018, IEEE.","DOI":"10.1109\/CVPR.2018.00212"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Jung, H., Park, E., and Yoo, S. (2021). Fine-grained semantics-aware representation enhancement for self-supervised monocular depth estimation. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada, 10\u201317 October 2021, IEEE.","DOI":"10.1109\/ICCV48922.2021.01241"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Godard, C., Mac Aodha, O., Firman, M., and Brostow, G.J. (2019). Digging into self-supervised monocular depth estimation. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea, 27 October\u20132 November 2019, IEEE.","DOI":"10.1109\/ICCV.2019.00393"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zhou, H., Greenwood, D., and Taylor, S. (2021). Self-supervised monocular depth estimation with internal feature fusion. arXiv.","DOI":"10.5244\/C.35.208"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Agarwal, A., and Arora, C. (2022). Depthformer: Multiscale vision transformer for monocular depth estimation with global local information fusion. Proceedings of the 2022 IEEE International Conference on Image Processing (ICIP), Bordeaux, France, 16\u201319 October 2022, IEEE.","DOI":"10.1109\/ICIP46576.2022.9897187"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Ranftl, R., Bochkovskiy, A., and Koltun, V. (2021). Vision transformers for dense prediction. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada, 10\u201317 October 2021, IEEE.","DOI":"10.1109\/ICCV48922.2021.01196"},{"key":"ref_19","unstructured":"Bae, J., Moon, S., and Im, S. (2022). Monoformer: Towards generalization of self-supervised monocular depth estimation with transformers. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhao, C., Zhang, Y., Poggi, M., Tosi, F., Guo, X., Zhu, Z., Huang, G., Tang, Y., and Mattoccia, S. (2022). Monovit: Self-supervised monocular depth estimation with a vision transformer. Proceedings of the 2022 International Conference on 3D Vision (3DV), Prague, Czechia, 12\u201315 September 2022, IEEE.","DOI":"10.1109\/3DV57658.2022.00077"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Liu, L., Song, X., Wang, M., Liu, Y., and Zhang, L. (2021). Self-supervised monocular depth estimation for all day images using domain separation. Proceedings of the CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada, 10\u201317 October 2021, IEEE.","DOI":"10.1109\/ICCV48922.2021.01250"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1237","DOI":"10.1109\/TETCI.2022.3182360","article-title":"Unsupervised monocular depth estimation in highly complex environments","volume":"6","author":"Zhao","year":"2022","journal-title":"IEEE Trans. Emerg. Top. Comput. Intell."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Lee, Y., Jeon, J., Ko, Y., Jeon, B., and Jeon, M. (2021). Task-driven deep image enhancement network for autonomous driving in bad weather. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi\u2019an, China, 30 May\u20135 June 2021, IEEE.","DOI":"10.1109\/ICRA48506.2021.9561076"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wang, J., Lin, C., Nie, L., Huang, S., Zhao, Y., Pan, X., and Ai, R. (2024). Weatherdepth: Curriculum contrastive learning for self-supervised depth estimation under adverse weather conditions. Proceedings of the 2024 IEEE International Conference on Robotics and Automation (ICRA), Yokohama, Japan, 13\u201317 May 2024, IEEE.","DOI":"10.1109\/ICRA57147.2024.10611100"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhou, Z., Fan, X., Shi, P., and Xin, Y. (2021, January 10\u201317). R-msfm: Recurrent multi-scale feature modulation for monocular depth estimating. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.01254"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Yang, G., Song, X., Huang, C., Deng, Z., Shi, J., and Zhou, B. (2019). Drivingstereo: A large-scale dataset for stereo matching in autonomous driving scenarios. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 15\u201320 June 2019, IEEE.","DOI":"10.1109\/CVPR.2019.00099"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wang, R., Yu, Z., and Gao, S. (2023). Planedepth: Self-supervised depth estimation via orthogonal planes. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada, 17\u201324 June 2023, IEEE.","DOI":"10.1109\/CVPR52729.2023.02052"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Watson, J., Firman, M., Brostow, G.J., and Turmukhambetov, D. (2019). Self-supervised monocular depth hints. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea, 27 October\u20132 November 2019, IEEE.","DOI":"10.1109\/ICCV.2019.00225"},{"key":"ref_30","first-page":"2294","article-title":"Hr-depth: High resolution self-supervised monocular depth estimation","volume":"Volume 35","author":"Lyu","year":"2021","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence, Virtual, 19\u201321 May 2021"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Yan, J., Zhao, H., Bu, P., and Jin, Y. (2021). Channel-wise attention-based network for self-supervised monocular depth estimation. Proceedings of the 2021 International Conference on 3D Vision (3DV), Virtual, 1\u20133 December 2021, IEEE.","DOI":"10.1109\/3DV53792.2021.00056"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Watson, J., Mac Aodha, O., Prisacariu, V., Brostow, G., and Firman, M. (2021). The temporal opportunist: Self-supervised multi-frame monocular depth. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA, 20\u201325 June 2021, IEEE.","DOI":"10.1109\/CVPR46437.2021.00122"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhang, S., Zhang, J., and Tao, D. (2022). Towards scale-aware, robust, and generalizable unsupervised monocular depth estimation by integrating IMU motion dynamics. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel, 23\u201327 October 2022, Springer.","DOI":"10.1007\/978-3-031-19839-7_9"},{"key":"ref_34","first-page":"21298","article-title":"Robodepth: Robust out-of-distribution depth estimation under corruptions","volume":"36","author":"Kong","year":"2023","journal-title":"Adv. Neural Inf. Process. Syst."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/5\/1705\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T05:25:14Z","timestamp":1773120314000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/5\/1705"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,8]]},"references-count":34,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2026,3]]}},"alternative-id":["s26051705"],"URL":"https:\/\/doi.org\/10.3390\/s26051705","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,8]]}}}