{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,5]],"date-time":"2026-06-05T04:25:52Z","timestamp":1780633552035,"version":"3.54.1"},"reference-count":52,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2022,7,12]],"date-time":"2022-07-12T00:00:00Z","timestamp":1657584000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["52006137"],"award-info":[{"award-number":["52006137"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["19YF1423400"],"award-info":[{"award-number":["19YF1423400"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["2016M600313"],"award-info":[{"award-number":["2016M600313"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Shanghai Sailing Program","award":["52006137"],"award-info":[{"award-number":["52006137"]}]},{"name":"Shanghai Sailing Program","award":["19YF1423400"],"award-info":[{"award-number":["19YF1423400"]}]},{"name":"Shanghai Sailing Program","award":["2016M600313"],"award-info":[{"award-number":["2016M600313"]}]},{"name":"China Postdoctoral Science Funding","award":["52006137"],"award-info":[{"award-number":["52006137"]}]},{"name":"China Postdoctoral Science Funding","award":["19YF1423400"],"award-info":[{"award-number":["19YF1423400"]}]},{"name":"China Postdoctoral Science Funding","award":["2016M600313"],"award-info":[{"award-number":["2016M600313"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Accurate lane detection is an essential function of dynamic traffic perception. Though deep learning (DL) based methods have been widely applied to lane detection tasks, such models rarely achieve sufficient accuracy in low-light weather conditions. To improve the model accuracy in foggy conditions, a new approach was proposed based on monocular depth prediction and an atmospheric scattering model to generate fog artificially. We applied our method to the existing CULane dataset collected in clear weather and generated 107,451 labeled foggy lane images under three different fog densities. The original and generated datasets were then used to train state-of-the-art (SOTA) lane detection networks. The experiments demonstrate that the synthetic dataset can significantly increase the lane detection accuracy of DL-based models in both artificially generated foggy lane images and real foggy scenes. Specifically, the lane detection model performance (F1-measure) was increased from 11.09 to 70.41 under the heaviest foggy conditions. Additionally, this data augmentation method was further applied to another dataset, VIL-100, to test the adaptability of this approach. Similarly, it was found that even when the camera position or level of brightness was changed from one dataset to another, the foggy data augmentation approach is still valid to improve model performance under foggy conditions without degrading accuracy on other weather conditions. Finally, this approach also sheds light on practical applications for other complex scenes such as nighttime and rainy days.<\/jats:p>","DOI":"10.3390\/s22145210","type":"journal-article","created":{"date-parts":[[2022,7,12]],"date-time":"2022-07-12T23:02:01Z","timestamp":1657666921000},"page":"5210","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["Foggy Lane Dataset Synthesized from Monocular Images for Lane Detection Algorithms"],"prefix":"10.3390","volume":"22","author":[{"given":"Xiangyu","family":"Nie","sequence":"first","affiliation":[{"name":"China-UK Low Carbon College, Shanghai Jiao Tong University, Shanghai 201306, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhejun","family":"Xu","sequence":"additional","affiliation":[{"name":"China-UK Low Carbon College, Shanghai Jiao Tong University, Shanghai 201306, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei","family":"Zhang","sequence":"additional","affiliation":[{"name":"China-UK Low Carbon College, Shanghai Jiao Tong University, Shanghai 201306, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xue","family":"Dong","sequence":"additional","affiliation":[{"name":"China-UK Low Carbon College, Shanghai Jiao Tong University, Shanghai 201306, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ning","family":"Liu","sequence":"additional","affiliation":[{"name":"Midea Group, Shanghai 201702, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuanfeng","family":"Chen","sequence":"additional","affiliation":[{"name":"Midea Group, Shanghai 201702, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1002\/rob.20255","article-title":"Autonomous driving in urban environments: Boss and the Urban Challenge","volume":"25","author":"Urmson","year":"2008","journal-title":"J. Field Robot."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3485767","article-title":"Level-5 Autonomous Driving\u2014Are We There Yet? A Review of Research Literature","volume":"55","author":"Khan","year":"2022","journal-title":"ACM Comput. Surv."},{"key":"ref_3","unstructured":"Huval, B., Wang, T., Tandon, S., Kiske, J., Song, W., Pazhayampallil, J., Andriluka, M., Rajpurkar, P., Migimatsu, T., and Cheng-Yue, R. (2015). An empirical evaluation of deep learning on highway driving. arXiv."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kim, J., and Lee, M. (2014). Robust lane detection based on convolutional neural network and random sample consensus. Neural Information Processing. ICONIP 2014, Springer.","DOI":"10.1007\/978-3-319-12637-1_57"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"690","DOI":"10.1109\/TNNLS.2016.2522428","article-title":"Deep neural network for structural prediction and lane detection in traffic scene","volume":"28","author":"Li","year":"2016","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Pan, X., Shi, J., Luo, P., Wang, X., and Tang, X. (2018, January 2\u20137). Spatial as deep: Spatial CNN for traffic scene understanding. Proceedings of the AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.12301"},{"key":"ref_7","unstructured":"Hou, Y., Ma, Z., Liu, C., and Loy, C.C. (November, January 27). Learning lightweight lane detection cnns by self attention distillation. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Korea."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1109\/TITS.2017.2750080","article-title":"Erfnet: Efficient residual factorized convnet for real-time semantic segmentation","volume":"19","author":"Romera","year":"2017","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Tabelini, L., Berriel, R., Paix\u00e3o, T.M., Badue, C., De Souza, A.F., and Olivera-Santos, T. (2020). Keep your eyes on the lane: Attention-guided lane detection. arXiv.","DOI":"10.1109\/CVPR46437.2021.00036"},{"key":"ref_10","unstructured":"Wang, Z., Ren, W., and Qiu, Q. (2018). Lanenet: Real-time lane detection networks for autonomous driving. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Hu, X., Fu, C.-W., Zhu, L., and Heng, P.-A. (2019, January 15\u201320). Depth-attentional features for single-image rain removal. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00821"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Liu, T., Chen, Z., Yang, Y., Wu, Z., and Li, H. (November, January 19). Lane detection in low-light conditions using an efficient data enhancement: Light conditions style transfer. Proceedings of the 2020 IEEE Intelligent Vehicles Symposium (IV), Las Vegas, NV, USA.","DOI":"10.1109\/IV47402.2020.9304613"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Tarel, J.-P., Hautiere, N., Cord, A., Gruyer, D., and Halmaoui, H. (2010, January 21\u201324). Improved visibility of road scene images under heterogeneous fog. Proceedings of the 2010 IEEE Intelligent Vehicles Symposium, La Jolla, CA, USA.","DOI":"10.1109\/IVS.2010.5548128"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/MITS.2012.2189969","article-title":"Vision enhancement in homogeneous and heterogeneous fog","volume":"4","author":"Tarel","year":"2012","journal-title":"IEEE Intell. Transp. Syst. Mag."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"973","DOI":"10.1007\/s11263-018-1072-8","article-title":"Semantic foggy scene understanding with synthetic data","volume":"126","author":"Sakaridis","year":"2018","journal-title":"Int. J. Comput. Vis."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Mai, N.A.M., Duthon, P., Khoudour, L., Crouzil, A., and Velastin, S.A. (2021). 3D Object Detection with SLS-Fusion Network in Foggy Weather Conditions. Sensors, 21.","DOI":"10.3390\/s21206711"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2505","DOI":"10.1109\/TTE.2021.3080690","article-title":"A feature fusion method to improve the driving obstacle detection under foggy weather","volume":"7","author":"He","year":"2021","journal-title":"IEEE Trans. Transp. Electrif."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Yan, M., Chen, J., Xu, J., and Xiang, L. (2022, January 25\u201327). Visibility detection of single image in foggy days based on Fourier transform and convolutional neural network. Proceedings of the 2nd International Conference on Applied Mathematics, Modelling, and Intelligent Computing (CAMMIC 2022), Kunming, China.","DOI":"10.1117\/12.2638782"},{"key":"ref_19","unstructured":"Schechner, Y.Y., Narasimhan, S.G., and Nayar, S.K. (2001, January 8\u201314). Instant dehazing of images using polarization. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, Kauai, HI, USA."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1360612.1360671","article-title":"Single image dehazing","volume":"27","author":"Fattal","year":"2008","journal-title":"ACM Trans. Graph."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2651362","article-title":"Dehazing using color-lines","volume":"34","author":"Fattal","year":"2014","journal-title":"ACM Trans. Graph."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Berman, D., and Avidan, S. (2016, January 27\u201330). Non-local image dehazing. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.185"},{"key":"ref_23","first-page":"2341","article-title":"Single image haze removal using dark channel prior","volume":"33","author":"He","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3271","DOI":"10.1109\/TIP.2013.2262284","article-title":"Single image dehazing by multi-scale fusion","volume":"22","author":"Ancuti","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"3522","DOI":"10.1109\/TIP.2015.2446191","article-title":"A fast single image haze removal algorithm using color attenuation prior","volume":"24","author":"Zhu","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ren, W., Liu, S., Zhang, H., Pan, J., Cao, X., and Yang, M.-H. (2016, January 11\u201314). Single image dehazing via multi-scale convolutional neural networks. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46475-6_10"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Li, B., Peng, X., Wang, Z., Xu, J., and Feng, D. (2017, January 22\u201329). Aod-net: All-in-one dehazing network. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.511"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"5187","DOI":"10.1109\/TIP.2016.2598681","article-title":"Dehazenet: An end-to-end system for single image haze removal","volume":"25","author":"Cai","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_29","unstructured":"Li, R., Zhang, X., You, S., and Li, Y. (2020). Learning to Dehaze from Realistic Scene with A Fast Physics-based Dehazing Network. arXiv."},{"key":"ref_30","unstructured":"Anvari, Z., and Athitsos, V. (2020). Dehaze-GLCGAN: Unpaired single image de-hazing via adversarial training. arXiv."},{"key":"ref_31","unstructured":"Wang, Y., Yan, X., Wang, F.L., Xie, H., Yang, W., Wei, M., and Qin, J. (2020). UCL-Dehaze: Towards Real-world Image Dehazing via Unsupervised Contrastive Learning. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Kumar, B., Gupta, H., Sinha, A., and Vyas, O. (2021, January 17\u201318). Lane Detection for Autonomous Vehicle in Hazy Environment with Optimized Deep Learning Techniques. Proceedings of the International Conference on Advanced Network Technologies and Intelligent Computing, Varanasi, India.","DOI":"10.1007\/978-3-030-96040-7_45"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Bijelic, M., Gruber, T., Mannan, F., Kraus, F., Ritter, W., Dietmayer, K., and Heide, F. (2020, January 13\u201319). Seeing through fog without seeing fog: Deep multimodal sensor fusion in unseen adverse weather. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01170"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Aly, M. (2008, January 4\u20136). Real time detection of lane markers in urban streets. Proceedings of the 2008 IEEE Intelligent Vehicles Symposium, Eindhoven, The Netherlands.","DOI":"10.1109\/IVS.2008.4621152"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16\u201321). Are we ready for autonomous driving? the kitti vision benchmark suite. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., and Schiele, B. (2016, January 27\u201330). The cityscapes dataset for semantic urban scene understanding. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.350"},{"key":"ref_37","unstructured":"TuSimple (2017, July 11). TuSimple Benchmark. Available online: https:\/\/github.com\/TuSimple\/tusimple-benchmark."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Huang, X., Cheng, X., Geng, Q., Cao, B., Zhou, D., Wang, P., Lin, Y., and Yang, R. (2018, January 18\u201323). The apolloscape dataset for autonomous driving. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00141"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Yu, F., Chen, H., Wang, X., Xian, W., Chen, Y., Liu, F., Madhavan, V., and Darrell, T. (2020, January 13\u201319). Bdd100k: A diverse driving dataset for heterogeneous multitask learning. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00271"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Behrendt, K., and Soussan, R. (2019, January 27\u201328). Unsupervised labeled lane markers using maps. Proceedings of the IEEE\/CVF International Conference on Computer Vision Workshops, Seoul, Korea.","DOI":"10.1109\/ICCVW.2019.00111"},{"key":"ref_41","unstructured":"Geyer, J., Kassahun, Y., Mahmudi, M., Ricou, X., Durgesh, R., Chung, A.S., Hauswald, L., Pham, V.H., M\u00fchlegg, M., and Dorn, S. (2020). A2d2: Audi autonomous driving dataset. arXiv."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Zhu, L., Feng, W., Fu, H., Wang, M., Li, Q., Li, C., and Wang, S. (2021, January 11\u201317). VIL-100: A New Dataset and A Baseline Model for Video Instance Lane Detection. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.01539"},{"key":"ref_43","unstructured":"Harald, K. (1924). Theorie der Horizontalen Sichtweite: Kontrast und Sichtweite, Keim Nemnich."},{"key":"ref_44","unstructured":"McCartney, E.J. (1976). Optics of the Atmosphere: Scattering by Molecules and Particles, John Wiley and Sons."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Nayar, S.K., and Narasimhan, S.G. (1999, January 20\u201327). Vision in bad weather. Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece.","DOI":"10.1109\/ICCV.1999.790306"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Facil, J.M., Ummenhofer, B., Zhou, H., Montesano, L., Brox, T., and Civera, J. (2019, January 15\u201320). CAM-Convs: Camera-aware multi-scale convolutions for single-view depth. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01210"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Garg, R., Bg, V.K., Carneiro, G., and Reid, I. (2016, January 11\u201314). Unsupervised cnn for single view depth estimation: Geometry to the rescue. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46484-8_45"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Wang, R., Pizer, S.M., and Frahm, J.-M. (2019, January 15\u201320). Recurrent neural network for (un-) supervised learning of monocular video visual odometry and depth. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00570"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Chakravarty, P., Narayanan, P., and Roussel, T. (2019, January 20\u201324). GEN-SLAM: Generative modeling for monocular simultaneous localization and mapping. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8793530"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Aleotti, F., Tosi, F., Poggi, M., and Mattoccia, S. (2018, January 8\u201314). Generative adversarial networks for unsupervised monocular depth prediction. Proceedings of the European Conference on Computer Vision (ECCV) Workshops, Munich, Germany.","DOI":"10.1007\/978-3-030-11009-3_20"},{"key":"ref_51","unstructured":"Eigen, D., Puhrsch, C., and Fergus, R. (2014). Depth map prediction from a single image using a multi-scale deep network. arXiv, 27."},{"key":"ref_52","unstructured":"Godard, C., Mac Aodha, O., Firman, M., and Brostow, G.J. (November, January 27). Digging into self-supervised monocular depth estimation. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Korea."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/14\/5210\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:48:46Z","timestamp":1760140126000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/14\/5210"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,12]]},"references-count":52,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["s22145210"],"URL":"https:\/\/doi.org\/10.3390\/s22145210","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,12]]}}}