{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T15:47:17Z","timestamp":1778082437610,"version":"3.51.4"},"reference-count":28,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2024,11,5]],"date-time":"2024-11-05T00:00:00Z","timestamp":1730764800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Union\u2019s Horizon 2020 research and innovation programme under the Marie Sk\u0142odowska-Curie","award":["858101"],"award-info":[{"award-number":["858101"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Adverse weather (rain, snow, and fog) can negatively impact computer vision tasks by introducing noise in sensor data; therefore, it is essential to recognize weather conditions for building safe and robust autonomous systems in the agricultural and autonomous driving\/drone sectors. The performance degradation in computer vision tasks due to adverse weather depends on the type of weather and the intensity, which influences the amount of noise in sensor data. However, existing weather recognition datasets often lack intensity labels, limiting their effectiveness. To address this limitation, we present VARG, a novel video-based weather recognition dataset with weather intensity labels. The dataset comprises a diverse set of short video sequences collected from various social media platforms and videos recorded by the authors, processed into usable clips, and categorized into three major weather categories, rain, fog, and snow, with three intensity classes: absent\/no, moderate, and high. The dataset contains 6742 annotated clips from 1079 videos, with the training set containing 5159 clips and the test set containing 1583 clips. Two sets of annotations are provided for training, the first set to train the models as a multi-label weather intensity classifier and the second set to train the models as a multi-class classifier for three weather scenarios. This paper describes the dataset characteristics and presents an evaluation study using several deep learning-based video recognition approaches for weather intensity prediction.<\/jats:p>","DOI":"10.3390\/jimaging10110281","type":"journal-article","created":{"date-parts":[[2024,11,5]],"date-time":"2024-11-05T05:30:53Z","timestamp":1730784653000},"page":"281","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Video WeAther RecoGnition (VARG): An Intensity-Labeled Video Weather Recognition Dataset"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9364-7994","authenticated-orcid":false,"given":"Himanshu","family":"Gupta","sequence":"first","affiliation":[{"name":"Centre for Applied Autonomous Sensor Systems, \u00d6rebro University, 701 82 \u00d6rebro, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2744-0132","authenticated-orcid":false,"given":"Oleksandr","family":"Kotlyar","sequence":"additional","affiliation":[{"name":"Centre for Applied Autonomous Sensor Systems, \u00d6rebro University, 701 82 \u00d6rebro, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Henrik","family":"Andreasson","sequence":"additional","affiliation":[{"name":"Centre for Applied Autonomous Sensor Systems, \u00d6rebro University, 701 82 \u00d6rebro, Sweden"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0217-9326","authenticated-orcid":false,"given":"Achim J.","family":"Lilienthal","sequence":"additional","affiliation":[{"name":"Centre for Applied Autonomous Sensor Systems, \u00d6rebro University, 701 82 \u00d6rebro, Sweden"},{"name":"Perception for Intelligent Systems, Technical University of Munich, 80333 M\u00fcnchen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,11,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1016\/j.iatssr.2019.11.005","article-title":"Automated driving recognition technologies for adverse weather conditions","volume":"43","author":"Yoneda","year":"2019","journal-title":"IATSS Res."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Roser, M., and Moosmann, F. (2008, January 4\u20136). Classification of weather situations on single color images. Proceedings of the 2008 IEEE Intelligent Vehicles Symposium, Eindhoven, The Netherlands.","DOI":"10.1109\/IVS.2008.4621205"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Pavlic, M., Rigoll, G., and Ilic, S. (2013, January 23). Classification of images in fog and fog-free scenes for use in vehicles. Proceedings of the 2013 IEEE Intelligent Vehicles Symposium (IV), Gold Coast City, Australia.","DOI":"10.1109\/IVS.2013.6629514"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.neucom.2018.09.048","article-title":"A CNN\u2013RNN architecture for multi-label weather recognition","volume":"322","author":"Zhao","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ibrahim, M.R., Haworth, J., and Cheng, T. (2019). WeatherNet: Recognising weather and visual conditions from street-level images using deep residual learning. ISPRS Int. J. Geo-Inf., 8.","DOI":"10.3390\/ijgi8120549"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Tarel, J.P., Hautiere, N., Cord, A., Gruyer, D., and Halmaoui, H. (2010, January 21\u201324). Improved visibility of road scene images under heterogeneous fog. Proceedings of the 2010 IEEE Intelligent Vehicles Symposium, La Jolla, CA, USA.","DOI":"10.1109\/IVS.2010.5548128"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Wang, T., Yang, X., Xu, K., Chen, S., Zhang, Q., and Lau, R.W. (2019, January 17\u201321). Spatial Attentive Single-Image Deraining with a High Quality Real Rain Dataset. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR.2019.01255"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wang, J., Lin, C., Nie, L., Huang, S., Zhao, Y., Pan, X., and Ai, R. (2024, January 13\u201317). Weatherdepth: Curriculum contrastive learning for self-supervised depth estimation under adverse weather conditions. Proceedings of the 2024 IEEE International Conference on Robotics and Automation (ICRA), Yokohama, Japan.","DOI":"10.1109\/ICRA57147.2024.10611100"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sheeny, M., De Pellegrin, E., Mukherjee, S., Ahrabian, A., Wang, S., and Wallace, A. (June, January 30). RADIATE: A radar dataset for automotive perception in bad weather. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi\u2019an, China.","DOI":"10.1109\/ICRA48506.2021.9562089"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1177\/02783649231160195","article-title":"Boreas: A multi-season autonomous driving dataset","volume":"42","author":"Burnett","year":"2023","journal-title":"Int. J. Robot. Res."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1177\/0278364920979368","article-title":"Canadian adverse driving conditions dataset","volume":"40","author":"Pitropov","year":"2021","journal-title":"Int. J. Robot. Res."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Carballo, A., Lambert, J., Monrroy, A., Wong, D., Narksri, P., Kitsukawa, Y., Takeuchi, E., Kato, S., and Takeda, K. (November, January 19). LIBRE: The multiple 3D Lidar dataset. Proceedings of the 2020 IEEE Intelligent Vehicles Symposium (IV), Las Vegas, NV, USA.","DOI":"10.1109\/IV47402.2020.9304681"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Bijelic, M., Gruber, T., and Ritter, W. (2018, January 26\u201330). A benchmark for lidar sensors in fog: Is detection breaking down?. Proceedings of the 2018 IEEE Intelligent Vehicles Symposium (IV), Changshu, China.","DOI":"10.1109\/IVS.2018.8500543"},{"key":"ref_14","unstructured":"Garg, K., and Nayar, S.K. (July, January 27). Detection and removal of rain from videos. Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Washington, DC, USA."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2089","DOI":"10.1109\/TIP.2018.2880512","article-title":"Fastderain: A novel video rain streak removal method using directional gradient priors","volume":"28","author":"Jiang","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Sobral, A., Bouwmans, T., and Zahzah, E.h. (2015). LRSLibrary: Low-Rank and Sparse tools for Background Modeling and Subtraction in Videos. Robust Low-Rank and Sparse Matrix Decomposition: Applications in Image and Video Processing, Taylor and Francis Group.","DOI":"10.1201\/b20190"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2802","DOI":"10.1109\/TITS.2018.2872502","article-title":"Rain Removal in Traffic Surveillance: Does it Matter?","volume":"20","author":"Bahnsen","year":"2018","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_18","unstructured":"Tkachenko, M., Malyuk, M., Holmanyuk, A., and Liubimov, N. (2024, October 07). Label Studio: Data Labeling Software. 2020\u20132022. Available online: https:\/\/github.com\/heartexlabs\/label-studio."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Pavli\u0107, M., Belzner, H., Rigoll, G., and Ili\u0107, S. (2012, January 3\u20137). Image based fog detection in vehicles. Proceedings of the 2012 IEEE Intelligent Vehicles Symposium, Alcala de Henares, Spain.","DOI":"10.1109\/IVS.2012.6232256"},{"key":"ref_20","unstructured":"Lin, J., Gan, C., and Han, S. (November, January 27). Tsm: Temporal shift module for efficient video understanding. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Carreira, J., and Zisserman, A. (2017, January 21\u201326). Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.502"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Feichtenhofer, C. (2020, January 13\u201319). X3d: Expanding architectures for efficient video recognition. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00028"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Liu, Z., Ning, J., Cao, Y., Wei, Y., Zhang, Z., Lin, S., and Hu, H. (2022, January 18\u201324). Video Swin Transformer. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00320"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Li, Y., Wu, C.Y., Fan, H., Mangalam, K., Xiong, B., Malik, J., and Feichtenhofer, C. (2022, January 18\u201324). Mvitv2: Improved multiscale vision transformers for classification and detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.","DOI":"10.1109\/CVPR52688.2022.00476"},{"key":"ref_25","unstructured":"Zisserman, A., Carreira, J., Simonyan, K., Kay, W., Zhang, B., Hillier, C., Vijayanarasimhan, S., Viola, F., Green, T., and Back, T. (2017). The Kinetics Human Action Video Dataset. arXiv."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Fan, H., Murrell, T., Wang, H., Alwala, K.V., Li, Y., Li, Y., Xiong, B., Ravi, N., Li, M., and Yang, H. (2021, January 20\u201324). PyTorchVideo: A Deep Learning Library for Video Understanding. Proceedings of the 29th ACM International Conference on Multimedia, Virtual. Available online: https:\/\/pytorchvideo.org\/.","DOI":"10.1145\/3474085.3478329"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8\u201314). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Cubuk, E.D., Zoph, B., Shlens, J., and Le, Q.V. (2019, January 16\u201319). Randaugment: Practical automated data augmentation with a reduced search space. Proceedings of the CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Long Beach, CA, USA.","DOI":"10.1109\/CVPRW50498.2020.00359"}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/10\/11\/281\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:26:29Z","timestamp":1760113589000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/10\/11\/281"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,5]]},"references-count":28,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2024,11]]}},"alternative-id":["jimaging10110281"],"URL":"https:\/\/doi.org\/10.3390\/jimaging10110281","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,5]]}}}