{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,28]],"date-time":"2025-10-28T18:44:10Z","timestamp":1761677050612,"version":"build-2065373602"},"reference-count":50,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2021,11,16]],"date-time":"2021-11-16T00:00:00Z","timestamp":1637020800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the National Science Foundation of China","award":["No. U1803261"],"award-info":[{"award-number":["No. U1803261"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Outdoor vision sensing systems often struggle with poor weather conditions, such as snow and rain, which poses a great challenge to existing video desnowing and deraining methods. In this paper, we propose a novel video desnowing and deraining model that utilizes the salience information of moving objects to address this problem. First, we remove the snow and rain from the video by low-rank tensor decomposition, which makes full use of the spatial location information and the correlation between the three channels of the color video. Second, because existing algorithms often regard sparse snowflakes and rain streaks as moving objects, this paper injects salience information into moving object detection, which reduces the false alarms and missed alarms of moving objects. At the same time, feature point matching is used to mine the redundant information of moving objects in continuous frames, and a dual adaptive minimum filtering algorithm in the spatiotemporal domain is proposed by us to remove snow and rain in front of moving objects. Both qualitative and quantitative experimental results show that the proposed algorithm is more competitive than other state-of-the-art snow and rain removal methods.<\/jats:p>","DOI":"10.3390\/s21227610","type":"journal-article","created":{"date-parts":[[2021,11,17]],"date-time":"2021-11-17T09:16:11Z","timestamp":1637140571000},"page":"7610","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Video Desnowing and Deraining via Saliency and Dual Adaptive Spatiotemporal Filtering"],"prefix":"10.3390","volume":"21","author":[{"given":"Yongji","family":"Li","sequence":"first","affiliation":[{"name":"College of Information Science and Engineering, Xinjiang University, Urumqi 830046, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rui","family":"Wu","sequence":"additional","affiliation":[{"name":"College of Information Science and Engineering, Xinjiang University, Urumqi 830046, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhenhong","family":"Jia","sequence":"additional","affiliation":[{"name":"College of Information Science and Engineering, Xinjiang University, Urumqi 830046, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jie","family":"Yang","sequence":"additional","affiliation":[{"name":"Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, Shanghai 200400, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4433-7521","authenticated-orcid":false,"given":"Nikola","family":"Kasabov","sequence":"additional","affiliation":[{"name":"Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, Auckland 1020, New Zealand"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,11,16]]},"reference":[{"key":"ref_1","unstructured":"Garg, K., and Nayar, S.K. (July, January 27). Detection and removal of rain from videos. Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2004), Washington, DC, USA."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Zhang, X., Li, H., Qi, Y., Leow, W.K., and Ng, T.K. (2006, January 9\u201312). Rain removal in video by combining temporal and chromatic properties. Proceedings of the 2006 IEEE International Conference on Multimedia and Expo, Toronto, ON, Canada.","DOI":"10.1109\/ICME.2006.262572"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Brewer, N., and Liu, N. (2008, January 4\u20136). Using the shape characteristics of rain to identify and remove rain from video. Proceedings of the Joint IAPR International Workshops on Statistical Techniques in Pattern Recognition (SPR) and Structural and Syntactic Pattern Recognition (SSPR), Orlando, FL, USA.","DOI":"10.1007\/978-3-540-89689-0_49"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Park, W.-J., and Lee, K.-H. (2008, January 9\u201311). Rain removal using Kalman filter in video. Proceedings of the 2008 International Conference on Smart Manufacturing Application, Goyangi, Korea.","DOI":"10.1109\/ICSMA.2008.4505573"},{"key":"ref_5","unstructured":"Pei, S.-C., Tsai, Y.-T., and Lee, C.-Y. (2014, January 14\u201318). Removing rain and snow in a single image using saturation and visibility features. Proceedings of the 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW), Chengdu, China."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2697","DOI":"10.1007\/s11042-015-2657-7","article-title":"Single image rain and snow removal via guided L0 smoothing filter","volume":"75","author":"Ding","year":"2016","journal-title":"Multimedia Tools Appl."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Xu, J., Zhao, W., Liu, P., and Tang, X. (2012, January 25\u201327). Removing rain and snow in a single image using guided filter. Proceedings of the 2012 IEEE International Conference on Computer Science and Automation Engineering (CSAE), Zhangjiajie, China.","DOI":"10.1109\/CSAE.2012.6272780"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3936","DOI":"10.1109\/TIP.2017.2708502","article-title":"A hierarchical approach for rain or snow removing in a single color image","volume":"26","author":"Wang","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1124","DOI":"10.1016\/j.ipl.2010.10.003","article-title":"Detecting and extracting natural snow from videos","volume":"110","author":"Shen","year":"2010","journal-title":"Inf. Process. Lett."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Huiying, D., and Xuejing, Z. (2015, January 23\u201325). Detection and removal of rain and snow from videos based on frame difference method. Proceedings of the 27th Chinese Control and Decision Conference (2015 CCDC), Qingdao, China.","DOI":"10.1109\/CCDC.2015.7162843"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Yang, T., Nsabimana, V., Wang, B., Sun, Y., Cheng, X., Dong, H., Qin, Y., Zhang, B., and Ingrabire, F. (November, January 29). Snow fluff detection and removal from video images. Proceedings of the IECON 2017\u201443rd Annual Conference of the IEEE Industrial Electronics Society, Beijing, China.","DOI":"10.1109\/IECON.2017.8216655"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wei, W., Yi, L., Xie, Q., Zhao, Q., Meng, D., and Xu, Z. (2017, January 22\u201329). Should we encode rain streaks in video as deterministic or stochastic?. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.275"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ren, W., Tian, J., Han, Z., Chan, A., and Tang, Y. (2017, January 21\u201326). Video desnowing and deraining based on matrix decomposition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.303"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2029","DOI":"10.1109\/TIP.2021.3050313","article-title":"Online rain\/snow removal from surveillance videos","volume":"30","author":"Li","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2659","DOI":"10.1109\/TMM.2018.2808763","article-title":"Snowflake removal for videos via global and local low-rank decomposition","volume":"20","author":"Tian","year":"2018","journal-title":"IEEE Trans. Multimed."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2658","DOI":"10.1109\/TIP.2015.2428933","article-title":"Video deraining and desnowing using temporal correlation and low-rank matrix completion","volume":"24","author":"Kim","year":"2015","journal-title":"IEEE Trans. Image Process."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Yang, Y., Loquercio, A., Scaramuzza, D., and Soatto, S. (2019, January 15\u201320). Unsupervised moving object detection via contextual information separation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00097"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1007","DOI":"10.1109\/TIP.2018.2874289","article-title":"Moving object detection in complex scene using spatiotemporal structured-sparse RPCA","volume":"28","author":"Javed","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1109\/TCSVT.2016.2630731","article-title":"Incremental learning with saliency map for moving object detection","volume":"28","author":"Pang","year":"2016","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"724","DOI":"10.1109\/TIP.2016.2627803","article-title":"Moving object detection using tensor-based low-rank and saliently fused-sparse decomposition","volume":"26","author":"Hu","year":"2016","journal-title":"IEEE Trans Image Process."},{"key":"ref_21","first-page":"2191","article-title":"Video salient object detection via robust seeds extraction and multi-graphs manifold propagation","volume":"30","author":"Xu","year":"2019","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_22","unstructured":"Barnum, P., Kanade, T., and Narasimhan, S. (2007, January 14\u201321). Spatio-temporal frequency analysis for removing rain and snow from videos. Proceedings of the First International Workshop on Photometric Analysis for Computer Vision\u2014PACV 2007, Rio de Janeiro, Brazil. Available online: https:\/\/hal.inria.fr\/PACV2007\/inria-00264716v1."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"348","DOI":"10.1007\/s11263-011-0421-7","article-title":"Rain or snow detection in image sequences through use of a histogram of orientation of streaks","volume":"93","author":"Bossu","year":"2011","journal-title":"Int. J. Comput. Vis."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Islam, M.R., and Paul, M. (2021). Video Rain-Streaks Removal by Combining Data-Driven and Feature-Based Models. Sensors, 21.","DOI":"10.3390\/s21206856"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Jiang, T.-X., Huang, T.-Z., Zhao, X.-L., Deng, L.-J., and Wang, Y. (2017, January 21\u201326). A novel tensor-based video rain streaks removal approach via utilizing discriminatively intrinsic priors. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.301"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2089","DOI":"10.1109\/TIP.2018.2880512","article-title":"Fastderain: A novel video rain streak removal method using directional gradient priors","volume":"28","author":"Jiang","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Li, M., Xie, Q., Zhao, Q., Wei, W., Gu, S., Tao, J., and Meng, D. (2018, January 18\u201323). Video rain streak removal by multiscale convolutional sparse coding. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00695"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"107006","DOI":"10.1016\/j.knosys.2021.107006","article-title":"Robust online rain removal for surveillance videos with dynamic rains","volume":"222","author":"Yi","year":"2021","journal-title":"Knowl.-Based Syst."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zheng, X., Liao, Y., Guo, W., Fu, X., and Ding, X. (2013, January 3\u20137). Single-image-based rain and snow removal using multi-guided filter. Proceedings of the International Conference on Neural Information Processing, Daegu, Korea.","DOI":"10.1007\/978-3-642-42051-1_33"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Qian, R., Tan, R.T., Yang, W., Su, J., and Liu, J. (2018, January 18\u201323). Attentive generative adversarial network for raindrop removal from a single image. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00263"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Ren, Y., Nie, M., Li, S., and Li, C. (2020). Single Image De-Raining via Improved Generative Adversarial Nets. Sensors, 20.","DOI":"10.3390\/s20061591"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Chen, W.-T., Fang, H.-Y., Ding, J.-J., Tsai, C.-C., and Kuo, S.-Y. (2020, January 23\u201328). JSTASR: Joint size and transparency-aware snow removal algorithm based on modified partial convolution and veiling effect removal. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58589-1_45"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1342","DOI":"10.1109\/TCSVT.2020.3003025","article-title":"DesnowGAN: An efficient single image snow removal framework using cross-resolution lateral connection and GANs","volume":"31","author":"Jaw","year":"2020","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"3064","DOI":"10.1109\/TIP.2018.2806202","article-title":"DesnowNet: Context-aware deep network for snow removal","volume":"27","author":"Liu","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.neucom.2019.07.023","article-title":"Stacked dense networks for single-image snow removal","volume":"367","author":"Li","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"944","DOI":"10.1109\/TCSVT.2019.2901311","article-title":"Low CP rank and tucker rank tensor completion for estimating missing components in image data","volume":"30","author":"Liu","year":"2019","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Chen, Y., Xiao, X., Peng, C., Lu, G., and Zhou, Y. (2021). Low-rank tensor graph learning for multi-view subspace clustering. IEEE Trans. Circuits Syst. Video Technol.","DOI":"10.1109\/TIP.2021.3068646"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2724","DOI":"10.1109\/TSP.2018.2816568","article-title":"Tensor train neighborhood preserving embedding","volume":"66","author":"Wang","year":"2018","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"6813","DOI":"10.1109\/TIP.2020.2994411","article-title":"Hyperspectral image compressive sensing reconstruction using subspace-based nonlocal tensor ring decomposition","volume":"29","author":"Chen","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"925","DOI":"10.1109\/TPAMI.2019.2891760","article-title":"Tensor robust principal component analysis with a new tensor nuclear norm","volume":"42","author":"Lu","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Lu, C., Feng, J., Chen, Y., Liu, W., Lin, Z., and Yan, S. (2016, January 27\u201330). Tensor robust principal component analysis: Exact recovery of corrupted low-rank tensors via convex optimization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.567"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Xu, H., Zheng, J., Yao, X., Feng, Y., and Chen, S. (2021). Fast Tensor Nuclear Norm for Structured Low-Rank Visual Inpainting. IEEE Trans. Circuits Syst. Video Technol.","DOI":"10.1109\/TCSVT.2021.3067022"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"4489","DOI":"10.1109\/TIP.2020.2972692","article-title":"A novel saliency detection algorithm based on adversarial learning model","volume":"29","author":"Cai","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"8177","DOI":"10.1109\/TIP.2020.3002083","article-title":"Context-aware graph label propagation network for saliency detection","volume":"29","author":"Ji","year":"2020","journal-title":"IEEE Trans. Image Process."},{"key":"ref_45","first-page":"2398","article-title":"Robust deep co-saliency detection with group semantic and pyramid attention","volume":"31","author":"Zha","year":"2020","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Goyette, N., Jodoin, P.-M., Porikli, F., Konrad, J., and Ishwar, P. (2012, January 16\u201321). Changedetection net: A new change detection benchmark dataset. Proceedings of the 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Providence, RI, USA.","DOI":"10.1109\/CVPRW.2012.6238919"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2378","DOI":"10.1109\/TIP.2011.2109730","article-title":"FSIM: A feature similarity index for image quality assessment","volume":"20","author":"Zhang","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1109\/TIP.2005.859378","article-title":"Image information and visual quality","volume":"15","author":"Sheikh","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Zeng, X., Howe, G., and Xu, M. (2021, January 11\u201317). End-to-End Robust Joint Unsupervised Image Alignment and Clustering. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00383"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/22\/7610\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:31:20Z","timestamp":1760167880000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/22\/7610"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,16]]},"references-count":50,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["s21227610"],"URL":"https:\/\/doi.org\/10.3390\/s21227610","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,11,16]]}}}