{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,12]],"date-time":"2026-05-12T15:31:42Z","timestamp":1778599902976,"version":"3.51.4"},"reference-count":39,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2020,6,18]],"date-time":"2020-06-18T00:00:00Z","timestamp":1592438400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>The method of Semantic Background Subtraction (SBS), which combines semantic segmentation and background subtraction, has recently emerged for the task of segmenting moving objects in video sequences. While SBS has been shown to improve background subtraction, a major difficulty is that it combines two streams generated at different frame rates. This results in SBS operating at the slowest frame rate of the two streams, usually being the one of the semantic segmentation algorithm. We present a method, referred to as \u201cAsynchronous Semantic Background Subtraction\u201d (ASBS), able to combine a semantic segmentation algorithm with any background subtraction algorithm asynchronously. It achieves performances close to that of SBS while operating at the fastest possible frame rate, being the one of the background subtraction algorithm. Our method consists in analyzing the temporal evolution of pixel features to possibly replicate the decisions previously enforced by semantics when no semantic information is computed. We showcase ASBS with several background subtraction algorithms and also add a feedback mechanism that feeds the background model of the background subtraction algorithm to upgrade its updating strategy and, consequently, enhance the decision. Experiments show that we systematically improve the performance, even when the semantic stream has a much slower frame rate than the frame rate of the background subtraction algorithm. In addition, we establish that, with the help of ASBS, a real-time background subtraction algorithm, such as ViBe, stays real time and competes with some of the best non-real-time unsupervised background subtraction algorithms such as SuBSENSE.<\/jats:p>","DOI":"10.3390\/jimaging6060050","type":"journal-article","created":{"date-parts":[[2020,6,18]],"date-time":"2020-06-18T12:21:46Z","timestamp":1592482906000},"page":"50","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Asynchronous Semantic Background Subtraction"],"prefix":"10.3390","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5314-9015","authenticated-orcid":false,"given":"Anthony","family":"Cioppa","sequence":"first","affiliation":[{"name":"Montefiore Institute, University of Li\u00e8ge, Quartier Polytech 1, All\u00e9e de la D\u00e9couverte 10, 4000 Li\u00e8ge, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9162-3411","authenticated-orcid":false,"given":"Marc","family":"Braham","sequence":"additional","affiliation":[{"name":"Montefiore Institute, University of Li\u00e8ge, Quartier Polytech 1, All\u00e9e de la D\u00e9couverte 10, 4000 Li\u00e8ge, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6260-6487","authenticated-orcid":false,"given":"Marc","family":"Van Droogenbroeck","sequence":"additional","affiliation":[{"name":"Montefiore Institute, University of Li\u00e8ge, Quartier Polytech 1, All\u00e9e de la D\u00e9couverte 10, 4000 Li\u00e8ge, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,6,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.cosrev.2014.04.001","article-title":"Traditional and recent approaches in background modeling for foreground detection: An overview","volume":"11\u201312","author":"Bouwmans","year":"2014","journal-title":"Comput. Sci. Rev."},{"key":"ref_2","unstructured":"Stauffer, C., and Grimson, E. (1995, January 20\u201325). Adaptive background mixture models for real-time tracking. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Corfu, Greece."},{"key":"ref_3","first-page":"751","article-title":"Non-parametric Model for Background Subtraction","volume":"Volume 1843","author":"Elgammal","year":"2000","journal-title":"European Conference on Computer Vision (ECCV)"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1168","DOI":"10.1109\/TIP.2008.924285","article-title":"A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications","volume":"17","author":"Maddalena","year":"2008","journal-title":"IEEE Trans. Image Proc."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1709","DOI":"10.1109\/TIP.2010.2101613","article-title":"ViBe: A universal background subtraction algorithm for video sequences","volume":"20","author":"Barnich","year":"2011","journal-title":"IEEE Trans. Image Proc."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1109\/TIP.2014.2378053","article-title":"SuBSENSE: A Universal Change Detection Method with Local Adaptive Sensitivity","volume":"24","author":"Bilodeau","year":"2015","journal-title":"IEEE Trans. Image Proc."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"4768","DOI":"10.1109\/TIP.2016.2598691","article-title":"Universal Background Subtraction Using Word Consensus Models","volume":"25","author":"Bilodeau","year":"2016","journal-title":"IEEE Trans. Image Proc."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"914","DOI":"10.1109\/TEVC.2017.2694160","article-title":"Combination of Video Change Detection Algorithms by Genetic Programming","volume":"21","author":"Bianco","year":"2017","journal-title":"IEEE Trans. Evol. Comput."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"5840","DOI":"10.1109\/TIP.2017.2746268","article-title":"Background-Foreground Modeling Based on Spatiotemporal Sparse Subspace Clustering","volume":"26","author":"Javed","year":"2017","journal-title":"IEEE Trans. Image Proc."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"2273","DOI":"10.1109\/TPAMI.2017.2745573","article-title":"Foreground Segmentation with Tree-Structured Sparse RPCA","volume":"40","author":"Ebadi","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_11","first-page":"291","article-title":"A Benchmark Dataset for Outdoor Foreground\/ Background Extraction","volume":"Volume 7728","author":"Vacavant","year":"2012","journal-title":"Asian Conference on Computer Vision (ACCV)"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wang, Y., Jodoin, P.M., Porikli, F., Konrad, J., Benezeth, Y., and Ishwar, P. (2014, January 23\u201328). CDnet 2014: An Expanded Change Detection Benchmark Dataset. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Columbus, OH, USA.","DOI":"10.1109\/CVPRW.2014.126"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.cviu.2016.08.005","article-title":"Labeled dataset for integral evaluation of moving object detection algorithms: LASIESTA","volume":"152","author":"Cuevas","year":"2016","journal-title":"Comput. Vis. Image Understand."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Braham, M., and Van Droogenbroeck, M. (2016, January 23\u201325). Deep Background Subtraction with Scene-Specific Convolutional Neural Networks. Proceedings of the IEEE International Conference on Systems, Signals and Image Processing (IWSSIP), Bratislava, Slovakia.","DOI":"10.1109\/IWSSIP.2016.7502717"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Bouwmans, T., and Garcia-Garcia, B. (2019). Background Subtraction in Real Applications: Challenges, Current Models and Future Directions. arXiv.","DOI":"10.1016\/j.cosrev.2019.100204"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"256","DOI":"10.1016\/j.patrec.2018.08.002","article-title":"Foreground Segmentation Using Convolutional Neural Networks for Multiscale Feature Encoding","volume":"112","author":"Lim","year":"2018","journal-title":"Pattern Recognit. Lett."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.patrec.2016.09.014","article-title":"Interactive Deep Learning Method for Segmenting Moving Objects","volume":"96","author":"Wang","year":"2017","journal-title":"Pattern Recognit. Lett."},{"key":"ref_18","first-page":"878","article-title":"Background Subtraction Algorithm With Bayesian Generative Adversarial Networks","volume":"44","author":"Zheng","year":"2018","journal-title":"Acta Autom. Sin."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1016\/j.patcog.2017.09.040","article-title":"A Deep Convolutional Neural Network for Background Subtraction","volume":"76","author":"Babaee","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhou, B., Zhao, H., Puig, X., Fidler, S., Barriuso, A., and Torralba, A. (2017, January 21\u201326). Scene Parsing through ADE20K Dataset. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.544"},{"key":"ref_21","unstructured":"Everingham, M., Van Gool, L., Williams, C., Winn, J., and Zisserman, A. (2019, August 01). The PASCAL Visual Object Classes Challenge 2012 (VOC2012) Results. Available online: http:\/\/www.pascal-network.org\/challenges\/VOC\/voc2012\/workshop\/index.html."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., and Schiele, B. (2016, January 27\u201330). The Cityscapes Dataset for Semantic Urban Scene Understanding. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.350"},{"key":"ref_23","first-page":"740","article-title":"Microsoft COCO: Common Objects in Context","volume":"Volume 8693","author":"Lin","year":"2014","journal-title":"European Conference on Computer Vision (ECCV)"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 24\u201327). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21\u201326). Pyramid Scene Parsing Network. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.660"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Dollar, P., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_27","unstructured":"Sevilla-Lara, L., Sun, D., Jampani, V., and Black, M.J. (July, January 26). Optical Flow with Semantic Segmentation and Localized Layers. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Vertens, J., Valada, A., and Burgard, W. (2017, January 24\u201328). SMSnet: Semantic motion segmentation using deep convolutional neural networks. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8202211"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Reddy, N., Singhal, P., and Krishna, K. (2014, January 14\u201318). Semantic Motion Segmentation Using Dense CRF Formulation. Proceedings of the Indian Conference on Computer Vision Graphics and Image Processing, Bangalore, India.","DOI":"10.1145\/2683483.2683539"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Braham, M., Pi\u00e9rard, S., and Van Droogenbroeck, M. (2017, January 17\u201320). Semantic Background Subtraction. Proceedings of the IEEE International Conference on Image Processing (ICIP), Beijing, China.","DOI":"10.1109\/ICIP.2017.8297144"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Cioppa, A., Van Droogenbroeck, M., and Braham, M. (2020, January 25\u201328). Real-Time Semantic Background Subtraction. Proceedings of the IEEE International Conference on Image Processing (ICIP), Abu Dhabi, UAE.","DOI":"10.1109\/ICIP40778.2020.9190838"},{"key":"ref_32","unstructured":"Van Droogenbroeck, M., Braham, M., and Pi\u00e9rard, S. (2017). Foreground and Background Detection Method. (Office, EP 3438929 A1), European Patent."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1513","DOI":"10.1109\/TCSVT.2017.2669362","article-title":"Real-Time Adaptive Histogram Min-Max Bucket (HMMB) Model for Background Subtraction","volume":"28","author":"Roy","year":"2018","journal-title":"IEEE Trans. Circ. Syst. Video Technol."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Pi\u00e9rard, S., and Van Droogenbroeck, M. (2020, January 25\u201328). Summarizing the performances of a background subtraction algorithm measured on several videos. Proceedings of the IEEE International Conference on Image Processing (ICIP), Abu Dhabi, UAE.","DOI":"10.1109\/ICIP40778.2020.9190865"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1007\/s11263-018-1140-0","article-title":"Semantic understanding of scenes through the ADE20K dataset","volume":"127","author":"Zhou","year":"2019","journal-title":"Int. J. Comput. Vis."},{"key":"ref_36","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2019, August 01). Implementation of PSPNet. Available online: https:\/\/github.com\/hszhao\/PSPNet."},{"key":"ref_37","unstructured":"Barnich, O., and Van Droogenbroeck, M. (2019, August 01). Code for ViBe. Available online: https:\/\/orbi.uliege.be\/handle\/2268\/145853."},{"key":"ref_38","unstructured":"St-Charles, P.L. (2019, August 01). Code for SuBSENSE. Available online: https:\/\/bitbucket.org\/pierre_luc_st_charles\/subsense."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"2105","DOI":"10.1109\/TCSVT.2017.2711659","article-title":"WeSamBE: A Weight-Sample-Based Method for Background Subtraction","volume":"28","author":"Jiang","year":"2018","journal-title":"IEEE Trans. Circuits Syst. Video Technol."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/6\/6\/50\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:40:34Z","timestamp":1760175634000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/6\/6\/50"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,18]]},"references-count":39,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2020,6]]}},"alternative-id":["jimaging6060050"],"URL":"https:\/\/doi.org\/10.3390\/jimaging6060050","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,6,18]]}}}