{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,15]],"date-time":"2025-11-15T03:57:44Z","timestamp":1763179064026,"version":"build-2065373602"},"reference-count":32,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2018,6,25]],"date-time":"2018-06-25T00:00:00Z","timestamp":1529884800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Given a video sequence acquired from a fixed camera, the stationary background generation problem consists of generating a unique image estimating the stationary background of the sequence. During the IEEE Scene Background Modeling Contest (SBMC) organized in 2016, we presented the LaBGen-P method. In short, this method relies on a motion detection algorithm for selecting, for each pixel location, a given amount of pixel intensities that are most likely static by keeping the ones with the smallest quantities of motion. These quantities are estimated by aggregating the motion scores returned by the motion detection algorithm in the spatial neighborhood of the pixel. After this selection process, the background image is then generated by blending the selected intensities with a median filter. In our previous works, we showed that using a temporally-memoryless motion detection, detecting motion between two frames without relying on additional temporal information, leads our method to achieve the best performance. In this work, we go one step further by developing LaBGen-P-Semantic, a variant of LaBGen-P, the motion detection step of which is built on the current frame only by using semantic segmentation. For this purpose, two intra-frame motion detection algorithms, detecting motion from a unique frame, are presented and compared. Our experiments, carried out on the Scene Background Initialization (SBI) and SceneBackgroundModeling.NET (SBMnet) datasets, show that leveraging semantic segmentation improves the robustness against intermittent motions, background motions and very short video sequences, which are among the main challenges in the background generation field. Moreover, our results confirm that using an intra-frame motion detection is an appropriate choice for our method and paves the way for more techniques based on semantic segmentation.<\/jats:p>","DOI":"10.3390\/jimaging4070086","type":"journal-article","created":{"date-parts":[[2018,6,25]],"date-time":"2018-06-25T11:03:25Z","timestamp":1529924605000},"page":"86","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":18,"title":["LaBGen-P-Semantic: A First Step for Leveraging Semantic Segmentation in Background Generation"],"prefix":"10.3390","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3408-0833","authenticated-orcid":false,"given":"Benjamin","family":"Laugraud","sequence":"first","affiliation":[{"name":"Montefiore Institute, University of Li\u00e8ge, Quartier Polytech 1, All\u00e9e de la D\u00e9couverte 10, 4000 Li\u00e8ge, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8076-1157","authenticated-orcid":false,"given":"S\u00e9bastien","family":"Pi\u00e9rard","sequence":"additional","affiliation":[{"name":"Montefiore Institute, University of Li\u00e8ge, Quartier Polytech 1, All\u00e9e de la D\u00e9couverte 10, 4000 Li\u00e8ge, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6260-6487","authenticated-orcid":false,"given":"Marc","family":"Van Droogenbroeck","sequence":"additional","affiliation":[{"name":"Montefiore Institute, University of Li\u00e8ge, Quartier Polytech 1, All\u00e9e de la D\u00e9couverte 10, 4000 Li\u00e8ge, Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,6,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Maddalena, L., and Petrosino, A. (2014). Background Model Initialization for Static Cameras. Background Modeling and Foreground Detection for Video Surveillance, Chapman and Hall\/CRC. Chapter 3.","DOI":"10.1201\/b17223-5"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.patrec.2016.12.024","article-title":"Scene Background Initialization: A Taxonomy","volume":"96","author":"Bouwmans","year":"2017","journal-title":"Pattern Recognit. Lett."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"5244","DOI":"10.1109\/TIP.2017.2728181","article-title":"Extensive Benchmark and Survey of Modeling Methods for Scene Background Initialization","volume":"26","author":"Jodoin","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_4","first-page":"477","article-title":"Simple median-based method for stationary background generation using background subtraction algorithms","volume":"Volume 9281","author":"Laugraud","year":"2015","journal-title":"Proceedings of the International Conference on Image Analysis and Processing (ICIAP), Workshop on Scene Background Modeling and Initialization (SBMI)"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.patrec.2016.11.022","article-title":"LaBGen: A method based on motion detection for generating the background of a scene","volume":"96","author":"Laugraud","year":"2017","journal-title":"Pattern Recognit. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Laugraud, B., Pi\u00e9rard, S., and Van Droogenbroeck, M. (2016, January 4\u20138). LaBGen-P: A Pixel-Level Stationary Background Generation Method Based on LaBGen. Proceedings of the 23rd International Conference on IEEE International Conference on Pattern Recognition (ICPR), Canc\u00fan, Mexico.","DOI":"10.1109\/ICPR.2016.7899617"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1007\/978-3-319-70353-4_38","article-title":"Is a Memoryless Motion Detection Truly Relevant for Background Generation with LaBGen?","volume":"Volume 10617","author":"Laugraud","year":"2017","journal-title":"Proceedings of the International Conference on Advanced Concepts for Intelligent Vision Systems (ACIVS)"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Braham, M., Pi\u00e9rard, S., and Van Droogenbroeck, M. (2017, January 17\u201320). Semantic Background Subtraction. Proceedings of the IEEE International Conference on Image Processing (ICIP), Beijing, China.","DOI":"10.1109\/ICIP.2017.8297144"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21\u201326). Pyramid Scene Parsing Network. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.660"},{"key":"ref_10","first-page":"147","article-title":"Recent Advanced Statistical Background Modeling for Foreground Detection\u2014A Systematic Survey","volume":"4","author":"Bouwmans","year":"2011","journal-title":"Recent Pat. Comput. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"223","DOI":"10.2174\/2213275910902030223","article-title":"Subspace Learning for Background Modeling: A Survey","volume":"2","author":"Bouwmans","year":"2009","journal-title":"Recent Pat. Comput. Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cosrev.2016.11.001","article-title":"Decomposition into low-rank plus additive matrices for background\/foreground separation: A review for a comparative evaluation with a large-scale dataset","volume":"23","author":"Bouwmans","year":"2017","journal-title":"Comput. Sci. Rev."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Sobral, A., Javed, S., Jung, S.K., Bouwmans, T., and Zahzah, E.H. (2015, January 11\u201318). Online Stochastic Tensor Decomposition for Background Subtraction in Multispectral Video Sequences. Proceedings of the International Conference on Computer Vision Workshops (ICCV Workshops), Santiago, Chile.","DOI":"10.1109\/ICCVW.2015.125"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Pal, S.K., Petrosino, A., and Maddalena, L. (2012). Background Subtraction for Visual Surveillance: A Fuzzy Approach. Handbook on Soft Computing for Video Surveillance, Taylor and Francis Group. Chapter 5.","DOI":"10.1201\/b11631"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.cosrev.2014.04.001","article-title":"Traditional and recent approaches in background modeling for foreground detection: An overview","volume":"11\u201312","author":"Bouwmans","year":"2014","journal-title":"Comput. Sci. Rev."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1145\/800031.808600","article-title":"Summed-area tables for texture mapping","volume":"Volume 18","author":"Crow","year":"1984","journal-title":"Proceedings of the 11th Annual Conference on Computer Graphics and Interactive Techniques SIGGRAPH"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zhou, B., Zhao, H., Puig, X., Fidler, S., Barriuso, A., and Torralba, A. (2016). Semantic understanding of scenes through the ADE20K dataset. arXiv.","DOI":"10.1109\/CVPR.2017.544"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zhou, B., Zhao, H., Puig, X., Fidler, S., Barriuso, A., and Torralba, A. (2017, January 21\u201326). Scene Parsing through ADE20K Dataset. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.544"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Maddalena, L., and Petrosino, A. (2015, January 7\u201311). Towards Benchmarking Scene Background Initialization. Proceedings of the International Conference on Image Analysis and Processing Workshops (ICIAP Workshops), Genova, Italy.","DOI":"10.1007\/978-3-319-23222-5_57"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1016\/j.patrec.2016.09.014","article-title":"Interactive Deep Learning Method for Segmenting Moving Objects","volume":"96","author":"Wang","year":"2017","journal-title":"Pattern Recognit. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Goyette, N., Jodoin, P.M., Porikli, F., Konrad, J., and Ishwar, P. (2012, January 16\u201321). changedetection.net: A New Change Detection Benchmark Dataset. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Providence, RI, USA.","DOI":"10.1109\/CVPRW.2012.6238919"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Wang, Y., Jodoin, P.M., Porikli, F., Konrad, J., Benezeth, Y., and Ishwar, P. (2014, January 23\u201328). CDnet 2014: An Expanded Change Detection Benchmark Dataset. Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Columbus, OH, USA.","DOI":"10.1109\/CVPRW.2014.126"},{"key":"ref_23","unstructured":"Wang, Z., Simoncelli, E.P., and Bovik, A.C. (2003, January 9\u201312). Multiscale structural similarity for image quality assessment. Proceedings of the Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, USA."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_25","first-page":"603","article-title":"A new color image quality measure based on YUV transformation and PSNR for human vision system","volume":"21","author":"Yalman","year":"2013","journal-title":"Turk. J. Electr. Eng. Comput. Sci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"5840","DOI":"10.1109\/TIP.2017.2746268","article-title":"Background-Foreground Modeling Based on Spatiotemporal Sparse Subspace Clustering","volume":"26","author":"Javed","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.patrec.2017.05.029","article-title":"Background estimation by weightless neural networks","volume":"96","author":"Giordano","year":"2017","journal-title":"Pattern Recognit. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Maddalena, L., and Petrosino, A. (2016, January 4\u20138). Extracting a Background Image by a Multi-modal Scene Background Model. Proceedings of the 23rd International Conference on IEEE International Conference on Pattern Recognition (ICPR), Canc\u00fan, Mexico.","DOI":"10.1109\/ICPR.2016.7899623"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Javed, S., Mahmmod, A., Bouwmans, T., and Jung, S.K. (2016, January 4\u20138). Motion-Aware Graph Regularized RPCA for Background Modeling of Complex Scene. Proceedings of the IEEE International Conference on Pattern Recognition (ICPR), Canc\u00fan, Mexico.","DOI":"10.1109\/ICPR.2016.7899619"},{"key":"ref_30","unstructured":"Liu, W., Cai, Y., Zhang, M., Li, H., and Gu, H. (2016, January 4\u20138). Scene Background Estimation Based on Temporal Median Filter with Gaussian Filtering. Proceedings of the IEEE International Conference on Pattern Recognition (ICPR), Canc\u00fan, Mexico."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1145\/1015706.1015718","article-title":"Interactive Digital Photomontage","volume":"23","author":"Agarwala","year":"2004","journal-title":"ACM Trans. Graph."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1016\/j.cviu.2016.03.012","article-title":"Rejection based multipath reconstruction for background estimation in video sequences with stationary objects","volume":"147","author":"Ortego","year":"2016","journal-title":"Comput. Vis. Image Underst."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/4\/7\/86\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:10:05Z","timestamp":1760195405000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/4\/7\/86"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,25]]},"references-count":32,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2018,7]]}},"alternative-id":["jimaging4070086"],"URL":"https:\/\/doi.org\/10.3390\/jimaging4070086","relation":{},"ISSN":["2313-433X"],"issn-type":[{"type":"electronic","value":"2313-433X"}],"subject":[],"published":{"date-parts":[[2018,6,25]]}}}