{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:27:03Z","timestamp":1760243223292,"version":"build-2065373602"},"reference-count":36,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2014,1,24]],"date-time":"2014-01-24T00:00:00Z","timestamp":1390521600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Low-cost systems that can obtain a high-quality foreground segmentation almostindependently of the existing illumination conditions for indoor environments are verydesirable, especially for security and surveillance applications. In this paper, a novelforeground segmentation algorithm that uses only a Kinect depth sensor is proposedto satisfy the aforementioned system characteristics. This is achieved by combininga mixture of Gaussians-based background subtraction algorithm with a new Bayesiannetwork that robustly predicts the foreground\/background regions between consecutivetime steps. The Bayesian network explicitly exploits the intrinsic characteristics ofthe depth data by means of two dynamic models that estimate the spatial and depthevolution of the foreground\/background regions. The most remarkable contribution is thedepth-based dynamic model that predicts the changes in the foreground depth distributionbetween consecutive time steps. This is a key difference with regard to visible imagery,where the color\/gray distribution of the foreground is typically assumed to be constant.Experiments carried out on two different depth-based databases demonstrate that theproposed combination of algorithms is able to obtain a more accurate segmentation of theforeground\/background than other state-of-the art approaches.<\/jats:p>","DOI":"10.3390\/s140201961","type":"journal-article","created":{"date-parts":[[2014,1,24]],"date-time":"2014-01-24T11:30:50Z","timestamp":1390563050000},"page":"1961-1987","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Foreground Segmentation in Depth Imagery Using Depth and Spatial Dynamic Models for Video Surveillance Applications"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0618-3488","authenticated-orcid":false,"given":"Carlos","family":"Del-Blanco","sequence":"first","affiliation":[{"name":"Grupo de Tratamiento de Im\u00e1genes, E.T.S.I de Telecomunicaci\u00f3n, Universidad Polit\u00e9cnica de Madrid, Avenida Complutense 30, Madrid 28040, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tom\u00e1s","family":"Mantec\u00f3n","sequence":"additional","affiliation":[{"name":"Grupo de Tratamiento de Im\u00e1genes, E.T.S.I de Telecomunicaci\u00f3n, Universidad Polit\u00e9cnica de Madrid, Avenida Complutense 30, Madrid 28040, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Massimo","family":"Camplani","sequence":"additional","affiliation":[{"name":"Grupo de Tratamiento de Im\u00e1genes, E.T.S.I de Telecomunicaci\u00f3n, Universidad Polit\u00e9cnica de Madrid, Avenida Complutense 30, Madrid 28040, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fernando","family":"Jaureguizar","sequence":"additional","affiliation":[{"name":"Grupo de Tratamiento de Im\u00e1genes, E.T.S.I de Telecomunicaci\u00f3n, Universidad Polit\u00e9cnica de Madrid, Avenida Complutense 30, Madrid 28040, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luis","family":"Salgado","sequence":"additional","affiliation":[{"name":"Grupo de Tratamiento de Im\u00e1genes, E.T.S.I de Telecomunicaci\u00f3n, Universidad Polit\u00e9cnica de Madrid, Avenida Complutense 30, Madrid 28040, Spain"},{"name":"Video Processing and Understanding Laboratory, Universidad Aut\u00f3noma de Madrid, Madrid 28049, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Narciso","family":"Garc\u00eda","sequence":"additional","affiliation":[{"name":"Grupo de Tratamiento de Im\u00e1genes, E.T.S.I de Telecomunicaci\u00f3n, Universidad Polit\u00e9cnica de Madrid, Avenida Complutense 30, Madrid 28040, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2014,1,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"875","DOI":"10.3390\/s130100875","article-title":"Deciphering the crowd: Modeling and identification of pedestrian group motion","volume":"13","author":"Yucel","year":"2013","journal-title":"Sensors"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Del Blanco, C., Jaureguizar, F., and Garcia, N. (2011, January 11\u201314). Bayesian Visual Surveillance: A Model for Detecting and Tracking a Variable Number of Moving Objects. Brussels, Belgium.","DOI":"10.1109\/ICIP.2011.6115712"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"14397","DOI":"10.3390\/s121114397","article-title":"A coded aperture compressive imaging array and its visual detection and tracking algorithms for surveillance systems","volume":"12","author":"Chen","year":"2012","journal-title":"Sensors"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"799","DOI":"10.1016\/j.patrec.2012.12.008","article-title":"Multi-modal user identification and object recognition surveillance system","volume":"34","author":"Reyes","year":"2013","journal-title":"Pattern Recognit. Lett."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2010\/343057","article-title":"Background subtraction for automated multisensor surveillance: A comprehensive review","volume":"2010","author":"Cristani","year":"2010","journal-title":"EURASIP J. Adv. Signal Process."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Narayana, M., Hanson, A., and Learned-Miller, E. (2012, January 16\u201321). Background Modeling Using Adaptive Pixelwise Kernel Variances in a Hybrid Feature Space. Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6247916"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Liao, S., and Zhao, G. (2010, January 13\u201318). Modeling Pixel Process with Scale Invariant Local Patterns for Background Subtraction in Complex Scenes. San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5539817"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1109\/TPAMI.2006.68","article-title":"A texture-based method for modeling the background and detecting moving objects","volume":"28","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","unstructured":"Bellotti, C., Bellotti, F., de Gloria, A., Andreone, L., and Mariani, M. (2004, January 14\u201317). Developing a Near Infrared Based Night Vision System. Parma, Italy."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1273","DOI":"10.1016\/j.robot.2010.06.002","article-title":"Optical flow or image subtraction in human detection from infrared camera on mobile robot","volume":"58","author":"Castillo","year":"2010","journal-title":"Robot. Auton. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1007\/s11263-006-4121-7","article-title":"Background-subtraction in thermal imagery using contour saliency","volume":"71","author":"Davis","year":"2006","journal-title":"Int. J. Comput. Vis."},{"key":"ref_12","unstructured":"Davis, J., and Sharma, V. (July, January 27). Robust Background-Subtraction for Person Detection in Thermal Imagery. Washington, DC, USA."},{"key":"ref_13","unstructured":"Han, J., Shao, L., Xu, D., and Shotton, J. (2013). Enhanced computer vision with Microsoft Kinect sensor: A review. IEEE Trans. Cybern, in press."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Cruz, L., Lucio, D., and Velho, L. (2012, January 22\u201325). Kinect and RGBD Images: Challenges and Applications. Ouro Preto, Brazil.","DOI":"10.1109\/SIBGRAPI-T.2012.13"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1007\/978-3-642-04667-4_11","article-title":"Combining color, depth, and motion for video segmentation","volume":"5815","author":"Leens","year":"2009","journal-title":"Comput. Vis. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1709","DOI":"10.1109\/TIP.2010.2101613","article-title":"ViBe: A universal background subtraction algorithm for video sequences","volume":"20","author":"Barnich","year":"2011","journal-title":"IEEE Trans. Image Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1016\/j.jvcir.2013.03.009","article-title":"Background foreground segmentation with RGB-D Kinect data: An efficient combination of classifiers","volume":"25","author":"Camplani","year":"2014","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"8895","DOI":"10.3390\/s130708895","article-title":"Background subtraction based on color and depth using active sensors","volume":"13","author":"Diaz","year":"2013","journal-title":"Sensors"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1016\/j.rti.2004.12.004","article-title":"Real-time foreground\u2013background segmentation using codebook model","volume":"11","author":"Kim","year":"2005","journal-title":"Real Time Imaging"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Stormer, A., Hofmann, M., and Rigoll, G. (2010, January 26\u201329). Depth Gradient Based Segmentation of Overlapping Foreground Objects in Range Images. Edinburgh, UK.","DOI":"10.1109\/ICIF.2010.5712108"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1560","DOI":"10.1109\/TCYB.2013.2271112","article-title":"Depth-color fusion strategy for 3D scene modeling with Kinect","volume":"43","author":"Camplani","year":"2013","journal-title":"IEEE Trans. Cybern."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1437","DOI":"10.3390\/s120201437","article-title":"Accuracy and resolution of Kinect depth data for indoor mapping applications","volume":"12","author":"Khoshelham","year":"2012","journal-title":"Sensors"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"8222","DOI":"10.3390\/s130708222","article-title":"On the use of simple geometric descriptors provided by RGB-D sensors for re-identification","volume":"13","year":"2013","journal-title":"Sensors"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1016\/j.patrec.2005.11.005","article-title":"Efficient adaptive density estimation per image pixel for the task of background subtraction","volume":"27","author":"Zivkovic","year":"2006","journal-title":"Pattern Recognit. Lett."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Suarez, J., and Murphy, R.R. (2012, January 9\u201313). Hand Gesture Recognition with Depth Images: A Review. Paris, France.","DOI":"10.1109\/ROMAN.2012.6343787"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"226","DOI":"10.1109\/34.667881","article-title":"On combining classifiers","volume":"20","author":"Kittler","year":"1998","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Cao, Y., Wang, C., Li, Z., Zhang, L., and Zhang, L. (2010, January 13\u201318). Spatial-Bag-of-Features. San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5540021"},{"key":"ref_28","unstructured":"Doucet, A., Freitas, N.d., Murphy, K.P., and Russell, S.J. (2000, January 30). Rao-Blackwellised Particle Filtering for Dynamic Bayesian Networks. San Francisco, CA, USA."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Bandouch, J., Engstler, F., and Beetz, M. (2008, January 1\u20134). Evaluation of Hierarchical Sampling Strategies in 3D Human Pose Estimation. Leeds, UK.","DOI":"10.5244\/C.22.92"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1109\/78.978374","article-title":"A tutorial on particle filters for online nonlinear\/non-Gaussian Bayesian tracking","volume":"50","author":"Arulampalam","year":"2002","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Spinello, L. (2011, January 25\u201330). People Detection in RGB-D Data. San Francisco, CA, USA.","DOI":"10.1109\/IROS.2011.6095074"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1049\/iet-cvi.2011.0140","article-title":"Who is who at different cameras: People re-identification using depth cameras","volume":"6","author":"Albiol","year":"2012","journal-title":"IET Comput. Vis."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"380","DOI":"10.1093\/sysbio\/45.3.380","article-title":"The probabilistic basis of Jaccard's index of similarity","volume":"45","author":"Real","year":"1996","journal-title":"Syst. Biol."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Goyette, N., Jodoin, P.M., Porikli, F., Konrad, J., and Ishwar, P. (2012, January 16\u201321). Changedetection.net: A New Change Detection Benchmark Dataset. Providence, RI, USA.","DOI":"10.1109\/CVPRW.2012.6238919"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Hofmann, M., Tiefenbacher, P., and Rigoll, G. (2012, January 16\u201321). Background Segmentation with Feedback: The Pixel-Based Adaptive Segmenter. Providence, RI, USA.","DOI":"10.1109\/CVPRW.2012.6238925"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1168","DOI":"10.1109\/TIP.2008.924285","article-title":"A self-organizing approach to background subtraction for visual surveillance applications","volume":"17","author":"Maddalena","year":"2008","journal-title":"IEEE Trans. Image Process."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/14\/2\/1961\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:07:39Z","timestamp":1760216859000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/14\/2\/1961"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,1,24]]},"references-count":36,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2014,2]]}},"alternative-id":["s140201961"],"URL":"https:\/\/doi.org\/10.3390\/s140201961","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2014,1,24]]}}}