{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:48:43Z","timestamp":1760240923075,"version":"build-2065373602"},"reference-count":49,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2019,10,8]],"date-time":"2019-10-08T00:00:00Z","timestamp":1570492800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Moving object segmentation is the most fundamental task for many vision-based applications. In the past decade, it has been performed on the stationary camera, or moving camera, respectively. In this paper, we show that the moving object segmentation can be addressed in a unified framework for both type of cameras. The proposed method consists of two stages: (1) In the first stage, a novel multi-frame homography model is generated to describe the background motion. Then, the inliers and outliers of that model are classified as background trajectories and moving object trajectories by the designed cumulative acknowledgment strategy. (2) In the second stage, a super-pixel-based Markov Random Fields model is used to refine the spatial accuracy of initial segmentation and obtain final pixel level labeling, which has integrated trajectory classification information, a dynamic appearance model, and spatial temporal cues. The proposed method overcomes the limitations of existing object segmentation algorithms and resolves the difference between stationary and moving cameras. The algorithm is tested on several challenging open datasets. Experiments show that the proposed method presents significant performance improvement over state-of-the-art techniques quantitatively and qualitatively.<\/jats:p>","DOI":"10.3390\/s19194344","type":"journal-article","created":{"date-parts":[[2019,10,8]],"date-time":"2019-10-08T09:00:38Z","timestamp":1570525238000},"page":"4344","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Unsupervised Moving Object Segmentation from Stationary or Moving Camera Based on Multi-frame Homography Constraints"],"prefix":"10.3390","volume":"19","author":[{"given":"Zhigao","family":"Cui","sequence":"first","affiliation":[{"name":"Xi\u2019an Research Institute of High-Tech, Xi\u2019an 710025, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ke","family":"Jiang","sequence":"additional","affiliation":[{"name":"Xi\u2019an Research Institute of High-Tech, Xi\u2019an 710025, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tao","family":"Wang","sequence":"additional","affiliation":[{"name":"Xi\u2019an Research Institute of High-Tech, Xi\u2019an 710025, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,10,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1016\/j.cosrev.2018.03.001","article-title":"New trends on moving object detection in video images captured by a moving camera: A survey","volume":"28","author":"Yazdi","year":"2018","journal-title":"Comput. Sci. Rev."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.image.2019.03.003","article-title":"Motion and appearance based background subtraction for freely moving cameras","volume":"75","author":"Sajid","year":"2019","journal-title":"Signal Process. Image Commun."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Hu, Y., Huang, J., and Schwing, A. (2018, January 8\u201314). Unsupervised video object segmentation using motion saliency-guided spatio-temporal propagation. Proceedings of the European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-030-01246-5_48"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Cho, J., Jung, Y., Kim, D., and Lee, S. (2019). Moving object detection based on optical flow estimation and a Gaussian mixture model for advanced driver assistance systems. Sensors, 19.","DOI":"10.3390\/s19143217"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1025","DOI":"10.1007\/s11045-017-0486-8","article-title":"Anomaly detection with a moving camera using spatio-temporal codebooks","volume":"29","author":"Nakahata","year":"2018","journal-title":"Multidimens. Syst. Signal Process."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1168","DOI":"10.1109\/TIP.2008.924285","article-title":"A self-organizing approach to background subtraction for visual surveillance applications","volume":"17","author":"Maddalena","year":"2008","journal-title":"Ieee Trans. Image Process."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"22489","DOI":"10.1007\/s11042-018-6104-4","article-title":"Foreground segmentation with PTZ camera: A survey","volume":"77","author":"Komagal","year":"2018","journal-title":"Multimed. Tools Appl."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Avola, D., Bernardi, M., Cinque, L., and Foresti, G. (2018, January 16\u201318). Combining keypoint clustering and neural background subtraction for real-time moving object detection by PTZ Cameras. Proceedings of the 7th International Conference on Pattern Recognition Applications and Methods, Madeira, Portugal.","DOI":"10.5220\/0006722506380645"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1016\/j.jvcir.2005.08.002","article-title":"Real-time image processing for active monitoring of wide areas","volume":"17","author":"Micheloni","year":"2006","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Allebosch, G., Van, D., Veelaert, P., and Philips, W. (2019). Robust pan\/tilt compensation for foreground\u2013background segmentation. Sensors, 19.","DOI":"10.3390\/s19122668"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1109\/TCSVT.2010.2087811","article-title":"Background compensation for pan-tilt-zoom cameras using 1-d feature matching and outlier rejection","volume":"21","author":"Suhr","year":"2011","journal-title":"Ieee Trans. Circuits Syst. Video Technol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1007\/s00138-012-0426-4","article-title":"Panoramic gaussian mixture model and large-scale range background subtraction method for PTZ camera-based surveillance systems","volume":"24","author":"Xue","year":"2013","journal-title":"Mach. Vis. Appl."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1015","DOI":"10.1007\/s00138-012-0448-y","article-title":"Detection of moving objects with a moving camera using non-panoramic background model","volume":"24","author":"Kim","year":"2013","journal-title":"Mach. Vis. Appl."},{"key":"ref_14","unstructured":"Lucas, B., and Kanade, T. (1981, January 24\u201328). An iterative image registration technique with an application to stereo vision. Proceedings of the International Joint Conference on Artificial Intelligence, Vancouver, BC, Canada."},{"key":"ref_15","first-page":"1265","article-title":"Neural background subtraction for pan-tilt-zoom cameras","volume":"43","author":"Ferone","year":"2013","journal-title":"Ieee Trans. Syst. ManCybern. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Brox, T., and Malik, J. (2010, January 5\u201311). Object segmentation by long term analysis of point trajectories. Proceedings of the European Conference on Computer Vision, Crete, Greece.","DOI":"10.1007\/978-3-642-15555-0_21"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Sundaram, N., Brox, T., and Keutzer, K. (2010, January 5\u201311). Dense point trajectories by GPU-accelerated large displacement optical flow. Proceedings of the European Conference on Computer Vision, Crete, Greece.","DOI":"10.1007\/978-3-642-15549-9_32"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Dey, S., Reilly, V., Saleemi, I., and Shah, M. (2012, January 7\u201313). Detection of independently moving objects in non-planar scenes via multi-frame montocular epipolar constraint. Proceedings of the European Conference on Computer Vision, Firenze, Italy.","DOI":"10.1007\/978-3-642-33715-4_62"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ochs, P., and Brox, T. (2011, January 6\u201313). Object segmentation in video: A hierarchical variational approach for turning point trajectories into dense regions. Proceedings of the IEEE International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126418"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Cui, X., Huang, J., Zhang, S., and Metaxas, D. (2012, January 7\u201313). Background subtraction using low rank and group sparsity constraints. Proceedings of the European Conference on Computer Vision, Firenze, Italy.","DOI":"10.1007\/978-3-642-33718-5_44"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"597","DOI":"10.1109\/TPAMI.2012.132","article-title":"Moving object detection by detection by detecting contiguous outliers in the low rank representation","volume":"35","author":"Zhou","year":"2013","journal-title":"Ieee Trans. Pattern Anal. Mach. Intell."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Sheikh, Y., Javed, O., and Kanade, T. (2009, January 28\u201330). Background subtraction for freely moving cameras. Proceedings of the IEEE International Conference on Computer Vision, Kyoto, Japan.","DOI":"10.1109\/ICCV.2009.5459334"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2004). Multiple View Geometry in Computer Vision, Cambridge University Press.","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/BF00129684","article-title":"Shape and motion from image streams under orthography: A factorization method","volume":"9","author":"Tomasi","year":"1992","journal-title":"Int. J. Comput. Vis."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1145\/1970392.1970395","article-title":"Robust principal component analysis?","volume":"58","author":"Candes","year":"2011","journal-title":"J. ACM"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zhu, Y., and Elgammal, A. (2017, January 22\u201329). A multilayer-based framework for online background subtraction with freely moving cameras. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.549"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Lim, J., and Han, B. (2014, January 6\u201312). Generalized background subtraction using superpixels with label integrated motion estimation. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_12"},{"key":"ref_28","unstructured":"Kwak, S., Lim, T., Nam, W., Han, B., and Han, J. (2011, January 6\u201313). Generalized background subtraction based on hybrid inference by belief propagation and bayesian filtering. Proceedings of the IEEE International Conference on Computer Vision, Barcelona, Spain."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Lee, Y., Kim, J., and Grauman, K. (2011, January 6\u201313). Key-segments for video object segmentation. Proceedings of the IEEE International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126471"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Zhang, D., Javed, O., and Shah, M. (2013, January 23\u201328). Video object segmentation through spatially accurate and temporally dense extraction of primary object regions. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.87"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1927","DOI":"10.1007\/s11760-014-0686-8","article-title":"Prominent moving object segmentation from moving camera video shots using iterative energy minimization","volume":"9","author":"Chiranjoy","year":"2015","journal-title":"SignalImage Video Process."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Yang, C., Zhang, L., Lu, H., Ruan, X., and Yang, M. (2013, January 23\u201328). Saliency detection via graph-based manifold ranking. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.407"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Yang, Y., Loquercio, A., Scaramuzza, D., and Soatto, S. (2019, January 16\u201320). Unsupervised moving objects detection via contextual information separation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00097"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1007\/s11263-008-0136-6","article-title":"Particle video: Long-range motion estimation using point trajectories","volume":"80","author":"Sand","year":"2008","journal-title":"Int. J. Comput. Vis."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zamalieva, D., Yilmaz, A., and Davis, J. (2014, January 6\u201312). A multi-transformational model for background subtraction with moving cameras. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10590-1_52"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1016\/j.cviu.2014.06.007","article-title":"Background subtraction for the moving camera: A geometric approach","volume":"127","author":"Zamalieva","year":"2014","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"1222","DOI":"10.1109\/34.969114","article-title":"Fast approximate energy minimization via graph cuts","volume":"23","author":"Boykov","year":"2001","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1007\/s11263-006-7934-5","article-title":"Graph cuts and efficient N-D image segmentation","volume":"70","author":"Boykov","year":"2006","journal-title":"Int. J. Comput. Vis."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Tron, R., and Vidal, R. (2007, January 18\u201323). A benchmark for the comparison of 3-d motion segmentation algorithm. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.382974"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"2274","DOI":"10.1109\/TPAMI.2012.120","article-title":"SLIC superpixels compared to state-of-the-art superpixel methods","volume":"34","author":"Achanta","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_42","unstructured":"Achanta, R., and Shaji, A. (2010). Slicsuperpixels, ACM. EPFL Technical Report."},{"key":"ref_43","unstructured":"Vazquez, A., Avidan, S., and Pfister, H. (2010, January 5\u201311). Multiple hypothesis video segmentation from superpixel flows. Proceedings of the European Conference on Computer Vision, Crete, Greece."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Fulkerson, B., Vedaldi, A., and Soatto, S. (2009, January 28\u201330). Class segmentation and object localization with superpixel neighborhoods. Proceedings of the IEEE International Conference on Computer Vision, Kyoto, Japan.","DOI":"10.1109\/ICCV.2009.5459175"},{"key":"ref_45","unstructured":"Del Bimbo, A., Lisanti, G., Masi, I., and Pernici, F. (September, January 30). Continuous recovery for real time pan tilt zoom localization and mapping. Proceedings of the IEEE Advanced Video and Signal based Surveillance, Klagenfurt, Austria."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Goyette, N., Jodoin, P., and Porikil, F. (2012, January 16\u201321). Changedetection.net: A new change detection benchmark dataset. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Providence, Rhode Island.","DOI":"10.1109\/CVPRW.2012.6238919"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"32","DOI":"10.2174\/1874479610801010032","article-title":"Moving object detection in spatial domain using background removal techniques-state-of-art","volume":"1","author":"Elhabian","year":"2008","journal-title":"Recent Pat. Comput. Sci."},{"key":"ref_48","first-page":"99","article-title":"Real-time moving object segmentation and classification from HEVC compressed surveillance video","volume":"27","author":"Zhao","year":"2017","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Che, E., Jung, J., and Olsen, M. (2019). Object recognition, segmentation, and classification of mobile laser scanning point clouds: A state of the art review. Sensors, 19.","DOI":"10.3390\/s19040810"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/19\/4344\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:28:17Z","timestamp":1760189297000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/19\/4344"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,10,8]]},"references-count":49,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2019,10]]}},"alternative-id":["s19194344"],"URL":"https:\/\/doi.org\/10.3390\/s19194344","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2019,10,8]]}}}