{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:55:55Z","timestamp":1760241355007,"version":"build-2065373602"},"reference-count":33,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2018,1,5]],"date-time":"2018-01-05T00:00:00Z","timestamp":1515110400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Extended from superpixel segmentation by adding an additional constraint on temporal consistency, supervoxel segmentation is to partition video frames into atomic segments. In this work, we propose a novel scheme for supervoxel segmentation to address the problem of new and moving objects, where the segmentation is performed on every two consecutive frames and thus each internal frame has two valid superpixel segmentations. This scheme provides coarse-grained parallel ability, and subsequent algorithms can validate their result using two segmentations that will further improve robustness. To implement this scheme, a voxel-related Gaussian mixture model (GMM) is proposed, in which each supervoxel is assumed to be distributed in a local region and represented by two Gaussian distributions that share the same color parameters to capture temporal consistency. Our algorithm has a lower complexity with respect to frame size than the traditional GMM. According to our experiments, it also outperforms the state-of-the-art in accuracy.<\/jats:p>","DOI":"10.3390\/s18010128","type":"journal-article","created":{"date-parts":[[2018,1,8]],"date-time":"2018-01-08T04:21:21Z","timestamp":1515385281000},"page":"128","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Supervoxel Segmentation with Voxel-Related Gaussian Mixture Model"],"prefix":"10.3390","volume":"18","author":[{"given":"Zhihua","family":"Ban","sequence":"first","affiliation":[{"name":"National Key Laboratory of Science and Technology on Multi-spectral Information Processing, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhong","family":"Chen","sequence":"additional","affiliation":[{"name":"National Key Laboratory of Science and Technology on Multi-spectral Information Processing, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jianguo","family":"Liu","sequence":"additional","affiliation":[{"name":"National Key Laboratory of Science and Technology on Multi-spectral Information Processing, School of Automation, Huazhong University of Science and Technology, Wuhan 430074, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,1,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2274","DOI":"10.1109\/TPAMI.2012.120","article-title":"SLIC Superpixels Compared to State-of-the-Art Superpixel Methods","volume":"34","author":"Achanta","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3317","DOI":"10.1109\/TIP.2017.2651389","article-title":"Linear Spectral Clustering Superpixel","volume":"26","author":"Chen","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2290","DOI":"10.1109\/TPAMI.2009.96","article-title":"TurboPixels: Fast Superpixels Using Geometric Flows","volume":"31","author":"Levinshtein","year":"2009","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"doi-asserted-by":"crossref","unstructured":"Ban, Z., Liu, J., and Fouriaux, J. (2016). GLSC: LSC superpixels at over 130 FPS. J. Real-Time Image Process., 1\u201312.","key":"ref_4","DOI":"10.1007\/s11554-016-0652-5"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1101","DOI":"10.3390\/s17051101","article-title":"An Automatic Localization Algorithm for Ultrasound Breast Tumors Based on Human Visual Mechanism","volume":"17","author":"Xie","year":"2017","journal-title":"Sensors"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.cviu.2017.04.015","article-title":"Salient object detection based on super-pixel clustering and unified low-rank representation","volume":"161","author":"Zhang","year":"2017","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/j.neucom.2017.02.064","article-title":"Salient object detection via color and texture cues","volume":"243","author":"Zhang","year":"2017","journal-title":"Neurocomputing"},{"doi-asserted-by":"crossref","unstructured":"Van De Sande, K.E.A., Uijlings, J.R.R., Gevers, T., and Smeulders, A.W.M. (2011, January 6\u201313). Segmentation as selective search for object recognition. Proceedings of the 2011 International Conference on Computer Vision (ICCV), Barcelona, Spain.","key":"ref_8","DOI":"10.1109\/ICCV.2011.6126456"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1016\/j.neucom.2017.02.068","article-title":"Class-specific object proposals re-ranking for object detection in automatic driving","volume":"242","author":"Zhong","year":"2017","journal-title":"Neurocomputing"},{"doi-asserted-by":"crossref","unstructured":"Liu, J., Tang, Z., Cui, Y., and Wu, G. (2017). Local Competition-Based Superpixel Segmentation Algorithm in Remote Sensing. Sensors, 17.","key":"ref_10","DOI":"10.3390\/s17061364"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1016\/j.neucom.2017.03.016","article-title":"A superpixel-based CRF saliency detection approach","volume":"244","author":"Qiu","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1016\/j.neucom.2017.05.057","article-title":"A spatially cohesive superpixel model for image noise level estimation","volume":"266","author":"Fu","year":"2017","journal-title":"Neurocomputing"},{"doi-asserted-by":"crossref","unstructured":"Reso, M., Jachalsky, J., Rosenhahn, B., and Ostermann, J. (2013, January 1\u20138). Temporally Consistent Superpixels. Proceedings of the 2013 IEEE International Conference on Computer Vision (ICCV), Sydney, Australia.","key":"ref_13","DOI":"10.1109\/ICCV.2013.55"},{"doi-asserted-by":"crossref","unstructured":"Liang, Y., Dong, X., and Shen, J. (2014, January 14\u201316). Supervoxel using random walks. Proceedings of the 2014 7th International Congress on Image and Signal Processing, Dalian, China.","key":"ref_14","DOI":"10.1109\/CISP.2014.7003761"},{"unstructured":"Xu, C., and Corso, J.J. (2012, January 16\u201321). Evaluation of super-voxel methods for early video processing. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA.","key":"ref_15"},{"doi-asserted-by":"crossref","unstructured":"Veksler, O., Boykov, Y., and Mehrani, P. (2010, January 5\u201311). Superpixels and Supervoxels in an Energy Optimization Framework. Proceedings of the 11th European Conference on Computer Vision (ECCV), Crete, Greece.","key":"ref_16","DOI":"10.1007\/978-3-642-15555-0_16"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"928","DOI":"10.1109\/TCSVT.2015.2406232","article-title":"Video Supervoxels Using Partially Absorbing Random Walks","volume":"26","author":"Liang","year":"2016","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"doi-asserted-by":"crossref","unstructured":"Levinshtein, A., Sminchisescu, C., and Dickinson, S. (2011, January 8\u201312). Spatiotemporal Closure. Proceedings of the 10th Asian Conference on Computer Vision (ACCV), Queenstown, New Zealand.","key":"ref_18","DOI":"10.1007\/978-3-642-19315-6_29"},{"doi-asserted-by":"crossref","unstructured":"Bergh, M.V.D., Roig, G., Boix, X., Manen, S., and Gool, L.V. (2013, January 1\u20138). Online Video SEEDS for Temporal Window Objectness. Proceedings of the 2013 IEEE International Conference on Computer Vision (ICCV), Sydney, Australia.","key":"ref_19","DOI":"10.1109\/ICCV.2013.54"},{"doi-asserted-by":"crossref","unstructured":"Chang, J., Wei, D., and Fisher, J.W. (2013, January 23\u201328). A Video Representation Using Temporal Superpixels. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, OR, USA.","key":"ref_20","DOI":"10.1109\/CVPR.2013.267"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/0004-3702(81)90024-2","article-title":"Determining optical flow","volume":"17","author":"Horn","year":"1981","journal-title":"Artif. Intell."},{"doi-asserted-by":"crossref","unstructured":"Li, S.Z., and Jain, A.K. (2015). Gaussian mixture models. Encyclopedia of Biometrics, Springer.","key":"ref_22","DOI":"10.1007\/978-1-4899-7488-4"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"772","DOI":"10.1016\/j.patcog.2014.09.005","article-title":"Non-rigid visible and infrared face registration via regularized Gaussian fields criterion","volume":"48","author":"Ma","year":"2015","journal-title":"Pattern Recognit."},{"unstructured":"Ban, Z., Liu, J., and Cao, L. (arXiv, 2016). Superpixel Segmentation Using Gaussian Mixture Model, arXiv.","key":"ref_24"},{"doi-asserted-by":"crossref","unstructured":"Ren, X., and Malik, J. (2003, January 13\u201316). Learning a classification model for segmentation. Proceedings of the 9th IEEE International Conference on Computer Vision (ICCV), Nice, France.","key":"ref_25","DOI":"10.1109\/ICCV.2003.1238308"},{"doi-asserted-by":"crossref","unstructured":"Grundmann, M., Kwatra, V., Han, M., and Essa, I. (2010, January 13\u201318). Efficient hierarchical graph-based video segmentation. Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA.","key":"ref_26","DOI":"10.1109\/CVPR.2010.5539893"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1023\/B:VISI.0000022288.19776.77","article-title":"Efficient Graph-Based Image Segmentation","volume":"59","author":"Felzenszwalb","year":"2004","journal-title":"Int. J. Comput. Vis."},{"doi-asserted-by":"crossref","unstructured":"Xu, C., Xiong, C., and Corso, J.J. (2012, January 7\u201313). Streaming Hierarchical Video Segmentation. Proceedings of the 12th European Conference on Computer Vision (ECCV), Florence, Italy.","key":"ref_28","DOI":"10.1007\/978-3-642-33783-3_45"},{"doi-asserted-by":"crossref","unstructured":"Van den Bergh, M., Boix, X., Roig, G., de Capitani, B., and Van Gool, L. (2012, January 7\u201313). SEEDS: Superpixels Extracted via Energy-Driven Sampling. Proceedings of the 12th European Conference on Computer Vision (ECCV), Florence, Italy.","key":"ref_29","DOI":"10.1007\/978-3-642-33786-4_2"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1007\/s11263-014-0744-2","article-title":"SEEDS: Superpixels Extracted via Energy-Driven Sampling","volume":"111","author":"Boix","year":"2015","journal-title":"Int. J. Comput. Vis."},{"doi-asserted-by":"crossref","unstructured":"Chen, A.Y.C., and Corso, J.J. (2010, January 5). Propagating multi-class pixel labels throughout video frames. Proceedings of the 2010 Western New York Image Processing Workshop, Rochester, NY, USA.","key":"ref_31","DOI":"10.1109\/WNYIPW.2010.5649773"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1187","DOI":"10.1109\/TPAMI.2013.242","article-title":"Segmentation of Moving Objects by Long Term Video Analysis","volume":"36","author":"Ochs","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"doi-asserted-by":"crossref","unstructured":"Brox, T., and Malik, J. (2010, January 5\u201311). Object Segmentation by Long Term Analysis of Point Trajectories. Proceedings of the 11th European Conference on Computer Vision (ECCV), Crete, Greece.","key":"ref_33","DOI":"10.1007\/978-3-642-15555-0_21"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/1\/128\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T14:50:12Z","timestamp":1760194212000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/1\/128"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,1,5]]},"references-count":33,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2018,1]]}},"alternative-id":["s18010128"],"URL":"https:\/\/doi.org\/10.3390\/s18010128","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2018,1,5]]}}}