{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,11]],"date-time":"2025-12-11T20:52:39Z","timestamp":1765486359148},"reference-count":44,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,11,29]],"date-time":"2019-11-29T00:00:00Z","timestamp":1574985600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,11,29]],"date-time":"2019-11-29T00:00:00Z","timestamp":1574985600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["IPSJ T Comput Vis Appl"],"published-print":{"date-parts":[[2019,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>We address a method of pedestrian segmentation in a video in a spatio-temporally consistent way. For this purpose, given a bounding box sequence of each pedestrian obtained by a conventional pedestrian detector and tracker, we construct a spatio-temporal graph on a video and segment each pedestrian on the basis of a well-established graph-cut segmentation framework. More specifically, we consider three terms as an energy function for the graph-cut segmentation: (1) a data term, (2) a spatial pairwise term, and (3) a temporal pairwise term. To maintain better temporal consistency of segmentation even under relatively large motions, we introduce a transportation minimization framework that provides a temporal correspondence. Moreover, we introduce the edge-sticky superpixel to maintain the spatial consistency of object boundaries. In experiments, we demonstrate that the proposed method improves segmentation accuracy indices, such as the average and weighted intersection of union on TUD datasets and the PETS2009 dataset at both the instance level and semantic level.<\/jats:p>","DOI":"10.1186\/s41074-019-0062-2","type":"journal-article","created":{"date-parts":[[2019,11,29]],"date-time":"2019-11-29T19:02:26Z","timestamp":1575054146000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Pedestrian segmentation based on a spatio-temporally consistent graph-cut with optimal transport"],"prefix":"10.1186","volume":"11","author":[{"given":"Yang","family":"Yu","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yasushi","family":"Makihara","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yasushi","family":"Yagi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2019,11,29]]},"reference":[{"key":"62_CR1","first-page":"325","volume-title":"European Conference on Computer Vision","author":"R Plaenkers","year":"2002","unstructured":"Plaenkers R, Fua P (2002) Model-based silhouette extraction for accurate people tracking In: European Conference on Computer Vision, 325\u2013339.. Springer, Berlin."},{"key":"62_CR2","doi-asserted-by":"publisher","first-page":"561","DOI":"10.1109\/ICIP.2006.312487","volume-title":"Image Processing, 2006 IEEE International Conference On","author":"X Chen","year":"2006","unstructured":"Chen X, He Z, Anderson D, Keller J, Skubic M (2006) Adaptive silhouette extraction and human tracking in complex and dynamic environments In: Image Processing, 2006 IEEE International Conference On, 561\u2013564.. IEEE, New York."},{"issue":"2","key":"62_CR3","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1007\/s10044-008-0112-3","volume":"12","author":"J-H Ahn","year":"2009","unstructured":"Ahn J-H, Choi C, Kwak S, Kim K, Byun H (2009) Human tracking and silhouette extraction for human\u2013robot interaction systems. Patt Anal Appl 12(2):167\u2013177.","journal-title":"Patt Anal Appl"},{"key":"62_CR4","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1109\/CVPR.2004.438","volume-title":"Computer Vision and Pattern Recognition Workshop, 2004. CVPRW\u201904. Conference On","author":"NR Howe","year":"2004","unstructured":"Howe NR (2004) Silhouette lookup for automatic pose tracking In: Computer Vision and Pattern Recognition Workshop, 2004. CVPRW\u201904. Conference On, 15\u201322.. IEEE, New York."},{"key":"62_CR5","first-page":"1","volume-title":"Computer Vision and Pattern Recognition, 2007. CVPR\u201907. IEEE Conference On","author":"L Wang","year":"2007","unstructured":"Wang L, Suter D (2007) Recognizing human activities from silhouettes: Motion subspace and factorial discriminative graphical model In: Computer Vision and Pattern Recognition, 2007. CVPR\u201907. IEEE Conference On, 1\u20138.. IEEE, New York."},{"issue":"15","key":"62_CR6","doi-asserted-by":"publisher","first-page":"1799","DOI":"10.1016\/j.patrec.2013.01.021","volume":"34","author":"AA Chaaraoui","year":"2013","unstructured":"Chaaraoui AA, Climent-P\u00e9rez P, Fl\u00f3rez-Revuelta F (2013) Silhouette-based human action recognition using sequences of key poses. Patt Recogn Lett 34(15):1799\u20131807.","journal-title":"Patt Recogn Lett"},{"issue":"6","key":"62_CR7","doi-asserted-by":"publisher","first-page":"1646","DOI":"10.1109\/TIP.2007.896661","volume":"16","author":"L Wang","year":"2007","unstructured":"Wang L, Suter D (2007) Learning and matching of dynamic shape manifolds for human action recognition. IEEE Trans Image Process 16(6):1646\u20131661.","journal-title":"IEEE Trans Image Process"},{"issue":"10","key":"62_CR8","doi-asserted-by":"publisher","first-page":"1515","DOI":"10.1016\/j.imavis.2009.02.002","volume":"27","author":"N Ikizler","year":"2009","unstructured":"Ikizler N, Duygulu P (2009) Histogram of oriented rectangles: a new pose descriptor for human action recognition. Image Vision Comput 27(10):1515\u20131526.","journal-title":"Image Vision Comput"},{"key":"62_CR9","doi-asserted-by":"publisher","first-page":"366","DOI":"10.1109\/AFGR.2002.1004181","volume-title":"Automatic Face and Gesture Recognition, 2002. Proceedings. Fifth IEEE International Conference On","author":"RT Collins","year":"2002","unstructured":"Collins RT, Gross R, Shi J (2002) Silhouette-based human identification from body shape and gait In: Automatic Face and Gesture Recognition, 2002. Proceedings. Fifth IEEE International Conference On, 366\u2013371.. IEEE, New York."},{"issue":"12","key":"62_CR10","doi-asserted-by":"publisher","first-page":"1505","DOI":"10.1109\/TPAMI.2003.1251144","volume":"25","author":"L Wang","year":"2003","unstructured":"Wang L, Tan T, Ning H, Hu W (2003) Silhouette analysis-based gait recognition for human identification. IEEE Trans Patt Anal Mach Intell 25(12):1505\u20131518.","journal-title":"IEEE Trans Patt Anal Mach Intell"},{"key":"62_CR11","first-page":"211","volume-title":"Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference On","author":"Z Liu","year":"2004","unstructured":"Liu Z, Sarkar S (2004) Simplest representation yet for gait recognition: averaged silhouette In: Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference On, 211\u2013214.. IEEE, New York."},{"key":"62_CR12","volume-title":"CVPR 2017","author":"S Caelles","year":"2017","unstructured":"Caelles S, Maninis K-K, Pont-Tuset J, Leal-Taix\u00e9 L, Cremers D, Van Gool L (2017) One-shot video object segmentation In: CVPR 2017.. IEEE, New York."},{"key":"62_CR13","doi-asserted-by":"publisher","first-page":"686","DOI":"10.1109\/ICCV.2017.81","volume-title":"2017 IEEE International Conference on Computer Vision (ICCV)","author":"J Cheng","year":"2017","unstructured":"Cheng J, Tsai Y-H, Wang S, Yang M-H (2017) Segflow: joint learning for video object segmentation and optical flow In: 2017 IEEE International Conference on Computer Vision (ICCV), 686\u2013695.. IEEE, New York."},{"key":"62_CR14","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1109\/ACVMOT.2005.33","volume-title":"Application of Computer Vision, 2005. WACV\/MOTIONS\u201905 Volume 1. Seventh IEEE Workshops On","author":"J Migdal","year":"2005","unstructured":"Migdal J, Grimson WEL (2005) Background subtraction using markov thresholds In: Application of Computer Vision, 2005. WACV\/MOTIONS\u201905 Volume 1. Seventh IEEE Workshops On, 58\u201365.. IEEE, New York."},{"key":"62_CR15","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1109\/ICPR.2004.1333992","volume-title":"Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference On","author":"Z Zivkovic","year":"2004","unstructured":"Zivkovic Z (2004) Improved adaptive gaussian mixture model for background subtraction In: Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference On, 28\u201331.. IEEE, New York."},{"issue":"6","key":"62_CR16","doi-asserted-by":"publisher","first-page":"1187","DOI":"10.1109\/TPAMI.2013.242","volume":"36","author":"P Ochs","year":"2014","unstructured":"Ochs P, Malik J, Brox T (2014) Segmentation of moving objects by long term video analysis. IEEE Trans Patt Anal Mach Intell 36(6):1187\u20131200.","journal-title":"IEEE Trans Patt Anal Mach Intell"},{"key":"62_CR17","doi-asserted-by":"publisher","first-page":"1577","DOI":"10.1109\/ICCV.2013.199","volume-title":"Computer Vision (ICCV), 2013 IEEE International Conference On","author":"M Narayana","year":"2013","unstructured":"Narayana M, Hanson A, Learned-Miller E (2013) Coherent motion segmentation in moving camera videos using optical flow orientations In: Computer Vision (ICCV), 2013 IEEE International Conference On, 1577\u20131584.. IEEE, New York."},{"key":"62_CR18","doi-asserted-by":"publisher","first-page":"1878","DOI":"10.1109\/CVPR.2012.6247887","volume-title":"Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference On","author":"M Unger","year":"2012","unstructured":"Unger M, Werlberger M, Pock T, Bischof H (2012) Joint motion estimation and segmentation of complex scenes with label costs and occlusion modeling In: Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference On, 1878\u20131885.. IEEE, New York."},{"issue":"9","key":"62_CR19","doi-asserted-by":"publisher","first-page":"1316","DOI":"10.1109\/TCSVT.2011.2148490","volume":"21","author":"Y-M Chen","year":"2011","unstructured":"Chen Y-M, Bajic IV (2011) A joint approach to global motion estimation and motion segmentation from a coarsely sampled motion vector field. IEEE Trans Circ Syst Vid Technol 21(9):1316\u20131328.","journal-title":"IEEE Trans Circ Syst Vid Technol"},{"issue":"6","key":"62_CR20","doi-asserted-by":"publisher","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","volume":"39","author":"Shaoqing Ren","year":"2017","unstructured":"Ren S, He K, Girshick RB, Sun J (2015) Faster r-cnn: Towards real-time object detection with region proposal networks In: IEEE Transactions on pattern analysis and machine intelligence, 39, 1137\u20131149.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"62_CR21","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"R Girshick","year":"2014","unstructured":"Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).. IEEE, New York."},{"key":"62_CR22","volume-title":"Proceedings of the International Conference on Computer Vision (ICCV)","author":"R Girshick","year":"2015","unstructured":"Girshick R (2015) Fast R-CNN In: Proceedings of the International Conference on Computer Vision (ICCV).. IEEE, New York."},{"key":"62_CR23","first-page":"4696","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"C Kim","year":"2015","unstructured":"Kim C, Li F, Ciptadi A, Rehg JM (2015) Multiple hypothesis tracking revisited In: Proceedings of the IEEE International Conference on Computer Vision, 4696\u20134704.. IEEE, New York."},{"key":"62_CR24","first-page":"3029","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"W Choi","year":"2015","unstructured":"Choi W (2015) Near-online multi-target tracking with aggregated local flow descriptor In: Proceedings of the IEEE International Conference on Computer Vision, 3029\u20133037.. IEEE, New York."},{"key":"62_CR25","unstructured":"Keuper M, Tang S, Zhongjie Y, Andres B, Brox T, Schiele B (2016) A multi-cut formulation for joint segmentation and tracking of multiple objects. Computing Research Repository (CoRR):1\u201314."},{"key":"62_CR26","doi-asserted-by":"publisher","first-page":"5397","DOI":"10.1109\/CVPR.2015.7299178","volume-title":"Computer Vision and Pattern Recognition (CVPR), 2015 IEEE Conference On","author":"A Milan","year":"2015","unstructured":"Milan A, Leal-Taix\u00e9 L, Schindler K, Reid I (2015) Joint tracking and segmentation of multiple targets In: Computer Vision and Pattern Recognition (CVPR), 2015 IEEE Conference On, 5397\u20135406.. IEEE, New York."},{"issue":"11","key":"62_CR27","doi-asserted-by":"publisher","first-page":"2274","DOI":"10.1109\/TPAMI.2012.120","volume":"34","author":"R Achanta","year":"2012","unstructured":"Achanta R, Shaji A, Smith K, Lucchi A, Fua P, S\u00fcsstrunk S (2012) Slic superpixels compared to state-of-the-art superpixel methods. IEEE Trans Pattern Anal Mach Intell 34(11):2274\u20132282.","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"62_CR28","first-page":"25","volume-title":"European Conference on Computer Vision","author":"T Brox","year":"2004","unstructured":"Brox T, Bruhn A, Papenberg N, Weickert J (2004) High accuracy optical flow estimation based on a theory for warping In: European Conference on Computer Vision, 25\u201336.. Springer, Berlin."},{"issue":"3","key":"62_CR29","doi-asserted-by":"publisher","first-page":"298","DOI":"10.1007\/s11263-014-0744-2","volume":"111","author":"M Van den Bergh","year":"2015","unstructured":"Van den Bergh M, Boix X, Roig G, Van Gool L (2015) Seeds: Superpixels extracted via energy-driven sampling. Int J Comput Vis 111(3):298\u2013314.","journal-title":"Int J Comput Vis"},{"key":"62_CR30","doi-asserted-by":"publisher","first-page":"74","DOI":"10.2197\/ipsjtcva.7.74","volume":"7","author":"Y Makihara","year":"2015","unstructured":"Makihara Y, Tanoue T, Muramatsu D, Yagi Y, Mori S, Utsumi Y, Iwamura M, Kise K (2015) Individuality-preserving silhouette extraction for gait recognition. IPSJ Trans Comput Vis Appl 7:74\u201378.","journal-title":"IPSJ Trans Comput Vis Appl"},{"key":"62_CR31","volume-title":"IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"G Lin","year":"2017","unstructured":"Lin G, Milan A, Shen C, Reid I (2017) Refinenet: multi-path refinement networks for high-resolution semantic segmentation In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR).. IEEE, New York."},{"key":"62_CR32","doi-asserted-by":"publisher","first-page":"2980","DOI":"10.1109\/ICCV.2017.322","volume-title":"Computer Vision (ICCV), 2017 IEEE International Conference On","author":"K He","year":"2017","unstructured":"He K, Gkioxari G, Doll\u00e1r P, Girshick R (2017) Mask r-cnn In: Computer Vision (ICCV), 2017 IEEE International Conference On, 2980\u20132988.. IEEE, New York."},{"key":"62_CR33","first-page":"770","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"K He","year":"2016","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 770\u2013778.. IEEE, New York."},{"key":"62_CR34","first-page":"2758","volume-title":"Proceedings of the IEEE International Conference on Computer Vision","author":"A Dosovitskiy","year":"2015","unstructured":"Dosovitskiy A, Fischer P, Ilg E, Hausser P, Hazirbas C, Golkov V, van der Smagt P, Cremers D, Brox T (2015) Flownet: Learning optical flow with convolutional networks In: Proceedings of the IEEE International Conference on Computer Vision, 2758\u20132766.. IEEE, New York."},{"key":"62_CR35","doi-asserted-by":"publisher","first-page":"2051","DOI":"10.1109\/CVPR.2013.267","volume-title":"Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference On","author":"J Chang","year":"2013","unstructured":"Chang J, Wei D, Fisher III JW (2013) A video representation using temporal superpixels In: Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference On, 2051\u20132058.. IEEE, New York."},{"key":"62_CR36","first-page":"3431","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"J Long","year":"2015","unstructured":"Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3431\u20133440.. IEEE, New York."},{"issue":"6","key":"62_CR37","doi-asserted-by":"publisher","first-page":"2872","DOI":"10.1109\/TIP.2019.2891895","volume":"28","author":"Y Wu","year":"2019","unstructured":"Wu Y, Lin Y, Dong X, Yan Y, Bian W, Yang Y (2019) Progressive learning for person re-identification with one example. IEEE Trans Image Process 28(6):2872\u20132881.","journal-title":"IEEE Trans Image Process"},{"key":"62_CR38","doi-asserted-by":"publisher","first-page":"1841","DOI":"10.1109\/ICCV.2013.231","volume-title":"Computer Vision (ICCV), 2013 IEEE International Conference On","author":"P Doll\u00e1r","year":"2013","unstructured":"Doll\u00e1r P, Zitnick CL (2013) Structured forests for fast edge detection In: Computer Vision (ICCV), 2013 IEEE International Conference On, 1841\u20131848.. IEEE, New York."},{"key":"62_CR39","doi-asserted-by":"crossref","unstructured":"\u00c12 \u00c0. (2001) Fast approximate energy minimization via graph cuts. IEEE Trans Patt Anal Mach Intell 23(11):1.","DOI":"10.1109\/34.969114"},{"key":"62_CR40","first-page":"3213","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"M Cordts","year":"2016","unstructured":"Cordts M, Omran M, Ramos S, Rehfeld T, Enzweiler M, Benenson R, Franke U, Roth S, Schiele B (2016) The cityscapes dataset for semantic urban scene understanding In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3213\u20133223.. IEEE, New York."},{"key":"62_CR41","first-page":"309","volume-title":"ACM Transactions on Graphics (TOG)","author":"C Rother","year":"2004","unstructured":"Rother C, Kolmogorov V, Blake A (2004) Grabcut: interactive foreground extraction using iterated graph cuts In: ACM Transactions on Graphics (TOG), 309\u2013314.. ACM, New York."},{"key":"62_CR42","unstructured":"Liu C, et al (2009) Beyond pixels: exploring new representations and applications for motion analysis. PhD Thesis:48\u201350."},{"key":"62_CR43","volume-title":"CVPR","author":"Z Cao","year":"2017","unstructured":"Cao Z, Simon T, Wei S-E, Sheikh Y (2017) Realtime multi-person 2d pose estimation using part affinity fields In: CVPR.. IEEE, New York."},{"key":"62_CR44","doi-asserted-by":"crossref","unstructured":"Henschel R, Leal-Taix\u00e9 L, Cremers D, Rosenhahn B (2017) Fusion of head and full-body detectors for multi-object tracking In: 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 1509\u2013150909.","DOI":"10.1109\/CVPRW.2018.00192"}],"container-title":["IPSJ Transactions on Computer Vision and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s41074-019-0062-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s41074-019-0062-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s41074-019-0062-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,30]],"date-time":"2021-07-30T12:15:23Z","timestamp":1627647323000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s41074-019-0062-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,29]]},"references-count":44,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,12]]}},"alternative-id":["62"],"URL":"https:\/\/doi.org\/10.1186\/s41074-019-0062-2","relation":{},"ISSN":["1882-6695"],"issn-type":[{"value":"1882-6695","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,29]]},"assertion":[{"value":"4 December 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 November 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 November 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"10"}}