{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,10]],"date-time":"2025-12-10T08:42:09Z","timestamp":1765356129363,"version":"3.41.0"},"reference-count":69,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2016,11,11]],"date-time":"2016-11-11T00:00:00Z","timestamp":1478822400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61521002, 61272226"],"award-info":[{"award-number":["61521002, 61272226"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Tsinghua University Initiative Scientific Research Program"},{"name":"the General Financial Grant from the China Postdoctoral Science Foundation","award":["2015M580100"],"award-info":[{"award-number":["2015M580100"]}]},{"name":"the National High Technology Research and Development Program of China","award":["2013AA013903"],"award-info":[{"award-number":["2013AA013903"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2016,11,11]]},"abstract":"<jats:p>Extracting background features for estimating the camera path is a key step in many video editing and enhancement applications. Existing approaches often fail on highly dynamic videos that are shot by moving cameras and contain severe foreground occlusion. Based on existing theories, we present a new, practical method that can reliably identify background features in complex video, leading to accurate camera path estimation and background layering. Our approach contains a local motion analysis step and a global optimization step. We first divide the input video into overlapping temporal windows, and extract local motion clusters in each window. We form a directed graph from these local clusters, and identify background ones by finding a minimal path through the graph using optimization. We show that our method significantly outperforms other alternatives, and can be directly used to improve common video editing applications such as stabilization, compositing and background reconstruction.<\/jats:p>","DOI":"10.1145\/2980179.2980243","type":"journal-article","created":{"date-parts":[[2016,11,11]],"date-time":"2016-11-11T17:02:54Z","timestamp":1478883774000},"page":"1-12","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":23,"title":["Robust background identification for dynamic video editing"],"prefix":"10.1145","volume":"35","author":[{"given":"Fang-Lue","family":"Zhang","sequence":"first","affiliation":[{"name":"Tsinghua University, Beijing"}]},{"given":"Xian","family":"Wu","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing"}]},{"given":"Hao-Tian","family":"Zhang","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing"}]},{"given":"Jue","family":"Wang","sequence":"additional","affiliation":[{"name":"Adobe Research"}]},{"given":"Shi-Min","family":"Hu","sequence":"additional","affiliation":[{"name":"Tsinghua University, Beijing and Cardiff University"}]}],"member":"320","published-online":{"date-parts":[[2016,12,5]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601198"},{"key":"e_1_2_2_2_1","doi-asserted-by":"crossref","unstructured":"Bai X. Wang J. and Simons D. 2011. Towards temporally-coherent video matting. In Mirage. Bai X. Wang J. and Simons D. 2011. Towards temporally-coherent video matting. In Mirage.","DOI":"10.1007\/978-3-642-24136-9_6"},{"key":"e_1_2_2_3_1","doi-asserted-by":"crossref","unstructured":"Bai J. Agarwala A. Agrawala M. and Ramamoorthi R. 2014. User-assisted video stabilization. Computer Graphics Forum (EGSR 2014) 33 4 61--70. Bai J. Agarwala A. Agrawala M. and Ramamoorthi R. 2014. User-assisted video stabilization. Computer Graphics Forum (EGSR 2014) 33 4 61--70.","DOI":"10.1111\/cgf.12413"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000011205.11775.fd"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP.2009.4959741"},{"volume-title":"Int. Conf. Image Analysis and Processing, 825--830","author":"Battiato S.","key":"e_1_2_2_6_1","unstructured":"Battiato , S. , Gallo , G. , Puglisi , G. , and Scellato , S . 2007. Sift features tracking for video stabilization . In Int. Conf. Image Analysis and Processing, 825--830 . Battiato, S., Gallo, G., Puglisi, G., and Scellato, S. 2007. Sift features tracking for video stabilization. In Int. Conf. Image Analysis and Processing, 825--830."},{"volume-title":"IEEE Workshop on Visual Motion, IEEE, 179--186","author":"Boult T. E.","key":"e_1_2_2_7_1","unstructured":"Boult , T. E. , and Brown , L. G . 1991. Factorization-based segmentation of motions . In IEEE Workshop on Visual Motion, IEEE, 179--186 . Boult, T. E., and Brown, L. G. 1991. Factorization-based segmentation of motions. In IEEE Workshop on Visual Motion, IEEE, 179--186."},{"key":"e_1_2_2_8_1","doi-asserted-by":"crossref","unstructured":"Brox T. and Malik J. 2010. Object segmentation by long term analysis of point trajectories. In ECCV. Springer 282--295. Brox T. and Malik J. 2010. Object segmentation by long term analysis of point trajectories. In ECCV. Springer 282--295.","DOI":"10.1007\/978-3-642-15555-0_21"},{"key":"e_1_2_2_9_1","doi-asserted-by":"crossref","unstructured":"Brox T. and Malik J. 2010. Object segmentation by long term analysis of point trajectories. In ECCV. Springer 282--295. Brox T. and Malik J. 2010. Object segmentation by long term analysis of point trajectories. In ECCV. Springer 282--295.","DOI":"10.1007\/978-3-642-15555-0_21"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.267"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2008.01326.x"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2013.2251642"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2010.2087764"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2002.800516"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCSVT.2009.2035843"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185560"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.544079"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1008000628999"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33718-5_44"},{"key":"e_1_2_2_20_1","doi-asserted-by":"crossref","unstructured":"Elgammal A. Harwood D. and Davis L. 2000. Non-parametric model for background subtraction. In ECCV Springer 751--767. Elgammal A. Harwood D. and Davis L. 2000. Non-parametric model for background subtraction. In ECCV Springer 751--767.","DOI":"10.1007\/3-540-45053-X_48"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995366"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.438"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/1404880.1404882"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2231816.2231824"},{"key":"e_1_2_2_25_1","doi-asserted-by":"crossref","unstructured":"Grundmann M. Kwatra V. Han M. and Essa I. 2010. Efficient hierarchical graph based video segmentation. IEEE CVPR. Grundmann M. Kwatra V. Han M. and Essa I. 2010. Efficient hierarchical graph based video segmentation. IEEE CVPR.","DOI":"10.1109\/CVPR.2010.5539893"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.5995525"},{"key":"e_1_2_2_27_1","first-page":"67","article-title":"Statistical background subtraction for a mobile observer","volume":"1","author":"Hayman E.","year":"2003","unstructured":"Hayman , E. , and Eklundh , J.-O. 2003 . Statistical background subtraction for a mobile observer . In IEEE ICCV , vol. 1 , 67 -- 74 . Hayman, E., and Eklundh, J.-O. 2003. Statistical background subtraction for a mobile observer. In IEEE ICCV, vol. 1, 67--74.","journal-title":"IEEE ICCV"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-005-0313-3"},{"key":"e_1_2_2_29_1","doi-asserted-by":"crossref","unstructured":"Litvin A. Konrad J. and Karl W. C. 2003. Probabilistic video stabilization using kalman filtering and mosaicing. In Electronic Imaging 663--674. Litvin A. Konrad J. and Karl W. C. 2003. Probabilistic video stabilization using kalman filtering and mosaicing. In Electronic Imaging 663--674.","DOI":"10.1117\/12.476436"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1899404.1899408"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/1531326.1531350"},{"key":"e_1_2_2_32_1","doi-asserted-by":"crossref","unstructured":"Liu F. Niu Y. and Jin H. 2013. Joint subspace stabilization for stereoscopic video. In IEEE ICCV 73--80. Liu F. Niu Y. and Jin H. 2013. Joint subspace stabilization for stereoscopic video. In IEEE ICCV 73--80.","DOI":"10.1109\/ICCV.2013.16"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461995"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.16"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1085"},{"key":"e_1_2_2_36_1","unstructured":"Malis E. and Vargas M. 2007. Deeper understanding of the homography decomposition for vision-based control. Malis E. and Vargas M. 2007. Deeper understanding of the homography decomposition for vision-based control."},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2006.141"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.54"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2013.242"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.223"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.369"},{"volume-title":"A benchmark dataset and evaluation methodology for video object segmentation","author":"Perazzi F.","key":"e_1_2_2_42_1","unstructured":"Perazzi , F. , Pont-Tuset , J. , McWilliams , B. , Gool , L. V. , Gross , M. , and Sorkine-Hornung , A. 2016. A benchmark dataset and evaluation methodology for video object segmentation . In IEEE CVPR , 724--732. Perazzi, F., Pont-Tuset, J., McWilliams, B., Gool, L. V., Gross, M., and Sorkine-Hornung, A. 2016. A benchmark dataset and evaluation methodology for video object segmentation. In IEEE CVPR, 724--732."},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2009.191"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.275"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-008-0136-6"},{"key":"e_1_2_2_46_1","doi-asserted-by":"crossref","unstructured":"Sheikh Y. Javed O. and Kanade T. 2009. Background subtraction for freely moving cameras. In IEEE ICCV 1219--1225. Sheikh Y. Javed O. and Kanade T. 2009. Background subtraction for freely moving cameras. In IEEE ICCV 1219--1225.","DOI":"10.1109\/ICCV.2009.5459334"},{"key":"e_1_2_2_47_1","doi-asserted-by":"crossref","unstructured":"Shi J. and Tomasi C. 1994. Good features to track. In IEEE CVPR 593--600. Shi J. and Tomasi C. 1994. Good features to track. In IEEE CVPR 593--600.","DOI":"10.1109\/CVPR.1994.323794"},{"key":"e_1_2_2_48_1","doi-asserted-by":"crossref","unstructured":"Sturm P. and Triggs B. 1996. A factorization based algorithm for multi-image projective structure and motion. In ECCV 709--720. Sturm P. and Triggs B. 1996. A factorization based algorithm for multi-image projective structure and motion. In ECCV 709--720.","DOI":"10.1007\/3-540-61123-1_183"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.210"},{"key":"e_1_2_2_50_1","doi-asserted-by":"crossref","unstructured":"Sun D. Roth S. and Black M. J. 2010. Secrets of optical flow estimation and their principles. In IEEE CVPR 2432--2439. Sun D. Roth S. and Black M. J. 2010. Secrets of optical flow estimation and their principles. In IEEE CVPR 2432--2439.","DOI":"10.1109\/CVPR.2010.5539939"},{"key":"e_1_2_2_51_1","doi-asserted-by":"crossref","unstructured":"Taylor B. Karasev V. and Soatto S. 2015. Causal video object segmentation from persistence of occlusions. In IEEE CVPR 4268--4276. Taylor B. Karasev V. and Soatto S. 2015. Causal video object segmentation from persistence of occlusions. In IEEE CVPR 4268--4276.","DOI":"10.1109\/CVPR.2015.7299055"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00129684"},{"key":"e_1_2_2_53_1","doi-asserted-by":"crossref","unstructured":"Tron R. and Vidal R. 2007. A benchmark for the comparison of 3-d motion segmentation algorithms. In IEEE CVPR IEEE 1--8. Tron R. and Vidal R. 2007. A benchmark for the comparison of 3-d motion segmentation algorithms. In IEEE CVPR IEEE 1--8.","DOI":"10.1109\/CVPR.2007.382974"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2005.226"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33786-4_2"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-007-0099-z"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601208"},{"key":"e_1_2_2_58_1","first-page":"I","article-title":"Space-time video completion","volume":"1","author":"Wexler Y.","year":"2004","unstructured":"Wexler , Y. , Shechtman , E. , and Irani , M. 2004 . Space-time video completion . In IEEE CVPR , vol. 1 , I .120. Wexler, Y., Shechtman, E., and Irani, M. 2004. Space-time video completion. In IEEE CVPR, vol. 1, I.120.","journal-title":"IEEE CVPR"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.60"},{"key":"e_1_2_2_60_1","first-page":"1","article-title":"Spatio-temporal point path analysis and optimization of a galvanoscopic scanning laser projector","volume":"99","author":"Willi S.","year":"2016","unstructured":"Willi , S. , and Grundhofer , A. 2016 . Spatio-temporal point path analysis and optimization of a galvanoscopic scanning laser projector . IEEE Transactions on Visualization and Computer Graphics PP , 99 , 1 -- 8 . Willi, S., and Grundhofer, A. 2016. Spatio-temporal point path analysis and optimization of a galvanoscopic scanning laser projector. IEEE Transactions on Visualization and Computer Graphics PP, 99, 1--8.","journal-title":"IEEE Transactions on Visualization and Computer Graphics PP"},{"key":"e_1_2_2_61_1","volume-title":"IEEE CVPR","volume":"2","author":"Wu Y.","unstructured":"Wu , Y. , Zhang , Z. , Huang , T. S. , and Lin , J. Y . 2001. Multi-body grouping via orthogonal subspace decomposition . In IEEE CVPR , vol. 2 , IEEE, II--252. Wu, Y., Zhang, Z., Huang, T. S., and Lin, J. Y. 2001. Multi-body grouping via orthogonal subspace decomposition. In IEEE CVPR, vol. 2, IEEE, II--252."},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.27"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1007\/11744085_8"},{"key":"e_1_2_2_64_1","doi-asserted-by":"crossref","unstructured":"Yang M. Pei M. Wu Y. and Jia Y. Learning online structural appearance model for robust object tracking. Sci China Inf Sci 58 3 1--14. Yang M. Pei M. Wu Y. and Jia Y. Learning online structural appearance model for robust object tracking. Sci China Inf Sci 58 3 1--14.","DOI":"10.1007\/s11432-014-5177-6"},{"key":"e_1_2_2_65_1","doi-asserted-by":"crossref","unstructured":"Zhang Y. Tang Y.-L. and Cheng K.-L. Efficient video cutout by paint selection. Journal of Computer Science and Technology 30 3 467--477. Zhang Y. Tang Y.-L. and Cheng K.-L. Efficient video cutout by paint selection. Journal of Computer Science and Technology 30 3 467--477.","DOI":"10.1007\/s11390-015-1537-y"},{"key":"e_1_2_2_66_1","doi-asserted-by":"crossref","unstructured":"Zhang G. Jia J. Xiong W. Wong T.-T. Heng P.-A. and Bao H. 2007. Moving object extraction with a hand-held camera. In IEEE ICCV 1--8. Zhang G. Jia J. Xiong W. Wong T.-T. Heng P.-A. and Bao H. 2007. Moving object extraction with a hand-held camera. In IEEE ICCV 1--8.","DOI":"10.1109\/ICCV.2007.4408963"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2015.2493959"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/2661229.2661281"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2008.08.006"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2980179.2980243","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2980179.2980243","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T03:49:57Z","timestamp":1750218597000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2980179.2980243"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,11,11]]},"references-count":69,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2016,11,11]]}},"alternative-id":["10.1145\/2980179.2980243"],"URL":"https:\/\/doi.org\/10.1145\/2980179.2980243","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"type":"print","value":"0730-0301"},{"type":"electronic","value":"1557-7368"}],"subject":[],"published":{"date-parts":[[2016,11,11]]},"assertion":[{"value":"2016-12-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}