{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T05:19:35Z","timestamp":1784179175170,"version":"3.55.0"},"reference-count":68,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2016,3,15]],"date-time":"2016-03-15T00:00:00Z","timestamp":1458000000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2016,6,2]]},"abstract":"<jats:p>Precise object segmentation in image data is a fundamental problem with various applications, including 3D object reconstruction. We present an efficient algorithm to automatically segment a static foreground object from highly cluttered background in light fields. A key insight and contribution of our article is that a significant increase of the available input data can enable the design of novel, highly efficient approaches. In particular, the central idea of our method is to exploit high spatio-angular sampling on the order of thousands of input frames, for example, captured as a hand-held video, such that new structures are revealed due to the increased coherence in the data. We first show how purely local gradient information contained in slices of such a dense light field can be combined with information about the camera trajectory to make efficient estimates of the foreground and background. These estimates are then propagated to textureless regions using edge-aware filtering in the epipolar volume. Finally, we enforce global consistency in a gathering step to derive a precise object segmentation in both 2D and 3D space, which captures fine geometric details even in very cluttered scenes. The design of each of these steps is motivated by efficiency and scalability, allowing us to handle large, real-world video datasets on a standard desktop computer. We demonstrate how the results of our method can be used for considerably improving the speed and quality of image-based 3D reconstruction algorithms, and we compare our results to state-of-the-art segmentation and multiview stereo methods.<\/jats:p>","DOI":"10.1145\/2876504","type":"journal-article","created":{"date-parts":[[2016,3,18]],"date-time":"2016-03-18T13:50:44Z","timestamp":1458309044000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":73,"title":["Efficient 3D Object Segmentation from Densely Sampled Light Fields with Applications to 3D Reconstruction"],"prefix":"10.1145","volume":"35","author":[{"given":"Kaan","family":"Y\u00fccer","sequence":"first","affiliation":[{"name":"ETH Zurich and Disney Research Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander","family":"Sorkine-Hornung","sequence":"additional","affiliation":[{"name":"Disney Research Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Oliver","family":"Wang","sequence":"additional","affiliation":[{"name":"Disney Research Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Olga","family":"Sorkine-Hornung","sequence":"additional","affiliation":[{"name":"ETH Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2016,3,15]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/1360612.1360639"},{"key":"e_1_2_2_2_1","volume-title":"Proceedings of the British Machine Vision Conference. 1089--1098","author":"Apostoloff Nicholas","unstructured":"Nicholas Apostoloff and Andrew W. Fitzgibbon . 2006. Automatic video segmentation using spatiotemporal t-junctions . In Proceedings of the British Machine Vision Conference. 1089--1098 . Nicholas Apostoloff and Andrew W. Fitzgibbon. 2006. Automatic video segmentation using spatiotemporal t-junctions. In Proceedings of the British Machine Vision Conference. 1089--1098."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2007.905883"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00128525"},{"key":"e_1_2_2_5_1","volume-title":"Proceedings of the British Machine Vision Conference. 1--8.","author":"Bowen Adam","year":"2007","unstructured":"Adam Bowen , Andrew Mullins , Roland Wilson , and Nasir Rajpoot . 2007 . Bayesian surface estimation from multiple cameras using a prior based on the visual hull and its application to image based rendering . In Proceedings of the British Machine Vision Conference. 1--8. Adam Bowen, Andrew Mullins, Roland Wilson, and Nasir Rajpoot. 2007. Bayesian surface estimation from multiple cameras using a prior based on the visual hull and its application to image based rendering. In Proceedings of the British Machine Vision Conference. 1--8."},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2001.937505"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2008.4587792"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/383259.383309"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2008.09.005"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVMP.2011.21"},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.197"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/566654.566572"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cviu.2004.06.001"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2012.03009.x"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015778"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8659.2008.01138.x"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP.2003.1247340"},{"key":"e_1_2_2_18_1","volume-title":"Proceedings of the International Conference on Vision, Modeling and Visualization. 569--576","author":"Feldmann Ingo","year":"2003","unstructured":"Ingo Feldmann , Peter Kauff , and Peter Eisert . 2003 b. Image cube trajectory analysis for 3D reconstruction of concentric mosaics . In Proceedings of the International Conference on Vision, Modeling and Visualization. 569--576 . Ingo Feldmann, Peter Kauff, and Peter Eisert. 2003b. Image cube trajectory analysis for 3D reconstruction of concentric mosaics. In Proceedings of the International Conference on Vision, Modeling and Visualization. 569--576."},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2005.105"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601097.2601163"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2010.5539802"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-008-0134-8"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2009.161"},{"key":"e_1_2_2_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964964"},{"key":"e_1_2_2_25_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 1--8.","author":"Goesele Michael","unstructured":"Michael Goesele , Noah Snavely , Brian Curless , Hugues Hoppe , and Steven M. Seitz . 2007. Multi-view stereo for community photo collections . In Proceedings of the IEEE International Conference on Computer Vision. 1--8. Michael Goesele, Noah Snavely, Brian Curless, Hugues Hoppe, and Steven M. Seitz. 2007. Multi-view stereo for community photo collections. In Proceedings of the IEEE International Conference on Computer Vision. 1--8."},{"key":"e_1_2_2_26_1","volume-title":"Proceedings of the Conference on Computer Vision and Pattern Recognition. 683--688","author":"Goldl\u00fccke Bastian","unstructured":"Bastian Goldl\u00fccke and Marcus A. Magnor . 2003. Joint 3D-reconstruction and background separation in multiple views using graph cuts . In Proceedings of the Conference on Computer Vision and Pattern Recognition. 683--688 . Bastian Goldl\u00fccke and Marcus A. Magnor. 2003. Joint 3D-reconstruction and background separation in multiple views using graph cuts. In Proceedings of the Conference on Computer Vision and Pattern Recognition. 683--688."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237200"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.5555\/1965841.1965864"},{"key":"e_1_2_2_29_1","volume-title":"Proceedings of the Conference on Computer Vision and Pattern Recognition. 2141--2148","author":"Grundmann Matthias","unstructured":"Matthias Grundmann , Vivek Kwatra , Mei Han , and Irfan A. Essa . 2010. Efficient hierarchical graph-based video segmentation . In Proceedings of the Conference on Computer Vision and Pattern Recognition. 2141--2148 . Matthias Grundmann, Vivek Kwatra, Mei Han, and Irfan A. Essa. 2010. Efficient hierarchical graph-based video segmentation. In Proceedings of the Conference on Computer Vision and Pattern Recognition. 2141--2148."},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-010-0413-z"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.20"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2006.294"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.5555\/946247.946752"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2010.5539868"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487228.2487237"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461926"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/11861898_69"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276497"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33715-4_57"},{"key":"e_1_2_2_40_1","volume-title":"Proceedings of the Annual Conference on Neural Information Processing Systems. 109--117","author":"Kr\u00e4henb\u00fchl Philipp","year":"2012","unstructured":"Philipp Kr\u00e4henb\u00fchl and Vladlen Koltun . 2012 . Efficient inference in fully connected CRFs with Gaussian edge potentials . In Proceedings of the Annual Conference on Neural Information Processing Systems. 109--117 . Philipp Kr\u00e4henb\u00fchl and Vladlen Koltun. 2012. Efficient inference in fully connected CRFs with Gaussian edge potentials. In Proceedings of the Annual Conference on Neural Information Processing Systems. 109--117."},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.5555\/794189.794352"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2185520.2185530"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.273735"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.196"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237199"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2011.6044588"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.273"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073234"},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.1983.4767367"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/344779.344951"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCVW.2013.46"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/1281500.1281602"},{"key":"e_1_2_2_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015777"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015706.1015720"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.511"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2005.159"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2000.855839"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.5244\/C.20.121"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1006\/ciun.1993.1029"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.28"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2005.238"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/1073204.1073233"},{"key":"e_1_2_2_63_1","volume-title":"Proceedings of the Conference on Computer Vision and Pattern Recognition. 41--48","author":"Wanner S.","unstructured":"S. Wanner and B. Goldluecke . 2012. Globally consistent depth labeling of 4D lightfields . In Proceedings of the Conference on Computer Vision and Pattern Recognition. 41--48 . S. Wanner and B. Goldluecke. 2012. Globally consistent depth labeling of 4D lightfields. In Proceedings of the Conference on Computer Vision and Pattern Recognition. 41--48."},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2013.135"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2013.25"},{"key":"e_1_2_2_66_1","volume-title":"Proceedings of the IEEE International Conference on Computer Vision. 59--66","author":"Anthony","unstructured":"Anthony J. Yezzi and Stefano Soatto. 2001. Stereoscopic segmentation . In Proceedings of the IEEE International Conference on Computer Vision. 59--66 . Anthony J. Yezzi and Stefano Soatto. 2001. Stereoscopic segmentation. In Proceedings of the IEEE International Conference on Computer Vision. 59--66."},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2013.347"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2009.52"}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2876504","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2876504","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:39:10Z","timestamp":1750221550000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2876504"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,3,15]]},"references-count":68,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2016,6,2]]}},"alternative-id":["10.1145\/2876504"],"URL":"https:\/\/doi.org\/10.1145\/2876504","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,3,15]]},"assertion":[{"value":"2015-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2016-03-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}