{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T01:56:16Z","timestamp":1782784576828,"version":"3.54.5"},"reference-count":57,"publisher":"Association for Computing Machinery (ACM)","issue":"6","license":[{"start":{"date-parts":[[2017,11,20]],"date-time":"2017-11-20T00:00:00Z","timestamp":1511136000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Salt River Project Agricultural Improvement and Power District Cooperative","award":["12061288"],"award-info":[{"award-number":["12061288"]}]},{"name":"KAUST Office of Sponsored Research","award":["OCRF-2014-CGR3-62140401"],"award-info":[{"award-number":["OCRF-2014-CGR3-62140401"]}]},{"name":"ERC","award":["StG-2013-335373"],"award-info":[{"award-number":["StG-2013-335373"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Graph."],"published-print":{"date-parts":[[2017,12,31]]},"abstract":"<jats:p>The creation of high-quality semantically parsed 3D models for dense metropolitan areas is a fundamental urban modeling problem. Although recent advances in acquisition techniques and processing algorithms have resulted in large-scale imagery or 3D polygonal reconstructions, such data-sources are typically noisy, and incomplete, with no semantic structure. In this paper, we present an automatic data fusion technique that produces high-quality structured models of city blocks. From coarse polygonal meshes, street-level imagery, and GIS footprints, we formulate a binary integer program that globally balances sources of error to produce semantically parsed mass models with associated facade elements. We demonstrate our system on four city regions of varying complexity; our examples typically contain densely built urban blocks spanning hundreds of buildings. In our largest example, we produce a structured model of 37 city blocks spanning a total of 1, 011 buildings at a scale and quality previously impossible to achieve automatically.<\/jats:p>","DOI":"10.1145\/3130800.3130823","type":"journal-article","created":{"date-parts":[[2017,11,22]],"date-time":"2017-11-22T16:25:08Z","timestamp":1511367908000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":71,"title":["BigSUR"],"prefix":"10.1145","volume":"36","author":[{"given":"Tom","family":"Kelly","sequence":"first","affiliation":[{"name":"University College London"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John","family":"Femiani","sequence":"additional","affiliation":[{"name":"Miami University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Wonka","sequence":"additional","affiliation":[{"name":"KAUST"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Niloy J.","family":"Mitra","sequence":"additional","affiliation":[{"name":"University College London"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2017,11,20]]},"reference":[{"key":"e_1_2_2_1_1","volume-title":"Large Scale Asset Extraction for Urban Images. ECCV","author":"Affara Lama","year":"2016","unstructured":"Lama Affara , Liangliang Nan , Bernard Ghanem , and Peter Wonka . 2016. Large Scale Asset Extraction for Urban Images. ECCV ( 2016 ), 437--452. Lama Affara, Liangliang Nan, Bernard Ghanem, and Peter Wonka. 2016. Large Scale Asset Extraction for Urban Images. ECCV (2016), 437--452."},{"key":"e_1_2_2_2_1","volume-title":"The Journal of Universal Computer Science","author":"Aichholzer Oswin","unstructured":"Oswin Aichholzer , Franz Aurenhammer , David Alberts , and Bernd G\u00e4rtner . 1996. A novel type of skeleton for polygons . In The Journal of Universal Computer Science . Springer , 752--761. Oswin Aichholzer, Franz Aurenhammer, David Alberts, and Bernd G\u00e4rtner. 1996. A novel type of skeleton for polygons. In The Journal of Universal Computer Science. Springer, 752--761."},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2010.170"},{"key":"e_1_2_2_4_1","volume-title":"SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation","author":"Badrinarayanan Vijay","year":"2017","unstructured":"Vijay Badrinarayanan , Alex Kendall , and Roberto Cipolla . 2017. SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation . IEEE TPAMI ( 2017 ). Vijay Badrinarayanan, Alex Kendall, and Roberto Cipolla. 2017. SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation. IEEE TPAMI (2017)."},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.comgeo.2014.08.006"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jag.2004.10.006"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88682-2_5"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12788"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2517348"},{"key":"e_1_2_2_10_1","volume-title":"Feasibility and Infeasibility in Optimization: Algorithms and Computational Methods","author":"Chinneck John W.","unstructured":"John W. Chinneck . 2008. Feasibility and Infeasibility in Optimization: Algorithms and Computational Methods . Springer . John W. Chinneck. 2008. Feasibility and Infeasibility in Optimization: Algorithms and Computational Methods. Springer."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2014.410"},{"key":"e_1_2_2_12_1","volume-title":"The Cityscapes Dataset for Semantic Urban Scene Understanding","author":"Cordts Marius","unstructured":"Marius Cordts , Mohamed Omran , Sebastian Ramos , Timo Rehfeld , Markus Enzweiler , Rodrigo Benenson , Uwe Franke , Stefan Roth , and Bernt Schiele . 2016. The Cityscapes Dataset for Semantic Urban Scene Understanding . In IEEE CVPR. Marius Cordts, Mohamed Omran, Sebastian Ramos, Timo Rehfeld, Markus Enzweiler, Rodrigo Benenson, Uwe Franke, Stefan Roth, and Bernt Schiele. 2016. The Cityscapes Dataset for Semantic Urban Scene Understanding. In IEEE CVPR."},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33718-5_51"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/237170.237191"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:VISI.0000029665.07652.61"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.304"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/PL00009479"},{"key":"e_1_2_2_18_1","first-page":"1720","article-title":"Image-based modeling of unwrappable facades","volume":"19","author":"Fang Tian","year":"2013","unstructured":"Tian Fang , Zhexi Wang , Honghui Zhang , and Long Quan . 2013 . Image-based modeling of unwrappable facades . IEEE TVCG 19 , 10 (2013), 1720 -- 1731 . Tian Fang, Zhexi Wang, Honghui Zhang, and Long Quan. 2013. Image-based modeling of unwrappable facades. IEEE TVCG 19, 10 (2013), 1720--1731.","journal-title":"IEEE TVCG"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1975.1055330"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2009.161"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2013.07.003"},{"key":"e_1_2_2_22_1","volume-title":"Shape-based recognition of 3D point clouds in urban environments","author":"Golovinskiy Aleksey","year":"2009","unstructured":"Aleksey Golovinskiy , Vladimir G Kim , and Thomas Funkhouser . 2009. Shape-based recognition of 3D point clouds in urban environments . IEEE ICCV ( 2009 ), 2154--2161. Aleksey Golovinskiy, Vladimir G Kim, and Thomas Funkhouser. 2009. Shape-based recognition of 3D point clouds in urban environments. IEEE ICCV (2009), 2154--2161."},{"key":"e_1_2_2_23_1","unstructured":"Gurobi. 2016. Gurobi Optimizer Reference Manual. (2016). http:\/\/www.gurobi.com  Gurobi. 2016. Gurobi Optimizer Reference Manual. (2016). http:\/\/www.gurobi.com"},{"key":"e_1_2_2_24_1","volume-title":"Caffe: Convolutional Architecture for Fast Feature Embedding. arXiv preprint arXiv:1408.5093","author":"Jia Yangqing","year":"2014","unstructured":"Yangqing Jia , Evan Shelhamer , Jeff Donahue , Sergey Karayev , Jonathan Long , Ross Girshick , Sergio Guadarrama , and Trevor Darrell . 2014 . Caffe: Convolutional Architecture for Fast Feature Embedding. arXiv preprint arXiv:1408.5093 (2014). Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, and Trevor Darrell. 2014. Caffe: Convolutional Architecture for Fast Feature Embedding. arXiv preprint arXiv:1408.5093 (2014)."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2015.2480059"},{"key":"e_1_2_2_26_1","volume-title":"Poisson Surface Reconstruction. SGP","author":"Kazhdan Michael","year":"2006","unstructured":"Michael Kazhdan , Matthew Bolitho , and Hugues Hoppe . 2006. Poisson Surface Reconstruction. SGP ( 2006 ), 61--70. Michael Kazhdan, Matthew Bolitho, and Hugues Hoppe. 2006. Poisson Surface Reconstruction. SGP (2006), 61--70."},{"key":"e_1_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2487228.2487237"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/1944846.1944854"},{"key":"e_1_2_2_29_1","volume-title":"Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understanding. arXiv preprint arXiv.1511.02680","author":"Kendall Alex","year":"2015","unstructured":"Alex Kendall , Vijay Badrinarayanan , and Roberto Cipolla . 2015. Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understanding. arXiv preprint arXiv.1511.02680 ( 2015 ). Alex Kendall, Vijay Badrinarayanan, and Roberto Cipolla. 2015. Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understanding. arXiv preprint arXiv.1511.02680 (2015)."},{"key":"e_1_2_2_30_1","volume-title":"A MRF shape prior for facade parsing with occlusions","author":"Kozinski Mateusz","year":"2015","unstructured":"Mateusz Kozinski , Raghudeep Gadde , Sergey Zagoruyko , Guillaume Obozinski , and Renaud Marlet . 2015. A MRF shape prior for facade parsing with occlusions . IEEE CVPR ( 2015 ), 2820--2828. Mateusz Kozinski, Raghudeep Gadde, Sergey Zagoruyko, Guillaume Obozinski, and Renaud Marlet. 2015. A MRF shape prior for facade parsing with occlusions. IEEE CVPR (2015), 2820--2828."},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.281"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/781606.781663"},{"key":"e_1_2_2_33_1","volume-title":"Manhattan-world urban reconstruction from point clouds. ECCV","author":"Li Minglei","year":"2016","unstructured":"Minglei Li , Peter Wonka , and Liangliang Nan . 2016. Manhattan-world urban reconstruction from point clouds. ECCV ( 2016 ), 54--69. Minglei Li, Peter Wonka, and Liangliang Nan. 2016. Manhattan-world urban reconstruction from point clouds. ECCV (2016), 54--69."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2010324.1964947"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2011.6126329"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2461912.2461969"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-33786-4_31"},{"key":"e_1_2_2_38_1","volume-title":"Building segmentation for densely built urban regions using aerial lidar data","author":"Matei Bogdan C","year":"2008","unstructured":"Bogdan C Matei , Harpreet S Sawhney , Supun Samarasekera , Janet Kim , and Rakesh Kumar . 2008. Building segmentation for densely built urban regions using aerial lidar data . IEEE CVPR ( 2008 ), 1--8. Bogdan C Matei, Harpreet S Sawhney, Supun Samarasekera, Janet Kim, and Rakesh Kumar. 2008. Building segmentation for densely built urban regions using aerial lidar data. IEEE CVPR (2008), 1--8."},{"key":"e_1_2_2_39_1","unstructured":"Peter Miller et al. 2017. Buildings - OpenStreetMap Wiki. (2017). Retrieved August 8 2017 from http:\/\/wiki.openstreetmap.org\/wiki\/Buildings  Peter Miller et al. 2017. Buildings - OpenStreetMap Wiki. (2017). Retrieved August 8 2017 from http:\/\/wiki.openstreetmap.org\/wiki\/Buildings"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/2766995"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141931"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1276377.1276484"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12077"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12554"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778830"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925951"},{"key":"e_1_2_2_47_1","volume-title":"Automatic reconstruction of cities from remote sensor data","author":"Poullis Charalambos","year":"2009","unstructured":"Charalambos Poullis and Suya You . 2009. Automatic reconstruction of cities from remote sensor data . IEEE CVPR ( 2009 ), 2775--2782. Charalambos Poullis and Suya You. 2009. Automatic reconstruction of cities from remote sensor data. IEEE CVPR (2009), 2775--2782."},{"key":"e_1_2_2_48_1","volume-title":"Irregular lattices for complex shape grammar facade parsing","author":"Riemenschneider Hayko","year":"2012","unstructured":"Hayko Riemenschneider , Ulrich Krispel , Wolfgang Thaller , Michael Donoser , Sven Havemann , Dieter Fellner , and Horst Bischof . 2012. Irregular lattices for complex shape grammar facade parsing . IEEE CVPR ( 2012 ), 1640--1647. Hayko Riemenschneider, Ulrich Krispel, Wolfgang Thaller, Michael Donoser, Sven Havemann, Dieter Fellner, and Horst Bischof. 2012. Irregular lattices for complex shape grammar facade parsing. IEEE CVPR (2012), 1640--1647."},{"key":"e_1_2_2_49_1","doi-asserted-by":"publisher","DOI":"10.1111\/cgf.12531"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2070781.2024218"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/1141911.1141964"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2012.252"},{"key":"e_1_2_2_54_1","volume-title":"Building reconstruction using manhattan-world grammars","author":"Vanegas Carlos A","year":"2010","unstructured":"Carlos A Vanegas , Daniel G Aliaga , and Bed\u0159ich Bene\u0161 . 2010. Building reconstruction using manhattan-world grammars . IEEE CVPR ( 2010 ), 358--365. Carlos A Vanegas, Daniel G Aliaga, and Bed\u0159ich Bene\u0161. 2010. Building reconstruction using manhattan-world grammars. IEEE CVPR (2010), 358--365."},{"key":"e_1_2_2_56_1","first-page":"161","article-title":"Image-based fa\u00e7ade modeling","volume":"27","author":"Xiao Jianxiong","year":"2008","unstructured":"Jianxiong Xiao , Tian Fang , Ping Tan , Peng Zhao , Eyal Ofek , and Long Quan . 2008 . Image-based fa\u00e7ade modeling . ACM SIGGRAPH Asia 27 , 5 (2008), 161 . Jianxiong Xiao, Tian Fang, Ping Tan, Peng Zhao, Eyal Ofek, and Long Quan. 2008. Image-based fa\u00e7ade modeling. ACM SIGGRAPH Asia 27, 5 (2008), 161.","journal-title":"ACM SIGGRAPH Asia"},{"key":"e_1_2_2_57_1","volume-title":"Parsing fa\u00e7ade with rank-one approximation","author":"Yang Chao","year":"2012","unstructured":"Chao Yang , Tian Han , Long Quan , and Chiew-Lan Tai . 2012. Parsing fa\u00e7ade with rank-one approximation . IEEE CVPR ( 2012 ), 1720--1727. Chao Yang, Tian Han, Long Quan, and Chiew-Lan Tai. 2012. Parsing fa\u00e7ade with rank-one approximation. IEEE CVPR (2012), 1720--1727."},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/1778765.1778831"},{"key":"e_1_2_2_59_1","volume-title":"a robust approach to creating building models from aerial lidar point clouds. ECCV","author":"Zhou Qian-Yi","year":"2010","unstructured":"Qian-Yi Zhou and Ulrich Neumann . 2010. 2.5 D dual contouring : a robust approach to creating building models from aerial lidar point clouds. ECCV ( 2010 ), 115--128. Qian-Yi Zhou and Ulrich Neumann. 2010. 2.5D dual contouring: a robust approach to creating building models from aerial lidar point clouds. ECCV (2010), 115--128."}],"container-title":["ACM Transactions on Graphics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3130800.3130823","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3130800.3130823","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:26:17Z","timestamp":1750213577000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3130800.3130823"}},"subtitle":["large-scale structured urban reconstruction"],"short-title":[],"issued":{"date-parts":[[2017,11,20]]},"references-count":57,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2017,12,31]]}},"alternative-id":["10.1145\/3130800.3130823"],"URL":"https:\/\/doi.org\/10.1145\/3130800.3130823","relation":{},"ISSN":["0730-0301","1557-7368"],"issn-type":[{"value":"0730-0301","type":"print"},{"value":"1557-7368","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,11,20]]},"assertion":[{"value":"2017-11-20","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}