{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,11]],"date-time":"2026-01-11T01:28:27Z","timestamp":1768094907173,"version":"3.49.0"},"reference-count":43,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2020,6,19]],"date-time":"2020-06-19T00:00:00Z","timestamp":1592524800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001381","name":"National Research Foundation Singapore","doi-asserted-by":"publisher","award":["NRF2015VSG-AA3DCM001-024"],"award-info":[{"award-number":["NRF2015VSG-AA3DCM001-024"]}],"id":[{"id":"10.13039\/501100001381","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61901311"],"award-info":[{"award-number":["61901311"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Openings such as windows and doors are essential components of architectural wall surfaces. It is still a challenge to reconstruct them robustly from unstructured 3D point clouds because of occlusions, noises and non-uniformly distributed points. Current research primarily focuses on meliorating the robustness of detection and pays little attention to the geometric correctness. To improve the reconstruction quality, assumptions on the opening layout are usually applied as rules to support the reconstruction algorithm. The commonly used assumptions, such as the strict grid and symmetry pattern, however, are not suitable in many cases. In this paper, we propose a novel approach, named an inference machine, to identify and use flexible rules in wall opening modelling. Our method first detects and models openings through a data-driven method and then refines the opening boundaries by global and flexible rules. The key is to identify the global flexible rules from the detected openings, composed by various combinations of alignments. As our method is oblivious of the type of architectural layout, it can be applied to both interior wall surfaces and exterior building facades. We demonstrate the flexibility of our approach in both outdoor and indoor scenes with a variety of opening layouts. The qualitative and quantitative evaluation results indicate the potential of the approach to be a general method in opening detection and modelling. However, this data-driven method suffers from the existence of occlusions and non-planar wall surfaces.<\/jats:p>","DOI":"10.3390\/rs12121968","type":"journal-article","created":{"date-parts":[[2020,6,19]],"date-time":"2020-06-19T10:43:58Z","timestamp":1592563438000},"page":"1968","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["A Flexible Inference Machine for Global Alignment of Wall Openings"],"prefix":"10.3390","volume":"12","author":[{"given":"Jiaqiang","family":"Li","sequence":"first","affiliation":[{"name":"ETH Zurich, Future Cities Laboratory, Singapore-ETH Centre, 1 Create Way, CREATE Tower, 06-01, Singapore 138602, Singapore"}]},{"given":"Biao","family":"Xiong","sequence":"additional","affiliation":[{"name":"ETH Zurich, Future Cities Laboratory, Singapore-ETH Centre, 1 Create Way, CREATE Tower, 06-01, Singapore 138602, Singapore"},{"name":"School of Computer Science and Technology, Wuhan University of Technology, Luoyu Rd. 122, Dst Hongshan, Wuhan 430079, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5896-1379","authenticated-orcid":false,"given":"Rongjun","family":"Qin","sequence":"additional","affiliation":[{"name":"Department of Civil, Environmental and Geodetic Engineering, The Ohio State University, Columbus, OH 43210, USA"},{"name":"Department of Electrical and Computer Engineering, The Ohio State University, Columbus, OH 43210, USA"}]},{"given":"Armin","family":"Gruen","sequence":"additional","affiliation":[{"name":"ETH Zurich, Future Cities Laboratory, Singapore-ETH Centre, 1 Create Way, CREATE Tower, 06-01, Singapore 138602, Singapore"}]}],"member":"1968","published-online":{"date-parts":[[2020,6,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1111\/cgf.12077","article-title":"A Survey of Urban Reconstruction","volume":"32","author":"Musialski","year":"2013","journal-title":"Comput. Graph. Forum"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1007\/s11263-012-0517-8","article-title":"Creating large-scale city models from 3D-point clouds: A robust approach with hybrid representation","volume":"99","author":"Lafarge","year":"2012","journal-title":"Int. J. Comput. Vis."},{"key":"ref_3","first-page":"4","article-title":"Plan3D: Viewpoint and Trajectory Optimization for Aerial Multi-View Stereo Reconstruction","volume":"38","author":"Hepp","year":"2018","journal-title":"ACM Trans. Graph."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Nan, L., and Wonka, P. (2017, January 22\u201329). Polyfit: Polygonal surface reconstruction from point clouds. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.258"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Poullis, C., and You, S. (2009, January 20\u201325). Automatic reconstruction of cities from remote sensor data. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206562"},{"key":"ref_6","first-page":"11","article-title":"Semantically Enriched High Resolution LOD 3 Building Model Generation","volume":"XLII-4\/W15","author":"Gruen","year":"2019","journal-title":"ISPRS Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_7","unstructured":"Gruen, A., Schrotter, G., Schubiger, S., Qin, R., Xiong, B., Xiao, C., Li, J., Ling, X., and Yao, S. (2020). An Operable System for LoD3 Model Generation Using Multi-Source Data and User-Friendly Interactive Editing, Singapore ETH Centre, Future Cities Laboratory. Technical Report."},{"key":"ref_8","first-page":"97","article-title":"A sliding window method for detecting corners of openings from terrestrial LiDAr data","volume":"XLII-4\/W10","author":"Li","year":"2018","journal-title":"ISPRS Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"823","DOI":"10.1016\/j.enbuild.2007.02.003","article-title":"Using results from field surveys to predict the effect of open windows on thermal comfort and energy use in buildings","volume":"39","author":"Rijal","year":"2007","journal-title":"Energy Build."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Cui, Y., Li, Q., and Dong, Z. (2019). Structural 3D Reconstruction of Indoor Space for 5G Signal Simulation with Mobile Laser Scanning Point Clouds. Remote Sens., 11.","DOI":"10.3390\/rs11192262"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"560","DOI":"10.1145\/1141911.1141924","article-title":"Partial and approximate symmetry detection for 3D geometry","volume":"25","author":"Mitra","year":"2006","journal-title":"ACM Trans. Graph."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"M\u00fcller, P., Zeng, G., Wonka, P., and Van Gool, L. (2007). Image-based procedural modeling of facades. ACM Trans. Graph.","DOI":"10.1145\/1275808.1276484"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wang, R., Bach, J., and Ferrie, F.P. (2011, January 5\u20137). Window detection from mobile LiDAR data. Proceedings of the IEEE Workshop on Applications of Computer Vision, Kona, HI, USA.","DOI":"10.1109\/WACV.2011.5711484"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Wang, J., Liu, C., Shen, T., and Quan, L. (2015, January 3\u20136). Structure-driven facade parsing with irregular patterns. Proceedings of the 3rd IAPR Asian Conference on Pattern Recognition, Kuala Lumpur, Malaysia.","DOI":"10.1109\/ACPR.2015.7486462"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1145\/3197517.3201319","article-title":"Reconstructing scenes with mirror and glass surfaces","volume":"37","author":"Whelan","year":"2018","journal-title":"ACM Trans. Graph."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Cohen, A., Sch\u00f6nberger, J.L., Speciale, P., Sattler, T., Frahm, J.M., and Pollefeys, M. (2016, January 11\u201314). Indoor-outdoor 3d reconstruction alignment. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46487-9_18"},{"key":"ref_17","unstructured":"Huber, D., Akinci, B., Oliver, A.A., Anil, E., Okorn, B.E., and Xiong, X. (2011, January 4\u20137). Methods for automatically modeling and representing as-built building information models. Proceedings of the NSF CMMI Research Innovation Conference, Atlanta, GA, USA."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1016\/j.autcon.2012.10.006","article-title":"Automatic creation of semantically rich 3D building models from laser scanner data","volume":"31","author":"Xiong","year":"2013","journal-title":"Automat. Constrn."},{"key":"ref_19","first-page":"7","article-title":"Refinement of building fassades by integrated processing of lidar and image data","volume":"36","author":"Becker","year":"2007","journal-title":"ISPRS Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1016\/j.isprsjprs.2016.06.011","article-title":"Slicing Method for curved fa\u00e7ade and window extraction from point clouds","volume":"119","author":"Zolanvari","year":"2016","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1016\/j.isprsjprs.2009.04.001","article-title":"Knowledge based reconstruction of building models from terrestrial laser scanning data","volume":"64","author":"Pu","year":"2009","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_22","first-page":"1","article-title":"Alpha shapes\u2014A survey","volume":"27","author":"Edelsbrunner","year":"2010","journal-title":"Tessellations Sci."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1109\/TIT.1983.1056714","article-title":"On the shape of a set of points in the plane","volume":"29","author":"Edelsbrunner","year":"1983","journal-title":"IEEE Trans. Inform. Theory"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1016\/j.isprsjprs.2009.06.002","article-title":"Generation and application of rules for quality dependent fa\u00e7ade reconstruction","volume":"64","author":"Becker","year":"2009","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1145\/2601097.2601162","article-title":"Inverse procedural modeling of facade layouts","volume":"33","author":"Wu","year":"2014","journal-title":"ACM Trans. Graph."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1145\/2421636.2421644","article-title":"Procedural facade variations from a single layout","volume":"32","author":"Bao","year":"2013","journal-title":"ACM Trans. Graph."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1145\/1360612.1360642","article-title":"Discovering structural regularity in 3D geometry","volume":"27","author":"Pauly","year":"2008","journal-title":"ACM Trans. Graph."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1145\/2070781.2024218","article-title":"Adaptive partitioning of urban facades","volume":"30","author":"Shen","year":"2011","journal-title":"ACM Trans. Graph."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Mesolongitis, A., and Stamos, I. (2012, January 16\u201321). Detection of windows in point clouds of urban scenes. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Providence, RI, USA.","DOI":"10.1109\/CVPRW.2012.6238910"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1111\/cgf.12554","article-title":"Template assembly for detailed urban reconstruction","volume":"34","author":"Nan","year":"2015","journal-title":"Comput. Graph. Forum."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1145\/1778765.1778830","article-title":"Smartboxes for interactive urban reconstruction","volume":"29","author":"Nan","year":"2010","journal-title":"ACM SIGGRAPH"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1597","DOI":"10.1109\/TPAMI.2009.152","article-title":"Geometric feature extraction by a multimarked point process","volume":"32","author":"Lafarge","year":"2009","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1016\/j.isprsjprs.2010.02.002","article-title":"An efficient stochastic approach for building footprint extraction from digital elevation models","volume":"65","author":"Tournaire","year":"2010","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Tyle\u010dek, R., and \u0160\u00e1ra, R. (2010, January 8\u201312). A weak structure model for regular pattern recognition applied to facade images. Proceedings of the Asian Conference on Computer Vision, Queenstown, New Zealand.","DOI":"10.1007\/978-3-642-19315-6_35"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Martinovi\u0107, A., Knopp, J., Riemenschneider, H., and Van Gool, L. (2015, January 7\u201312). 3d all the way: Semantic segmentation of urban scenes from start to end in 3d. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299075"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1016\/j.isprsjprs.2012.09.002","article-title":"Automated planimetric quality control in high accuracy airborne laser scanning surveys","volume":"74","author":"Vosselman","year":"2012","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1145\/2421636.2421642","article-title":"O-snap: Optimization-based snapping for modeling architecture","volume":"32","author":"Arikan","year":"2013","journal-title":"ACM Trans. Graph."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1145\/3828.3830","article-title":"Generalized Best-First Search Strategies and the Optimality of A*","volume":"32","author":"Dechter","year":"1985","journal-title":"J. ACM"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1007\/s13218-010-0059-6","article-title":"Semantic 3d object maps for everyday manipulation in human living environments","volume":"24","author":"Rusu","year":"2010","journal-title":"K\u00fcnstl. Intell."},{"key":"ref_40","first-page":"367","article-title":"The ISPRS Benchmark on Indoor Modelling","volume":"XLII-2\/W7","author":"Khoshelham","year":"2017","journal-title":"ISPRS Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"4270","DOI":"10.1109\/JSTARS.2018.2817227","article-title":"Unsupervised segmentation of point clouds from buildings using hierarchical clustering based on gestalt principles","volume":"11","author":"Xu","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1016\/j.isprsjprs.2015.01.011","article-title":"Octree-based region growing for point cloud segmentation","volume":"104","author":"Vo","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1109\/JSTARS.2009.2012488","article-title":"A comparison of evaluation techniques for building extraction from airborne laser scanning","volume":"2","author":"Rutzinger","year":"2009","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/12\/1968\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T09:40:48Z","timestamp":1760175648000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/12\/12\/1968"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,19]]},"references-count":43,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2020,6]]}},"alternative-id":["rs12121968"],"URL":"https:\/\/doi.org\/10.3390\/rs12121968","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,6,19]]}}}