{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,30]],"date-time":"2025-12-30T15:44:09Z","timestamp":1767109449128,"version":"build-2065373602"},"reference-count":36,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2022,10,13]],"date-time":"2022-10-13T00:00:00Z","timestamp":1665619200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Natural Science Foundation of Shanghai","award":["20ZR1419100","19ZR1455500","20SG40"],"award-info":[{"award-number":["20ZR1419100","19ZR1455500","20SG40"]}]},{"DOI":"10.13039\/501100018558","name":"Shanghai Shuguang Program","doi-asserted-by":"publisher","award":["20ZR1419100","19ZR1455500","20SG40"],"award-info":[{"award-number":["20ZR1419100","19ZR1455500","20SG40"]}],"id":[{"id":"10.13039\/501100018558","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Aligning indoor and outdoor point clouds is a challenging problem since the overlapping area is usually limited, thus resulting in a lack of correspondence features. The windows and doors can be observed from both sides and are usually utilized as shared features to make connections between indoor and outdoor models. However, the registration performance using the geometric features of windows and doors is limited due to the considerable number of extracted features and the mismatch of similar features. This paper proposed an indoor\/outdoor alignment framework with a semantic feature matching method to solve the problem. After identifying the 3D window and door instances from the point clouds, a novel semantic\u2013geometric descriptor (SGD) is proposed to describe the semantic information and the spatial distribution pattern of the instances. The best object match is identified with an improved Hungarian algorithm using indoor and outdoor SGDs. The matching method is effective even when the numbers of objects are not equal in the indoor and outdoor models, which is robust to measurement occlusions and feature outliers. The experimental results conducted in the collected dataset and the public dataset demonstrated that the proposed method could identify accurate object matches under complicated conditions, and the alignment accuracy reached the centimeter level.<\/jats:p>","DOI":"10.3390\/rs14205119","type":"journal-article","created":{"date-parts":[[2022,10,13]],"date-time":"2022-10-13T22:21:11Z","timestamp":1665699671000},"page":"5119","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Indoor\u2013Outdoor Point Cloud Alignment Using Semantic\u2013Geometric Descriptor"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6762-4158","authenticated-orcid":false,"given":"Yusheng","family":"Yang","sequence":"first","affiliation":[{"name":"School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200444, China"}]},{"given":"Guorun","family":"Fang","sequence":"additional","affiliation":[{"name":"School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200444, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7203-0901","authenticated-orcid":false,"given":"Zhonghua","family":"Miao","sequence":"additional","affiliation":[{"name":"School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200444, China"}]},{"given":"Yangmin","family":"Xie","sequence":"additional","affiliation":[{"name":"School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200444, China"}]}],"member":"1968","published-online":{"date-parts":[[2022,10,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Soheilian, B., Tournaire, O., Paparoditis, N., Vallet, B., and Papelard, J.P. (2013, January 23\u201326). Generation of an integrated 3D city model with visual landmarks for autonomous navigation in dense urban areas. Proceedings of the 2013 IEEE Intelligent Vehicles Symposium (IV), Gold Coast, QLD, Australia.","DOI":"10.1109\/IVS.2013.6629486"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Dudhee, V., and Vukovic, V. (2021). Building information model visualisation in augmented reality. Smart Sustain. Built Environ., ahead-of-print.","DOI":"10.1108\/SASBE-02-2021-0021"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Tariq, M.A., Farooq, U., Aamir, E., and Shafaqat, R. (2019, January 24\u201325). Exploring Adoption of Integrated Building Information Modelling and Virtual Reality. Proceedings of the 2019 International Conference on Electrical, Communication, and Computer Engineering (ICECCE), Swat, Pakistan.","DOI":"10.1109\/ICECCE47252.2019.8940805"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1016\/j.vrih.2020.05.003","article-title":"Urban 3D modeling with mobile laser scanning: A review","volume":"2","author":"Wang","year":"2020","journal-title":"Virtual Real. Intell. Hardw."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3252040","DOI":"10.1155\/2022\/3252040","article-title":"Research on Dynamic Simulation Technology of Urban 3D Art Landscape Based on VR-Platform","volume":"2022","author":"Cao","year":"2022","journal-title":"Math. Probl. Eng."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"L\u00f3pez, F.J., Lerones, P.M., Llamas, J., G\u00f3mez-Garc\u00eda-Bermejo, J., and Zalama, E. (2018). A review of heritage building information modeling (H-BIM). Multimodal Technol. Interact., 2.","DOI":"10.3390\/mti2020021"},{"key":"ref_7","unstructured":"Koch, T., Korner, M., and Fraundorfer, F. (July, January 26). Automatic alignment of indoor and outdoor building models using 3D line segments. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Las Vegas, NV, USA."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"177","DOI":"10.5194\/isprs-archives-XLIII-B2-2022-177-2022","article-title":"Detecting Openings For Indoor\/Outdoor Registration","volume":"XLIII-B2-2022","author":"Djahel","year":"2022","journal-title":"Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"133","DOI":"10.5194\/isprs-archives-XLII-2-W15-133-2019","article-title":"Assessment of a Keypoints Detector for the Registration of Indoor and Outdoor Heritage Point Clouds","volume":"42","author":"Assi","year":"2019","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Pan, Y., Yang, B., Liang, F., and Dong, Z. (2018, January 5\u20138). Iterative global similarity points: A robust coarse-to-fine integration solution for pairwise 3d point cloud registration. Proceedings of the 2018 International Conference on 3D Vision (3DV), Verona, Italy.","DOI":"10.1109\/3DV.2018.00030"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Li, Z., Zhang, X., Tan, J., and Liu, H. (2021). Pairwise Coarse Registration of Indoor Point Clouds Using 2D Line Features. ISPRS Int. J. Geo-Inf., 10.","DOI":"10.3390\/ijgi10010026"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"51","DOI":"10.5194\/isprs-annals-V-2-2021-51-2021","article-title":"Towards Efficient Indoor\/outdoor Registration Using Planar Polygons","volume":"2","author":"Djahel","year":"2021","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Previtali, M., Barazzetti, L., Brumana, R., and Scaioni, M. (2014, January 23\u201325). Laser scan registration using planar features. Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Riva del Garda, Italy.","DOI":"10.5194\/isprsarchives-XL-5-501-2014"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Favre, K., Pressigout, M., Marchand, E., and Morin, L. (2021, January 10\u201315). A plane-based approach for indoor point clouds registration. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy.","DOI":"10.1109\/ICPR48806.2021.9412379"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Malihi, S., Valadan Zoej, M.J., Hahn, M., and Mokhtarzade, M. (2018). Window detection from UAS-derived photogrammetric point cloud employing density-based filtering and perceptual organization. Remote Sens., 10.","DOI":"10.3390\/rs10081320"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Cohen, A., Sch\u00f6nberger, J.L., Speciale, P., Sattler, T., Frahm, J.M., and Pollefeys, M. (2016, January 8\u201316). Indoor-outdoor 3d reconstruction alignment. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46487-9_18"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Geng, H., Gao, Z., Fang, G., and Xie, Y. (2022). 3D Object Recognition and Localization with a Dense LiDAR Scanner. Actuators, 11.","DOI":"10.3390\/act11010013"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Cai, Y., and Fan, L. (2021). An efficient approach to automatic construction of 3D watertight geometry of buildings using point clouds. Remote Sens., 13.","DOI":"10.3390\/rs13101947"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Imanullah, M., Yuniarno, E.M., and Sumpeno, S. (2019, January 28\u201329). Sift and icp in multi-view based point clouds registration for indoor and outdoor scene reconstruction. Proceedings of the 2019 International Seminar on Intelligent Technology and Its Applications (ISITIA), Surabaya, Indonesia.","DOI":"10.1109\/ISITIA.2019.8937292"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Xiong, B., Jiang, W., Li, D., and Qi, M. (2021). Voxel Grid-Based Fast Registration of Terrestrial Point Cloud. Remote Sens., 13.","DOI":"10.3390\/rs13101905"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Popi\u0219ter, F., Popescu, D., P\u0103curar, A., and P\u0103curar, R. (2021). Mathematical Approach in Complex Surfaces Toolpaths. Mathematics, 9.","DOI":"10.3390\/math9121360"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1790","DOI":"10.1109\/LGRS.2018.2856514","article-title":"Line structure-based indoor and outdoor integration using backpacked and TLS point cloud data","volume":"15","author":"Wen","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2530","DOI":"10.1109\/TGRS.2019.2952086","article-title":"PLADE: A plane-based descriptor for point cloud registration with small overlap","volume":"58","author":"Chen","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Li, J., Huang, S., Cui, H., Ma, Y., and Chen, X. (2021). Automatic point cloud registration for large outdoor scenes using a priori semantic information. Remote Sens., 13.","DOI":"10.3390\/rs13173474"},{"key":"ref_25","unstructured":"Parkison, S.A., Gan, L., Jadidi, M.G., and Eustice, R.M. (2018, January 3\u20136). Semantic Iterative Closest Point through Expectation-Maximization. Proceedings of the BMVC, Newcastle, UK."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Wang, L., and Sohn, G. (2011). An integrated framework for reconstructing full 3d building models. Advances in 3D Geo-Information Sciences, Springer.","DOI":"10.1007\/978-3-642-12670-3_16"},{"key":"ref_27","first-page":"158","article-title":"Automatic co-registration of terrestrial laser scanning data and 2D floor plan","volume":"38","author":"Wang","year":"2010","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Lang, A.H., Vora, S., Caesar, H., Zhou, L., Yang, J., and Beijbom, O. (2019, January 16\u201320). Pointpillars: Fast encoders for object detection from point clouds. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.01298"},{"key":"ref_29","unstructured":"Qi, C.R., Yi, L., Su, H., and Guibas, L.J. (2017, January 4\u20139). Pointnet++: Deep hierarchical feature learning on point sets in a metric space. Proceedings of the 31st International Conference on Neural Information Processing Systems, Red Hook, NY, USA."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"He, K., Gkioxari, G., Doll\u00e1r, P., and Girshick, R. (2017, January 22\u201329). Mask r-cnn. Proceedings of the IEEE international Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.322"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"6325","DOI":"10.1080\/01431161.2020.1737339","article-title":"Outlier detection and robust plane fitting for building roof extraction from LiDAR data","volume":"41","author":"Dey","year":"2020","journal-title":"Int. J. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Gool, L.V. (2006, January 7\u201313). Surf: Speeded up robust features. Proceedings of the European Conference on Computer Vision, Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1109\/TSC.2016.2597143","article-title":"Querying similar process models based on the Hungarian algorithm","volume":"10","author":"Cao","year":"2016","journal-title":"IEEE Trans. Serv. Comput."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"103649","DOI":"10.1016\/j.robot.2020.103649","article-title":"Map merging with terrain-adaptive density using mobile 3D laser scanner","volume":"134","author":"Xie","year":"2020","journal-title":"Robot. Auton. Syst."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/20\/5119\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:53:30Z","timestamp":1760144010000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/20\/5119"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,13]]},"references-count":36,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2022,10]]}},"alternative-id":["rs14205119"],"URL":"https:\/\/doi.org\/10.3390\/rs14205119","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2022,10,13]]}}}