{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T12:40:22Z","timestamp":1782823222851,"version":"3.54.5"},"reference-count":35,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2021,12,15]],"date-time":"2021-12-15T00:00:00Z","timestamp":1639526400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003725","name":"National Research Foundation of Korea","doi-asserted-by":"publisher","award":["NRF-2020R1C1C1008726"],"award-info":[{"award-number":["NRF-2020R1C1C1008726"]}],"id":[{"id":"10.13039\/501100003725","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Urban scene modeling is a challenging but essential task for various applications, such as 3D map generation, city digitization, and AR\/VR\/metaverse applications. To model man-made structures, such as roads and buildings, which are the major components in general urban scenes, we present a clustering-based plane segmentation neural network using 3D point clouds, called hybrid K-means plane segmentation (HKPS). The proposed method segments unorganized 3D point clouds into planes by training the neural network to estimate the appropriate number of planes in the point cloud based on hybrid K-means clustering. We consider both the Euclidean distance and cosine distance to cluster nearby points in the same direction for better plane segmentation results. Our network does not require any labeled information for training. We evaluated the proposed method using the Virtual KITTI dataset and showed that our method outperforms conventional methods in plane segmentation. Our code is publicly available.<\/jats:p>","DOI":"10.3390\/s21248382","type":"journal-article","created":{"date-parts":[[2021,12,15]],"date-time":"2021-12-15T21:47:36Z","timestamp":1639604856000},"page":"8382","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Clustering-Based Plane Segmentation Neural Network for Urban Scene Modeling"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5312-139X","authenticated-orcid":false,"given":"Hongjae","family":"Lee","sequence":"first","affiliation":[{"name":"Department of Electronic Engineering, Kyung Hee University, Yongin-si 17104, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9316-9750","authenticated-orcid":false,"given":"Jiyoung","family":"Jung","sequence":"additional","affiliation":[{"name":"Department of Artificial Intelligence, University of Seoul, Seoul 02504, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Feng, C., Taguchi, Y., and Kamat, V.R. (June, January 31). Fast plane extraction in organized point clouds using agglomerative hierarchical clustering. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6907776"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1006\/cviu.1999.0832","article-title":"MLESAC: A new robust estimator with application to estimating image geometry","volume":"78","author":"Torr","year":"2000","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Schaefer, A., Vertens, J., B\u00fcscher, D., and Burgard, W. (2019, January 20\u201324). A maximum likelihood approach to extract finite planes from 3-D laser scans. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.","DOI":"10.1109\/ICRA.2019.8794318"},{"key":"ref_4","unstructured":"Arthur, D., and Vassilvitskii, S. (2006). k-Means++: The Advantages of Careful Seeding, Stanford University. Technical Report."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1109\/TIT.1982.1056489","article-title":"Least squares quantization in PCM","volume":"28","author":"Lloyd","year":"1982","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_6","unstructured":"Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21\u201326). PointNet: Deep learning on point sets for 3D classification and segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA."},{"key":"ref_7","unstructured":"Lee, H. (2021, December 01). HKPS. Available online: https:\/\/www.github.com\/jimmy9704\/plane-segmentation-network."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2481","DOI":"10.1109\/TPAMI.2016.2644615","article-title":"Segnet: A deep convolutional encoder-decoder architecture for image segmentation","volume":"39","author":"Badrinarayanan","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1109\/TPAMI.2017.2699184","article-title":"Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs","volume":"40","author":"Chen","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Su, H., Maji, S., Kalogerakis, E., and Learned-Miller, E. (2015, January 7\u201313). Multi-view convolutional neural networks for 3D shape recognition. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.114"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Li, L., Sung, M., Dubrovina, A., Yi, L., and Guibas, L.J. (2019, January 15\u201320). Supervised fitting of geometric primitives to 3D point clouds. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00276"},{"key":"ref_13","first-page":"165","article-title":"Automatic classification of point clouds for highway documentation","volume":"53","author":"Pavelka","year":"2018","journal-title":"Acta Polytech."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"5432","DOI":"10.1109\/LRA.2020.3007440","article-title":"3D-mininet: Learning a 2D representation from point clouds for fast and efficient 3D lidar semantic segmentation","volume":"5","author":"Alonso","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhu, X., Zhou, H., Wang, T., Hong, F., Ma, Y., Li, W., Li, H., and Lin, D. (2021, January 19\u201325). Cylindrical and asymmetrical 3D convolution networks for lidar segmentation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00981"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Paigwar, A., Erkent, \u00d6., Sierra-Gonzalez, D., and Laugier, C. (January, January 24). Gndnet: Fast ground plane estimation and point cloud segmentation for autonomous vehicles. Proceedings of the 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA.","DOI":"10.1109\/IROS45743.2020.9340979"},{"key":"ref_17","unstructured":"Qi, C.R., Yi, L., Su, H., and Guibas, L.J. (2017, January 4\u20139). PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space. Proceedings of the 31st Conference on Neural Information Processing Systems (NeurIPS), Long Beach, CA, USA."},{"key":"ref_18","unstructured":"Hough, P.V. (1962). Method and Means for Recognizing Complex Patterns. (3069654), US Patent."},{"key":"ref_19","first-page":"33","article-title":"Recognising structure in laser scanner point clouds","volume":"46","author":"Vosselman","year":"2004","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2043","DOI":"10.1016\/j.patcog.2014.12.020","article-title":"Real-time detection of planar regions in unorganized point clouds","volume":"48","author":"Limberger","year":"2015","journal-title":"Pattern Recognit."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1016\/j.patcog.2007.04.003","article-title":"Real-time line detection through an improved Hough transform voting scheme","volume":"41","author":"Fernandes","year":"2008","journal-title":"Pattern Recognit."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_23","unstructured":"Gotardo, P.F., Bellon, O.R.P., and Silva, L. (2003, January 18\u201320). Range image segmentation by surface extraction using an improved robust estimator. Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Madison, WI, USA."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"214","DOI":"10.1111\/j.1467-8659.2007.01016.x","article-title":"Efficient RANSAC for point-cloud shape detection","volume":"Volume 26","author":"Schnabel","year":"2007","journal-title":"Computer Graphics Forum"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1016\/j.patrec.2010.10.009","article-title":"CC-RANSAC: Fitting planes in the presence of multiple surfaces in range data","volume":"32","author":"Gallo","year":"2011","journal-title":"Pattern Recognit. Lett."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Nurunnabi, A., Belton, D., and West, G. (2012, January 3\u20135). Robust segmentation in laser scanning 3D point cloud data. Proceedings of the 2012 International Conference on Digital Image Computing Techniques and Applications (DICTA), Fremantle, WA, Australia.","DOI":"10.1109\/DICTA.2012.6411672"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"88","DOI":"10.1016\/j.isprsjprs.2015.01.011","article-title":"Octree-based region growing for point cloud segmentation","volume":"104","author":"Vo","year":"2015","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"107115","DOI":"10.1016\/j.patcog.2019.107115","article-title":"A robust statistics approach for plane detection in unorganized point clouds","volume":"100","author":"Oliveira","year":"2020","journal-title":"Pattern Recognit."},{"key":"ref_29","unstructured":"Ester, M., Kriegel, H.P., Sander, J., and Xu, X. (1996, January 2\u20134). A density-based algorithm for discovering clusters in large spatial databases with noise. Proceedings of the kdd, Portland, OR, USA."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1023\/A:1007612920971","article-title":"Concept decompositions for large sparse text data using clustering","volume":"42","author":"Dhillon","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_31","unstructured":"Zhou, Q.Y., Park, J., and Koltun, V. (2018). Open3D: A Modern Library for 3D Data Processing. arXiv."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Gaidon, A., Wang, Q., Cabon, Y., and Vig, E. (2016, January 27\u201330). Virtual Worlds as Proxy for Multi-Object Tracking Analysis. Proceedings of the CVPR, Las Vegas, NV, USA. Available online: https:\/\/europe.naverlabs.com\/research\/computer-vision\/proxy-virtual-worlds-vkitti-1\/.","DOI":"10.1109\/CVPR.2016.470"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16\u201321). Are we ready for Autonomous Driving? The KITTI Vision Benchmark Suite. Proceedings of the IEEE International Conference on Computer Vision (CVPR), Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6248074"},{"key":"ref_34","unstructured":"Mariga, L. (2021, October 01). pyRANSAC-3D. Available online: https:\/\/github.com\/leomariga\/pyRANSAC-3D."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1109\/34.506791","article-title":"An experimental comparison of range image segmentation algorithms","volume":"18","author":"Hoover","year":"1996","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/24\/8382\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:48:52Z","timestamp":1760168932000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/24\/8382"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,15]]},"references-count":35,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["s21248382"],"URL":"https:\/\/doi.org\/10.3390\/s21248382","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,15]]}}}