{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T02:18:37Z","timestamp":1760149117128,"version":"build-2065373602"},"reference-count":36,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2023,7,4]],"date-time":"2023-07-04T00:00:00Z","timestamp":1688428800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Fine-grained urban environment instance segmentation is a fundamental and important task in the field of environment perception for autonomous vehicles. To address this goal, a model was designed with LiDAR pointcloud data and camera image data as the subject of study, and the reliability of the model was enhanced using dual fusion at the data level and feature level. By introducing the Markov Random Field algorithm, the Support Vector Machine classification results were optimized according to the spatial contextual linkage while providing the model with the prerequisite of the differentiation of similar but foreign objects, and the object classification and instance segmentation of 3D urban environments were completed by combining the Mean Shift. The dual fusion approach in this paper is a method for the deeper fusion of data from different sources, and the model, designed more accurately, describes the categories of items in the environment with a classification accuracy of 99.3%, and segments the different individuals into groups of the same kind of objects without instance labels. Moreover, our model does not have high computational resource and time cost requirements, and is a lightweight, efficient, and accurate instance segmentation model.<\/jats:p>","DOI":"10.3390\/s23136141","type":"journal-article","created":{"date-parts":[[2023,7,5]],"date-time":"2023-07-05T00:53:04Z","timestamp":1688518384000},"page":"6141","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["A Model for Urban Environment Instance Segmentation with Data Fusion"],"prefix":"10.3390","volume":"23","author":[{"given":"Kaiyue","family":"Du","sequence":"first","affiliation":[{"name":"School of Optoelectronic Engineering, Changchun University of Science and Technology, Changchun 130022, China"}]},{"given":"Jin","family":"Meng","sequence":"additional","affiliation":[{"name":"School of Optoelectronic Engineering, Changchun University of Science and Technology, Changchun 130022, China"}]},{"given":"Xin","family":"Meng","sequence":"additional","affiliation":[{"name":"School of Optoelectronic Engineering, Changchun University of Science and Technology, Changchun 130022, China"}]},{"given":"Shifeng","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Optoelectronic Engineering, Changchun University of Science and Technology, Changchun 130022, China"},{"name":"Zhongshan Institute of Changchun University of Science and Technology, Zhongshan 528400, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-8356-4770","authenticated-orcid":false,"given":"Jinhua","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Optoelectronic Engineering, Changchun University of Science and Technology, Changchun 130022, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,7,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Vinodkumar, P.K., Karabulut, D., Avots, E., Ozcinar, C., and Anbarjafari, G. (2023). A Survey on Deep Learning Based Segmentation, Detection and Classification for 3D Point Clouds. Entropy, 25.","DOI":"10.3390\/e25040635"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Dreissig, M., Scheuble, D., Piewak, F., and Boedecker, J. (2023). Survey on LiDAR Perception in Adverse Weather Conditions. arXiv.","DOI":"10.1109\/IV55152.2023.10186539"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Zhong, Z., Zhang, C., Liu, Y., and Wu, Y. (2019, January 22\u201325). VIASEG: Visual Information Assisted Lightweight Point Cloud Segmentation. Proceedings of the 2019 IEEE International Conference on Image Processing, Taipei, Taiwan.","DOI":"10.1109\/ICIP.2019.8803061"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kellner, M., Stahl, B., and Reiterer, A. (2022). Fused Projection-Based Point Cloud Segmentation. Sensors, 22.","DOI":"10.3390\/s22031139"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Jaritz, M., Vu, T.H., Charette, R., Wirbel, \u00c9., and P\u00e9rez, P. (2020). xMUDA: Cross-Modal Unsupervised Domain Adaptation for 3D Semantic Segmentation. arXiv.","DOI":"10.1109\/CVPR42600.2020.01262"},{"key":"ref_6","unstructured":"Huang, K.L., Shi, B.T., Li, X., Li, X., Huang, S.Y., and Li, Y.K. (2022). Multi-modal Sensor Fusion for Auto Driving Perception: A Survey. arXiv."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Engelmann, F., Bokeloh, M., Fathi, A., Leibe, B., and Nie\u00dfner, M. (2020). 3D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentation. arXiv.","DOI":"10.1109\/CVPR42600.2020.00905"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Jiang, H., Yan, F., Cai, J., Zheng, J., and Xiao, J. (2020, January 13\u201319). End-to-End 3D Point Cloud Instance Segmentation Without Detection. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01281"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Liang, Z.D., Yang, M., and Wang, C.X. (2019). 3D Graph Embedding Learning with a Structure-aware Loss Function for Point Cloud Semantic Instance Segmentation. arXiv.","DOI":"10.1109\/LRA.2020.3004802"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Su, S.H., Xu, J.Y., Wang, H.Y., Miao, Z.W., Zhan, X., Hao, D.Y., and Li, L. (2023). PUPS: Point Cloud Unified Panoptic Segmentation. arXiv.","DOI":"10.1609\/aaai.v37i2.25329"},{"key":"ref_11","first-page":"89","article-title":"Deep semantic segmentation MRF model for information extraction of marine floating raft aquaculture","volume":"52","author":"Wang","year":"2022","journal-title":"J. Shandong Univ. (Eng. Sci.)"},{"key":"ref_12","first-page":"866","article-title":"Analysis of Remote Sensing Image Segmentation Based on Wavelet Domin Triple MRF Segmentation Algorithm","volume":"35","author":"Zhang","year":"2021","journal-title":"Beijing Surv. Mapp."},{"key":"ref_13","first-page":"1353","article-title":"Image segmentation based on higher-order MRF model with multi-node topological overlap measure","volume":"48","author":"Xu","year":"2022","journal-title":"Acta Autom. Sin."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Sun, C.Y., Tong, X., and Liu, Y. (2022). Semantic Segmentation-Assisted Instance Feature Fusion for Multi-Level 3D Part Instance Segmentation. arXiv.","DOI":"10.1007\/s41095-022-0300-x"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Sheikh, M., Asghar, M.A., Bibi, R., Malik, M.N., Shorfuzzaman, M., Mehmood, R.M., and Kim, S.-H. (2022). DFT-Net: Deep Feature Transformation Based Network for Object Categorization and Part Segmentation in 3-Dimensional Point Clouds. Sensors, 22.","DOI":"10.3390\/s22072512"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Kuo, W.C., Angelova, A., Malik, J., and Lin, T.Y. (2019). ShapeMask: Learning to Segment Novel Objects by Refining Shape Priors. arXiv.","DOI":"10.1109\/ICCV.2019.00930"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"10999","DOI":"10.1109\/TCYB.2021.3096185","article-title":"Semantic Attention and Scale Complementary Network for Instance Segmentation in Remote Sensing Images","volume":"52","author":"Zhang","year":"2022","journal-title":"IEEE Trans. Cybern."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Lahoud, J., Ghanem, B., Pollefeys, M., and Oswald, M.R. (2019). 3D Instance Segmentation via Multi-Task Metric Learning. arXiv.","DOI":"10.1109\/ICCV.2019.00935"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"4338","DOI":"10.1109\/TPAMI.2020.3005434","article-title":"Deep Learning for 3D Point Clouds: A Survey","volume":"43","author":"Guo","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_20","unstructured":"He, Y., Yu, H., Liu, X., Yang, Z., Sun, W., Wang, Y., Fu, Q., Zou, Y., and Mian, A. (2021). Deep Learning based 3D Segmentation: A Survey. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"19","DOI":"10.4316\/AECE.2022.02003","article-title":"Attention-Based Joint Semantic-Instance Segmentation of 3D Point Clouds","volume":"22","author":"Hao","year":"2022","journal-title":"Adv. Electr. Comput. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Imad, M., Doukhi, O., and Lee, D.-J. (2021). Transfer Learning Based Semantic Segmentation for 3D Object Detection from Point Cloud. Sensors, 21.","DOI":"10.3390\/s21123964"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Li, S.J., Liu, Y., and Gall, J.G. (2021). Rethinking 3-D LiDAR Point Cloud Segmentation. IEEE Trans. Neural Netw. Learn. Syst., 1\u201312.","DOI":"10.1109\/TNNLS.2021.3132836"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Xie, X., Wei, H., and Yang, Y. (2023). Real-Time LiDAR Point-Cloud Moving Object Segmentation for Autonomous Driving. Sensors, 23.","DOI":"10.3390\/s23010547"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wang, N., Shi, C., Guo, R., Lu, H., Zheng, Z., and Chen, X. (2023). InsMOS: Instance-Aware Moving Object Segmentation in LiDAR Data. arXiv.","DOI":"10.1109\/IROS55552.2023.10342277"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zhou, Z., Zhang, Y., and Foroosh, H. (2021). Panoptic-PolarNet: Proposal-free LiDAR Point Cloud Panoptic Segmentation. arXiv.","DOI":"10.1109\/CVPR46437.2021.01299"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1177\/0278364913491297","article-title":"Vision meets robotics: The KITTI dataset","volume":"32","author":"Geiger","year":"2013","journal-title":"Int. J. Robot. Res."},{"key":"ref_28","first-page":"48","article-title":"LiDAR point cloud classification using point elevation and reflection intensity","volume":"5","author":"Nguyen","year":"2022","journal-title":"J. Min. Earth Sci."},{"key":"ref_29","unstructured":"Li, Y., Ma, L.X., Zheng, G., and Ju, W.M. (2013). A Method of Forest Point Cloud Classification Based on Pattern Recognition. (CN 103324945B)."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Wang, Z., Zhuang, Z., Liu, Y., Ding, F., and Tang, M. (2021). Color Classification and Texture Recognition System of Solid Wood Panels. Forests, 12.","DOI":"10.3390\/f12091154"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"080006","DOI":"10.1063\/1.5136199","article-title":"Extracting a new Fractal and Semi-variance Attributes for Texture Images","volume":"1","author":"Yousif","year":"2019","journal-title":"AIP Conf. Proc."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1556","DOI":"10.1109\/TIP.2016.2526902","article-title":"The Semi-Variogram and Spectral Distortion Measures for Image Texture Retrieval","volume":"4","author":"Pham","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_33","first-page":"89","article-title":"Adaptively suppressed fuzzy clustering color image segmentation with fused features","volume":"5","author":"Lan","year":"2021","journal-title":"J. Xi\u2019an Univ. Posts Telecommun."},{"key":"ref_34","unstructured":"Zhou, Z.H. (2016). Machine Learning, Tsinghua University Press. [1st ed.]."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1109\/TIT.1975.1055330","article-title":"The estimation of the gradient of a density function, with applications in pattern recognition","volume":"21","author":"Fukunaga","year":"1975","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"790","DOI":"10.1109\/34.400568","article-title":"Mean Shift, Mode Seeking, and Clustering","volume":"17","author":"Cheng","year":"1995","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/13\/6141\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:06:02Z","timestamp":1760126762000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/13\/6141"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,4]]},"references-count":36,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2023,7]]}},"alternative-id":["s23136141"],"URL":"https:\/\/doi.org\/10.3390\/s23136141","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,7,4]]}}}