{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T20:26:40Z","timestamp":1778876800792,"version":"3.51.4"},"reference-count":31,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2018,10,29]],"date-time":"2018-10-29T00:00:00Z","timestamp":1540771200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The recognition of three-dimensional (3D) lidar (light detection and ranging) point clouds remains a significant issue in point cloud processing. Traditional point cloud recognition employs the 3D point clouds from the whole object. Nevertheless, the lidar data is a collection of two-and-a-half-dimensional (2.5D) point clouds (each 2.5D point cloud comes from a single view) obtained by scanning the object within a certain field angle by lidar. To deal with this problem, we initially propose a novel representation which expresses 3D point clouds using 2.5D point clouds from multiple views and then we generate multi-view 2.5D point cloud data based on the Point Cloud Library (PCL). Subsequently, we design an effective recognition model based on a multi-view convolutional neural network. The model directly acts on the raw 2.5D point clouds from all views and learns to get a global feature descriptor by fusing the features from all views by the view fusion network. It has been proved that our approach can achieve an excellent recognition performance without any requirement for three-dimensional reconstruction and the preprocessing of point clouds. In conclusion, this paper can effectively solve the recognition problem of lidar point clouds and provide vital practical value.<\/jats:p>","DOI":"10.3390\/s18113681","type":"journal-article","created":{"date-parts":[[2018,10,31]],"date-time":"2018-10-31T03:50:56Z","timestamp":1540957856000},"page":"3681","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":32,"title":["3D Point Cloud Recognition Based on a Multi-View Convolutional Neural Network"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3736-3297","authenticated-orcid":false,"given":"Le","family":"Zhang","sequence":"first","affiliation":[{"name":"State Key Laboratory for Strength and Vibration of Mechanical Structures, School of Aerospace, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"},{"name":"Shaanxi Engineering Laboratory for Vibration Control of Aerospace Structures, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jian","family":"Sun","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Strength and Vibration of Mechanical Structures, School of Aerospace, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"},{"name":"Shaanxi Engineering Laboratory for Vibration Control of Aerospace Structures, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qiang","family":"Zheng","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Strength and Vibration of Mechanical Structures, School of Aerospace, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"},{"name":"Shaanxi Engineering Laboratory for Vibration Control of Aerospace Structures, Xi\u2019an Jiaotong University, Xi\u2019an 710049, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,10,29]]},"reference":[{"key":"ref_1","first-page":"76920D","article-title":"Velodyne HDL-64E lidar for unmanned surface vehicle obstacle detection","volume":"7692","author":"Bruch","year":"2010","journal-title":"Proc. SPIE Int. Soc. Opt. Eng."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"21931","DOI":"10.3390\/s150921931","article-title":"A Framework for Applying Point Clouds Grabbed by Multi-Beam LIDAR in Perceiving the Driving Environment","volume":"15","author":"Liu","year":"2015","journal-title":"Sensors"},{"key":"ref_3","first-page":"73310H","article-title":"3D imaging lidar for lunar robotic exploration","volume":"7331","author":"Hussein","year":"2009","journal-title":"Proc. SPIE Int. Soc. Opt. Eng."},{"key":"ref_4","first-page":"394","article-title":"Mobile Robot for SLAM Research Based on Lidar and Binocular Vision Fusion","volume":"31","author":"Wang","year":"2018","journal-title":"Chin. J. Sens. Actuators"},{"key":"ref_5","unstructured":"Beck, S.M., Gelbwachs, J.A., Hinkley, D.A., and Warren, D.W. (1998, January 10). Aerospace applications of optical sensing with lidar. Proceedings of the Aerospace Applications Conference, Aspen, CO, USA."},{"key":"ref_6","unstructured":"Mcmanamon, P. (1991, January 22\u201324). Aerospace Applications Of Lidar For DOD. Proceedings of the Spaceborne Photonics: Aerospace Applications of Lasers and Electro-Optics\/Optical Millimeter-Wave Interactions: Measurements, Generation, Transmission and Control, Newport Beach, CA, USA."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"Lecun","year":"2015","journal-title":"Nature"},{"key":"ref_8","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20136). ImageNet classification with deep convolutional neural networks. Proceedings of the International Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"Lecun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_10","unstructured":"Simonyan, K., and Zisserman, A. (arXiv, 2014). Very Deep Convolutional Networks for Large-Scale Image Recognition, arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Graves, A., Mohamed, A.R., and Hinton, G. (2013, January 26\u201331). Speech recognition with deep recurrent neural networks. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, Vancouver, BC, Canada.","DOI":"10.1109\/ICASSP.2013.6638947"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1109\/MSP.2012.2205597","article-title":"Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups","volume":"29","author":"Hinton","year":"2012","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Sak, H., Senior, A., Rao, K., and Beaufays, F. (arXiv, 2015). Fast and Accurate Recurrent Neural Network Acoustic Models for Speech Recognition, arXiv.","DOI":"10.21437\/Interspeech.2015-350"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Conneau, A., Schwenk, H., Barrault, L., and Lecun, Y. (arXiv, 2016). Very Deep Convolutional Networks for Natural Language Processing, arXiv.","DOI":"10.18653\/v1\/E17-1104"},{"key":"ref_15","first-page":"3104","article-title":"Sequence to Sequence Learning with Neural Networks","volume":"4","author":"Sutskever","year":"2014","journal-title":"Comput. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"858","DOI":"10.1109\/TNN.2010.2044802","article-title":"A convolutional learning system for object classification in 3-D Lidar data","volume":"21","author":"Prokhorov","year":"2010","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_17","unstructured":"Maturana, D., and Scherer, S. (October, January 28). VoxNet: A 3D Convolutional Neural Network for Real-Time Object Recognition. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany."},{"key":"ref_18","unstructured":"Wu, Z., Song, S., Khosla, A., Yu, F., and Zhang, L. (2015, January 7\u201312). 3D ShapeNets: A deep representation for volumetric shapes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Charles, R.Q., Hao, S., Mo, K., and Guibas, L.J. (2017, January 21\u201326). PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.16"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Su, H., Maji, S., Kalogerakis, E., and Learnedmiller, E. (2015, January 7\u201313). Multi-view Convolutional Neural Networks for 3D Shape Recognition. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.114"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1016\/j.cag.2017.12.001","article-title":"Ensemble of PANORAMA-based convolutional neural networks for 3D model classification and retrieval","volume":"71","author":"Sfikas","year":"2017","journal-title":"Comput. Graph."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Pang, G., and Neumann, U. (2015, January 19\u201322). Fast and Robust Multi-view 3D Object Recognition in Point Clouds. Proceedings of the International Conference on 3d Vision, Lyon, France.","DOI":"10.1109\/3DV.2015.27"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Pang, G., and Neumann, U. (2016, January 4\u20138). 3D point cloud object detection with multi-view convolutional neural network. Proceedings of the International Conference on Pattern Recognition, Cancun, Mexico.","DOI":"10.1109\/ICPR.2016.7899697"},{"key":"ref_24","unstructured":"Chen, X., Ma, H., Wan, J., Li, B., and Xia, T. (arXiv, 1611). Multi-View 3D Object Detection Network for Autonomous Driving, arXiv."},{"key":"ref_25","unstructured":"Vinyals, O., Bengio, S., and Kudlur, M. (arXiv, 1511). Order Matters: Sequence to sequence for sets, arXiv."},{"key":"ref_26","unstructured":"Ravanbakhsh, S., Schneider, J., and Poczos, B. (arXiv, 2016). Deep Learning with Sets and Point Clouds, arXiv."},{"key":"ref_27","unstructured":"Jaderberg, M., Simonyan, K., Zisserman, A., and Kavukcuoglu, K. (arXiv, 2015). Spatial Transformer Networks, arXiv."},{"key":"ref_28","unstructured":"Xie, R., Wang, X., Li, Y., and Zhao, K. (2010, January 15\u201317). Research and application on improved BP neural network algorithm. Proceedings of the Industrial Electronics and Applications, Taichung, Taiwan."},{"key":"ref_29","unstructured":"Kazhdan, M., Funkhouser, T., and Rusinkiewicz, S. (2003, January 23\u201325). Rotation invariant spherical harmonic representation of 3D shape descriptors. Proceedings of the 2003 Eurographics\/ACM SIGGRAPH Symposium on Geometry Processing, Aachen, Germany."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1111\/1467-8659.00669","article-title":"On Visual Similarity Based 3D Model Retrieval","volume":"22","author":"Chen","year":"2010","journal-title":"Comput. Graph. Forum"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2339","DOI":"10.1109\/LSP.2015.2480802","article-title":"DeepPano: Deep Panoramic Representation for 3-D Shape Recognition","volume":"22","author":"Shi","year":"2015","journal-title":"IEEE Signal Process. Lett."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/11\/3681\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:26:52Z","timestamp":1760196412000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/11\/3681"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,29]]},"references-count":31,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2018,11]]}},"alternative-id":["s18113681"],"URL":"https:\/\/doi.org\/10.3390\/s18113681","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,10,29]]}}}