{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,26]],"date-time":"2026-06-26T15:07:24Z","timestamp":1782486444729,"version":"3.54.5"},"reference-count":46,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2024,10,5]],"date-time":"2024-10-05T00:00:00Z","timestamp":1728086400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Institute of Artificial Intelligence at De Montfort University"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The rapid growth in technologies for 3D sensors has made point cloud data increasingly available in different applications such as autonomous driving, robotics, and virtual and augmented reality. This raises a growing need for deep learning methods to process the data. Point clouds are difficult to be used directly as inputs in several deep learning techniques. The difficulty is raised by the unstructured and unordered nature of the point cloud data. So, machine learning models built for images or videos cannot be used directly on point cloud data. Although the research in the field of point clouds has gained high attention and different methods have been developed over the decade, very few research works directly with point cloud data, and most of them convert the point cloud data into 2D images or voxels by performing some pre-processing that causes information loss. Methods that directly work on point clouds are in the early stage and this affects the performance and accuracy of the models. Advanced techniques in classical convolutional neural networks, such as the attention mechanism, need to be transferred to the methods directly working with point clouds. In this research, an attention mechanism is proposed to be added to deep convolutional neural networks that process point clouds directly. The attention module was proposed based on specific pooling operations which are designed to be applied directly to point clouds to extract vital information from the point clouds. Segmentation of the ShapeNet dataset was performed to evaluate the method. The mean intersection over union (mIoU) score of the proposed framework was increased after applying the attention method compared to a base state-of-the-art framework that does not have the attention mechanism.<\/jats:p>","DOI":"10.3390\/s24196446","type":"journal-article","created":{"date-parts":[[2024,10,7]],"date-time":"2024-10-07T07:30:18Z","timestamp":1728286218000},"page":"6446","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["PointCloud-At: Point Cloud Convolutional Neural Networks with Attention for 3D Data Processing"],"prefix":"10.3390","volume":"24","author":[{"given":"Saidu","family":"Umar","sequence":"first","affiliation":[{"name":"School of Computer Science and Informatics, De Montfort University, Leicester LE1 9BH, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3627-6362","authenticated-orcid":false,"given":"Aboozar","family":"Taherkhani","sequence":"additional","affiliation":[{"name":"School of Computer Science and Informatics, De Montfort University, Leicester LE1 9BH, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,10,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1910","DOI":"10.3390\/heritage5030099","article-title":"Rapid and Accurate Production of 3D Point Cloud via Latest-Generation Sensors in the Field of Cultural Heritage: A Comparison between SLAM and Spherical Videogrammetry","volume":"5","author":"Pepe","year":"2022","journal-title":"Heritage"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Bello, S.A., Yu, S., Wang, C., Adam, J.M., and Li, J. (2020). Review: Deep learning on 3D point clouds. Remote Sens., 12.","DOI":"10.3390\/rs12111729"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.neucom.2018.09.040","article-title":"Deep-FS: A feature selection algorithm for Deep Boltzmann Machines","volume":"322","author":"Taherkhani","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1016\/j.neucom.2020.03.064","article-title":"AdaBoost-CNN: An adaptive boosting algorithm for convolutional neural networks to classify multi-class imbalanced datasets using transfer learning","volume":"404","author":"Taherkhani","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Alani, A.A., Cosma, G., Taherkhani, A., and McGinnity, T.M. (2018, January 25\u201327). Hand Gesture Recognition Using an Adapted Convolutional Neural Network with Data Augmentation. Proceedings of the 2018 4th International Conference on Information Management (ICIM 2018), Oxford, UK.","DOI":"10.1109\/INFOMAN.2018.8392660"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1007\/978-3-030-01177-2_15","article-title":"Activity recognition from multi-modal sensor data using a deep convolutional neural network","volume":"857","author":"Taherkhani","year":"2019","journal-title":"Adv. Intell. Syst. Comput."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"4338","DOI":"10.1109\/TPAMI.2020.3005434","article-title":"Deep Learning for 3D Point Clouds: A Survey","volume":"43","author":"Guo","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","first-page":"3523","article-title":"Image Segmentation Using Deep Learning: A Survey","volume":"44","author":"Minaee","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1016\/j.cag.2020.02.005","article-title":"ConvPoint: Continuous convolutions for point cloud processing","volume":"88","author":"Boulch","year":"2020","journal-title":"Comput. Graph."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.neucom.2021.03.091","article-title":"A review on the attention mechanism of deep learning","volume":"452","author":"Niu","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Liu, T., Luo, R., Xu, L., Feng, D., Cao, L., Liu, S., and Guo, J. (2022). Spatial Channel Attention for Deep Convolutional Neural Networks. Mathematics, 10.","DOI":"10.3390\/math10101750"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhang, Q.L., and Yang, Y.B. (2021, January 6\u201311). SA-Net: Shuffle Attention for Deep Convolutional Neural Networks (ICASSP). Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing-Proceedings, Toronto, ON, Canada.","DOI":"10.1109\/ICASSP39728.2021.9414568"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3412","DOI":"10.1109\/TNNLS.2020.3015992","article-title":"Deep Learning for LiDAR Point Clouds in Autonomous Driving: A Review","volume":"32","author":"Li","year":"2021","journal-title":"IEEE Trans. Neural. Netw. Learn Syst."},{"key":"ref_14","unstructured":"Qi, C., Yi, L., Su, H., and Guibas, L. (2017, January 4). PointNet++: Deep Hierarchical Feature Learning on. Proceedings of the NIPS\u201917: 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_15","first-page":"13","article-title":"Dynamic Graph CNN for Learning on Point Clouds","volume":"38","author":"Wang","year":"2018","journal-title":"ACM Trans. Graph."},{"key":"ref_16","unstructured":"Zhao, H., Jiang, L., Fu, C.-W., and Jia, J. (2022, November 07). PointWeb: Enhancing Local Neighborhood Features for Point Cloud Processing. Available online: https:\/\/github.com\/hszhao\/PointWeb."},{"key":"ref_17","unstructured":"Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21\u201326). PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA."},{"key":"ref_18","unstructured":"Hua, B.-S., Tran, M.-K., and Yeung, S.-K. (2017, December 14). Pointwise Convolutional Neural Networks. Available online: http:\/\/arxiv.org\/abs\/1712.05245."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Lei, H., Akhtar, N., and Mian, A. (2019, February 28). Octree Guided CNN with Spherical Kernels for 3D Point Clouds. Available online: http:\/\/arxiv.org\/abs\/1903.00343.","DOI":"10.1109\/CVPR.2019.00986"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Liu, Y., Fan, B., Xiang, S., and Pan, C. (2019, January 15\u201320). Relation-Shape Convolutional Neural Network for Point Cloud Analysis. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00910"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018). CBAM: Convolutional Block Attention Module, Springer. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics).","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Yang, Y., Ma, Y., Zhang, J., Gao, X., and Xu, M. (2020). Attpnet: Attention-based deep neural network for 3D point set analysis. Sensors, 20.","DOI":"10.3390\/s20195455"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1016\/j.cag.2020.06.001","article-title":"Attention-based relation and context modeling for point cloud semantic segmentation","volume":"90","author":"Hu","year":"2020","journal-title":"Comput. Graph."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1300","DOI":"10.1109\/LSP.2021.3082851","article-title":"GA-NET: Global Attention Network for Point Cloud Semantic Segmentation","volume":"28","author":"Deng","year":"2021","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Li, J., Chen, B.M., and Lee, G.H. (2018, January 18\u201323). SO-Net: Self-Organizing Network for Point Cloud Analysis. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00979"},{"key":"ref_26","unstructured":"Shen, Y., Feng, C., Yang, Y., and Tian, D. (2022, November 07). Mining Point Cloud Local Structures by Kernel Correlation and Graph Pooling. Available online: http:\/\/www.merl.com\/research\/."},{"key":"ref_27","first-page":"1","article-title":"Lightweight Attention Module for Deep Learning on Classification and Segmentation of 3-D Point Clouds","volume":"70","author":"Cui","year":"2021","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"107446","DOI":"10.1016\/j.patcog.2020.107446","article-title":"Point attention network for semantic segmentation of 3D point clouds","volume":"107","author":"Feng","year":"2020","journal-title":"Pattern Recognit."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Landrieu, L., and Simonovsky, M. (2018, January 18\u201323). Large-Scale Point Cloud Semantic Segmentation with Superpoint Graphs. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00479"},{"key":"ref_30","unstructured":"Chang, A.X., Funkhouser, T., Guibas, L., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., and Su, H. (2015). ShapeNet: An Information-Rich 3D Model Repository. arXiv."},{"key":"ref_31","first-page":"1","article-title":"Learning Semantic Segmentation of Large-Scale Point Clouds with Random Sampling","volume":"44","author":"Hu","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Graham, B., Engelcke, M., and Van Der Maaten, L. (2018, January 18\u201323). 3D Semantic Segmentation with Submanifold Sparse Convolutional Networks. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00961"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Su, H., Jampani, V., Sun, D., Maji, S., Kalogerakis, E., Yang, M.H., and Kautz, J. (2018, January 18\u201323). SPLATNet: Sparse Lattice Networks for Point Cloud Processing. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00268"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Yi, L., Su, H., Guo, X., and Guibas, L.J. (2017, January 21\u201326). SyncSpecCNN: Synchronized Spectral CNN for 3D Shape Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.697"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Klokov, R., and Lempitsky, V. (2017, January 22\u201329). Escape from Cells: Deep Kd-Networks for the Recognition of 3D Point Cloud Models. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.99"},{"key":"ref_36","unstructured":"Ben-Shabat, Y., Lindenbaum, M., and Fischer, A. (2017). 3D Point Cloud Classification and Segmentation using 3D Modified Fisher Vector Representation for Convolutional Neural Networks. arXiv."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Xu, Y., Fan, T., Xu, M., Zeng, L., and Qiao, Y. (2018, January 8\u201314). SpiderCNN: Deep Learning on Point Sets with Parameterized Convolutional Filters. Proceedings of the European Conference on Computer Vision, Munich, Germany. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics).","DOI":"10.1007\/978-3-030-01237-3_6"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Atzmon, M., Maron, H., and Lipman, Y. (2018). Point Convolutional Neural Networks by Extension Operators. arXiv.","DOI":"10.1145\/3197517.3201301"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Huang, Q., Wang, W., and Neumann, U. (2018, January 18\u201323). Recurrent Slice Networks for 3D Segmentation of Point Clouds. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00278"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Wang, C., Samari, B., and Siddiqi, K. (2018, January 8\u201314). Local Spectral Graph Convolution for Point Set Feature Learning. Proceedings of the European Conference on Computer Vision, Munich, Germany. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics).","DOI":"10.1007\/978-3-030-01225-0_4"},{"key":"ref_41","unstructured":"Li, Y., Bu, R., Sun, M., Wu, W., Di, X., and Chen, B. (, January 3\u20138). PointCNN: Convolution On X-Transformed Points. Proceedings of the 32nd International Conference on Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_42","unstructured":"Thomas, H., Qi, C.R., Deschaud, J.E., Marcotegui, B., Goulette, F., and Guibas, L. (November, January 27). KPConv: Flexible and Deformable Convolution for Point Clouds. Proceedings of the IEEE International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Tarsha Kurdi, F., Gharineiat, Z., Campbell, G., Awrangjeb, M., and Dey, E.K. (2022). Automatic Filtering of Lidar Building Point Cloud in Case of Trees Associated to Building Roof. Remote Sens., 14.","DOI":"10.3390\/rs14020430"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1109\/LGRS.2018.2867736","article-title":"Building extraction from LiDAR data applying deep convolutional neural networks","volume":"16","author":"Maltezos","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_45","unstructured":"Bethel, J., Elaksher, A.F., and Bethel, J.S. (2022, November 07). Reconstructing 3D Buildings from LiDAR Data. Available online: https:\/\/www.researchgate.net\/publication\/228777898."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"107646","DOI":"10.1016\/j.patcog.2020.107646","article-title":"Tackling mode collapse in multi-generator GANs with orthogonal vectors","volume":"110","author":"Li","year":"2021","journal-title":"Pattern Recognit."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/19\/6446\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:11:02Z","timestamp":1760112662000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/19\/6446"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,5]]},"references-count":46,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2024,10]]}},"alternative-id":["s24196446"],"URL":"https:\/\/doi.org\/10.3390\/s24196446","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,5]]}}}