{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,12]],"date-time":"2026-02-12T17:51:02Z","timestamp":1770918662895,"version":"3.50.1"},"reference-count":42,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2021,6,28]],"date-time":"2021-06-28T00:00:00Z","timestamp":1624838400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["19KK0256"],"award-info":[{"award-number":["19KK0256"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]},{"name":"AY2020 Program for Asia-Japan Research Development, Ritsumeikan University.","award":["co-creation-2020"],"award-info":[{"award-number":["co-creation-2020"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Large-scale 3D-scanned point clouds enable the accurate and easy recording of complex 3D objects in the real world. The acquired point clouds often describe both the surficial and internal 3D structure of the scanned objects. The recently proposed edge-highlighted transparent visualization method is effective for recognizing the whole 3D structure of such point clouds. This visualization utilizes the degree of opacity for highlighting edges of the 3D-scanned objects, and it realizes clear transparent viewing of the entire 3D structures. However, for 3D-scanned point clouds, the quality of any edge-highlighting visualization depends on the distribution of the extracted edge points. Insufficient density, sparseness, or partial defects in the edge points can lead to unclear edge visualization. Therefore, in this paper, we propose a deep learning-based upsampling method focusing on the edge regions of 3D-scanned point clouds to generate more edge points during the 3D-edge upsampling task. The proposed upsampling network dramatically improves the point-distributional density, uniformity, and connectivity in the edge regions. The results on synthetic and scanned edge data show that our method can improve the percentage of edge points more than 15% compared to the existing point cloud upsampling network. Our upsampling network works well for both sharp and soft edges. A combined use with a noise-eliminating filter also works well. We demonstrate the effectiveness of our upsampling network by applying it to various real 3D-scanned point clouds. We also prove that the improved edge point distribution can improve the visibility of the edge-highlighted transparent visualization of complex 3D-scanned objects.<\/jats:p>","DOI":"10.3390\/rs13132526","type":"journal-article","created":{"date-parts":[[2021,6,28]],"date-time":"2021-06-28T13:39:22Z","timestamp":1624887562000},"page":"2526","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Deep Learning-Based Point Upsampling for Edge Enhancement of 3D-Scanned Data and Its Application to Transparent Visualization"],"prefix":"10.3390","volume":"13","author":[{"given":"Weite","family":"Li","sequence":"first","affiliation":[{"name":"Graduate School of Information Science and Engineering, Ritsumeikan University, Kusatsu 525-8577, Shiga, Japan"}]},{"given":"Kyoko","family":"Hasegawa","sequence":"additional","affiliation":[{"name":"College of Information Science and Engineering, Ritsumeikan University, Kusatsu 525-8577, Shiga, Japan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9452-9965","authenticated-orcid":false,"given":"Liang","family":"Li","sequence":"additional","affiliation":[{"name":"College of Information Science and Engineering, Ritsumeikan University, Kusatsu 525-8577, Shiga, Japan"}]},{"given":"Akihiro","family":"Tsukamoto","sequence":"additional","affiliation":[{"name":"Graduate School of Integrated Arts and Sciences, Tokushima University, Tokushima 770-8502, Tokushima, Japan"}]},{"given":"Satoshi","family":"Tanaka","sequence":"additional","affiliation":[{"name":"College of Information Science and Engineering, Ritsumeikan University, Kusatsu 525-8577, Shiga, Japan"}]}],"member":"1968","published-online":{"date-parts":[[2021,6,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Tanaka, S., Hasegawa, K., Okamoto, N., Umegaki, R., Wang, S., Uemura, M., Okamoto, A., and Koyamada, K. (2016, January 12\u201319). See-Through Imaging of Laser-Scanned 3D Cultural Heritage Objects Based on Stochastic Rendering of Large-Scale Point Clouds. Proceedings of the ISPRS Annals of Photogrammetry, Remote Sensing & Spatial Information Sciences, Prague, Czech Republic.","DOI":"10.5194\/isprsannals-III-5-73-2016"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"373","DOI":"10.5194\/isprs-annals-V-2-2020-373-2020","article-title":"Opacity-based edge highlighting for transparent visualization of 3D scanned point clouds","volume":"5","author":"Kawakami","year":"2020","journal-title":"ISPRS Ann. Photogramm. Remote. Sens. Spat. Inf. Sci."},{"key":"ref_3","unstructured":"Tanaka, S., Hasegawa, K., Shimokubo, Y., Kaneko, T., Kawamura, T., Nakata, S., Ojima, S., Sakamoto, N., Tanaka, H.T., and Koyamada, K. (2012, January 5\u20138). Particle-Based Transparent Rendering of Implicit Surfaces and its Application to Fused Visualization. Proceedings of the Eurographics Conference on Visualization (EuroVis), Vienna, Austria."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1016\/j.isprsjprs.2020.01.004","article-title":"Noise-robust transparent visualization of large-scale point clouds acquired by laser scanning","volume":"161","author":"Uchida","year":"2020","journal-title":"ISPRS J. Photogramm. Remote. Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/TVCG.2003.1175093","article-title":"Computing and rendering point set surfaces","volume":"9","author":"Alexa","year":"2003","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1145\/1276377.1276405","article-title":"Parameterization-free projection for geometry reconstruction","volume":"26","author":"Lipman","year":"2007","journal-title":"ACM Trans. Graph."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1618452.1618522","article-title":"Consolidation of unorganized point clouds for surface reconstruction","volume":"28","author":"Huang","year":"2009","journal-title":"ACM Trans. Graph."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zhou, Y., and Tuzel, O. (2018, January 18\u201322). VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00472"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Shi, S., Wang, X., and Li, H. (2019, January 15\u201320). PointRCNN: 3D Object Proposal Generation and Detection From Point Cloud. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00086"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Huang, Z., Yu, Y., Xu, J., Ni, F., and Le, X. (2020, January 13\u201319). PF-Net: Point Fractal Network for 3D Point Cloud Completion. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00768"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Wen, X., Li, T., Han, Z., and Liu, Y.-S. (2020, January 13\u201319). Point Cloud Completion by Skip-Attention Network With Hierarchical Folding. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00201"},{"key":"ref_12","unstructured":"Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21\u201326). Pointnet: Deep Learning on Point Sets for 3d Classification and Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zhang, Y., and Rabbat, M. (2018, January 15\u201320). A Graph-CNN for 3D Point Cloud Classification. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.","DOI":"10.1109\/ICASSP.2018.8462291"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Liu, Y., Fan, B., Xiang, S., and Pan, C. (2019, January 15\u201320). Relation-Shape Convolutional Neural Network for Point Cloud Analysis. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00910"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Landrieu, L., and Simonovsky, M. (2018, January 18\u201323). Large-Scale Point Cloud Semantic Segmentation with Superpoint Graphs. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00479"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Wang, W., Yu, R., Huang, Q., and Neumann, U. (2018, January 18\u201323). SGPN: Similarity Group Proposal Network for 3D Point Cloud Instance Segmentation. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00272"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Yu, L., Li, X., Fu, C.-W., Cohen-Or, D., and Heng, P.A. (2018, January 18\u201323). PU-Net: Point Cloud Upsampling Network. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00295"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Yifan, W., Wu, S., Huang, H., Cohen-Or, D., and Sorkine-Hornung, O. (2019, January 15\u201321). Patch-based Progressive 3D Point Set Upsampling. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00611"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Li, R., Li, X., Fu, C.-W., Cohen-Or, D., and Heng, P.-A. (November, January 27). PU-GAN: A Point Cloud Upsampling Adversarial Network. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00730"},{"key":"ref_20","unstructured":"Chang, A.X., Funkhouser, T., Guibas, L., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., and Su, H. (2015). Shapenet: An information-rich 3d model repository. arXiv."},{"key":"ref_21","unstructured":"Wu, Z., Song, S., Khosla, A., Yu, F., Zhang, L., Tang, X., and Xiao, J. (2015, January 7\u201312). 3D ShapeNets: A deep representation for volumetric shapes. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA."},{"key":"ref_22","unstructured":"West, K.F., Webb, B.N., Lersch, J.R., Pothier, S., Triscari, J.M., and Iverson, A.E. (2004, January 21). Context-Driven Automated Target Detection in 3D Data. Proceedings of the Automatic Target Recognition XIV, Orlando, FL, USA."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1007\/s13218-010-0059-6","article-title":"Semantic 3D Object Maps for Everyday Manipulation in Human Living Environments","volume":"24","author":"Rusu","year":"2010","journal-title":"KI K\u00fcnstliche Intell."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"181","DOI":"10.5194\/isprsannals-II-3-181-2014","article-title":"Semantic 3D scene interpretation: A framework combining optimal neighborhood size selection with relevant features","volume":"II-3","author":"Weinmann","year":"2014","journal-title":"ISPRS Ann. Photogramm. Remote. Sens. Spat. Inf. Sci."},{"key":"ref_25","first-page":"4","article-title":"Nearest neighbour classification on laser point clouds to gain object structures from buildings","volume":"38","author":"Jutzi","year":"2009","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"914","DOI":"10.1109\/TVCG.2012.34","article-title":"Efficient and Flexible Sampling with Blue Noise Properties of Triangular Meshes","volume":"18","author":"Corsini","year":"2012","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_27","unstructured":"Qi, C.R., Yi, L., Su, H., and Guibas, L.J. (2017). Pointnet++: Deep hierarchical feature learning on point sets in a metric space. Comput. Vis. Pattern Recognit."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Yu, L., Li, X., Fu, C.-W., Cohen-Or, D., and Heng, P.A. (2018, January 8\u201314). EC-Net: An Edge-Aware Point Set Consolidation Network. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_24"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Chen, N., Liu, L., Cui, Z., Chen, R., Ceylan, D., Tu, C., and Wang, W. (2020, January 13\u201319). Unsupervised Learning of Intrinsic Structural Representation Points. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00914"},{"key":"ref_30","first-page":"1","article-title":"Dynamic Graph CNN for Learning on Point Clouds","volume":"38","author":"Wang","year":"2019","journal-title":"ACM Trans. Graph."},{"key":"ref_31","unstructured":"Achlioptas, P., Diamanti, O., Mitliagkas, I., and Guibas, L. (2018, January 10\u201315). Learning Representations and Generative Models for 3d Point Clouds. Proceedings of the International Conference on Machine Learning, Stockholm, Sweden."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Yang, Y., Feng, C., Shen, Y., and Tian, D. (2018, January 18\u201323). FoldingNet: Point Cloud Auto-Encoder via Deep Grid Deformation. Proceedings of the 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00029"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Yuan, W., Khot, T., Held, D., Mertz, C., and Hebert, M. (2018, January 5\u20138). Pcn: Point Completion Network. Proceedings of the 2018 International Conference on 3D Vision (3DV), Verona, Italy.","DOI":"10.1109\/3DV.2018.00088"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Fan, H., Su, H., and Guibas, L. (2017, January 21\u201326). A Point Set Generation Network for 3D Object Reconstruction from a Single Image. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.264"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Mao, X., Li, Q., Xie, H., Lau, R.Y., Wang, Z., and Paul Smolley, S. (2017, January 22\u201329). Least Squares Generative Adversarial Networks. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.304"},{"key":"ref_36","unstructured":"(2021, March 21). Visionair. Available online: http:\/\/www.infra-visionair.eu."},{"key":"ref_37","unstructured":"Kingma, D.P., and Ba, J. (2015, January 5\u20138). Adam: A method for Stochastic Optimization. Proceedings of the International Conference Learn Represent (ICLR), San Diego, CA, USA."},{"key":"ref_38","first-page":"1","article-title":"A benchmark for surface reconstruction","volume":"32","author":"Berger","year":"2013","journal-title":"ACM Trans. Graph."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1016\/j.isprsjprs.2013.04.009","article-title":"Accurate 3D comparison of complex topography with terrestrial laser scanner: Application to the Rangitikei canyon (N-Z)","volume":"82","author":"Lague","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_40","unstructured":"(2021, June 04). ShapeNetCore. Available online: https:\/\/shapenet.org."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Rusu, R.B., and Cousins, S. (2011, January 9\u201313). 3d is Here: Point Cloud Library (pcl). Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980567"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Li, W., Shigeta, K., Hasegawa, K., Li, L., Yano, K., Adachi, M., and Tanaka, S. (2019). Transparent Collision Visualization of Point Clouds Acquired by Laser Scanning. ISPRS Int. J. Geo-Inf., 8.","DOI":"10.3390\/ijgi8090425"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/13\/2526\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:25:50Z","timestamp":1760163950000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/13\/2526"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,28]]},"references-count":42,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["rs13132526"],"URL":"https:\/\/doi.org\/10.3390\/rs13132526","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,28]]}}}