{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,3,6]],"date-time":"2023-03-06T07:36:45Z","timestamp":1678088205155},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,7,2]],"date-time":"2020-07-02T00:00:00Z","timestamp":1593648000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,7,2]],"date-time":"2020-07-02T00:00:00Z","timestamp":1593648000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["IPSJ T Comput Vis Appl"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Manually labelling point cloud scenes for use as training data in machine learning applications is a time- and labour-intensive task. In this paper, we aim to reduce the effort associated with learning semantic segmentation tasks by introducing a semi-supervised method that operates on scenes with only a small number of labelled points. For this task, we advocate the use of pseudo-labelling in combination with PointNet, a neural network architecture for point cloud classification and segmentation. We also introduce a method for incorporating information derived from spatial relationships to aid in the pseudo-labelling process. This approach has practical advantages over current methods by working directly on point clouds and not being reliant on predefined features. Moreover, we demonstrate competitive performance on scenes from three publicly available datasets and provide studies on parameter sensitivity.<\/jats:p>","DOI":"10.1186\/s41074-020-00064-w","type":"journal-article","created":{"date-parts":[[2020,7,2]],"date-time":"2020-07-02T07:24:46Z","timestamp":1593674686000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Pseudo-labelling-aided semantic segmentation on sparsely annotated 3D point clouds"],"prefix":"10.1186","volume":"12","author":[{"given":"Yasuhiro","family":"Yao","sequence":"first","affiliation":[]},{"given":"Katie","family":"Xu","sequence":"additional","affiliation":[]},{"given":"Kazuhiko","family":"Murasaki","sequence":"additional","affiliation":[]},{"given":"Shingo","family":"Ando","sequence":"additional","affiliation":[]},{"given":"Atsushi","family":"Sagata","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,7,2]]},"reference":[{"key":"64_CR1","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1016\/j.cag.2015.01.006","volume":"49","author":"M Weinmann","year":"2015","unstructured":"Weinmann M, Urban S, Hinz S, Jutzi B, Mallet C (2015) Distinctive 2D and 3D features for automated large-scale scene analysis in urban areas. Comput Graphics 49:47\u201357.","journal-title":"Comput Graphics"},{"key":"64_CR2","doi-asserted-by":"publisher","unstructured":"Qi CR, Su H, Mo K, Guibas LJ (2017) Pointnet: deep learning on point sets for 3D classification and segmentation In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 652\u2013660. https:\/\/doi.org\/10.1109\/cvpr.2017.16.","DOI":"10.1109\/cvpr.2017.16"},{"key":"64_CR3","doi-asserted-by":"publisher","unstructured":"Munoz D, Bagnell JA, Vandapel N, Hebert M (2009) Contextual classification with functional max-margin Markov networks In: IEEE Conference on Computer Vision and Pattern Recognition, 975\u2013982.. IEEE. https:\/\/doi.org\/10.1109\/cvpr.2009.5206590.","DOI":"10.1109\/cvpr.2009.5206590"},{"key":"64_CR4","doi-asserted-by":"publisher","unstructured":"Hackel T, Savinov N, Ladicky L, Wegner JD, Schindler K, Pollefeys M (2017) SEMANTIC3D.NET: a new large-scale point cloud classification benchmark In: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. IV-1-W1, 91\u201398. https:\/\/doi.org\/10.5194\/isprs-annals-iv-1-w1-91-2017.","DOI":"10.5194\/isprs-annals-iv-1-w1-91-2017"},{"key":"64_CR5","doi-asserted-by":"publisher","unstructured":"Armeni I, Sener O, Zamir AR, Jiang H, Brilakis I, Fischer M, Savarese S (2016) 3D semantic parsing of large-scale indoor spaces In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1534\u20131543. https:\/\/doi.org\/10.1109\/cvpr.2016.170.","DOI":"10.1109\/cvpr.2016.170"},{"key":"64_CR6","doi-asserted-by":"publisher","unstructured":"Xu K, Yao Y, Murasaki K, Ando S, Sagata A (2019) Semantic segmentation of sparsely annotated 3D point clouds by pseudo-labelling In: International Conference on 3D Vision (3DV), 463\u2013471.. IEEE. https:\/\/doi.org\/10.1109\/3dv.2019.00058.","DOI":"10.1109\/3dv.2019.00058"},{"key":"64_CR7","doi-asserted-by":"publisher","unstructured":"Munoz D, Vandapel N, Hebert M (2009) Onboard contextual classification of 3-D point clouds with learned high-order Markov random fields In: 2009 IEEE International Conference on Robotics and Automation.. IEEE. https:\/\/doi.org\/10.1109\/robot.2009.5152856.","DOI":"10.1109\/robot.2009.5152856"},{"key":"64_CR8","doi-asserted-by":"publisher","unstructured":"Zhao H, Liu Y, Zhu X, Zhao Y, Zha H (2010) Scene understanding in a large dynamic environment through a laser-based sensing In: 2010 IEEE International Conference on Robotics and Automation, 127\u2013133.. IEEE. https:\/\/doi.org\/10.1109\/robot.2010.5509169.","DOI":"10.1109\/robot.2010.5509169"},{"key":"64_CR9","doi-asserted-by":"publisher","unstructured":"Mei J, Gao B, Xu D, Yao W, Zhao X, Zhao H (2019) Semantic segmentation of 3D lidar data in dynamic scene using semi-supervised learning. IEEE Trans Intell Transp Syst. https:\/\/doi.org\/10.1109\/tits.2019.2919741.","DOI":"10.1109\/tits.2019.2919741"},{"key":"64_CR10","first-page":"7","volume":"2","author":"A Boulch","year":"2017","unstructured":"Boulch A, Saux BL, Audebert N (2017) Unstructured point cloud semantic labeling using deep segmentation networks. 3DOR 2:7.","journal-title":"3DOR"},{"key":"64_CR11","doi-asserted-by":"publisher","unstructured":"Tchapmi LP, Choy C, Armeni I, Gwak J, Savarese S (2017) Segcloud: semantic segmentation of 3D point clouds In: International Conference on 3D Vision (3DV), 537\u2013547.. IEEE. https:\/\/doi.org\/10.1109\/3dv.2017.00067.","DOI":"10.1109\/3dv.2017.00067"},{"key":"64_CR12","doi-asserted-by":"publisher","unstructured":"Qi CR, Yi L, Su H, Guibas LJ (2017) Pointnet++: deep hierarchical feature learning on point sets in a metric space In: Advances in Neural Information Processing Systems, 5099\u20135108. https:\/\/doi.org\/10.1109\/cvpr.2017.16.","DOI":"10.1109\/cvpr.2017.16"},{"key":"64_CR13","doi-asserted-by":"publisher","unstructured":"Landrieu L, Simonovsky M (2018) Large-scale point cloud semantic segmentation with superpoint graphs In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 4558\u20134567. https:\/\/doi.org\/10.1109\/cvpr.2018.00479.","DOI":"10.1109\/cvpr.2018.00479"},{"key":"64_CR14","doi-asserted-by":"publisher","unstructured":"Liu K, Boehm J (2014) A new framework for interactive segmentation of point clouds In: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences-ISPRS Archives, vol. 40, 357\u2013362. International Society for Photogrammetry and Remote Sensing. https:\/\/doi.org\/10.5194\/isprsarchives-xl-5-357-2014.","DOI":"10.5194\/isprsarchives-xl-5-357-2014"},{"key":"64_CR15","doi-asserted-by":"publisher","first-page":"88","DOI":"10.1016\/j.isprsjprs.2015.01.011","volume":"104","author":"A Vo","year":"2015","unstructured":"Vo A, Truong-Hong L, Laefer DF, Bertolotto M (2015) Octree-based region growing for point cloud segmentation. ISPRS J Photogramm Remote Sens 104:88\u2013100.","journal-title":"ISPRS J Photogramm Remote Sens"},{"key":"64_CR16","doi-asserted-by":"publisher","unstructured":"Golovinskiy A, Funkhouser T (2009) Min-cut based segmentation of point clouds In: IEEE 12th International Conference on Computer Vision Workshops, 39\u201346. https:\/\/doi.org\/10.1109\/iccvw.2009.5457721.","DOI":"10.1109\/iccvw.2009.5457721"},{"key":"64_CR17","doi-asserted-by":"publisher","unstructured":"Guinard S, Landrieu L (2017) Weakly supervised segmentation-aided classification of urban scenes from 3D lidar point clouds In: ISPRS - International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XLII-1\/W1, 151\u2013157. https:\/\/doi.org\/10.5194\/isprs-archives-xlii-1-w1-151-2017.","DOI":"10.5194\/isprs-archives-xlii-1-w1-151-2017"},{"key":"64_CR18","first-page":"3235","volume-title":"Advances in Neural Information Processing Systems","author":"A Oliver","year":"2018","unstructured":"Oliver A, Odena A, Raffel CA, Cubuk ED, Goodfellow I (2018) Realistic evaluation of deep semi-supervised learning algorithms In: Advances in Neural Information Processing Systems, 3235\u20133246.. Curran Associates, Inc, NY."},{"key":"64_CR19","unstructured":"Lee D (2013) Pseudo-label : the simple and efficient semi-supervised learning method for deep neural networks In: ICML 2013 Workshop : Challenges in Representation Learning (WREPL). Workshop on challenges in representation learning, ICML. Vol. 3. No. 2. 2013."},{"key":"64_CR20","doi-asserted-by":"publisher","unstructured":"Iscen A, Tolias G, Avrithis Y, Chum O (2019) Label propagation for deep semi-supervised learning In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 5070\u20135079. https:\/\/doi.org\/10.1109\/cvpr.2019.00521.","DOI":"10.1109\/cvpr.2019.00521"},{"key":"64_CR21","volume-title":"Semi-supervised learning","author":"O Chapelle","year":"2010","unstructured":"Chapelle O, Schlkopf B, Zien A (2010) Semi-supervised learning. 1st edn.. The MIT Press, Cambridge."},{"key":"64_CR22","doi-asserted-by":"publisher","first-page":"152","DOI":"10.1016\/j.isprsjprs.2013.11.001","volume":"87","author":"J Niemeyer","year":"2014","unstructured":"Niemeyer J, Rottensteiner F, Soergel U (2014) Contextual classification of lidar data and building object detection in urban areas. ISPRS J Photogramm Remote Sens 87:152\u2013165.","journal-title":"ISPRS J Photogramm Remote Sens"},{"key":"64_CR23","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1016\/j.isprsjprs.2017.08.010","volume":"132","author":"L Landrieu","year":"2017","unstructured":"Landrieu L, Raguet H, Vallet B, Mallet C, Weinmann M (2017) A structured regularization framework for spatially smoothing semantic labelings of 3D point clouds. ISPRS J Photogramm Remote Sens 132:102\u2013118.","journal-title":"ISPRS J Photogramm Remote Sens"},{"key":"64_CR24","doi-asserted-by":"publisher","unstructured":"Fulkerson B, Vedaldi A, Soatto S (2009) Class segmentation and object localization with superpixel neighborhoods In: IEEE 12th International Conference on Computer Vision, 670\u2013677. https:\/\/doi.org\/10.1109\/iccv.2009.5459175.","DOI":"10.1109\/iccv.2009.5459175"},{"issue":"9","key":"64_CR25","doi-asserted-by":"publisher","first-page":"1124","DOI":"10.1109\/TPAMI.2004.60","volume":"26","author":"Y Boykov","year":"2004","unstructured":"Boykov Y, Kolmogorov V (2004) An experimental comparison of min-cut\/max- flow algorithms for energy minimization in vision. IEEE Trans Pattern Anal Mach Intell 26(9):1124\u20131137.","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"11","key":"64_CR26","doi-asserted-by":"publisher","first-page":"1222","DOI":"10.1109\/34.969114","volume":"23","author":"Y Boykov","year":"2001","unstructured":"Boykov Y, Veksler O, Zabih R (2001) Fast approximate energy minimization via graph cuts. IEEE Trans Pattern Anal Mach Intell 23(11):1222\u20131239.","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"2","key":"64_CR27","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1109\/TPAMI.2004.1262177","volume":"26","author":"V Kolmogorov","year":"2004","unstructured":"Kolmogorov V, Zabin R (2004) What energy functions can be minimized via graph cuts?IEEE Trans Pattern Anal Mach Intell 26(2):147\u2013159.","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"4","key":"64_CR28","doi-asserted-by":"publisher","first-page":"1724","DOI":"10.1137\/17M1113436","volume":"10","author":"L Landrieu","year":"2017","unstructured":"Landrieu L, Obozinski G (2017) Cut pursuit: fast algorithms to learn piecewise constant functions on general weighted graphs. SIAM J Imaging Sci 10(4):1724\u20131766.","journal-title":"SIAM J Imaging Sci"}],"container-title":["IPSJ Transactions on Computer Vision and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s41074-020-00064-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s41074-020-00064-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s41074-020-00064-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,30]],"date-time":"2021-07-30T12:15:30Z","timestamp":1627647330000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s41074-020-00064-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,7,2]]},"references-count":28,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["64"],"URL":"https:\/\/doi.org\/10.1186\/s41074-020-00064-w","relation":{},"ISSN":["1882-6695"],"issn-type":[{"value":"1882-6695","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,7,2]]},"assertion":[{"value":"17 November 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 June 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 July 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"2"}}