{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T16:18:22Z","timestamp":1782317902764,"version":"3.54.5"},"reference-count":41,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2022,3,26]],"date-time":"2022-03-26T00:00:00Z","timestamp":1648252800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["61972351"],"award-info":[{"award-number":["61972351"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"National Key Research and Development Program of China","award":["2018YFC0824406"],"award-info":[{"award-number":["2018YFC0824406"]}]},{"DOI":"10.13039\/501100004731","name":"Natural Science Foundation of Zhejiang Province","doi-asserted-by":"crossref","award":["LY19F030005"],"award-info":[{"award-number":["LY19F030005"]}],"id":[{"id":"10.13039\/501100004731","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Public Welfare Technology Research Project of Zhejiang Province","award":["LGF19G010002, LGF20G010002 and LGG20F020005"],"award-info":[{"award-number":["LGF19G010002, LGF20G010002 and LGG20F020005"]}]},{"DOI":"10.13039\/501100017599","name":"Science and Technology Program of Zhejiang Province","doi-asserted-by":"crossref","award":["2021C01120"],"award-info":[{"award-number":["2021C01120"]}],"id":[{"id":"10.13039\/501100017599","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Opening Foundation of State Key Laboratory of Virtual Reality Technology and System of Beihang University","award":["VRLAB2020B15"],"award-info":[{"award-number":["VRLAB2020B15"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Multimedia Comput. Commun. Appl."],"published-print":{"date-parts":[[2022,11,30]]},"abstract":"<jats:p>Digital dentistry has received more attention in the past decade. However, current deep learning-based methods still encounter difficult challenges. The proposal-based methods are sensitive to the localization results due to the lack of local cues, while the proposal-free methods have poor clustering outputs because of the affinity measured by the low-level characteristics, especially in situations of tightly arranged teeth. In this article, we present a novel proposal-based approach to combine objectness and pointwise knowledge in an attention mechanism for point cloud-based tooth instance segmentation, using local information to improve 3D proposal generation and measuring the importance of local points by calculating the center distance. We evaluate the performance of our approach by constructing a Shining3D tooth instance segmentation dataset. The experimental results verify that our approach gives competitive results when compared with the other available approaches.<\/jats:p>","DOI":"10.1145\/3504033","type":"journal-article","created":{"date-parts":[[2022,3,26]],"date-time":"2022-03-26T10:11:06Z","timestamp":1648289466000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":45,"title":["3D Tooth Instance Segmentation Learning Objectness and Affinity in Point Cloud"],"prefix":"10.1145","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0596-1209","authenticated-orcid":false,"given":"Yan","family":"Tian","sequence":"first","affiliation":[{"name":"School of Computer Science and Information Engineering, Zhejiang Gongshang University, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yujie","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Information Engineering, Zhejiang Gongshang University, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wei-Gang","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Computer Science and Information Engineering, Zhejiang Gongshang University, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dongsheng","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Computer Science and Information Engineering, Zhejiang Gongshang University, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huiyan","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer Science and Information Engineering, Zhejiang Gongshang University, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huayi","family":"Xu","sequence":"additional","affiliation":[{"name":"Shining3D Tech Co., Ltd., Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jianfeng","family":"Han","sequence":"additional","affiliation":[{"name":"Zhejiang Xinwangzhen Tech Inc., Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yiwen","family":"Ge","sequence":"additional","affiliation":[{"name":"School of Computer Science, University of Birmingham, Birmingham, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,3,26]]},"reference":[{"key":"e_1_3_1_2_1","first-page":"68","volume-title":"ECCV","author":"Chen Qi","year":"2020","unstructured":"Qi Chen, Lin Sun, Zhixin Wang, Kui Jia, and Alan Yuille. 2020. Object as hotspots: An anchor-free 3D object detection approach via firing of hotspots. In ECCV. 68\u201384."},{"key":"e_1_3_1_3_1","first-page":"1368","volume-title":"ICCV","author":"Chen Shaoyu","year":"2021","unstructured":"Shaoyu Chen, Jiemin Fang, Qian Zhang, Wenyu Liu, and Xinggang Wang. 2021. Hierarchical aggregation for 3D instance segmentation. In ICCV. 1368\u20131377."},{"key":"e_1_3_1_4_1","first-page":"9775","volume-title":"ICCV","author":"Chen Yilun","year":"2019","unstructured":"Yilun Chen, Shu Liu, Xiaoyong Shen, and Jiaya Jia. 2019. Fast point r-cnn. In ICCV. 9775\u20139784."},{"key":"e_1_3_1_5_1","first-page":"424","volume-title":"MICCAI","author":"\u00c7i\u00e7ek \u00d6zg\u00fcn","year":"2016","unstructured":"\u00d6zg\u00fcn \u00c7i\u00e7ek, Ahmed Abdulkadir, Soeren S. Lienkamp, Thomas Brox, and Olaf Ronneberger. 2016. 3D U-Net: Learning dense volumetric segmentation from sparse annotation. In MICCAI. 424\u2013432."},{"key":"e_1_3_1_6_1","first-page":"6368","volume-title":"CVPR","author":"Cui Zhiming","year":"2019","unstructured":"Zhiming Cui, Changjian Li, and Wenping Wang. 2019. ToothNet: Automatic tooth instance segmentation and identification from cone beam CT images. In CVPR. 6368\u20136377."},{"key":"e_1_3_1_7_1","first-page":"6868","volume-title":"ICRA","author":"Du Liang","year":"2020","unstructured":"Liang Du, Jingang Tan, Xiangyang Xue, Lili Chen, Hongkai Wen, Jianfeng Feng, Jiamao Li, and Xiaolin Zhang. 2020. 3DCFS: Fast and robust joint 3D semantic-instance segmentation via coupled feature selection. In ICRA. 6868\u20136875."},{"key":"e_1_3_1_8_1","first-page":"9031","volume-title":"CVPR","author":"Engelmann Francis","year":"2020","unstructured":"Francis Engelmann, Martin Bokeloh, Alireza Fathi, Bastian Leibe, and Matthias Niessner. 2020. 3D-MPA: Multi proposal aggregation for 3D semantic instance segmentation. In CVPR. 9031\u20139040."},{"key":"e_1_3_1_9_1","first-page":"9224","volume-title":"CVPR","author":"Graham Benjamin","year":"2018","unstructured":"Benjamin Graham, Martin Engelcke, and Laurens Van Der Maaten. 2018. 3d semantic segmentation with submanifold sparse convolutional networks. In CVPR. 9224\u20139232."},{"key":"e_1_3_1_10_1","first-page":"2940","volume-title":"CVPR","author":"Han Lei","year":"2020","unstructured":"Lei Han, Tian Zheng, Lan Xu, and Lu Fang. 2020. OccuSeg: Occupancy-aware 3D instance segmentation. In CVPR. 2940\u20132949."},{"key":"e_1_3_1_11_1","first-page":"11873","volume-title":"CVPR","author":"He Chenhang","year":"2020","unstructured":"Chenhang He, Hui Zeng, Jianqiang Huang, Xian-Sheng Hua, and Lei Zhang. 2020a. Structure aware single-stage 3D object detection from point cloud. In CVPR. 11873\u201311882."},{"key":"e_1_3_1_12_1","first-page":"564","volume-title":"ECCV","author":"He Tong","year":"2020","unstructured":"Tong He, Dong Gong, Zhi Tian, and Chunhua Shen. 2020b. Learning and memorizing representative prototypes for 3D point cloud semantic and instance segmentation. In ECCV. 564\u2013580."},{"key":"e_1_3_1_13_1","first-page":"354","volume-title":"CVPR","author":"He Tong","year":"2021","unstructured":"Tong He, Chunhua Shen, and Anton van den Hengel. 2021. DyCo3D: Robust instance segmentation of 3D point clouds through dynamic convolution. In CVPR. 354\u2013363."},{"key":"e_1_3_1_14_1","first-page":"4421","volume-title":"CVPR","author":"Hou Ji","year":"2019","unstructured":"Ji Hou, Angela Dai, and Matthias Nie\u00dfner. 2019. 3D-SIS: 3D semantic instance segmentation of rgb-d scans. In CVPR. 4421\u20134430."},{"key":"e_1_3_1_15_1","first-page":"4867","volume-title":"CVPR","author":"Jiang Li","year":"2020","unstructured":"Li Jiang, Hengshuang Zhao, Shaoshuai Shi, Shu Liu, Chi-Wing Fu, Jiaya Jia. 2020. PointGroup: Dual-Set point grouping for 3D instance segmentation. In CVPR. 4867\u20134876."},{"key":"e_1_3_1_16_1","first-page":"9256","volume-title":"ICCV","author":"Lahoud Jean","year":"2019","unstructured":"Jean Lahoud, Bernard Ghanem, Marc Pollefeys, and Martin R. Oswald. 2019. 3D instance segmentation via multi-task metric learning. In ICCV. 9256\u20139266."},{"key":"e_1_3_1_17_1","first-page":"1256","volume-title":"ICCV","author":"Liang Zhihao","year":"2021","unstructured":"Zhihao Liang, Zhihao Li, Songcen Xu, Mingkui Tan, and Kui Jia. 2021. Instance segmentation in 3D scenes using semantic superpoint tree networks. In ICCV. 1256\u20131266."},{"key":"e_1_3_1_18_1","article-title":"MASC: Multi-scale affinity with sparse convolution for 3d instance segmentation","author":"Liu Chen","year":"2019","unstructured":"Chen Liu and Yasutaka Furukawa. 2019. MASC: Multi-scale affinity with sparse convolution for 3d instance segmentation. arXiv preprint arXiv:1902.04478 (2019).","journal-title":"arXiv preprint arXiv:1902.04478"},{"key":"e_1_3_1_19_1","unstructured":"Nali Liu. 2020. Shining3d Dental Dataset. (2020). https:\/\/drive.google.com\/drive\/folders\/1fx9_KVEugZxbO3aTdwdfVTGf87_9FoLx?usp=sharing."},{"key":"e_1_3_1_20_1","first-page":"965","volume-title":"NeurIPS","author":"Liu Zhijian","year":"2019","unstructured":"Zhijian Liu, Haotian Tang, Yujun Lin, and Song Han. 2019. Point-Voxel CNN for efficient 3D deep learning. In NeurIPS. 965\u2013975."},{"key":"e_1_3_1_21_1","first-page":"8026","volume-title":"NeurIPS","author":"Paszke Adam","year":"2019","unstructured":"Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. Pytorch: An imperative style, high-performance deep learning library. In NeurIPS. 8026\u20138037."},{"key":"e_1_3_1_22_1","first-page":"8827","volume-title":"CVPR","author":"Pham Quang-Hieu","year":"2019","unstructured":"Quang-Hieu Pham, Thanh Nguyen, Binh-Son Hua, Gemma Roig, and Sai-Kit Yeung. 2019. JSIS3D: Joint semantic-instance segmentation of 3D point clouds with multi-task pointwise networks and multi-value conditional random fields. In CVPR. 8827\u20138836."},{"key":"e_1_3_1_23_1","first-page":"9277","volume-title":"ICCV","author":"Qi Charles R.","year":"2019","unstructured":"Charles R. Qi, Or Litany, Kaiming He, and Leonidas J. Guibas. 2019. Deep Hough voting for 3d object detection in point clouds. In ICCV. 9277\u20139286."},{"key":"e_1_3_1_24_1","first-page":"652","volume-title":"CVPR","author":"Qi Charles R.","year":"2017","unstructured":"Charles R. Qi, Or Litany, Kaiming He, and Leonidas J. Guibas. 2017a. Pointnet: Deep learning on point sets for 3D classification and segmentation. In CVPR. 652\u2013660."},{"key":"e_1_3_1_25_1","first-page":"5099","volume-title":"NeurIPS","author":"Qi Charles Ruizhongtai","year":"2017","unstructured":"Charles Ruizhongtai Qi, Li Yi, Hao Su, and Leonidas J. Guibas. 2017b. Pointnet++: Deep hierarchical feature learning on point sets in a metric space. In NeurIPS. 5099\u20135108."},{"key":"e_1_3_1_26_1","first-page":"10529","volume-title":"CVPR","author":"Shi Shaoshuai","year":"2020","unstructured":"Shaoshuai Shi, Chaoxu Guo, and Li Jiang. 2020. PV-RCNN: Point-voxel feature set abstraction for 3d object detection. In CVPR. 10529\u201310538."},{"key":"e_1_3_1_27_1","first-page":"770","volume-title":"CVPR","author":"Shi Shaoshuai","year":"2019","unstructured":"Shaoshuai Shi, Xiaogang Wang, and Hongsheng Li. 2019. POINTRCNN: 3D object proposal generation and detection from point cloud. In CVPR. 770\u2013779."},{"issue":"12","key":"e_1_3_1_28_1","first-page":"1","article-title":"Global context assisted structure-aware vehicle retrieval","volume":"22","author":"Tian Yan","year":"2021","unstructured":"Yan Tian, Tao Chen, Guohua Cheng, Shihao Yu, Xi Li, Jianyuan Li, and Bailin Yang. 2021. Global context assisted structure-aware vehicle retrieval. TITS 22, 12 (2021), 1\u201310.","journal-title":"TITS"},{"key":"e_1_3_1_29_1","first-page":"107158","article-title":"Joint temporal context exploitation and active learning for video segmentation","volume":"100","author":"Tian Yan","year":"2020","unstructured":"Yan Tian, Guohua Cheng, Judith Gelernter, Shihao Yu, Chao Song, and Bailin Yang. 2020a. Joint temporal context exploitation and active learning for video segmentation. PR 100 (2020), 107158.","journal-title":"PR"},{"issue":"12","key":"e_1_3_1_30_1","first-page":"4466","article-title":"Traffic sign detection using a multi-scale recurrent attention network","volume":"20","author":"Tian Yan","year":"2019","unstructured":"Yan Tian, Judith Gelernter, Xun Wang, Jianyuan Li, and Yizhou Yu. 2019a. Traffic sign detection using a multi-scale recurrent attention network. TITS 20, 12 (2019), 4466\u20134475.","journal-title":"TITS"},{"key":"e_1_3_1_31_1","doi-asserted-by":"publisher","DOI":"10.1613\/jair.1.11338"},{"key":"e_1_3_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2018.08.067"},{"key":"e_1_3_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2020.07.078"},{"key":"e_1_3_1_34_1","first-page":"2569","volume-title":"CVPR","author":"Wang Weiyue","year":"2018","unstructured":"Weiyue Wang, Ronald Yu, Qiangui Huang, and Ulrich Neumann. 2018. SGPN: Similarity group proposal network for 3D point cloud instance segmentation. In CVPR. 2569\u20132578."},{"key":"e_1_3_1_35_1","first-page":"4096","volume-title":"CVPR","author":"Wang Xinlong","year":"2019","unstructured":"Xinlong Wang, Shu Liu, Xiaoyong Shen, Chunhua Shen, and Jiaya Jia. 2019. Associatively segmenting instances and semantics in point clouds. In CVPR. 4096\u20134105."},{"key":"e_1_3_1_36_1","first-page":"1096","volume-title":"ACCV","author":"Wu Guangnan","year":"2020","unstructured":"Guangnan Wu, Zhiyi Pan, Peng Jiang, and Changhe Tu. 2020. Bi-directional attention for joint instance and semantic segmentation in point clouds. In ACCV. 1096\u20131105."},{"key":"e_1_3_1_37_1","first-page":"6737","volume-title":"NeurIPS","author":"Yang Bo","year":"2019","unstructured":"Bo Yang, Jianan Wang, Ronald Clark, Qingyong Hu, Sen Wang, Andrew Markham, and Niki Trigoni. 2019a. Learning object bounding boxes for 3D instance segmentation on point clouds. In NeurIPS. 6737\u20136746."},{"key":"e_1_3_1_38_1","first-page":"1951","volume-title":"ICCV","author":"Yang Zetong","year":"2019","unstructured":"Zetong Yang, Yanan Sun, Shu Liu, Xiaoyong Shen, and Jiaya Jia. 2019b. STD: Sparse-to-dense 3d object detector for point cloud. In ICCV. 1951\u20131960."},{"key":"e_1_3_1_39_1","first-page":"3947","volume-title":"CVPR","author":"Yi Li","year":"2019","unstructured":"Li Yi, Wang Zhao, He Wang, Minhyuk Sung, and Leonidas J. Guibas. 2019. GSPN: Generative shape proposal network for 3d instance segmentation in point cloud. In CVPR. 3947\u20133956."},{"key":"e_1_3_1_40_1","first-page":"8883","volume-title":"CVPR","author":"Zhang Biao","year":"2021","unstructured":"Biao Zhang and Peter Wonka. 2021. Point cloud instance segmentation using probabilistic embeddings. In CVPR. 8883\u20138892."},{"key":"e_1_3_1_41_1","first-page":"12951","volume-title":"AAAI","author":"Zhao Lin","year":"2020","unstructured":"Lin Zhao and Wenbing Tao. 2020. JSNet: Joint instance and semantic segmentation of 3D point clouds. In AAAI. 12951\u201312958."},{"key":"e_1_3_1_42_1","first-page":"4490","volume-title":"CVPR","author":"Zhou Yin","year":"2018","unstructured":"Yin Zhou and Oncel Tuzel. 2018. Voxelnet: End-to-end learning for point cloud based 3D object detection. In CVPR. 4490\u20134499."}],"container-title":["ACM Transactions on Multimedia Computing, Communications, and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3504033","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3504033","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T17:45:06Z","timestamp":1750268706000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3504033"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,26]]},"references-count":41,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,11,30]]}},"alternative-id":["10.1145\/3504033"],"URL":"https:\/\/doi.org\/10.1145\/3504033","relation":{},"ISSN":["1551-6857","1551-6865"],"issn-type":[{"value":"1551-6857","type":"print"},{"value":"1551-6865","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,26]]},"assertion":[{"value":"2021-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-03-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}