{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,10]],"date-time":"2026-08-10T15:30:52Z","timestamp":1786375852606,"version":"build-2736575974"},"reference-count":27,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T00:00:00Z","timestamp":1786060800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002241","name":"Japan Science and Technology Agency","doi-asserted-by":"publisher","award":["JPMJSP2109"],"award-info":[{"award-number":["JPMJSP2109"]}],"id":[{"id":"10.13039\/501100002241","id-type":"DOI","asserted-by":"publisher"}]},{"award":["JPMJSP2109"],"award-info":[{"award-number":["JPMJSP2109"]}],"id":[{"id":"https:\/\/ror.org\/00097mb19","id-type":"ROR","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["JP22H01439"],"award-info":[{"award-number":["JP22H01439"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]},{"award":["JP22H01439"],"award-info":[{"award-number":["JP22H01439"]}],"id":[{"id":"https:\/\/ror.org\/00hhkn466","id-type":"ROR","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Object-level point cloud extraction is relevant to robotic perception and may provide useful object-centric observations for mapping and SLAM. Many existing methods rely on per-frame instance segmentation, resulting in high computational cost and limited ability to extract multiple objects simultaneously in multi-object scenarios. This paper proposes an efficient MOT-assisted pipeline for multi-view object point cloud extraction. The pipeline first employs 2D multi-object tracking (MOT) to establish consistent object correspondences across views, and then combines monocular depth-based reconstruction with multi-view geometric association to estimate coarse object locations. An adaptive spherical proposal and a density-based refinement strategy are further introduced to extract clean object-specific point clouds while suppressing background noise and outliers. Experiments on the DTU, MVImgNet, and ScanNet++ datasets demonstrate the effectiveness of the proposed method. Relative to the unprocessed scene-level point cloud, the Chamfer Distance is reduced from 90.97 mm to 12.52 mm and Precision increases from 0.2998 to 0.8776 on DTU dataset Sequence 30. On MVImgNet, the Chamfer Distance decreases from 1.23 m to 0.46 m and Precision increases from 0.4777 to 0.9337, demonstrating effective removal of non-target scene points under real-world viewing conditions. Moreover, the proposed method reduces the cost of object-level association and provides competitive object-level extraction quality under the tested settings. Compared with the closely matched segmentation-based extraction, the proposed method provides lower measured object extraction runtime and built-in cross-view Track-ID association, while sacrificing some boundary accuracy.<\/jats:p>","DOI":"10.3390\/s26165032","type":"journal-article","created":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T16:00:43Z","timestamp":1786118443000},"page":"5032","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["MOT-Assisted Object-Level Point Cloud Extraction from Multi-View Observations"],"prefix":"10.3390","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-3538-7208","authenticated-orcid":false,"given":"Cheng","family":"Ju","sequence":"first","affiliation":[{"name":"Graduate School of Engineering, Chiba University, 1-33 Yayoicho, Inage-ku, Chiba 263-8522, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-9646-1125","authenticated-orcid":false,"given":"Zejing","family":"Zhao","sequence":"additional","affiliation":[{"name":"Graduate School of Engineering, Chiba University, 1-33 Yayoicho, Inage-ku, Chiba 263-8522, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5530-5405","authenticated-orcid":false,"given":"Chaowen","family":"Shen","sequence":"additional","affiliation":[{"name":"Graduate School of Engineering, Chiba University, 1-33 Yayoicho, Inage-ku, Chiba 263-8522, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-5330-9490","authenticated-orcid":false,"given":"Xuantong","family":"Li","sequence":"additional","affiliation":[{"name":"Graduate School of Engineering, Chiba University, 1-33 Yayoicho, Inage-ku, Chiba 263-8522, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3181-0818","authenticated-orcid":false,"given":"Akio","family":"Namiki","sequence":"additional","affiliation":[{"name":"Graduate School of Engineering, Chiba University, 1-33 Yayoicho, Inage-ku, Chiba 263-8522, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,8,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Oka, T., Komura, N., and Namiki, A. (2017). Ball juggling robot system controlled by high-speed vision. Proceedings of the 2017 IEEE International Conference on Cyborg and Bionic Systems (CBS), IEEE.","DOI":"10.1109\/CBS.2017.8266074"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Sato, M., Takahashi, A., and Namiki, A. (2020). High-speed catching by multi-vision robot hand. Proceedings of the 2020 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE.","DOI":"10.1109\/IROS45743.2020.9340968"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Lai, T. (2022). A review on visual-slam: Advancements from geometric modelling to learning-based semantic scene understanding using multi-modal sensor fusion. Sensors, 22.","DOI":"10.3390\/s22197265"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Rodr\u00edguez-Mart\u00ednez, E.A., Flores-Fuentes, W., Achakir, F., Sergiyenko, O., and Murrieta-Rico, F.N. (2025). Vision-based navigation and perception for autonomous robots: Sensors, SLAM, control strategies, and cross-domain applications\u2014A review. Eng, 6.","DOI":"10.3390\/eng6070153"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1109\/CVPR.2006.19","article-title":"A comparison and evaluation of multi-view stereo reconstruction algorithms","volume":"Volume 1","author":"Seitz","year":"2006","journal-title":"Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201906)"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Schonberger, J.L., and Frahm, J.M. (2016). Structure-from-motion revisited. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR.2016.445"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Sch\u00f6nberger, J.L., Zheng, E., Frahm, J.M., and Pollefeys, M. (2016). Pixelwise view selection for unstructured multi-view stereo. Proceedings of the European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-319-46487-9_31"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Chen, A., Xu, Z., Zhao, F., Zhang, X., Xiang, F., Yu, J., and Su, H. (2021). Mvsnerf: Fast generalizable radiance field reconstruction from multi-view stereo. Proceedings of the IEEE\/CVF International Conference on Computer Vision, IEEE.","DOI":"10.1109\/ICCV48922.2021.01386"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"11708","DOI":"10.1109\/TPAMI.2025.3598711","article-title":"Explicit correspondence matching for generalizable neural radiance fields","volume":"47","author":"Chen","year":"2025","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Gu\u00e9don, A., and Lepetit, V. (2024). Sugar: Surface-aligned gaussian splatting for efficient 3d mesh reconstruction and high-quality mesh rendering. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR52733.2024.00512"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Chen, Y., Xu, H., Zheng, C., Zhuang, B., Pollefeys, M., Geiger, A., Cham, T.J., and Cai, J. (2024). Mvsplat: Efficient 3d gaussian splatting from sparse multi-view images. Proceedings of the European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-031-72664-4_21"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Bewley, A., Ge, Z., Ott, L., Ramos, F., and Upcroft, B. (2016). Simple online and realtime tracking. Proceedings of the 2016 IEEE International Conference on Image Processing (ICIP), IEEE.","DOI":"10.1109\/ICIP.2016.7533003"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1115\/1.3662552","article-title":"A new approach to linear filtering and prediction problems","volume":"82","author":"Kalman","year":"1960","journal-title":"J. Basic Eng. Mar."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Wojke, N., Bewley, A., and Paulus, D. (2017). Simple Online and Realtime Tracking with a Deep Association Metric. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP), IEEE.","DOI":"10.1109\/ICIP.2017.8296962"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Sun, P., Jiang, Y., Yu, D., Weng, F., Yuan, Z., Luo, P., Liu, W., and Wang, X. (2022). Bytetrack: Multi-object tracking by associating every detection box. Proceedings of the European Conference on Computer Vision, Springer.","DOI":"10.1007\/978-3-031-20047-2_1"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Cao, J., Pang, J., Weng, X., Khirodkar, R., and Kitani, K. (2023). Observation-Centric SORT: Rethinking SORT for Robust Multi-Object Tracking. Proceedings of the 2023 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.","DOI":"10.1109\/CVPR52729.2023.00934"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ren, H., Han, S., Ding, H., Zhang, Z., Wang, H., and Wang, F. (2023). Focus on details: Online multi-object tracking with diverse fine-grained representation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, IEEE.","DOI":"10.1109\/CVPR52729.2023.01086"},{"key":"ref_18","first-page":"5740","article-title":"Smiletrack: Similarity learning for occlusion-aware multiple object tracking","volume":"38","author":"Wang","year":"2024","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Shim, K., Ko, K., Yang, Y., and Kim, C. (2025). Focusing on Tracks for Online Multi-Object Tracking. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.","DOI":"10.1109\/CVPR52734.2025.01091"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Weng, X., Wang, J., Held, D., and Kitani, K. (2020). AB3DMOT: A Baseline for 3D Multi-Object Tracking and New Evaluation Metrics. arXiv.","DOI":"10.1109\/IROS45743.2020.9341164"},{"key":"ref_21","first-page":"1179","article-title":"Mgtanet: Encoding sequential lidar points using long short-term motion-guided temporal attention for 3d object detection","volume":"37","author":"Koh","year":"2023","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1007\/s11263-016-0902-9","article-title":"Large-Scale Data for Multiple-View Stereopsis","volume":"120","author":"Jensen","year":"2016","journal-title":"Int. J. Comput. Vis."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Yu, X., Xu, M., Zhang, Y., Liu, H., Ye, C., Wu, Y., Yan, Z., Liang, T., Chen, G., and Cui, S. (2023). MVImgNet: A Large-scale Dataset of Multi-view Images. Proceedings of the 2023 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.","DOI":"10.1109\/CVPR52729.2023.00883"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Yeshwanth, C., Liu, Y.C., Nie\u00dfner, M., and Dai, A. (2023). Scannet++: A high-fidelity dataset of 3D indoor scenes. Proceedings of the IEEE\/CVF International Conference on Computer Vision, IEEE.","DOI":"10.1109\/ICCV51070.2023.00008"},{"key":"ref_25","unstructured":"Lin, H., Chen, S., Liew, J., Chen, D.Y., Li, Z., Shi, G., Feng, J., and Kang, B. (2025). Depth Anything 3: Recovering the Visual Space from Any Views. arXiv."},{"key":"ref_26","unstructured":"Jocher, G., Qiu, J., Liu, M., Lyu, S., Akyon, F.C., and Kalfaoglu, M.E. (2026). Ultralytics YOLO26: Unified Real-Time End-to-End Vision Models. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Maire, M., Belongie, S., Bourdev, L., Girshick, R., Hays, J., Perona, P., Ramanan, D., Zitnick, C.L., and Doll\u00e1r, P. (2015). Microsoft COCO: Common Objects in Context. arXiv.","DOI":"10.1007\/978-3-319-10602-1_48"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/16\/5032\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,10]],"date-time":"2026-08-10T15:10:50Z","timestamp":1786374650000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/26\/16\/5032"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,7]]},"references-count":27,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2026,8]]}},"alternative-id":["s26165032"],"URL":"https:\/\/doi.org\/10.3390\/s26165032","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,7]]}}}