{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T19:04:07Z","timestamp":1780513447260,"version":"3.54.1"},"reference-count":40,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2022,5,30]],"date-time":"2022-05-30T00:00:00Z","timestamp":1653868800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003662","name":"Korea Evaluation Institute of Industrial Technology (KEIT)","doi-asserted-by":"publisher","award":["20012603"],"award-info":[{"award-number":["20012603"]}],"id":[{"id":"10.13039\/501100003662","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>It is possible to construct cost-efficient three-dimensional (3D) or four-dimensional (4D) scanning systems using multiple affordable off-the-shelf RGB-D sensors to produce high-quality reconstructions of 3D objects. However, the quality of these systems\u2019 reconstructions is sensitive to a number of factors in reconstruction pipelines, such as multi-view calibration, depth estimation, 3D reconstruction, and color mapping accuracy, because the successive pipelines to reconstruct 3D meshes from multiple active stereo sensors are strongly correlated with each other. This paper categorizes the pipelines into sub-procedures and analyze various factors that can significantly affect reconstruction quality. Thus, this paper provides analytical and practical guidelines for high-quality 3D reconstructions with off-the-shelf sensors. For each sub-procedure, this paper shows comparisons and evaluations of several methods using data captured by 18 RGB-D sensors and provide analyses and discussions towards robust 3D reconstruction. Through various experiments, it has been demonstrated that significantly more accurate 3D scans can be obtained with the considerations along the pipelines. We believe our analyses, benchmarks, and guidelines will help anyone build their own studio and their further research for 3D reconstruction.<\/jats:p>","DOI":"10.3390\/s22114142","type":"journal-article","created":{"date-parts":[[2022,5,31]],"date-time":"2022-05-31T02:30:06Z","timestamp":1653964206000},"page":"4142","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Technical Consideration towards Robust 3D Reconstruction with Multi-View Active Stereo Sensors"],"prefix":"10.3390","volume":"22","author":[{"given":"Mingyu","family":"Jang","sequence":"first","affiliation":[{"name":"Department of Electrical and Electronic Engineering, Yonsei University, Seoul 03722, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1564-5077","authenticated-orcid":false,"given":"Seongmin","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronic Engineering, Yonsei University, Seoul 03722, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7622-0817","authenticated-orcid":false,"given":"Jiwoo","family":"Kang","sequence":"additional","affiliation":[{"name":"Department of IT Engineering, Sookmyung Women\u2019s University, Seoul 04310, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9895-5347","authenticated-orcid":false,"given":"Sanghoon","family":"Lee","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronic Engineering, Yonsei University, Seoul 03722, Korea"},{"name":"Department of Radiology, College of Medicine, Yonsei University, Seoul 03722, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,5,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2897824.2925969","article-title":"Fusion4D: Real-Time Perform. Capture Challenging Scenes","volume":"35","author":"Dou","year":"2016","journal-title":"ACM Trans. Graph."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2766945","article-title":"High-Qual. Streamable Free-Viewp. Video","volume":"34","author":"Collet","year":"2015","journal-title":"ACM Trans. Graph."},{"key":"ref_3","unstructured":"Nguyen, A.D., Choi, S., Kim, W., and Lee, S. (November, January 27). GraphX-convolution for point cloud deformation in 2D-to-3D conversion. Proceedings of the IEEE International Conference on Computer Vision, Seoul, Korea."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2211","DOI":"10.1109\/TCSVT.2021.3089695","article-title":"Gradient Flow Evol. 3D Fusion A Single Depth Sensor","volume":"32","author":"Kang","year":"2022","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Qu, Y., Huang, J., and Zhang, X. (2018). Rapid 3D Reconstr. Image Seq. Acquir. UAV Camera. Sensors, 18.","DOI":"10.3390\/s18010225"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Mao, A., Zhang, H., Liu, Y., Zheng, Y., Li, G., and Han, G. (2017). Easy and Fast Reconstruction of a 3D Avatar with an RGB-D Sensor. Sensors, 17.","DOI":"10.3390\/s17051113"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zhang, H., Wei, Q., and Jiang, Z. (2017). 3D Reconstruction of Space Objects from Multi-Views by a Visible Sensor. Sensors, 17.","DOI":"10.3390\/s17071689"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/MMUL.2012.24","article-title":"Microsoft kinect sensor and its effect","volume":"19","author":"Zhang","year":"2012","journal-title":"IEEE Multimed."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Keselman, L., Iselin Woodfill, J., Grunnet-Jepsen, A., and Bhowmik, A. (2017, January 21\u201326). Intel Realsense Stereoscopic Depth Cameras. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.167"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wang, C.W., and Peng, C.C. (2021). 3D Face Point Cloud Reconstruction and Recognition Using Depth Sensors. Sensors, 21.","DOI":"10.3390\/s21082587"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Luo, H., Pape, C., and Reithmeier, E. (2020). Scale-Aware Multi-View Reconstruction Using an Active Triple-Camera System. Sensors, 20.","DOI":"10.3390\/s20236726"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Paoli, A., Neri, P., Razion, A.V., Tambur, F., and Barone, S. (2020). Sensor Architectures and Technologies for Upper Limb 3D Surface Reconstruction: A Review. Sensors, 20.","DOI":"10.3390\/s20226584"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Um, D., and Lee, S. (2020). Microscopic Structure from Motion (SfM) for Microscale 3D Surface Reconstruction. Sensors, 20.","DOI":"10.3390\/s20195599"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Wang, R., Wang, X., He, D., Wang, L., and Xu, K. (2020). FCN-Based 3D Reconstruction with Multi-Source Photometric Stereo. Appl. Sci., 10.","DOI":"10.3390\/app10082914"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Li, Y., and Li, Z. (2017). A Multi-View Stereo Algorithm Based on Homogeneous Direct Spatial Expansion with Improved Reconstruction Accuracy and Completeness. Appl. Sci., 7.","DOI":"10.3390\/app7050446"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Jang, M., Yoon, H., Lee, S., Kang, J., and Lee, S. (2022). A Comparison and Evaluation of Stereo Matching on Active Stereo Images. Sensors, 22.","DOI":"10.3390\/s22093332"},{"key":"ref_17","unstructured":"Li, L. (2014). Time-of-Flight Camera\u2014An Introduction, Texas Instruments. Technical White Paper."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Konolige, K. (2010). Projected texture stereo. Proceedings of the IEEE International Conference on Robotics and Automation, IEEE.","DOI":"10.1109\/ROBOT.2010.5509796"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Jang, M., Lee, S., Kang, J., and Lee, S. (2021, January 13\u201315). Active Stereo Matching Benchmark for 3D Reconstruction using Multi-view Depths. Proceedings of the IEEE International Conference on Signal and Image Processing Applications, Online.","DOI":"10.1109\/ICSIPA52582.2021.9576787"},{"key":"ref_20","unstructured":"Grunnet-Jepsen, A., Sweetser, J.N., Winer, P., Takagi, A., and Woodfill, J. (2018). Projectors for Intel\u00ae RealSense\u2122 Depth Cameras D4xx, Intel Support, Interl Corporation."},{"key":"ref_21","unstructured":"Grunnet-Jepsen, A., Sweetser, J.N., and Woodfill, J. (2018). Best-Known Tuning Intel\u00ae RealSense\u2122 D400 Depth Cameras Best Performance, Interl Corporation."},{"key":"ref_22","unstructured":"Grunnet-Jepsen, A., and Tong, D. (2018). Depth Post-Processing for Intel\u00ae RealSense\u2122 D400 Depth Cameras, Interl Corporation. New Technology Group."},{"key":"ref_23","unstructured":"Corporation, I. (2022, April 15). Cross-Platform Library for Intel\u00ae RealSense\u2122 Depth Cameras. Available online: https:\/\/github.com\/IntelRealSense\/librealsense."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Yoon, H., Jang, M., Huh, J., Kang, J., and Lee, S. (2021). Multiple Sensor Synchronization with the RealSense RGB-D Camera. Sensors, 21.","DOI":"10.3390\/s21186276"},{"key":"ref_25","unstructured":"Bradski, G., and Kaehler, A. (2008). Learning OpenCV: Computer Vision with the OpenCV Library, O\u2019Reilly Media, Inc."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1162\/105474605774785325","article-title":"A Conv. Multicamera Self-Calibration Virtual Environ","volume":"14","author":"Svoboda","year":"2005","journal-title":"Presence: Teleoperators Virtual Environ."},{"key":"ref_28","unstructured":"Mitchelson, J., and Hilton, A. (2022, April 08). Wand-based multiple camera studio calibration. Center Vision, Speech and Signal Process Technical Report. Guildford, England. Available online: http:\/\/info.ee.surrey.ac.uk\/CVSSP\/Publications\/papers\/vssp-tr-2-2003.pdf."},{"key":"ref_29","first-page":"1331","article-title":"Multiple view geometry in computer vision","volume":"30","author":"Andrew","year":"2001","journal-title":"Kybernetes"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Zabih, R., and Woodfill, J. (1994, January 2\u20136). Non-parametric local transforms for computing visual correspondence. Proceedings of the European Conference on Computer Vision, Stockholm, Sweden.","DOI":"10.1007\/BFb0028345"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1109\/34.206955","article-title":"A multiple-baseline stereo","volume":"15","author":"Okutomi","year":"1993","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_32","first-page":"807","article-title":"Robust Stereo Matching Using Adaptive Normalized Cross-Correlation","volume":"33","author":"Heo","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1007\/BF00133032","article-title":"Kalman filter-based algorithms for estimating depth from image sequences","volume":"3","author":"Matthies","year":"1989","journal-title":"Int. J. Comput. Vis."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Xu, H., and Zhang, J. (2020, January 13\u201319). Aanet: Adaptive aggregation network for efficient stereo matching. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00203"},{"key":"ref_35","unstructured":"Duggal, S., Wang, S., Ma, W.C., Hu, R., and Urtasun, R. (November, January 27). Deeppruner: Learning efficient stereo matching via differentiable patchmatch. Proceedings of the IEEE International Conference on Computer Vision, Seoul, Korea."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Dai, J., Qi, H., Xiong, Y., Li, Y., Zhang, G., Hu, H., and Wei, Y. (2017, January 22\u201329). Deformable convolutional networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.89"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zhu, X., Hu, H., Lin, S., and Dai, J. (2019, January 16\u201317). Deformable convnets v2: More deformable, better results. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00953"},{"key":"ref_38","unstructured":"Kazhdan, M., Bolitho, M., and Hoppe, H. (2006, January 26\u201328). Poisson Surface Reconstruction. Proceedings of the Eurographics Symposium on Geometry Processing, Cagliari, Italy."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Akenine-M\u00f6ller, T., Haines, E., and Hoffman, N. (2019). Real-Time Rendering, CRC Press.","DOI":"10.1201\/9781315365459"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2858","DOI":"10.1109\/TSMC.2021.3054677","article-title":"Competitive Learning of Facial Fitting and Synthesis Using UV Energy","volume":"52","author":"Kang","year":"2022","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/11\/4142\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:21:51Z","timestamp":1760138511000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/11\/4142"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,30]]},"references-count":40,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2022,6]]}},"alternative-id":["s22114142"],"URL":"https:\/\/doi.org\/10.3390\/s22114142","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,30]]}}}