{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,30]],"date-time":"2026-01-30T02:44:55Z","timestamp":1769741095282,"version":"3.49.0"},"reference-count":27,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2020,2,17]],"date-time":"2020-02-17T00:00:00Z","timestamp":1581897600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Structured light (SL) has a trade-off between acquisition time and spatial resolution. Temporally coded SL can produce a 3D reconstruction with high density, yet it is not applicable to dynamic reconstruction. On the contrary, spatially coded SL works with a single shot, but it can only achieve sparse reconstruction. This paper aims to achieve accurate 3D dense and dynamic reconstruction at the same time. A speckle-based SL sensor is presented, which consists of two cameras and a diffractive optical element (DOE) projector. The two cameras record images synchronously. First, a speckle pattern was elaborately designed and projected. Second, a high-accuracy calibration method was proposed to calibrate the system; meanwhile, the stereo images were accurately aligned by developing an optimized epipolar rectification algorithm. Then, an improved semi-global matching (SGM) algorithm was proposed to improve the correctness of the stereo matching, through which a high-quality depth map was achieved. Finally, dense point clouds could be recovered from the depth map. The DOE projector was designed with a size of 8 mm \u00d7 8 mm. The baseline between stereo cameras was controlled to be below 50 mm. Experimental results validated the effectiveness of the proposed algorithm. Compared with some other single-shot 3D systems, our system displayed a better performance. At close range, such as 0.4 m, our system could achieve submillimeter accuracy.<\/jats:p>","DOI":"10.3390\/s20041094","type":"journal-article","created":{"date-parts":[[2020,2,20]],"date-time":"2020-02-20T03:20:03Z","timestamp":1582168803000},"page":"1094","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":36,"title":["Single-Shot Structured Light Sensor for 3D Dense and Dynamic Reconstruction"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4245-1494","authenticated-orcid":false,"given":"Feifei","family":"Gu","sequence":"first","affiliation":[{"name":"Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China"},{"name":"Mechanical and Automation Engineering Department, The Chinese University of Hong Kong, Hong Kong, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3585-6522","authenticated-orcid":false,"given":"Zhan","family":"Song","sequence":"additional","affiliation":[{"name":"Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China"},{"name":"Mechanical and Automation Engineering Department, The Chinese University of Hong Kong, Hong Kong, China"}]},{"given":"Zilong","family":"Zhao","sequence":"additional","affiliation":[{"name":"Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China"}]}],"member":"1968","published-online":{"date-parts":[[2020,2,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Tang, S.J., Zhang, Y.J., Li, Y., Yuan, Z.L., Wang, Y.K., Zhang, X., Li, X.M., Zhang, Y.T., Guo, R.Z., and Wang, W.X. (2019). Fast and Automatic Reconstruction of Semantically Rich 3D Indoor Maps from Low-quality RGB-D Sequences. Sensors, 19.","DOI":"10.3390\/s19030533"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Perez, L., Rodriguez, I., Rodriguez, N., Usamentiaga, R., and Garcia, D.F. (2016). Robot Guidance Using Machine Vision Techniques in Industrial Environments: A Comparative Review. Sensors, 16.","DOI":"10.3390\/s16030335"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Park, J., Kim, H., Tai, Y.W., Brown, M.S., and Kweon, I. (2011, January 6\u201313). High Quality Depth Map Upsampling for 3d-tof Cameras. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126423"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"27758","DOI":"10.1364\/OE.25.027758","article-title":"Design Tool for TOF and SL Based 3D Cameras","volume":"25","author":"Bouquet","year":"2017","journal-title":"Opt. Express"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Khamis, S., Fanello, S., Rhemann, C., Kowdle, A., Valentin, J., and Izadi, S. (2018, January 8\u201314). Stereonet: Guided Hierarchical Refinement for Real-time Edge-aware Depth Prediction. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01267-0_35"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1007\/s11554-012-0313-2","article-title":"Review of Stereo Vision Algorithms and Their Suitability for Resource-limited Systems","volume":"11","author":"Tippetts","year":"2016","journal-title":"J. Real-Time Image Process."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1016\/j.optlaseng.2017.04.008","article-title":"Robust Pattern Decoding in Shape-coded Structured Light","volume":"96","author":"Tang","year":"2017","journal-title":"Opt. Lasers Eng."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1016\/j.optlaseng.2016.01.011","article-title":"Real-time Structured Light Profilometry: A Review","volume":"87","author":"Dirckx","year":"2016","journal-title":"Opt. Lasers Eng."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhang, C., Huang, T., and Zhao, Q. (2019). A New Model of RGB-D Camera Calibration Based on 3D Control Field. Sensors, 19.","DOI":"10.3390\/s19235082"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wei, Z., and Zhao, K. (2016). Structural Parameters Calibration for Binocular Stereo Vision Sensors Using a Double-Sphere Target. Sensors, 16.","DOI":"10.3390\/s16071074"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2666","DOI":"10.1016\/j.patcog.2010.03.004","article-title":"A State of the Art in Structured Light Patterns for Surface Profilometry","volume":"43","author":"Salvi","year":"2010","journal-title":"Pattern Recognit."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Cheng, X., Liu, X.J., Li, Z.W., Zhong, K., Han, L.Y., He, W.T., Gan, W.B., Xi, G.Q., Wang, C.J., and Shi, Y.S. (2019). High-Accuracy Globally Consistent Surface Reconstruction Using Fringe Projection Profilometry. Sensors, 19.","DOI":"10.3390\/s19030668"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Kovalenko, O., Golyanik, V., Malik, J., Elhayek, A., and Stricker, D. (2019). Structure from Articulated Motion: Accurate and Stable Monocular 3D Reconstruction without Training Data. Sensors, 19.","DOI":"10.3390\/s19204603"},{"key":"ref_14","unstructured":"Bloom, D.M., and Leone, M.A. (2016). Grayscale Patterns From Binary Spatial Light Modulators. (No. 9,316,826), U.S. Patent."},{"key":"ref_15","unstructured":"Yamazaki, S., Nukada, A., and Mochimaru, M. (September, January 29). Hamming Color Code for Dense and Robust One-shot 3D Scanning. Proceedings of the British Machine Vision Conference, Dundee, UK."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Lei, Y., Bengtson, K.R., Li, L., and Allebach, J.P. (2013, January 15\u201318). Design and Decoding of an M-array Pattern for Low-cost Structured Light 3D Reconstruction Systems. Proceedings of the 2013 IEEE International Conference on Image Processing, Melbourne, Australia.","DOI":"10.1109\/ICIP.2013.6738447"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Bleyer, M., and Breiteneder, C. (2013). Stereo Matching\u2014State-of-the-Art and Research Challenges. Adv. Top. Comput. Vis., 143\u2013179.","DOI":"10.1007\/978-1-4471-5520-1_6"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Hirschmuller, H., and Scharstein, D. (2007, January 17\u201322). Evaluation of Cost Functions for Stereo Matching. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383248"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1109\/TIP.2000.826791","article-title":"A New Diamond Search Algorithm for Fast Block-Matching Motion Estimation","volume":"9","author":"Zhu","year":"2000","journal-title":"IEEE Trans. Image Process."},{"key":"ref_20","unstructured":"Bleyer, M., Rhemann, C., and Rother, C. (September, January 29). PatchMatch Stereo-Stereo Matching with Slanted Support Windows. Proceedings of the British Machine Vision Conference, Dundee, UK."},{"key":"ref_21","unstructured":"Yang, Q. (2012, January 16\u201321). A Non-Local Cost Aggregation Method for Stereo Matching. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"834","DOI":"10.1109\/TPAMI.2014.2353642","article-title":"Stereo Matching Using Tree Filtering","volume":"37","author":"Yang","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1109\/TPAMI.2007.1166","article-title":"Stereo Processing by Semiglobal Matching and Mutual Information","volume":"30","author":"Hirschmuller","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Keselman, L., Woodfill, J.I., Grunnet-Jepsen, A., and Bhowmik, A. (2017, January 21\u201326). Intel RealSense stereoscopic depth cameras. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.167"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1007\/s001380050120","article-title":"A Compact Algorithm for Rectification of Stereo Pairs","volume":"12","author":"Fusiello","year":"2000","journal-title":"Mach. Vis. Appl."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1330","DOI":"10.1109\/34.888718","article-title":"A flexible new technique for camera calibration","volume":"22","author":"Zhang","year":"2000","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"085007","DOI":"10.1088\/0957-0233\/27\/8\/085007","article-title":"Calibration of Stereo Rigs Based on the Backward Projection Process","volume":"27","author":"Gu","year":"2016","journal-title":"Meas. Sci. Technol."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/4\/1094\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T08:58:34Z","timestamp":1760173114000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/4\/1094"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,17]]},"references-count":27,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2020,2]]}},"alternative-id":["s20041094"],"URL":"https:\/\/doi.org\/10.3390\/s20041094","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,17]]}}}