{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,5]],"date-time":"2025-12-05T12:22:02Z","timestamp":1764937322869,"version":"build-2065373602"},"reference-count":13,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2021,9,26]],"date-time":"2021-09-26T00:00:00Z","timestamp":1632614400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The presented paper describes a hardware-accelerated field programmable gate array (FPGA)\u2013based solution capable of real-time stereo matching for temporal statistical pattern projector systems. Modern 3D measurement systems have seen an increased use of temporal statistical pattern projectors as their active illumination source. The use of temporal statistical patterns in stereo vision systems includes the advantage of not requiring information about pattern characteristics, enabling a simplified projector design. Stereo-matching algorithms used in such systems rely on the locally unique temporal changes in brightness to establish a pixel correspondence between the stereo image pair. Finding the temporal correspondence between individual pixels in temporal image pairs is computationally expensive, requiring GPU-based solutions to achieve real-time calculation. By leveraging a high-level synthesis approach, matching cost simplification, and FPGA-specific design optimizations, an energy-efficient, high throughput stereo-matching solution was developed. The design is capable of calculating disparity images on a 1024 \u00d7 1024(@291 FPS) input image pair stream at 8.1 W on an embedded FPGA platform (ZC706). Several different design configurations were tested, evaluating device utilization, throughput, power consumption, and performance-per-watt. The average performance-per-watt of the FPGA solution was two times higher than in a GPU-based solution.<\/jats:p>","DOI":"10.3390\/s21196435","type":"journal-article","created":{"date-parts":[[2021,9,27]],"date-time":"2021-09-27T22:16:38Z","timestamp":1632780998000},"page":"6435","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Real-Time FPGA Accelerated Stereo Matching for Temporal Statistical Pattern Projector Systems"],"prefix":"10.3390","volume":"21","author":[{"given":"Zan","family":"Brus","sequence":"first","affiliation":[{"name":"Faculty of Electrical Engineering and Computer Science, University of Maribor, 2000 Maribor, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marko","family":"Kos","sequence":"additional","affiliation":[{"name":"Faculty of Electrical Engineering and Computer Science, University of Maribor, 2000 Maribor, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Matic","family":"Erker","sequence":"additional","affiliation":[{"name":"Faculty of Electrical Engineering and Computer Science, University of Maribor, 2000 Maribor, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9609-3218","authenticated-orcid":false,"given":"Iztok","family":"Kramberger","sequence":"additional","affiliation":[{"name":"Faculty of Electrical Engineering and Computer Science, University of Maribor, 2000 Maribor, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,9,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.optlaseng.2018.02.017","article-title":"High-speed 3D shape measurement with structured light methods: A review","volume":"106","author":"Zhang","year":"2018","journal-title":"Opt. Lasers Eng."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2666","DOI":"10.1016\/j.patcog.2010.03.004","article-title":"A state of the art in structured light patterns for surface profilometry","volume":"43","author":"Salvi","year":"2010","journal-title":"Pattern Recognit."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1364\/AOP.3.000128","article-title":"Structured-light 3D surface imaging: A tutorial","volume":"3","author":"Geng","year":"2010","journal-title":"Adv. Opt. Photonics"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1016\/j.optlaseng.2016.02.017","article-title":"High-speed three-dimensional shape measurement using GOBO projection","volume":"87","author":"Heist","year":"2016","journal-title":"Opt. Lasers Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"024105","DOI":"10.1117\/1.OE.55.2.024105","article-title":"Experimental comparison of aperiodic sinusoidal fringes and phase-shifted sinusoidal fringes for high-speed three-dimensional shape measurement","volume":"55","author":"Heist","year":"2016","journal-title":"Opt. Eng."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Dietrich, P., Heist, S., Landmann, M., K\u00fchmstedt, P., and Notni, G. (2019). BICOS-an algorithm for fast real-time Correspondence Search for statistical pattern projection-based active stereo sensors. Appl. Sci., 9.","DOI":"10.3390\/app9163330"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"8742920","DOI":"10.1155\/2016\/8742920","article-title":"Literature survey on stereo vision disparity map algorithms","volume":"2016","author":"Hamzah","year":"2016","journal-title":"J. Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1515\/aot-2016-0052","article-title":"3D shape measurement with thermal pattern projection","volume":"5","author":"Brahm","year":"2016","journal-title":"Adv. Opt. Technol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2008","DOI":"10.1109\/LRA.2018.2800786","article-title":"Real-Time Dense Stereo Matching with ELAS on FPGA-Accelerated Embedded Devices","volume":"3","author":"Rahnama","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_10","unstructured":"Zhang, L., Zhang, K., Chang, T.S., Lafruit, G., Kuzmanov, G.K., and Verkest, D. (March, January 27). Real-time high-definition stereo matching on FPGA. Proceedings of the 19th ACM\/SIGDA International Symposium on Field Programmable Gate Arrays\u2014FPGA \u201911, Monterey, CA, USA."},{"key":"ref_11","unstructured":"Vega-Rodr\u00edguez, M., and S\u00e1nchez-P\u00e9rez, J. (2002, January 9\u201313). An FPGA-based implementation for median filter meeting the real-time requirements of automated visual inspection systems. Proceedings of the 10th IEEE Mediterranean Conference on Control and Automation (MED \u201902), Lisbon, Portugal."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Mu, W., Jin, J., Feng, H., and Wang, Q. (2013, January 6\u20139). Adaptive window multistage median filter for image salt-and-pepper denoising. Proceedings of the 2013 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), Minneapolis, MN, USA.","DOI":"10.1109\/I2MTC.2013.6555671"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1471","DOI":"10.1109\/TVLSI.2018.2822300","article-title":"Low-cost sorting network circuits using unary processing","volume":"26","author":"Najafi","year":"2018","journal-title":"IEEE Trans. Very Large Scale Integr. (VLSI) Syst."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/19\/6435\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:05:31Z","timestamp":1760166331000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/19\/6435"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,26]]},"references-count":13,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2021,10]]}},"alternative-id":["s21196435"],"URL":"https:\/\/doi.org\/10.3390\/s21196435","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,9,26]]}}}