{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:32:20Z","timestamp":1760243540063,"version":"build-2065373602"},"reference-count":62,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2012,2,9]],"date-time":"2012-02-09T00:00:00Z","timestamp":1328745600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper presents an architecture for computing vector disparity for active vision systems as used on robotics applications. The control of the vergence angle of a binocular system allows us to efficiently explore dynamic environments, but requires a generalization of the disparity computation with respect to a static camera setup, where the disparity is strictly 1-D after the image rectification. The interaction between vision and motor control allows us to develop an active sensor that achieves high accuracy of the disparity computation around the fixation point, and fast reaction time for the vergence control. In this contribution, we address the development of a real-time architecture for vector disparity computation using an FPGA device. We implement the disparity unit and the control module for vergence, version, and tilt to determine the fixation point. In addition, two on-chip different alternatives for the vector disparity engines are discussed based on the luminance (gradient-based) and phase information of the binocular images. The multiscale versions of these engines are able to estimate the vector disparity up to 32 fps on VGA resolution images with very good accuracy as shown using benchmark sequences with known ground-truth. The performances in terms of frame-rate, resource utilization, and accuracy of the presented approaches are discussed. On the basis of these results, our study indicates that the gradient-based approach leads to the best trade-off choice for the integration with the active vision system.<\/jats:p>","DOI":"10.3390\/s120201771","type":"journal-article","created":{"date-parts":[[2012,2,9]],"date-time":"2012-02-09T11:22:30Z","timestamp":1328786550000},"page":"1771-1799","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Vector Disparity Sensor with Vergence Control for Active Vision Systems"],"prefix":"10.3390","volume":"12","author":[{"given":"Francisco","family":"Barranco","sequence":"first","affiliation":[{"name":"Department of Computer Architecture and Technology, CITIC, ETSIIT, University of Granada, C\/Daniel Saucedo Aranda s\/n, E18071, Granada, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Javier","family":"Diaz","sequence":"additional","affiliation":[{"name":"Department of Computer Architecture and Technology, CITIC, ETSIIT, University of Granada, C\/Daniel Saucedo Aranda s\/n, E18071, Granada, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Agostino","family":"Gibaldi","sequence":"additional","affiliation":[{"name":"PSPC Group, Department of Biophysical and Electronic Engineering (DIBE), University of Genoa, Via Opera Pia 11A, I-16145, Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Silvio P.","family":"Sabatini","sequence":"additional","affiliation":[{"name":"PSPC Group, Department of Biophysical and Electronic Engineering (DIBE), University of Genoa, Via Opera Pia 11A, I-16145, Genoa, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eduardo","family":"Ros","sequence":"additional","affiliation":[{"name":"Department of Computer Architecture and Technology, CITIC, ETSIIT, University of Granada, C\/Daniel Saucedo Aranda s\/n, E18071, Granada, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2012,2,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1109\/83.650851","article-title":"GOLD: A parallel real-time stereo vision system for generic obstacle and lane detection","volume":"7","author":"Bertozzi","year":"1998","journal-title":"IEEE Trans. Image Process"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"El Ansari, M., Mousset, S., and Bensrhair, A. (2008, January 4\u20136). A new stereo matching approach for real-time road obstacle detection for situations with deteriorated visibility. Eindhoven, The Netherlands.","DOI":"10.1109\/IVS.2008.4621235"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1107","DOI":"10.1109\/TIP.2003.815257","article-title":"One-dimensional dense disparity estimation for three-dimensional reconstruction","volume":"12","author":"Oisel","year":"2003","journal-title":"IEEE Trans. Image Process"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1468","DOI":"10.1109\/82.899641","article-title":"Subpixel resolution binocular visual tracking using analog VLSI vision sensors","volume":"47","author":"Lu","year":"2000","journal-title":"IEEE Trans. Circuits Syst. II Analog Digit. Signal Process"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"8028","DOI":"10.3390\/s100908028","article-title":"Identifying and tracking pedestrians based on sensor fusion and motion stability predictions","volume":"10","author":"Musleh","year":"2010","journal-title":"Sensors"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1016\/S0921-8890(01)00158-0","article-title":"Developing haptic and visual perceptual categories for reaching and grasping with a humanoid robot","volume":"37","author":"Coelho","year":"2001","journal-title":"Robot. Auton. Syst"},{"key":"ref_7","unstructured":"Song, W., Minami, M., Yu, F., Zhang, Y., and Yanou, A. (2011, January 9\u201313). 3-D hand amp; Eye-vergence approaching visual servoing with lyapunouv-stable pose tracking. Shanghai, China."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"280","DOI":"10.1109\/TIP.2006.884931","article-title":"Real-time system for high-image resolution disparity estimation","volume":"16","author":"Diaz","year":"2007","journal-title":"IEEE Trans. Image Process"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Murphy, C., Lindquist, D., Rynning, A., Cecil, T., Leavitt, S., and Chang, M. (2007, January 23\u201325). Low-cost stereo vision on an FPGA. Napa, CA, USA.","DOI":"10.1109\/FCCM.2007.44"},{"key":"ref_10","unstructured":"Trucco, E., and Verri, A. (1998). Introductory Techniques for 3-D Computer Vision, Prentice Hall PTR."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Faugeras, O., Luong, Q.T., and Papadopoulou, T. (2001). The Geometry of Multiple Images: The Laws that Govern the Formation of Images of A Scene and Some of Their Applications, MIT Press.","DOI":"10.7551\/mitpress\/3259.001.0001"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Samarawickrama, J.G., and Sabatini, S.P. (2007, January 28\u201330). Version and vergence control of a stereo camera head by fitting the movement into the hering\u2019s law. Montreal, QC, Canada.","DOI":"10.1109\/CRV.2007.69"},{"key":"ref_13","unstructured":"Theimer, W.M., and Mallot, H.A. (1993). Vergence Guided Depth Reconstruction Using a Phase Method; Neuro-Nimes \u201993, EC2 Publishing."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Gibaldi, A., Canessa, A., Chessa, A., Sabatini, S.P., and Solari, F. (2011, January 6\u20138). A neuromorphic control module for real-time vergence eye movements on the iCub robot head. Nashville, TN, USA.","DOI":"10.1109\/Humanoids.2011.6100861"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1145","DOI":"10.1016\/S0042-6989(97)00251-4","article-title":"Evidence for separate control of slow version and vergence eye movements: Support for Hering\u2019s law","volume":"38","author":"Semmlow","year":"1998","journal-title":"Vis. Res"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1113\/jphysiol.1984.sp015186","article-title":"Changes in vergence mediated by saccades","volume":"350","author":"Enrights","year":"1983","journal-title":"J. Physiol"},{"key":"ref_17","unstructured":"Chessa, M., Sabatini, S.P., and Solari, F. (, January October). A fast joint bioinspired algorithm for optic flow and two-dimensional disparity estimation. Liege, Belgium."},{"key":"ref_18","unstructured":"Xu, Y., Zhou, J., and Zhai, G. (2005, January 2\u20134). 2D phase-based matching in uncalibrated images. Athens, Greece."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1049\/iet-ipr.2009.0262","article-title":"Efficient hierarchical matching algorithm for processing uncalibrated stereo vision images and its hardware architecture","volume":"5","author":"Nalpantidis","year":"2011","journal-title":"IET Image Process"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1145\/212094.212141","article-title":"The computation of optical flow","volume":"27","author":"Beauchemin","year":"1995","journal-title":"ACM Comput. Surv"},{"key":"ref_21","unstructured":"Lucas, B.D., and Kanade, T. (, January August). An iterative image registration technique with an application to stereo vision. Vancouver, BC, Canada."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1016\/1049-9660(91)90027-M","article-title":"Phase-based disparity measurement","volume":"53","author":"Fleet","year":"1991","journal-title":"CVGIP Image Underst"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1016\/j.cviu.2010.03.008","article-title":"A compact harmonic code for early vision based on anisotropic frequency channels","volume":"114","author":"Sabatini","year":"2010","journal-title":"Comput. Vis. Image Underst"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1382","DOI":"10.1049\/el:20010941","article-title":"Fast technique for phase-based disparity estimation with no explicit calculation of phase","volume":"37","author":"Solari","year":"2001","journal-title":"Electron. Lett"},{"key":"ref_25","unstructured":"iCub Project The EU iCub Project: An Open Source Cognitive Humanoid Robotic Platform. Available online: http:\/\/www.icub.org\/ (accessed on 28 December 2011)."},{"key":"ref_26","unstructured":"Beira, R., Lopes, M., Praga, M., Santos-Victor, J., Bernardino, A., Metta, G., Becchi, F., and Saltaren, R. (, January May). Design of the robot-cub (iCub) head. Orlando, CA, USA."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ivaldi, S. (2011). From Humans to Humanoids: A Study on Optimal Motor Control for the iCub. Ph.D. Thesis,.","DOI":"10.2478\/s13230-012-0022-3"},{"key":"ref_28","unstructured":"Georgoulas, C., and Andreadis, I. (, January September). A real-time occlusion aware hardware structure for disparity map computation. Vietri sul mare, Italy."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2357","DOI":"10.1364\/JOSAA.25.002357","article-title":"Cyclopean geometry of binocular vision","volume":"25","author":"Hansard","year":"2008","journal-title":"J. Opt. Soc. Am"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Tomasi, M., Vanegas, M., Barranco, F., Diaz, J., and Ros, E. (2010, January 5\u20137). A novel architecture for a massively parallel low level vision processing engine on chip. Bari, Italy.","DOI":"10.1109\/ISIE.2010.5637211"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Hadjitheophanous, S., Ttofis, C., Georghiades, A., and Theocharides, T. (2010, January 8\u201312). Towards hardware stereoscopic 3D reconstruction a real-time FPGA computation of the disparity map. Dresden, Germany.","DOI":"10.1109\/DATE.2010.5457096"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1109\/TCSVT.2009.2026831","article-title":"FPGA design and implementation of a real-time stereo vision system","volume":"20","author":"Jin","year":"2010","journal-title":"IEEE Trans. Circuits Syst. Video Technol"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Calderon, H., Ortiz, J., and Fontaine, J. (2010, January 8\u201310). High parallel disparity map computing on FPGA. Suzhou, China.","DOI":"10.1109\/MESA.2010.5552049"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"274","DOI":"10.1109\/TCSVT.2005.861947","article-title":"FPGA-based real-time optical-flow system","volume":"16","author":"Diaz","year":"2006","journal-title":"IEEE Trans. Circuits Syst. Video Technol"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Barranco, F., Tomasi, M., Diaz, J., Vanegas, M., and Ros, E. (2012). Parallel architecture for hierarchical optical flow estimation based on FPGA. IEEE Trans. Very Large Scale Integr. (VLSI) Syst.","DOI":"10.1109\/TVLSI.2011.2145423"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1016\/j.cviu.2008.05.006","article-title":"Superpipelined high-performance optical-flow computation architecture","volume":"112","author":"Diaz","year":"2008","journal-title":"Comput. Vis. Image Underst"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1007987001439","article-title":"Improved accuracy in Gradient-based optical flow estimation","volume":"25","author":"Brandt","year":"1997","journal-title":"Int. J. Comput. Vis"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1007\/BF01420984","article-title":"Performance of optical flow techniques","volume":"12","author":"Barron","year":"1994","journal-title":"Int. J. Comput. Vis"},{"key":"ref_39","first-page":"174","article-title":"Accuracy vs. efficiency trade-offs in optical flow algorithms","volume":"1065","author":"Liu","year":"1996","journal-title":"Computer Vision ECCV 96"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Pauwels, K., Tomasi, M., Diaz, J., Ros, E., and Hulle, M.M.V. (2011). A comparison of FPGA and GPU for real-time phase-based optical flow, stereo, and local image features. IEEE Trans. Comput.","DOI":"10.1109\/TC.2011.120"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1127","DOI":"10.1109\/TNN.2002.1031944","article-title":"A phase-based approach to the estimation of the optical flow field using spatial filtering","volume":"13","author":"Gautama","year":"2002","journal-title":"IEEE Trans. Neural Netw"},{"key":"ref_42","first-page":"237","article-title":"Hierarchical model-based motion estimation","volume":"588","author":"Sandini","year":"1992","journal-title":"Computer Vision ECCV\u201992"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1109\/TCOM.1983.1095851","article-title":"The laplacian pyramid as a compact image code","volume":"31","author":"Burt","year":"1983","journal-title":"IEEE Trans. Commun"},{"key":"ref_44","unstructured":"Sevensols Seven Solutions. Available online: http:\/\/www.sevensols.com\/ (accessed on 28 December 2011)."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1797","DOI":"10.1109\/TCSVT.2010.2087590","article-title":"High-performance optical-flow architecture based on a multiscale, multi-orientation phase-based model","volume":"20","author":"Tomasi","year":"2010","journal-title":"IEEE Trans. Circuits Syst. Video Technol"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"442","DOI":"10.1016\/j.sysarc.2010.05.007","article-title":"Multi-port abstraction layer for FPGA intensive memory exploitation applications","volume":"56","author":"Vanegas","year":"2010","journal-title":"J. Syst. Archit"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"435","DOI":"10.1016\/j.micpro.2006.03.004","article-title":"Hardware description of multi-layer perceptrons with different abstraction levels","volume":"30","author":"Ortigosa","year":"2006","journal-title":"Microprocess. Microsyst"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1016\/j.sysarc.2010.07.012","article-title":"Fine grain pipeline architecture for high performance phase-based optical flow computation","volume":"56","author":"Tomasi","year":"2010","journal-title":"J. Syst. Archit"},{"key":"ref_49","unstructured":"Vision, M.C. Middlebury Computer Vision. Available online: http:\/\/vision.middlebury.edu\/ (accessed on 28 December 2011)."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Kim, J.J. (2010). Virtual Reality, InTech.","DOI":"10.1145\/1900264.1900343"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"792","DOI":"10.1109\/TCSVT.2010.2045814","article-title":"Algorithm and architecture of disparity estimation with mini-census adaptive support weight","volume":"20","author":"Chang","year":"2010","journal-title":"IEEE Trans. Circuits Syst. Video Technol"},{"key":"ref_52","unstructured":"Ernst, I., and Hirschm\u00fcller, H. (, January December). Mutual information based semi-global stereo matching on the GPU. Las Vegas, NV, USA."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Han, S.K., Woo, S., Jeong, M.H., and You, B.J. (2009, January 5\u20139). Improved-quality real-time stereo vision processor. New Delhi, India.","DOI":"10.1109\/VLSI.Design.2009.89"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Gibson, J., and Marques, O. (2008, January 23\u201328). Stereo depth with a unified architecture GPU. Anchorage, AK, USA.","DOI":"10.1109\/CVPRW.2008.4563092"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"998","DOI":"10.1109\/TPAMI.2005.120","article-title":"Fast unambiguous stereo matching using reliability-based dynamic programming","volume":"27","author":"Gong","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell"},{"key":"ref_56","unstructured":"Virtual Reality Tool for Active Vision Available online: http:\/\/www.pspc.dibe.unige.it\/Research\/vr.html (accessed on 28 December 2011)."},{"key":"ref_57","unstructured":"Carneiro, G., and Jepson, A. (2003, January 18\u201320). Multi-scale phase-based local features. Madison, WI, USA."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1109\/PROC.1981.12022","article-title":"The importance of phase in signals","volume":"69","author":"Oppenheim","year":"1981","journal-title":"Proc. IEEE"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Tomasi, M., Vanegas, M., Barranco, F., Diaz, J., and Ros, E. (2011). Real-time architecture for a robust multi-scale stereo engine on FPGA. IEEE Trans. Very Large Scale Integr. (VLSI) Syst.","DOI":"10.1109\/TVLSI.2011.2172007"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"1253","DOI":"10.1109\/34.250844","article-title":"Stability of phase information","volume":"15","author":"Fleet","year":"1993","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"1080","DOI":"10.1109\/70.817671","article-title":"Binocular tracking: Integrating perception and control","volume":"15","author":"Bernardino","year":"1999","journal-title":"IEEE Trans. Robot. Autom"},{"key":"ref_62","unstructured":"Sapienza, M., Hansard, M., and Horaud, R. (2011). Real-Time 3D Reconstruction and Fixation with an Active Binocular Head, INRIA. Technical Report;."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/12\/2\/1771\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:48:49Z","timestamp":1760219329000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/12\/2\/1771"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,2,9]]},"references-count":62,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2012,2]]}},"alternative-id":["s120201771"],"URL":"https:\/\/doi.org\/10.3390\/s120201771","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2012,2,9]]}}}