{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:37:25Z","timestamp":1760243845700,"version":"build-2065373602"},"reference-count":48,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2011,8,22]],"date-time":"2011-08-22T00:00:00Z","timestamp":1313971200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Motion estimation is a low-level vision task that is especially relevant due to its wide range of applications in the real world. Many of the best motion estimation algorithms include some of the features that are found in mammalians, which would demand huge computational resources and therefore are not usually available in real-time. In this paper we present a novel bioinspired sensor based on the synergy between optical flow and orthogonal variant moments. The bioinspired sensor has been designed for Very Large Scale Integration (VLSI) using properties of the mammalian cortical motion pathway. This sensor combines low-level primitives (optical flow and image moments) in order to produce a mid-level vision abstraction layer. The results are described trough experiments showing the validity of the proposed system and an analysis of the computational resources and performance of the applied algorithms.<\/jats:p>","DOI":"10.3390\/s110808164","type":"journal-article","created":{"date-parts":[[2011,8,24]],"date-time":"2011-08-24T07:43:32Z","timestamp":1314171812000},"page":"8164-8179","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["FPGA-Based Multimodal Embedded Sensor System Integrating Low- and Mid-Level Vision"],"prefix":"10.3390","volume":"11","author":[{"given":"Guillermo","family":"Botella","sequence":"first","affiliation":[{"name":"Department of Computer Architectures and Automatic Control, Complutense University of Madrid, 28040 Madrid, Spain"}]},{"given":"Jos\u00e9 Antonio","family":"Mart\u00edn H.","sequence":"additional","affiliation":[{"name":"Department of Computer Architectures and Automatic Control, Complutense University of Madrid, 28040 Madrid, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1993-8368","authenticated-orcid":false,"given":"Matilde","family":"Santos","sequence":"additional","affiliation":[{"name":"Department of Computer Architectures and Automatic Control, Complutense University of Madrid, 28040 Madrid, Spain"}]},{"given":"Uwe","family":"Meyer-Baese","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, FAMU-FSU College of Engineering, Tallahassee, FL 32310, USA"}]}],"member":"1968","published-online":{"date-parts":[[2011,8,22]]},"reference":[{"key":"ref_1","unstructured":"Bruce, V, Green, PR, and Georgeson, MA (1998). Visual Perception: Physiology, Psychology & Ecology, Laurence Erlbaum Associates. [3rd ed]."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Szelinsky, R (2011). Computer Vision Algorithms and Applications, Springer.","DOI":"10.1007\/978-1-84882-935-0"},{"key":"ref_3","unstructured":"Guzel, MS, and Bicker, R (2010, January 28\u201330). Optical Flow Based System Design for Mobile Robots. Singapore."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Sim, KF, and Sundaraj, K (2010, January 15\u201317). Human Motion Tracking of Athlete Using Optical Flow and Artificial Markers. Kuala Lumpur, Malaysia.","DOI":"10.1109\/ICIAS.2010.5716200"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1513","DOI":"10.1109\/TCSVT.2009.2026932","article-title":"Statistical motion information extraction and representation for semantic video analysis","volume":"19","author":"Papadopoulos","year":"2009","journal-title":"IEEE Trans. Circuits Syst. Video Technol"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/0262-8856(95)91465-P","article-title":"Motion estimation method using 3D steerable filter","volume":"13","author":"Huang","year":"1995","journal-title":"Image Vis. Comput"},{"key":"ref_7","unstructured":"Lucas, BD, and Kanade, T (1981, January 24\u201328). An Iterative Image Registration Technique with an Application to Stereo Vision. Vancouver, BC, Canada."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1023\/B:VISI.0000011205.11775.fd","article-title":"Lucas-kanade 20 years on: A unifying framework","volume":"56","author":"Baker","year":"2004","journal-title":"Int. J. Comput. Vis"},{"key":"ref_9","first-page":"438","article-title":"A survey of moment-based techniques for unoccluded object representation and recognition","volume":"54","author":"Prokop","year":"1992","journal-title":"CVGIP: Graph. Models Image Process"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3619","DOI":"10.1016\/j.ins.2009.06.033","article-title":"A unified methodology for the efficient computation of discrete orthogonal image moments","volume":"176","author":"Papakostas","year":"2009","journal-title":"Inf. Sci"},{"key":"ref_11","unstructured":"Flusser, J (, January February). Moment Invariants in Image Analysis. Czech Republic."},{"key":"ref_12","first-page":"14","article-title":"Pattern recognition by moment invariants","volume":"49","author":"Hu","year":"1961","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1109\/TIT.1962.1057692","article-title":"Visual pattern recognition by moment invariants","volume":"8","author":"Hu","year":"1962","journal-title":"IRE Trans. Inf. Theory"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1304","DOI":"10.1049\/el.2009.1718","article-title":"Bioinspired robust optical flow processor system for VLSI implementation","volume":"45","author":"Botella","year":"2009","journal-title":"IEEE Electron. Lett"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"616","DOI":"10.1109\/TVLSI.2009.2013957","article-title":"Robust bioinspired architecture for optical flow computation","volume":"18","author":"Botella","year":"2010","journal-title":"IEEE Trans. VLSI Syst"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1109","DOI":"10.1016\/0042-6989(94)00175-L","article-title":"A unified account of three apparent motion illusions","volume":"35","author":"Johnston","year":"1994","journal-title":"Vis. Res"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1771","DOI":"10.1016\/0042-6989(94)00258-N","article-title":"Perceived motion of contrast modulated gratings: PredICTION of the McGM and the role of full-wave rectification","volume":"35","author":"Johnston","year":"1995","journal-title":"Vis. Res"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1098\/rspb.1999.0666","article-title":"Robust velocity computation from a biologically motivated model of motion perception","volume":"266","author":"Johnston","year":"1999","journal-title":"Proc. Biol. Sci"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1142\/S0129065799000435","article-title":"A multi-differential neuromorphic approach to motion detection","volume":"9","author":"McOwan","year":"1999","journal-title":"Int. J. Neural Syst"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1016\/j.jphysparis.2003.09.016","article-title":"Biological computation of image motion from flows over boundaries","volume":"97","author":"Johnston","year":"2003","journal-title":"J. Physiol. (Paris)"},{"key":"ref_21","unstructured":"Lindeberg, T, and Romeny, B (1994). Geometry-Driven Diffusion, Kluwer Academic Publishers."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1098\/rspb.1992.0162","article-title":"Computational model of the analysis of some first-order and second-order motion patterns by simple and complex cells","volume":"250","author":"Johnston","year":"1992","journal-title":"Proc. R. Soc. London"},{"key":"ref_23","unstructured":"Nalwa, VS (1993). A Guided Tour of Computer Vision, Addison-Wesley."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1007\/BF01420984","article-title":"Performance of optical flow techniques","volume":"12","author":"Barron","year":"1994","journal-title":"Int. J. Comput. Vis"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1016\/0042-6989(92)90113-W","article-title":"Temporal frequency filters in the human peripheral visual field","volume":"32","author":"Hess","year":"1992","journal-title":"Vis. Res"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1152\/jn.1993.69.1.19","article-title":"Speed and direction selectivity of macaque middle temporal neurons","volume":"69","author":"Lagae","year":"1993","journal-title":"J. Neurophysiol"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1308","DOI":"10.1152\/jn.1986.55.6.1308","article-title":"Motion selectivity in macaque visual cortex. I. Mechanisms of direction and speed selectivity in extrastriate area MT","volume":"55","author":"Mikami","year":"1986","journal-title":"J. Neurophysiol"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1080\/135062896395634","article-title":"Preserved and impaired detection of structure from motion by a motion-blind patient","volume":"3","author":"McLeod","year":"1996","journal-title":"Visual Cognit"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1016\/0004-3702(81)90024-2","article-title":"Determining optical flow","volume":"17","author":"Horn","year":"1981","journal-title":"Artif. Intell"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"496","DOI":"10.1109\/34.3913","article-title":"On image analysis by the methods of moments","volume":"10","author":"Teh","year":"1988","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"959","DOI":"10.1016\/S0262-8856(00)00038-X","article-title":"A new focus measure method using moments","volume":"18","author":"Zhang","year":"2000","journal-title":"Image Vis. Comput"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2802","DOI":"10.1016\/j.ins.2007.01.010","article-title":"A new class of zernike moments for computer vision applications","volume":"177","author":"Papakostas","year":"2007","journal-title":"Inf. Sci"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Papakostas, GA, Karakasis, EG, and Koulouriotis, DE (2007, January 6\u20138). Exact and Speedy Computation of Legendre Moments on Binary Images. Santorini, Greece.","DOI":"10.1109\/WIAMIS.2007.44"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"3619","DOI":"10.1016\/j.ins.2009.06.033","article-title":"A unified methodology for the efficient computation of discrete orthogonal image moments","volume":"176","author":"Papakostas","year":"2009","journal-title":"Inf. Sci"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/j.ins.2003.08.006","article-title":"New computational methods for full and subset zernike moments","volume":"159","author":"Wee","year":"2004","journal-title":"Inf. Sci"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2097","DOI":"10.1016\/j.ins.2005.10.005","article-title":"A new feature extractor invariant to intensity, rotation, and scaling of color images","volume":"176","author":"Sookhanaphibarn","year":"2006","journal-title":"Inf. Sci"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"846","DOI":"10.1016\/j.ins.2009.08.032","article-title":"Orthogonal variant moments features in image analysis","volume":"180","author":"Santos","year":"2010","journal-title":"Inf. Sci"},{"key":"ref_38","unstructured":"Available online: http:\/\/www.mentor.com\/products\/fpga\/handel-c\/upload\/handelc-reference.pdf (accessed on 16 August 2011)."},{"key":"ref_39","unstructured":"AlphaData RC1000 product Available online: http:\/\/www.alpha-data.com (accessed on 16 August 2011)."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Frigo, J (2001, January 11\u201313). Evaluation of the StreamsC, CtoFPGA compiler: An applications perspective. Monterey, CA, USA.","DOI":"10.1145\/360276.360326"},{"key":"ref_41","unstructured":"Software and Design Tools Available online: http:\/\/www.xilinx.com\/tools\/designtools.htm (accessed on 16 August 2011)."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Wei, Z, Lee, D-J, Nelson, BE, Archibald, JK, and Edwards, BB (2008). FPGA-based embedded motion estimation sensor. Int. J. Reconfig. Comput, 8.","DOI":"10.1155\/2008\/636145"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1016\/j.cviu.2008.05.006","article-title":"Superpipelined high-performance optical flow computation architecture","volume":"112","author":"Ros","year":"2008","journal-title":"Comput. Vis. Image Underst"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1016\/j.sysarc.2010.07.012","article-title":"Fine grain pipeline architecture for high performance phase-based optical flow computation","volume":"56","author":"Tomasi","year":"2010","journal-title":"J. Syst. Archit"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Sosa, JC, Gomez-Fabela, R, Boluda, JA, and Pardo, F (2006, January 20\u201322). Change-Driven Image Architecture on FPGA with Adaptive Threshold for Optical-Flow Computation. San Luis Potos\u00ed, M\u00e9xico.","DOI":"10.1109\/RECONF.2006.307775"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1109\/TVLSI.2008.2006900","article-title":"A VLSI architecture and algorithm for lucas-kanade-based optical flow computation","volume":"18","author":"Mahalingam","year":"2010","journal-title":"IEEE Trans. VLSI Syst"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1986","DOI":"10.1364\/JOSAA.5.001986","article-title":"Drift-balanced random stimuli: A general basis for studying non-Fourier motion perception","volume":"5","author":"Chubb","year":"1988","journal-title":"J. Opt. Soc. Am. A"},{"key":"ref_48","unstructured":"First-Order and Second-Order Motion Demos Available online: http:\/\/www.snl.salk.edu\/~maarten\/demos\/2nd.html (accessed on 16 August 2011)."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/11\/8\/8164\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:57:09Z","timestamp":1760219829000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/11\/8\/8164"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,8,22]]},"references-count":48,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2011,8]]}},"alternative-id":["s110808164"],"URL":"https:\/\/doi.org\/10.3390\/s110808164","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2011,8,22]]}}}