{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:43:20Z","timestamp":1760211800059,"version":"build-2065373602"},"reference-count":37,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2016,11,26]],"date-time":"2016-11-26T00:00:00Z","timestamp":1480118400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministerio de Econom\u00eda y Competitividad and FEDER funds","award":["TIN2015-65686-C5"],"award-info":[{"award-number":["TIN2015-65686-C5"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>There exist image processing applications, such as tracking or pattern recognition, that are not necessarily precise enough to maintain the same resolution across the whole image sensor. In fact, they must only keep it as high as possible in a relatively small region, but covering a wide field of view. This is the aim of foveal vision systems. Briefly, they propose to sense a large field of view at a spatially-variant resolution: one relatively small region, the fovea, is mapped at a high resolution, while the rest of the image is captured at a lower resolution. In these systems, this fovea must be moved, from one region of interest to another one, to scan a visual scene. It is interesting that the part of the scene that is covered by the fovea should not be merely spatial, but closely related to perceptual objects. Segmentation and attention are then intimately tied together: while the segmentation process is responsible for extracting perceptively-coherent entities from the scene (proto-objects), attention can guide segmentation. From this loop, the concept of foveal attention arises. This work proposes a hardware system for mapping a uniformly-sampled sensor to a space-variant one. Furthermore, this mapping is tied with a software-based, foveal attention mechanism that takes as input the stream of generated foveal images. The whole hardware\/software architecture has been designed to be embedded within an all programmable system on chip (AP SoC). Our results show the flexibility of the data port for exchanging information between the mapping and attention parts of the architecture and the good performance rates of the mapping procedure. Experimental evaluation also demonstrates that the segmentation method and the attention model provide results comparable to other more computationally-expensive algorithms.<\/jats:p>","DOI":"10.3390\/s16122003","type":"journal-article","created":{"date-parts":[[2016,11,28]],"date-time":"2016-11-28T10:25:22Z","timestamp":1480328722000},"page":"2003","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Data-Driven Multiresolution Camera Using the Foveal Adaptive Pyramid"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9216-0372","authenticated-orcid":false,"given":"Martin","family":"Gonz\u00e1lez","sequence":"first","affiliation":[{"name":"Dpto. Tecnolog\u00eda Electr\u00f3nica, University of M\u00e1laga, Campus de Teatinos, 29071 M\u00e1laga, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Antonio","family":"S\u00e1nchez-Pedraza","sequence":"additional","affiliation":[{"name":"Dpto. Tecnolog\u00eda Electr\u00f3nica, University of M\u00e1laga, Campus de Teatinos, 29071 M\u00e1laga, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rebeca","family":"Marfil","sequence":"additional","affiliation":[{"name":"Dpto. Tecnolog\u00eda Electr\u00f3nica, University of M\u00e1laga, Campus de Teatinos, 29071 M\u00e1laga, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Juan","family":"Rodr\u00edguez","sequence":"additional","affiliation":[{"name":"Dpto. Tecnolog\u00eda Electr\u00f3nica, University of M\u00e1laga, Campus de Teatinos, 29071 M\u00e1laga, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3147-0307","authenticated-orcid":false,"given":"Antonio","family":"Bandera","sequence":"additional","affiliation":[{"name":"Dpto. Tecnolog\u00eda Electr\u00f3nica, University of M\u00e1laga, Campus de Teatinos, 29071 M\u00e1laga, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2016,11,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Bailey, D.G., and Bouganis, C.S. (2009, January 9\u201311). Implementation of a foveal vision mapping. Proceedings of the International Conference on Field-Programmable Technology (FPT), Sydney, Australia.","DOI":"10.1109\/FPT.2009.5377646"},{"key":"ref_2","unstructured":"Ware, C. (2008). Visual Thinking for Design, Morgan Kaufmann."},{"key":"ref_3","unstructured":"Sandini, G., and Metta, G. (2002). Sensors and Sensing in Biology and Engineering, Springer."},{"key":"ref_4","first-page":"477","article-title":"Generalization of shifted fovea multiresolution geometries applied to object detection","volume":"2","author":"Arrebola","year":"1997","journal-title":"ICIAP"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"422","DOI":"10.1007\/3-540-63507-6_228","article-title":"Adaptive fovea structures for space variant sensors","volume":"1311","author":"Camacho","year":"1997","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_6","unstructured":"Coslado, F.J., Camacho, P., Gonz\u00e1lez, M., Arrebola, F., and Sandoval, F. (1999, January 27\u201329). VLSI implementation of a Foveal Polygon segmentation algorithm. Proceedings of the International Conference on Image Analysis and Processing, Venice, Italy."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2387","DOI":"10.1016\/S0042-6989(98)00020-0","article-title":"A model of attention-guided visual perception and recognition","volume":"38","author":"Rybaka","year":"1998","journal-title":"Vis. Res."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1016\/j.robot.2008.03.008","article-title":"Curious george: An attentive semantic robot","volume":"56","author":"Meger","year":"2008","journal-title":"Robot. Auton. Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"564","DOI":"10.1109\/TIP.2008.917218","article-title":"Gaffe: A gaze-attentive fixation finding engine","volume":"17","author":"Rajashekar","year":"2008","journal-title":"IEEE Trans. Image Proc."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Geisler, W., and Perry, J. (1998). A real-time foveated multiresolution system for low-bandwidth video communication. Proc. SPIE Int. Soc. Opt. Eng., 3299.","DOI":"10.1117\/12.320120"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Gide, M., and Karam, L. (2012, January 5\u20137). Improved foveation- and saliency-based visual attention prediction under a quality assessment task. Proceedings of the 2012 Fourth International Workshop on Quality of Multimedia Experience (QoMEX), Melbourne, Australia.","DOI":"10.1109\/QoMEX.2012.6263871"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1167\/8.7.32","article-title":"Sun: A bayesian framework for saliency using natural statistics","volume":"8","author":"Zhang","year":"2008","journal-title":"J. Vis."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Advani, S., Sustersic, J., Irick, K., and Narayanan, V. (2013). A multi-resolution saliency framework to drive foveation. Int. Conf. Acoust. Speech Signal Process., 2596\u20132600.","DOI":"10.1109\/ICASSP.2013.6638125"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1167\/9.3.5","article-title":"Saliency, attention, and visual search: An information theoretic approach","volume":"9","author":"Bruce","year":"2009","journal-title":"J. Vis."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"96","DOI":"10.3389\/fncom.2014.00096","article-title":"Combining segmentation and attention: A new foveal attention model","volume":"8","author":"Marfil","year":"2014","journal-title":"Front. Comput. Neurosci."},{"key":"ref_16","first-page":"133","article-title":"A new foveal Cartesian geometry approach used for object tracking","volume":"6","year":"2006","journal-title":"SPPRA"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1342","DOI":"10.1109\/30.735836","article-title":"Software pixel interpolation for digital still cameras suitable for a 32-bit MCU","volume":"44","author":"Sakamoto","year":"1998","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1430","DOI":"10.1016\/j.patcog.2006.02.017","article-title":"Pyramid segmentation algorithms revisited","volume":"39","author":"Marfil","year":"2006","journal-title":"Pattern Recognit."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1035","DOI":"10.1016\/S0167-8655(02)00249-0","article-title":"Stochastic pyramid revisited","volume":"24","author":"Jolion","year":"2003","journal-title":"Pattern Recognit. Lett."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1038\/nrn1411","article-title":"What attributes guide the deployment of visual attention and how do they do it?","volume":"5","author":"Wolfe","year":"2004","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"802","DOI":"10.1109\/TSMC.1981.4308619","article-title":"Segmentation and estimation of image region properties through cooperative hierarchical computation","volume":"11","author":"Burt","year":"1981","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1109\/TPAMI.1984.4767505","article-title":"Compact region extraction using weighted pixel linking in a pyramid","volume":"6","author":"Hong","year":"1984","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","unstructured":"Haxhimusa, Y., and Kropatsch, W.G. (2004). Joint IAPR International Workshops on Statistical Techniques in Pattern Recognition (SPR) and Structural and Syntactic Pattern Recognition (SSPR), Springer."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/3-540-45028-9_1","article-title":"Construction of combinatorial pyramids","volume":"2726","author":"Brun","year":"2003","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_25","unstructured":"Martin, D.R., Fowlkes, C.C., Tal, D., and Malik, J. (2001, January 7\u201314). A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. Proceedings of the Eighth IEEE International Conference on Computer Vision (ICCV), Vancouver, BC, Canada."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"898","DOI":"10.1109\/TPAMI.2010.161","article-title":"Contour detection and hierarchical image segmentation","volume":"33","author":"Maire","year":"2011","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_27","unstructured":"Arbel\u00e1ez, P. (2006, January 17\u201322). Boundary extraction in natural images using ultrametric contour maps. Proceedings of the Conference on Computer Vision and Pattern Recognition Workshop (CVPRW), New York, NY, USA."},{"key":"ref_28","unstructured":"Cour, T., Benezit, F., and Shi, J. (2005, January 20\u201325). Spectral segmentation with multiscale graph decomposition. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), San Diego, CA, USA."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1023\/B:VISI.0000022288.19776.77","article-title":"Efficient graph-based image segmentation","volume":"59","author":"Felzenszwalb","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1109\/34.1000236","article-title":"Mean-shift: A robust approach toward feature space analysis","volume":"24","author":"Comaniciu","year":"2002","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/TIP.2012.2210727","article-title":"Quantitative analysis of human-model agreement in visual saliency modeling: A comparative study","volume":"22","author":"Borji","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.imavis.2011.11.007","article-title":"Saliency from hierarchical adaptation through decorrelation and variance normalization","volume":"30","author":"Pardo","year":"2012","journal-title":"Image Vis. Comput."},{"key":"ref_33","unstructured":"Dynamic visual attention: Searching for coding length increments. Available online: http:\/\/papers.nips.cc\/paper\/3531-dynamic-visual-attention-searching-for-coding-length-increments."},{"key":"ref_34","unstructured":"Bruce, N., and Tsotsos, J. (2005). Advances in Neural Information Processing Systems, Academic Press."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Judd, T., Ehinger, K., Durand, F., and Torralba, A. (October, January 29). Learning to predict where humans look. Proceedings of the 2009 IEEE 12th International Conference on Computer Vision, Kyoto, Japan.","DOI":"10.1109\/ICCV.2009.5459462"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Liu, H., Xu, D., Huang, G., and Li, W. (2013, January 1\u20138). Semantically-based human scan path estimation with HMMs. Proceedings of the 2013 IEEE International Conference on Computer Vision, Sydney, Australia.","DOI":"10.1109\/ICCV.2013.401"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1395","DOI":"10.1016\/j.neunet.2006.10.001","article-title":"Modeling attention to salient proto-objects","volume":"19","author":"Walther","year":"2006","journal-title":"Neural Netw."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/12\/2003\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:27:30Z","timestamp":1760210850000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/12\/2003"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,11,26]]},"references-count":37,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2016,12]]}},"alternative-id":["s16122003"],"URL":"https:\/\/doi.org\/10.3390\/s16122003","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2016,11,26]]}}}