{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,8]],"date-time":"2026-04-08T19:37:40Z","timestamp":1775677060908,"version":"3.50.1"},"reference-count":52,"publisher":"IOP Publishing","issue":"2","license":[{"start":{"date-parts":[[2022,5,20]],"date-time":"2022-05-20T00:00:00Z","timestamp":1653004800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2022,5,20]],"date-time":"2022-05-20T00:00:00Z","timestamp":1653004800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"name":"EU Human Brain Project","award":["H2020 945539"],"award-info":[{"award-number":["H2020 945539"]}]},{"DOI":"10.13039\/501100000266","name":"EPSRC","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"crossref"}]},{"name":"EP","award":["D07908X\/1"],"award-info":[{"award-number":["D07908X\/1"]}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Neuromorph. Comput. Eng."],"published-print":{"date-parts":[[2022,6,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Attention leads the gaze of the observer towards interesting items, allowing a detailed analysis only for selected regions of a scene. A robot can take advantage of the perceptual organisation of the features in the scene to guide its attention to better understand its environment. Current bottom\u2013up attention models work with standard RGB cameras requiring a significant amount of time to detect the most salient item in a frame-based fashion. Event-driven cameras are an innovative technology to asynchronously detect contrast changes in the scene with a high temporal resolution and low latency. We propose a new neuromorphic pipeline exploiting the asynchronous output of the event-driven cameras to generate saliency maps of the scene. In an attempt to further decrease the latency, the neuromorphic attention model is implemented in a spiking neural network on SpiNNaker, a dedicated neuromorphic platform. The proposed implementation has been compared with its bio-inspired GPU counterpart, and it has been benchmarked against ground truth fixational maps. The system successfully detects items in the scene, producing saliency maps comparable with the GPU implementation. The asynchronous pipeline achieves an average of 16\u00a0ms latency to produce a usable saliency map.<\/jats:p>","DOI":"10.1088\/2634-4386\/ac6b50","type":"journal-article","created":{"date-parts":[[2022,4,28]],"date-time":"2022-04-28T18:14:42Z","timestamp":1651169682000},"page":"024008","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":14,"title":["Event driven bio-inspired attentive system for the iCub humanoid robot on SpiNNaker"],"prefix":"10.1088","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5529-7284","authenticated-orcid":true,"given":"Giulia","family":"D\u2019Angelo","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Adam","family":"Perrett","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Massimiliano","family":"Iacono","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6524-3367","authenticated-orcid":true,"given":"Steve","family":"Furber","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chiara","family":"Bartolozzi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"266","published-online":{"date-parts":[[2022,5,20]]},"reference":[{"key":"nceac6b50bib1","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1504\/ijsnet.2009.024680","article-title":"Bio-inspired visual attention in agile sensing for target detection","volume":"5","author":"Liu","year":"2009","journal-title":"Int. J. Sensor Netw."},{"key":"nceac6b50bib2","doi-asserted-by":"publisher","first-page":"6201","DOI":"10.4249\/scholarpedia.6201","article-title":"Computational models of visual attention","volume":"6","author":"Tsotsos","year":"2011","journal-title":"Scholarpedia"},{"key":"nceac6b50bib3","first-page":"50","article-title":"The icub humanoid robot: an open platform for research in embodied cognition","author":"Metta","year":"2008"},{"key":"nceac6b50bib4","first-page":"2204","article-title":"Recurrent models of visual attention","author":"Mnih","year":"2014"},{"key":"nceac6b50bib5","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2996463","article-title":"Fixation prediction through multimodal analysis","volume":"13","author":"Min","year":"2016","journal-title":"ACM Trans. Multimed. Comput. Commun. Appl."},{"key":"nceac6b50bib6","first-page":"457","article-title":"A reinforcement learning model of selective visual attention","author":"Minut","year":"2001"},{"key":"nceac6b50bib7","first-page":"p 2","article-title":"Is bottom-up attention useful for object recognition?","volume":"vol 2","author":"Rutishauser","year":"2004"},{"key":"nceac6b50bib8","author":"Yarbus","year":"2013"},{"key":"nceac6b50bib9","doi-asserted-by":"publisher","first-page":"194","DOI":"10.1038\/35058500","article-title":"Computational modelling of visual attention","volume":"2","author":"Itti","year":"2001","journal-title":"Nat. Rev. Neurosci."},{"key":"nceac6b50bib10","doi-asserted-by":"publisher","first-page":"640","DOI":"10.1162\/jocn.2009.21222","article-title":"On the temporal relation of top\u2013down and bottom\u2013up mechanisms during guidance of attention","volume":"22","author":"Wykowska","year":"2010","journal-title":"J. Cognit. Neurosci."},{"key":"nceac6b50bib11","doi-asserted-by":"publisher","first-page":"225","DOI":"10.3758\/bf03211502","article-title":"Visual attention within and around the field of focal attention: a zoom lens model","volume":"40","author":"Eriksen","year":"1986","journal-title":"Percept. Psychophys."},{"key":"nceac6b50bib12","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1080\/00335558008248231","article-title":"Orienting of attention","volume":"32","author":"Posner","year":"1980","journal-title":"Q. J. Exp. Psychol."},{"key":"nceac6b50bib13","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1016\/0010-0285(80)90005-5","article-title":"A feature-integration theory of attention","volume":"12","author":"Treisman","year":"1980","journal-title":"Cogn. Psychol."},{"key":"nceac6b50bib14","first-page":"219","article-title":"Shifts in selective visual attention: towards the underlying neural circuitry","volume":"4","author":"Koch","year":"1985","journal-title":"Hum. Neurobiol."},{"key":"nceac6b50bib15","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1111\/j.1469-8986.1995.tb03400.x","article-title":"Neural mechanisms of visual selective attention","volume":"32","author":"Mangun","year":"1995","journal-title":"Psychophysiology"},{"key":"nceac6b50bib16","doi-asserted-by":"publisher","first-page":"1395","DOI":"10.1016\/j.neunet.2006.10.001","article-title":"Modeling attention to salient proto-objects","volume":"19","author":"Walther","year":"2006","journal-title":"Neural Netw."},{"key":"nceac6b50bib17","doi-asserted-by":"publisher","first-page":"XVIII","DOI":"10.1007\/bf00422382","article-title":"Gestalt psychology","volume":"31","author":"K\u00f6hler","year":"1967","journal-title":"Psychol. Forsch."},{"key":"nceac6b50bib18","doi-asserted-by":"publisher","first-page":"1523","DOI":"10.1016\/j.cub.2004.08.060","article-title":"Efficiency of information transmission by retinal ganglion cells","volume":"14","author":"Koch","year":"2004","journal-title":"Curr. Biol."},{"key":"nceac6b50bib19","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1103\/physrevlett.80.197","article-title":"Entropy and information in neural spike trains","volume":"80","author":"Strong","year":"1998","journal-title":"Phys. Rev. Lett."},{"key":"nceac6b50bib20","article-title":"Attention in cognitive systems. Theories and systems from an interdisciplinary viewpoint","volume":"vol 4840","author":"Lucas","year":"2007"},{"key":"nceac6b50bib21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.visres.2013.10.005","article-title":"A model of proto-object based saliency","volume":"94","author":"Russell","year":"2014","journal-title":"Vis. Res."},{"key":"nceac6b50bib22","first-page":"25","article-title":"Proto-object based visual saliency model with a motion-sensitive channel","author":"Molin","year":"2013"},{"key":"nceac6b50bib23","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1016\/j.visres.2015.12.004","article-title":"A proto-object based saliency model in three-dimensional space","volume":"119","author":"Hu","year":"2016","journal-title":"Vis. Res."},{"key":"nceac6b50bib24","first-page":"1","article-title":"Proto-object based saliency model with second-order texture feature","author":"Uejima","year":"2018"},{"key":"nceac6b50bib25","first-page":"2203","article-title":"Event-driven ball detection and gaze fixation in clutter","author":"Glover","year":"2016"},{"key":"nceac6b50bib26","doi-asserted-by":"publisher","first-page":"593","DOI":"10.1109\/LRA.2016.2645143","article-title":"EVO: a geometric approach to event-based 6-DOF parallel tracking and mapping in real time","volume":"2","author":"Rebecq","year":"2016","journal-title":"IEEE Robot. Autom. Lett."},{"key":"nceac6b50bib27","first-page":"563","article-title":"Towards real-world neurorobotics: integrated neuromorphic visual attention","author":"Adams","year":"2014"},{"key":"nceac6b50bib28","doi-asserted-by":"publisher","first-page":"234","DOI":"10.3389\/fnins.2013.00234","article-title":"Event-driven visual attention for the humanoid robot iCub","volume":"7","author":"Rea","year":"2013","journal-title":"Front. Neurosci."},{"key":"nceac6b50bib29","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1109\/jssc.2010.2085952","article-title":"A QVGA 143 dB dynamic range frame-free PWM image sensor with lossless pixel-level video compression and time-domain CDS","volume":"46","author":"Posch","year":"2011","journal-title":"IEEE J. Solid-State Circuits"},{"key":"nceac6b50bib30","first-page":"129","article-title":"Embedded neuromorphic vision for humanoid robots","author":"Bartolozzi","year":"2011"},{"key":"nceac6b50bib31","first-page":"805","article-title":"Proto-object based saliency for event-driven cameras","author":"Iacono","year":"2019"},{"key":"nceac6b50bib32","author":"Furber","year":"2020"},{"key":"nceac6b50bib33","doi-asserted-by":"publisher","first-page":"504","DOI":"10.1109\/JSSC.2011.2167409","article-title":"An event-driven multi-kernel convolution processor module for event-driven vision sensors","volume":"47","author":"Camunas-Mesa","year":"2011","journal-title":"IEEE J. Solid-State Circuits"},{"key":"nceac6b50bib34","first-page":"101","article-title":"Depth matters: influence of depth cues on visual saliency","author":"Lang","year":"2012"},{"key":"nceac6b50bib35","doi-asserted-by":"publisher","first-page":"1070","DOI":"10.1152\/jn.1998.80.3.1070","article-title":"Contrast enhancement and distributed encoding by bipolar cells in the retina","volume":"80","author":"Burkhardt","year":"1998","journal-title":"J. Neurophysiol."},{"key":"nceac6b50bib36","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1113\/jphysiol.1962.sp006837","article-title":"Receptive fields, binocular interaction and functional architecture in the cat\u2019s visual cortex","volume":"160","author":"Hubel","year":"1962","journal-title":"J. Physiol."},{"key":"nceac6b50bib37","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1007\/bf00319978","article-title":"Theory of spatial position and spatial frequency relations in the receptive fields of simple cells in the visual cortex","volume":"43","author":"Kulikowski","year":"1982","journal-title":"Biol. Cybern."},{"key":"nceac6b50bib38","doi-asserted-by":"publisher","first-page":"6594","DOI":"10.1523\/jneurosci.20-17-06594.2000","article-title":"Coding of border ownership in monkey visual cortex","volume":"20","author":"Zhou","year":"2000","journal-title":"J. Neurosci."},{"key":"nceac6b50bib39","doi-asserted-by":"publisher","first-page":"740","DOI":"10.1109\/tpami.2018.2815601","article-title":"What do different evaluation metrics tell us about saliency models?","volume":"41","author":"Bylinskii","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"nceac6b50bib40","author":"Judd","year":"2012"},{"key":"nceac6b50bib41","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1109\/tip.2012.2210727","article-title":"Quantitative analysis of human-model agreement in visual saliency modeling: a comparative study","volume":"22","author":"Borji","year":"2013","journal-title":"IEEE Trans. Image Process."},{"key":"nceac6b50bib42","article-title":"CAT2000: a large scale fixation dataset for boosting saliency research","author":"Borji","year":"2015"},{"key":"nceac6b50bib43","doi-asserted-by":"publisher","first-page":"229","DOI":"10.1016\/0166-2236(86)90064-0","article-title":"Cat and monkey retinal ganglion cells and their visual functional roles","volume":"9","author":"Shapley","year":"1986","journal-title":"Trends Neurosci."},{"key":"nceac6b50bib44","doi-asserted-by":"publisher","first-page":"1028","DOI":"10.1002\/cne.24806","article-title":"Overlapping morphological and functional properties between M4 and M5 intrinsically photosensitive retinal ganglion cells","volume":"528","author":"Sonoda","year":"2020","journal-title":"J. Comp. Neurol."},{"key":"nceac6b50bib45","doi-asserted-by":"publisher","first-page":"2113","DOI":"10.1016\/0042-6989(73)90188-0","article-title":"Overlap of receptive field centers and representation of the visual field in the cat\u2019s optic tract","volume":"13","author":"Fischer","year":"1973","journal-title":"Vis. Res."},{"key":"nceac6b50bib46","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1167\/16.2.12","article-title":"A space-variant model for motion interpretation across the visual field","volume":"16","author":"Chessa","year":"2016","journal-title":"J. Vis."},{"key":"nceac6b50bib47","first-page":"770","article-title":"Saliency benchmarking made easy: separating models, maps and metrics","author":"Kummerer","year":"2018"},{"key":"nceac6b50bib48","article-title":"ESIM: an open event camera simulator","author":"Rebecq","year":"2018"},{"key":"nceac6b50bib49","first-page":"1153","article-title":"Saliency and human fixations: state-of-the-art and study of comparison metrics","author":"Riche","year":"2013"},{"key":"nceac6b50bib50","doi-asserted-by":"publisher","first-page":"20180036","DOI":"10.1098\/rstb.2018.0036","article-title":"In natural interaction with embodied robots, we prefer it when they follow our gaze: a gaze-contingent mobile eyetracking study","volume":"374","author":"Willemse","year":"2019","journal-title":"Phil. Trans. R. Soc. B"},{"key":"nceac6b50bib51","doi-asserted-by":"publisher","first-page":"451","DOI":"10.3389\/fnins.2020.00451","article-title":"Event-based eccentric motion detection exploiting time difference encoding","volume":"14","author":"D\u2019Angelo","year":"2020","journal-title":"Front. Neurosci."},{"key":"nceac6b50bib52","doi-asserted-by":"crossref","DOI":"10.1109\/ICIP46576.2022.9897354","article-title":"Utility and feasibility of a center surround event camera","author":"Delbruck","year":"2022"}],"container-title":["Neuromorphic Computing and Engineering"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ac6b50","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ac6b50\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ac6b50","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ac6b50\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ac6b50\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ac6b50\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ac6b50\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ac6b50\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,3]],"date-time":"2023-02-03T18:25:27Z","timestamp":1675448727000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ac6b50"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,20]]},"references-count":52,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,5,20]]},"published-print":{"date-parts":[[2022,6,1]]}},"URL":"https:\/\/doi.org\/10.1088\/2634-4386\/ac6b50","relation":{"has-review":[{"id-type":"doi","id":"10.1088\/2634-4386\/AC6B50\/v2\/response1","asserted-by":"object"},{"id-type":"doi","id":"10.1088\/2634-4386\/AC6B50\/v2\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1088\/2634-4386\/AC6B50\/v3\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1088\/2634-4386\/AC6B50\/v3\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1088\/2634-4386\/AC6B50\/v3\/review2","asserted-by":"object"},{"id-type":"doi","id":"10.1088\/2634-4386\/AC6B50\/v1\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1088\/2634-4386\/AC6B50\/v1\/review2","asserted-by":"object"},{"id-type":"doi","id":"10.1088\/2634-4386\/AC6B50\/v1\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1088\/2634-4386\/AC6B50\/v4\/decision1","asserted-by":"object"},{"id-type":"doi","id":"10.1088\/2634-4386\/AC6B50\/v2\/review1","asserted-by":"object"},{"id-type":"doi","id":"10.1088\/2634-4386\/AC6B50\/v4\/response1","asserted-by":"object"},{"id-type":"doi","id":"10.1088\/2634-4386\/AC6B50\/v2\/review2","asserted-by":"object"}]},"ISSN":["2634-4386"],"issn-type":[{"value":"2634-4386","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,20]]},"assertion":[{"value":"Event driven bio-inspired attentive system for the iCub humanoid robot on SpiNNaker","name":"article_title","label":"Article Title"},{"value":"Neuromorphic Computing and Engineering","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2022 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2021-10-22","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2022-04-28","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2022-05-20","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}