{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T03:50:28Z","timestamp":1772769028306,"version":"3.50.1"},"reference-count":39,"publisher":"IOP Publishing","issue":"1","license":[{"start":{"date-parts":[[2024,3,13]],"date-time":"2024-03-13T00:00:00Z","timestamp":1710288000000},"content-version":"vor","delay-in-days":12,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,13]],"date-time":"2024-03-13T00:00:00Z","timestamp":1710288000000},"content-version":"tdm","delay-in-days":12,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"DOI":"10.13039\/100012339","name":"Defence and Security Accelerator","doi-asserted-by":"crossref","award":["ACC2022261"],"award-info":[{"award-number":["ACC2022261"]}],"id":[{"id":"10.13039\/100012339","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"crossref","award":["EP\/V025198\/1"],"award-info":[{"award-number":["EP\/V025198\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Neuromorph. Comput. Eng."],"published-print":{"date-parts":[[2024,3,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Inspired by efficient biological spike-based neural networks, we demonstrate for the first time the detection and tracking of target patterns in image and video inputs at high-speed rates with networks of multiple artificial spiking optical neurons. Using photonic systems of in-parallel spiking vertical cavity surface emitting lasers (VCSELs), we demonstrate the implementation of multiple convolutional kernel operators which, in combination with optical spike signalling, enable the detection and tracking of target features in images\/video feeds at an ultrafast photonic operation speed of 1\u2009ns per pixel. Alongside a single layer optical spiking neural network (SNN) demonstration, a multi-layer network of photonic (GHz-rate) spike-firing neurons is reported where the photonic system successfully tracks a large complex feature (Handwritten Digit 3). The consecutive photonic layers perform spike-enabled image reduction and convolution operations, and interact with a software-implemented SNN, that learns the feature patterns that best identify the target to provide a high detection efficiency even in the presence of a distractor feature. This work therefore highlights the effectiveness of combining neuromorphic photonic hardware and software SNNs, for efficient learning and ultrafast operation, thanks to the use of spiking light signals, towards tackling complex AI and computer vision problems.<\/jats:p>","DOI":"10.1088\/2634-4386\/ad2d5c","type":"journal-article","created":{"date-parts":[[2024,2,27]],"date-time":"2024-02-27T22:29:12Z","timestamp":1709072952000},"page":"014010","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["VCSEL-based photonic spiking neural networks for ultrafast detection and tracking"],"prefix":"10.1088","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6316-5265","authenticated-orcid":true,"given":"Joshua","family":"Robertson","sequence":"first","affiliation":[]},{"given":"Paul","family":"Kirkland","sequence":"additional","affiliation":[]},{"given":"Gaetano","family":"Di Caterina","sequence":"additional","affiliation":[]},{"given":"Antonio","family":"Hurtado","sequence":"additional","affiliation":[]}],"member":"266","published-online":{"date-parts":[[2024,3,13]]},"reference":[{"key":"ncead2d5cbib1","doi-asserted-by":"publisher","first-page":"346","DOI":"10.1109\/JLT.2017.2647779","article-title":"Attojoule optoelectronics for low-energy information processing and communications","volume":"35","author":"Miller.","year":"2017","journal-title":"J. Lightwave Technol."},{"key":"ncead2d5cbib2","doi-asserted-by":"publisher","DOI":"10.1088\/2634-4386\/ac4a83","article-title":"2022 roadmap on neuromorphic computing and engineering","volume":"2","author":"Christensen","year":"2022","journal-title":"Neuromorph. Comput. Eng."},{"key":"ncead2d5cbib3","doi-asserted-by":"publisher","first-page":"795","DOI":"10.1515\/nanoph-2022-0485","article-title":"Photonic multiplexing techniques for neuromorphic computing","volume":"12","author":"Bai","year":"2023","journal-title":"Nanophotonics"},{"key":"ncead2d5cbib4","doi-asserted-by":"publisher","first-page":"102","DOI":"10.1038\/s41566-020-00754-y","article-title":"Photonics for artificial intelligence and neuromorphic computing","volume":"15","author":"Shastri","year":"2021","journal-title":"Nat. Photon."},{"key":"ncead2d5cbib5","doi-asserted-by":"publisher","first-page":"208","DOI":"10.1038\/s41586-019-1157-8","article-title":"All-optical spiking neurosynaptic networks with self-learning capabilities","volume":"569","author":"Feldmann","year":"2019","journal-title":"Nature"},{"key":"ncead2d5cbib6","doi-asserted-by":"publisher","first-page":"5181","DOI":"10.1364\/OE.27.005181","article-title":"Neuromorphic photonics with electro-absorption modulators","volume":"27","author":"George","year":"2019","journal-title":"Opt. Express"},{"key":"ncead2d5cbib7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/JSTQE.2019.2931252","article-title":"Noise analysis of photonic modulator neurons","volume":"26","author":"de Lima","year":"2020","journal-title":"IEEE J. Sel. Top. Quantum Electron."},{"key":"ncead2d5cbib8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/JSTQE.2019.2929187","article-title":"Photonic computing with single and coupled spiking micropillar lasers","volume":"26","author":"Anirudh Pammi","year":"2020","journal-title":"IEEE J. Sel. Top. Quantum Electron."},{"key":"ncead2d5cbib9","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.94.042219","article-title":"Spike latency and response properties of an excitable micropillar laser","volume":"94","author":"Selmi","year":"2016","journal-title":"Phys. Rev. E"},{"key":"ncead2d5cbib10","doi-asserted-by":"publisher","first-page":"440","DOI":"10.1364\/OL.410085","article-title":"Asymmetric excitable phase triggering in an optically injected semiconductor laser","volume":"46","author":"Dillane","year":"2021","journal-title":"Opt. Lett."},{"key":"ncead2d5cbib11","doi-asserted-by":"publisher","first-page":"2395","DOI":"10.1364\/OME.450926","article-title":"Photonic neuromorphic computing using vertical cavity semiconductor lasers","volume":"12","author":"Skalli","year":"2022","journal-title":"Opt. Mater. Express"},{"key":"ncead2d5cbib12","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevApplied.17.024072","article-title":"Resonant tunneling diode nano-optoelectronic excitable nodes for neuromorphic spike- based information processing","volume":"17","author":"Hejda","year":"2022","journal-title":"Phys. Rev. Appl."},{"key":"ncead2d5cbib13","doi-asserted-by":"publisher","DOI":"10.1088\/1361-6463\/aca914","article-title":"Tunable presynaptic weighting in optoelectronic spiking neurons built with laser-coupled resonant tunneling diodes","volume":"56","author":"Zhang","year":"2023","journal-title":"J.Appl. Phys."},{"key":"ncead2d5cbib14","doi-asserted-by":"publisher","first-page":"698","DOI":"10.3390\/photonics9100698","article-title":"Recent progress of neuromorphic computing based on silicon photonics: electronic-photonic co-design, device and architecture","volume":"9","author":"Xu","year":"2022","journal-title":"Photonics"},{"key":"ncead2d5cbib15","doi-asserted-by":"publisher","first-page":"7430","DOI":"10.1038\/s41598-017-07754-z","article-title":"Neuromorphic photonic networks using silicon photonic weight banks","volume":"7","author":"Tait","year":"2017","journal-title":"Sci. Rep."},{"key":"ncead2d5cbib16","doi-asserted-by":"publisher","DOI":"10.1088\/1361-6668\/ac4cd2","article-title":"SuperMind: a survey of the potential of superconducting electronics for neuromorphic computing","volume":"35","author":"Schneider","year":"2022","journal-title":"Supercond. Sci. Technol."},{"key":"ncead2d5cbib17","doi-asserted-by":"publisher","first-page":"4029","DOI":"10.1109\/JLT.2014.2345652","article-title":"Broadcast and weight: an integrated network for scalable photonic spike processing","volume":"32","author":"Tait","year":"2014","journal-title":"J. Lightwave Technol."},{"key":"ncead2d5cbib18","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1038\/s41586-020-03070-1","article-title":"Parallel convolutional processing using an integrated photonic tensor core","volume":"589","author":"Feldmann","year":"2021","journal-title":"Nature"},{"key":"ncead2d5cbib19","doi-asserted-by":"publisher","first-page":"723","DOI":"10.1038\/s41566-023-01233-w","article-title":"Deep learning with coherent VCSEL neural networks","volume":"17","author":"Chen","year":"2023","journal-title":"Nat. Photon."},{"key":"ncead2d5cbib20","doi-asserted-by":"publisher","DOI":"10.1364\/OE.435013","article-title":"Experimental realization of integrated photonic reservoir computing for nonlinear fiber distortion compensation","volume":"29","author":"Sackesyn","year":"2021","journal-title":"Opt. Express"},{"key":"ncead2d5cbib21","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-94952-5","article-title":"Reservoir computing based on a silicon microring and time multiplexing for binary and analog operations","volume":"11","author":"Borghi","year":"2021","journal-title":"Sci. Rep."},{"key":"ncead2d5cbib22","doi-asserted-by":"publisher","first-page":"920","DOI":"10.1109\/LPT.2021.3075095","article-title":"Comprehensive performance analysis of a VCSEL-based photonic reservoir computer","volume":"33","author":"Bueno","year":"2021","journal-title":"IEEE Photonics Technol. Lett."},{"key":"ncead2d5cbib23","doi-asserted-by":"publisher","DOI":"10.1364\/OE.458264","article-title":"Cross-gain modulation-based photonic reservoir computing using low-power-consumption membrane SOA on Si","volume":"30","author":"Tsurugaya","year":"2022","journal-title":"Opt. Express"},{"key":"ncead2d5cbib24","first-page":"3645","article-title":"Energy and policy considerations for deep learning in NLP","author":"Strubell","year":"2019"},{"key":"ncead2d5cbib25","first-page":"675","article-title":"A 65k-neuron 73-Mevents\/s 22-pJ\/event asynchronous micro-pipelined integrate-and-fire array transceiver","author":"Park","year":"2014"},{"key":"ncead2d5cbib26","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1146\/annurev.neuro.24.1.139","article-title":"Synaptic modification by correlated activity: Hebb\u2019s postulate revisited","volume":"24","author":"Guo-qiang","year":"2001","journal-title":"Annu. Rev. Neurosci."},{"key":"ncead2d5cbib27","doi-asserted-by":"publisher","DOI":"10.3389\/fnbot.2020.568319","article-title":"Perception understanding action: adding understanding to the perception action cycle with spiking segmentation","volume":"14","author":"Kirkland","year":"2020","journal-title":"Front. Neurorobot."},{"key":"ncead2d5cbib28","first-page":"p 15","article-title":"Imaging from temporal data via spiking convolutional neural networks","author":"Kirkland","year":"2020"},{"key":"ncead2d5cbib29","first-page":"724","author":"Kirkland","year":"2019"},{"key":"ncead2d5cbib30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-020-62945-5","article-title":"Ultrafast optical integration and pattern classification for neuromorphic photonics based on spiking VCSEL neurons","volume":"10","author":"Robertson","year":"2020","journal-title":"Sci. Rep."},{"key":"ncead2d5cbib31","doi-asserted-by":"publisher","DOI":"10.1109\/JSTQE.2019.2931215","article-title":"Towards neuromorphic photonic networks of ultrafast spiking laser neurons","volume":"26","author":"Robertson","year":"2020","journal-title":"IEEE J. Sel. Top. Quantum Electron."},{"key":"ncead2d5cbib32","doi-asserted-by":"publisher","DOI":"10.1088\/2515-7647\/aba670","article-title":"Spike-based information encoding in vertical cavity surface emitting lasers for neuromorphic photonic systems","volume":"2","author":"Hejda","year":"2020","journal-title":"J. Phys. Photonics"},{"key":"ncead2d5cbib33","doi-asserted-by":"publisher","first-page":"37526","DOI":"10.1364\/OE.408747","article-title":"Image edge detection with a photonic spiking VCSEL-neuron","volume":"28","author":"Robertson","year":"2020","journal-title":"Opt. Express"},{"key":"ncead2d5cbib34","doi-asserted-by":"publisher","first-page":"4874","DOI":"10.1038\/s41598-022-08703-1","article-title":"Ultrafast neuromorphic photonic image processing with a VCSEL neuron","volume":"12","author":"Robertson","year":"2022","journal-title":"Sci. Rep."},{"key":"ncead2d5cbib35","doi-asserted-by":"publisher","first-page":"4738","DOI":"10.1109\/IGARSS52108.2023.10282763","article-title":"Neuromorphic sensing and processing for space domain awareness","author":"Kirkland","year":"2023"},{"key":"ncead2d5cbib36","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1109\/TPAMI.2020.3008413","article-title":"Event-based vision: a survey","volume":"44","author":"Gallego","year":"2022","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ncead2d5cbib37","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1016\/j.neunet.2017.12.005","article-title":"STDP-based spiking deep convolutional neural networks for object recognition","volume":"99","author":"Reza Kheradpisheh","year":"2018","journal-title":"Neural Netw."},{"key":"ncead2d5cbib38","doi-asserted-by":"publisher","first-page":"2519","DOI":"10.1162\/089976600300014827","article-title":"On the computational power of winner-take-all","volume":"12","author":"Maass","year":"2000","journal-title":"Neural Comput."},{"key":"ncead2d5cbib39","article-title":"Mnist handwritten digit database","author":"LeCun","year":"2010"}],"container-title":["Neuromorphic Computing and Engineering"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ad2d5c","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ad2d5c\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ad2d5c","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ad2d5c\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ad2d5c\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ad2d5c\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ad2d5c\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ad2d5c\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,13]],"date-time":"2024-03-13T12:28:51Z","timestamp":1710332931000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ad2d5c"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,1]]},"references-count":39,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,3,13]]},"published-print":{"date-parts":[[2024,3,1]]}},"URL":"https:\/\/doi.org\/10.1088\/2634-4386\/ad2d5c","relation":{},"ISSN":["2634-4386"],"issn-type":[{"value":"2634-4386","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,1]]},"assertion":[{"value":"VCSEL-based photonic spiking neural networks for ultrafast detection and tracking","name":"article_title","label":"Article Title"},{"value":"Neuromorphic Computing and Engineering","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2024 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2023-11-03","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-02-27","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-03-13","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}