{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T08:02:52Z","timestamp":1771660972397,"version":"3.50.1"},"reference-count":28,"publisher":"IOP Publishing","issue":"1","license":[{"start":{"date-parts":[[2022,1,28]],"date-time":"2022-01-28T00:00:00Z","timestamp":1643328000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2022,1,28]],"date-time":"2022-01-28T00:00:00Z","timestamp":1643328000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"DOI":"10.13039\/100008902","name":"Los Alamos National Laboratory","doi-asserted-by":"crossref","award":["Not Applicable"],"award-info":[{"award-number":["Not Applicable"]}],"id":[{"id":"10.13039\/100008902","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Neuromorph. Comput. Eng."],"published-print":{"date-parts":[[2022,3,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Event-driven neuromorphic imagers have a number of attractive properties including low-power consumption, high dynamic range, the ability to detect fast events, low memory consumption and low band-width requirements. One of the biggest challenges with using event-driven imagery is that the field of event data processing is still embryonic. In contrast, decades worth of effort have been invested in the analysis of frame-based imagery. Hybrid approaches for applying established frame-based analysis techniques to event-driven imagery have been studied since event-driven imagers came into existence. However, the process for forming frames from event-driven imagery has not been studied in detail. This work presents a principled digital coded exposure approach for forming frames from event-driven imagery that is inspired by the physics exploited in a conventional camera featuring a shutter. The technique described in this work provides a fundamental tool for understanding the temporal information content that contributes to the formation of a frame from event-driven imagery data. Event-driven imagery allows for the application of arbitrary virtual digital shutter functions to form the final frame on a pixel-by-pixel basis. The proposed approach allows for the careful control of the spatio-temporal information that is captured in the frame. Furthermore, unlike a conventional physical camera, event-driven imagery can be formed into any variety of possible frames in post-processing after the data is captured. Furthermore, unlike a conventional physical camera, coded-exposure virtual shutter functions can assume arbitrary values including positive, negative, real, and complex values. The coded exposure approach also enables the ability to perform applications of industrial interest such as digital stroboscopy without any additional hardware. The ability to form frames from event-driven imagery in a principled manner opens up new possibilities in the ability to use conventional frame-based image processing techniques on event-driven imagery.<\/jats:p>","DOI":"10.1088\/2634-4386\/ac4917","type":"journal-article","created":{"date-parts":[[2022,1,7]],"date-time":"2022-01-07T22:11:36Z","timestamp":1641593496000},"page":"014005","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Digital coded exposure formation of frames from event-based imagery"],"prefix":"10.1088","volume":"2","author":[{"given":"Andrew","family":"Gothard","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel","family":"Jones","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andre","family":"Green","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Torrez","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9111-0683","authenticated-orcid":false,"given":"Alessandro","family":"Cattaneo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8548-9401","authenticated-orcid":false,"given":"David","family":"Mascare\u00f1as","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"266","published-online":{"date-parts":[[2022,1,28]]},"reference":[{"key":"nceac4917bib1","doi-asserted-by":"publisher","first-page":"566","DOI":"10.1109\/jssc.2007.914337","article-title":"A 128 \u00d7 128 120 dB 15 \u03bcs latency asynchronous temporal contrast vision sensor","volume":"43","author":"Lichtsteiner","year":"2008","journal-title":"IEEE J. Solid-State Circ."},{"key":"nceac4917bib2","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1109\/tpami.2020.3008413","article-title":"Event-based vision: a survey","volume":"44","author":"Gallego","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"nceac4917bib3","doi-asserted-by":"publisher","first-page":"19","DOI":"10.3167\/proj.2010.040203","article-title":"Through the looking glass: philosophical toys and digital visual effects","volume":"4","author":"Prince","year":"2010","journal-title":"Projections"},{"key":"nceac4917bib4","author":"Edgerton","year":"1979"},{"key":"nceac4917bib5","author":"Veen","year":"1977"},{"key":"nceac4917bib6","author":"Miller","year":"1963\/1967"},{"key":"nceac4917bib7","author":"Raskar","year":"2006"},{"key":"nceac4917bib8","doi-asserted-by":"crossref","DOI":"10.1109\/BioCAS.2015.7348419","article-title":"CMOS implementation of pixel-wise coded exposure imaging for insect-based sensor node","author":"Zhang","year":"2015"},{"key":"nceac4917bib9","doi-asserted-by":"publisher","first-page":"04018054","DOI":"10.1061\/(asce)em.1943-7889.0001449","article-title":"Efficient full-field vibration measurements and operational modal analysis using neuromorphic event-based imaging","volume":"144","author":"Dorn","year":"2018","journal-title":"J. Eng. Mech."},{"key":"nceac4917bib10","author":"Sutton","year":"2009"},{"key":"nceac4917bib11","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1016\/j.ymssp.2017.07.024","article-title":"Measuring full-field displacement spectral components using photographs taken with a DSLR camera via an analogue Fourier integral","volume":"100","author":"Javh","year":"2018","journal-title":"Mech. Syst. Signal Process."},{"key":"nceac4917bib12","article-title":"Digital stroboscopy using event-driven imagery","author":"Gothard","year":"2021"},{"key":"nceac4917bib13","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1109\/proc.1978.10837","article-title":"On the use of windows for harmonic analysis with the discrete Fourier transform","volume":"66","author":"Harris","year":"1978","journal-title":"Proc. IEEE"},{"key":"nceac4917bib14","first-page":"41","article-title":"Temporal compressive sensing for video","author":"Llull","year":"2010"},{"key":"nceac4917bib15","author":"Brady","year":"2009"},{"key":"nceac4917bib16","doi-asserted-by":"crossref","DOI":"10.1109\/ICCPhot.2012.6215211","article-title":"Flutter shutter video camera for compressive sensing of videos","author":"Holloway","year":"2012"},{"key":"nceac4917bib17","doi-asserted-by":"publisher","first-page":"248","DOI":"10.1109\/tpami.2013.129","article-title":"Efficient space-time sampling with pixel-wise coded exposure for high-speed imaging","volume":"36","author":"Dengyu Liu","year":"2014","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"nceac4917bib18","doi-asserted-by":"publisher","first-page":"10526","DOI":"10.1364\/oe.21.010526","article-title":"Coded aperture compressive temporal imaging","volume":"21","author":"Llull","year":"2013","journal-title":"Opt. Express"},{"key":"nceac4917bib19","doi-asserted-by":"publisher","first-page":"1332","DOI":"10.1364\/optica.399533","article-title":"Motion deblurring using spatiotemporal phase aperture coding","volume":"7","author":"Elmalem","year":"2020","journal-title":"Optica"},{"key":"nceac4917bib20","doi-asserted-by":"publisher","first-page":"1964","DOI":"10.1109\/tpami.2019.2963386","article-title":"High speed and high dynamic range video with an event camera","volume":"43","author":"Rebecq","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"nceac4917bib21","article-title":"jAER","year":"2021"},{"key":"nceac4917bib22","article-title":"Inivation, DV software framework","year":"2021"},{"key":"nceac4917bib23","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1049\/ji-3-2.1946.0074","article-title":"Theory of communication: 1. The analysis of information","volume":"93","author":"Gabor","year":"1946","journal-title":"J. Inst. Elect. Eng."},{"key":"nceac4917bib24","doi-asserted-by":"publisher","first-page":"1160","DOI":"10.1364\/josaa.2.001160","article-title":"Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters","volume":"2","author":"Gaugman","year":"1985","journal-title":"J. Opt. Soc. Am. A"},{"key":"nceac4917bib25","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1016\/j.neuroimage.2019.05.048","article-title":"A better way to define and describe Morlet wavelets for time-frequency analysis","volume":"199","author":"Cohen","year":"2019","journal-title":"NeuroImage"},{"key":"nceac4917bib26","article-title":"Inivation specifications\u2014current models","year":"2021"},{"key":"nceac4917bib27","article-title":"Inivation DVS 128","year":"2019"},{"key":"nceac4917bib28","doi-asserted-by":"publisher","first-page":"567","DOI":"10.1016\/j.ymssp.2016.08.041","article-title":"Blind identification of full-field vibration modes from video measurements with phase-based video motion magnification","volume":"85","author":"Yang","year":"2017","journal-title":"Mech. Syst. Signal Process."}],"container-title":["Neuromorphic Computing and Engineering"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ac4917","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ac4917\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ac4917","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ac4917\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ac4917\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ac4917\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ac4917\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ac4917\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,2,3]],"date-time":"2022-02-03T09:05:57Z","timestamp":1643879157000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2634-4386\/ac4917"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,28]]},"references-count":28,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1,28]]},"published-print":{"date-parts":[[2022,3,1]]}},"URL":"https:\/\/doi.org\/10.1088\/2634-4386\/ac4917","relation":{},"ISSN":["2634-4386"],"issn-type":[{"value":"2634-4386","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,28]]},"assertion":[{"value":"Digital coded exposure formation of frames from event-based imagery","name":"article_title","label":"Article Title"},{"value":"Neuromorphic Computing and Engineering","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2022 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2021-06-02","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2022-01-07","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2022-01-28","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}